Spatial encoding system, decoding system, imaging system, and methods thereof

Abstract

A system for imaging is provided, the illumination system including: a light source for generating a light beam; and a spatially-coded pattern generator comprising one or more optical elements for encoding the imaging beam to simultaneously illuminate an object with a plurality of different spatially-coded patterns, each coding pattern of the different coding patterns characterized by a distinct wavelength of the imaging pattern. The system may further include an imaging sensor for receiving the coded imaging beam transmitted through or reflected from the object, and a processor for decoding image data from the imaging and reconstructing an image of the object.

Description

[Technical Field]

[0001] The present invention relates to imaging, and more particularly to spatial encoding, decoding, and imaging systems and methods thereof. [Background technology]

[0002] In vivo biological tissue imaging typically requires careful selection among different bioimaging methods to suit specific experimental requirements and conditions. Deep-penetrating noninvasive imaging techniques such as magnetic resonance imaging (MRI), computed tomography (CT), and high- and low-frequency ultrasound (US) are expensive and have limitations in both duration and spatial resolution. Other high-resolution approaches, such as single / multiphoton fluorescence or confocal fluorescence microendoscopy, can be used in vivo but are typically only useful at shallow investigation depths.

[0003] Micro-endoscopic optical fibers have been developed to be inserted deep into target areas inside a patient's body using minimally invasive techniques. Such devices enable long-term in vivo monitoring of biological samples. Many commercially available micro-endoscopic optical fibers contain multiple core bundles, known as multi-core fibers (MCEs), where each core acts as a single fiber.

[0004] Many MCEs contain multimode fibers (MMFs) that allow the passage of many spatial electromagnetic modes through each core, thus increasing the intensity transmission of images through the endoscope. However, MMFs typically scramble the information transmitted through these fibers in both space and time. This problem can be addressed by MCF designs with sufficiently large spacing between adjacent cores to minimize inter-core optical coupling (crosstalk). As a result, image resolution is compromised and pixelation artifacts can appear in the generated images. Other solutions, such as optimization algorithms, digital phase conjugation, or transfer matrices, have been demonstrated, but all are typically sensitive to fiber bending.

[0005] Single-mode fiber bundles (SMFBs) are sometimes used instead of MMFs because they are typically less sensitive to fiber bending and less susceptible to information scrambling. SMFB imaging typically involves employing lensed scanning heads, spectral dispersion devices, speckle correlation, and other techniques that can yield resolution up to the diffraction limit. While the core-to-core length of an SMFB can be shortened, the brightness of the image transmitted through the device can also be reduced. As a result, the signal-to-noise ratio can be reduced as well. In addition to the need for fiber geometry, resolution remains limited, and the depth of field through scattering media can also be significantly reduced.

[0006] Various methods of illumination through the fibers are known for both MMF and SMFB bundles, such as illuminating the sample and collecting reflected light through the same bundle, confocal micro-endoscopes that allow optical sectioning, and speckle correlation techniques that allow optical sectioning without staining.

[0007] Current techniques exhibit typical penetration depths of less than 150 μm, have difficulty dealing with real biological scattering media (e.g., blood) between the distal end of the fiber and the sample, and have rather low typical image acquisition rates (typically around 5 Hz for up to several minutes for a 36 × 36 pixel image). Summary of the Invention

[0008] Thus, according to some embodiments of the present invention, there is provided an illumination system comprising a light source for generating a light beam and a spatially coded pattern generator comprising one or more optical elements for encoding an imaging beam to simultaneously illuminate an object with a plurality of different spatially coded patterns, each coding pattern of the different coding patterns being characterized by a distinct wavelength of the imaging pattern.

[0009] In some embodiments of the present invention, the system further includes one or more optical elements for splitting the light beam into an imaging beam and a reference beam and directing the reference beam to the imaging sensor after the reference beam is combined with the imaging beam.

[0010] In some embodiments of the invention, the spatially-coding pattern generator is configured to image the plurality of different spatially-coding patterns onto the object across a first axis perpendicular to the propagation direction of the imaging beam, and to perform a Fourier transform of the plurality of different spatially-coding patterns onto the object across a second axis perpendicular to both the first axis and the propagation direction of the imaging beam.

[0011] In some embodiments of the present invention, the one or more optical elements that encode the imaging beam are aligned along the optical path in the following order: a diffraction grating grid, a first lens, a coding pattern element, and a second lens.

[0012] In some embodiments of the invention, the first lens is spaced apart from both the diffraction grating grid and the coding pattern elements by a distance equal to the X-axis focal length of the first lens, and the second lens is spaced apart from the coding pattern elements by a distance equal to the X-axis focal length of the second lens.

[0013] In some embodiments of the present invention, the X-axis focal length of each of the lenses is twice the Y-axis focal length of that lens.

[0014] In some embodiments of the present invention, the one or more optical elements that encode the imaging beam define an optical path comprising, in this order, a diffraction grating grid, a first lens, a coding pattern element, a second lens, a second diffraction grating grid, and a third lens.

[0015] In some embodiments of the invention, the first lens is spaced apart from both the diffraction grating grid and the coding pattern elements by a distance equal to the X-axis focal length of the first lens, the second lens is spaced apart from the coding pattern elements by a distance equal to the X-axis focal length of the second lens, and the third lens is spaced apart from the second diffraction grating grid by a distance equal to the X-axis focal length of the third lens.

[0016] In some embodiments of the present invention, the X-axis focal length of each of the lenses is twice the Y-axis focal length of that lens.

[0017] In some embodiments of the present invention, the light source is a laser generator.

[0018] In some embodiments of the present invention, the laser source is a pulsed laser source.

[0019] In some embodiments of the present invention, the system is integrated into an endoscope.

[0020] In some embodiments of the present invention, the system is incorporated into an imaging system, the imaging system further including an imaging sensor for receiving the coded imaging beam transmitted through or reflected from the object, and a processor for decoding image data from the imaging and reconstructing an image of the object.

[0021] In some embodiments of the invention, to reconstruct an image of the object, the processor is configured to multiply an image of each coding pattern of said different coding patterns obtained from the reflected or transmitted coded imaging beam by a corresponding decoding pattern to obtain products and to sum all of the products to obtain a reconstructed image of the object.

[0022] In some embodiments of the present invention, there is provided a decoding system including an imaging sensor for receiving an encoded imaging beam that simultaneously illuminates an object with a plurality of different spatially encoded patterns, each encoded pattern being characterized by a distinct wavelength of the imaging pattern transmitted through or reflected from the object, and also including a processor for decoding image data from the imaging and reconstructing an image of the object.

[0023] In some embodiments of the invention, to reconstruct an image of the object, the processor is configured to multiply an image of each coding pattern of said different coding patterns obtained from the reflected or transmitted coded imaging beam by a corresponding decoding pattern to obtain products, and to sum all of the products to obtain a reconstructed image of the object.

[0024] In some embodiments of the present invention, there is provided a method comprising generating a light beam and encoding, using a spatially-coding pattern generator, the imaging beam to simultaneously illuminate an object with a plurality of different spatially-coding patterns, each coding pattern of the different coding patterns being characterized by a distinct wavelength of the imaging pattern.

[0025] In some embodiments of the present invention, encoding the imaging beam comprises applying a time gate.

[0026] In some embodiments of the invention, the time gating is applied using one of the following group of techniques: short optical pulse gating, coherence gating, and interference patterns generated by diffraction grating grids.

[0027] In some embodiments of the present invention, the spatially coded pattern generator The optical system includes one or more optical elements for encoding a beam, the one or more optical elements being aligned along an optical path in the following order: a diffraction grating grid, a first lens, a coding pattern element, and a second lens.

[0028] In some embodiments of the present invention, the step of encoding the imaging beam includes applying a time gate, which is achieved by splitting the light beam into an imaging beam and a reference beam, and directing the reference beam to the imaging sensor after the reference beam is combined with the imaging beam.

[0029] In some embodiments of the present invention, there is provided a method comprising: receiving, using an imaging sensor, a coded imaging beam that simultaneously illuminates an object with a plurality of different spatially coded patterns, each coded pattern being characterized by a distinct wavelength of the imaging pattern and being transmitted through or reflected from the object; and decoding, using a processor, image data from the imaging to reconstruct an image of the object.

[0030] For a better understanding of the present invention and to appreciate its utility, reference is made hereinafter to the following drawings, which are given by way of example only and are not intended to limit the scope of the present invention, and like elements are designated by like reference numerals. [Brief explanation of the drawings]

[0031] [Figure 1A] 1 is a graph showing photon count versus time for the interaction of light with a scattering medium. [Figure 1B] 1 shows a pair of Barker-based arrays that can be used in a system for imaging through scattering media. [Figure 2A] 1 illustrates a system for imaging through a scattering medium according to some embodiments of the present invention using a one-dimensional illumination pattern. [Figure 2B] 10 shows images of light intensity at specific wavelengths on different planes according to some embodiments of the present invention. [Figure 3] 1 illustrates a system for imaging through a scattering medium according to some embodiments of the present invention using a two-dimensional illumination pattern. [Figure 4]1 illustrates discrete light illumination achieved by a system for imaging through a scattering medium, according to some embodiments of the present invention. [Figure 5] 1 illustrates single wavelength convoluted components in optical illumination achieved by a system for imaging through a scattering medium according to some embodiments of the present invention. [Figure 6] 10 illustrates the final convolution for a single wavelength of light illumination achieved by a system for imaging through a scattering medium according to some embodiments of the present invention. [Figure 7] 1 illustrates spectral regions and pattern pixels for continuous wavelength encoding using a single frequency grating, according to some embodiments of the present invention. [Figure 8] 10 illustrates the deflection of each second grating grid frequency on the spatial axis plane, according to some embodiments of the present invention. [Figure 9] 1 illustrates a multicore fiber endoscope incorporating a system for imaging an object through a scattering medium, according to some embodiments of the present invention. [Figure 10] 1 is a diagram of a method for imaging an object through a scattering medium in accordance with some embodiments of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0032] In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the methods and systems. However, it will be understood by those skilled in the art that the methods and systems of the present invention may be practiced without these specific details. On the other hand, well-known methods, procedures, and components have not been described in detail so as not to obscure the methods and systems of the present invention.

[0033] The examples disclosed and described herein are not limited in this regard, although the terms "plurality" and "multiple" as used herein may include, for example, "multiple" or "two or more." These terms "plurality" and "multiple" may be used throughout this specification to describe two or more components, devices, elements, units, parameters, etc. Unless expressly stated, the method examples described herein are not limited to a particular order or sequence. Furthermore, some of the methods, examples, or elements thereof described herein may occur or be performed contemporaneously.

[0034] Unless otherwise specifically stated, and as will be apparent from the description that follows, throughout the specification, references to words such as "add," "associate," "select," "evaluate," "process," "operate," "calculate," "determine," "specify," "arrange," and the like refer to the actions and / or processes of a computer, computer processor, or computing system or similar electronic computing device that manipulates, performs, and / or transforms data represented as physical quantities, such as electronic quantities, in the computing system's registers and / or memory, into other data similarly represented as physical quantities in the computing system's memory, registers, or other information storage, transmission, or display device.

[0035] According to some embodiments of the present invention, a novel optical setup is provided that aims to enable deeper imaging through scattering media by employing spatial illumination.

[0036] Typically, four main parameters affect how light propagates through scattering media: the absorption coefficient μ measured in [m-1], which determines the energy loss of the signal; a and the scattering coefficient μ, measured in [m-1] and which is a measure of the typical length that light travels between scatterers. sand θ is the scattering deflection angle, and the average value<cos(θ)> The scattering anisotropy g, which measures the scattering intensity (which allows us to calculate how much the typical scattering is in the "forward" direction), and the medium refractive index n.

[0037] μ s and g, the reduced scattering coefficient μ s ' can be guided, μ s '=μ s *(1-g) (1) is.

[0038] This represents a realistic scattering length considering typical scattering directions. Typical scattering times can be calculated using the reduced scattering coefficient and the refractive index.

number

[0039] In realistic imaging, a pulse of light is projected through a scattering medium toward a sample. As a result of scattering in the medium, the pulse elongates and can be described by ballistic, snake, and diffuse signal components. The ballistic component takes the shortest path through the medium and preserves image information. In contrast, diffuse light undergoes multiple scattering, travels long distances within the scattering medium, and does not contribute to forming a direct image. Snake photons undergo some scattering in the forward direction and therefore retain some image information. The light then strikes the sample and either scatters back or is transmitted again through the scattering medium toward the sensor.

[0040] As previously mentioned, the signal is elongated and can be described by ballistic, snake and diffusive signal components.

[0041] Figure 1 is a graph of photon count versus time for light interacting with a scattering medium. Three sections (12, 14, and 16) of photons arriving from the interaction between the light illuminating through the scattering medium and the sample are shown, separated by their arrival time at the sensor. The first section (12) includes ballistic photons (B1) that arrived at the sample directly from the illumination source and ballistic photons (B2) that arrived at the sensor after interacting with the sample. The next section (14), a few picoseconds later, includes two groups of photons: photons (B1 and P2) scattered by the scattering medium en route from the sample to the sensor, and photons (P1 and B2) scattered by the medium toward the sample and ballistically traveled from the sample to the sensor. The third section (16) includes photons that arrive last, having been scattered by both the sample and the scattering medium before reaching the sensor.

[0042] Many approaches are known to screen the photons that contribute to the image data from the photons that do not. An ideal imaging method should gate the photons in the third section, utilize the photons in the first section, and collect the maximum amount of information from the snake photons in the second section.

[0043] Together with time gating to less than 100 ps from the first arrival of light, t s It is known that short light pulses of less than 1000 s have been used. This requires expensive laser sources of a few picoseconds or less and dedicated time-gated sensors.

[0044] According to some embodiments of the present invention, instead of using short pulses and time gating, a system for imaging through scattering media can employ narrow angle light collection, thereby omitting scattered photons while preserving ballistic photons.

[0045] Optical systems containing long optical channels that absorb light traveling at angles higher than a certain angle (e.g., 0.29°) are known, but they may not be suitable for imaging through scattering media under real in vivo conditions. Furthermore, the signals acquired in such systems are usually very weak and susceptible to stray light from photons that have been highly scattered and travel uniformly in all directions.

[0046] Longer pulse times may be possible by employing a holography-based approach with a short coherence length illumination source. In this approach, the coherence length is μ s ', where only photons that undergo scattering leading to a light path shorter than the coherence length contribute to the interference pattern, while light traveling longer distances is averaged out and contributes only to random noise. Increasing the width of the scattering medium (the length along the propagation direction (ballistic path) of the imaging beam) can reduce the number of interfering photons, but on the other hand, the averaged noise increases. As a result, the signal-to-noise ratio can be reduced, reducing blurring and limiting the reconstruction of spatial frequencies of the sample. Coding illumination using modulation phase has previously been used to enhance the signal-to-noise ratio. However, it was assumed that the illumination system illuminated the sample directly, without scattering through a scattering medium, as in a real in vivo scenario. Furthermore, such methods rely on time multiplexing, which increases the acquisition duration.

[0047] According to some embodiments of the present invention, scattering limitations and high acquisition times can be addressed by using spatially structured illumination, which may involve autocorrelation of the coded illumination pattern.

[0048] According to some embodiments of the present invention, a system for imaging an object through a scattering medium may include an illumination system, an imaging sensor, and a processing unit for processing image data sensed by the imaging sensor.

[0049] Illumination systems according to some embodiments of the present invention may include a light source that generates a light beam. In some embodiments, the light source may be, for example, a white light source, a light emitting diode (LED), a continuous laser source, a pulsed laser source (e.g., femtosecond, picosecond, nanosecond, millisecond pulsed laser source, etc.) for generating the imaging light beam.

[0050] A spatially coded pattern generator can be used to code an imaging beam to simultaneously illuminate an object with multiple different spatially coded patterns, where each coding pattern of the different coded patterns is characterized as having a distinct wavelength of the imaging pattern.

[0051] Some of the different coding patterns may overlap in whole or in part, but may be uncorrelated or may have a correlation function (between these different coding patterns) that has a sharp maximum at a particular point.

[0052] An imaging sensor can be used to receive the image beam after it has passed through or reflected from the object, and a processing unit can be used to reconstruct an image of the image data sensed by the sensor.

[0053] In reconstructing an image of the object, the processing unit may be designed to execute an image reconstruction algorithm that decodes the encoded spatial pattern that illuminates the object and ignores photons scattered by the scattering medium by ignoring any image data that represents deviations from the spatially encoded pattern. For example, if a green photon reaches an area that is assumed to be illuminated by one or more other colors, it is ignored in reconstructing the object image under the assumption that it is not a ballistic photon (e.g., it does not travel directly from the light source to the detected location but is most likely scattered along the way).

[0054] In some embodiments of the present invention, time gating is used to separate ballistic photons from scattered photons. Time gating may be achieved by applying a short coherence gate (e.g., via interference), for example, by applying a very short laser pulse. Coherence gating can be realized, for example, by employing a first-arrival-light (FAL) approach to perform coherence shaping of the illumination to obtain the desired time gate.

[0055] For example, to apply the FAL approach, a reference beam can be split from the light beam generated by the light source and directed along an alternate optical path to the sensor to enable interferometric measurements.

[0056] Spatially coded patterns can be obtained, for example, by using a Barker-based array. A set of laterally shifted Barker coded patterns (shown in FIG. 1B) can be projected onto the sample. This shift can cause the pattern to scan the sample.

[0057] A one-dimensional (1D) scan can enhance a two-dimensional (2D) image in all directions, regardless of the original scan direction. Another feature associated with the illumination generated by systems according to some embodiments of the present invention is the ability to project multiple patterns simultaneously, at different wavelengths. The shifted pattern illumination sample images can then be separated and analyzed (e.g., using wavelength multiplexing) to increase collection time.

[0058] FIG. 1B shows a pair of Barker-based arrays that can be used in a system for imaging through scattering media. In this example, (a) is a 13 x 13 Barker-based array, where each row is a 5-pixel shift of the basic Barker encoding vector. Array (b) is the autocorrelation of the Barker array in (a). Other arrangements (other numbers of pixels, other encoding vectors) can also be used in some embodiments of the invention.

[0059] The coherence length can be calculated by correlating with Figure 1A. A simple approach may involve determining the coherence length so that only photons from the first section interfere. Increasing the coherence length may allow more photons to be collected from the middle section, increasing both the signal and noise. Spatial encoding then retains the snake photons that contribute to the data while eliminating the noise coming from the B1+P2 photons that do not contribute to the data.

[0060] 2A illustrates a system for imaging through scattering media according to some embodiments of the present invention using a one-dimensional illumination pattern, which can be designed to perform different spatial encoding for different wavelengths of the illumination beam to improve resolution and see through scattering tissue.

[0061] System 100 includes an illumination source 102, e.g., a laser beam generator such as a continuous laser or a pulsed laser (e.g., a femtosecond or picosecond pulsed laser in some embodiments, or a nanosecond or millisecond pulsed laser in other embodiments; faster pulses may contribute better to high-resolution imaging results). The light beam generated by light source 102 can be split into two beams by beam splitter 104. One beam serves as a reference beam and is directed by mirrors (106 and 118) through a second beam splitter 126 to an optical imaging sensor 130. The other beam, hereafter referred to as the imaging beam, is directed through a spatially coded pattern generator 105, e.g., a series of optical elements. According to some embodiments of the invention, the spatially-coding pattern generator is configured to image a plurality of different spatially-coding patterns onto the object to be imaged across a first axis perpendicular to the direction of propagation of the image beam, and is also configured to perform a Fourier transform of said plurality of different spatially-coding patterns onto the object across a second axis orthogonal to both the first axis and the direction of propagation of the image beam.

[0062] First, the imaging beam traverses a diffraction grating grid G1 108 (e.g., 300 lines per mm, while other gratings may have grating lines in the range of 200 to 2 / lambda (the central illumination wavelength) per mm) and is diffracted into multiple parallel beams. The multiple parallel beams are then Fourier transformed in the X-axis direction when passing through a cylindrical lens L1. L1 is characterized by having two different focal length values ​​(e.g., f for the Y axis and 2f for the X axis, e.g., 25.4 mm and 50.8 mm, respectively) for each of the two orthogonal axes. The diffraction grating grid G1 108 is separated from L1 by 2f (the X-axis focal length of L1), such that the Fourier conjugate plane in the X axis is located at the X-axis focus of L1, and the beam's imaging plane is located at the Y-axis focus. This separates the imaging beam into multiple beams of different wavelengths at different deflection positions corresponding to the wavelengths in the X plane, while maintaining the original height of the beam in the Y plane. A coding pattern element 112 (e.g., two Barker-based arrays 114, such as those depicted in FIG. 1B ) is further positioned below the imaging beam in the propagation direction, at a distance of 2f (the X-axis focal length of L1) from L1, to encode each of the multiple beams of different wavelengths accordingly. The imaging beam then passes again through lens L2 116, whose X-axis focal length is twice its Y-axis focal length (e.g., 25.4 mm and 50.8 mm, respectively). The coding pattern element 112 is positioned 2f (the X-axis focal length of L1) away from L1 110, at which point an image of the coding pattern in the Y-axis is formed. Lens L2 116, positioned at a distance of 2f (the X-axis focal length of L1), serves to expand the imaging beam in the X-axis back to its original width.

[0063] The light exiting L2 116 is directed toward a sample (e.g., tissue within a patient's body), which may be located at a distance of 2f from L2 (the X-axis focal length of L2). Light transmitted through the sample is collected by an optical imaging sensor 130. A beam splitter 126 may be positioned along the way to combine the reference beam with the imaging beam before striking the optical imaging sensor 130.

[0064] The corresponding X-axis focal lengths and Y-axis focal lengths of L1 and L2 may be the same or different.

[0065] 2B shows images of light intensity at specific wavelengths on different planes according to some embodiments of the present invention. Image (a) shows the intensity image when the imaging beam reaches L1 at the X-axis focal plane just before the coding pattern. Image (b) shows the intensity image of the imaging beam after traversing the coding pattern. Clearly, only one line passes through, coded on the Y-axis. Image (c) is the projected intensity of the imaging beam on the object.

[0066] Ultimately, in the example of Figure 2, the result for each wavelength (of multiple wavelengths emerging from L1) is a spot that follows the encoded pattern in the Y axis and the original beam profile in the X axis. Each wavelength produces a different pattern on the object, according to the encoded pattern.

[0067] By using the encoding pattern to introduce a set of laterally shifted patterns (e.g., encoding the pattern of a single row in a 2D image, the pattern shown in Figure 2, and shifting the encoding row for each wavelength), image enhancement and coherence gating can be maintained as described in the introduction.

[0068] FIG. 3 illustrates a system for imaging through a scattering medium according to some embodiments of the present invention using a two-dimensional illumination pattern.

[0069] System 200 is designed similarly to system 100 of Figure 2A, but includes several additional optical elements within the spatially-coded pattern generator. These optical elements, in order along the optical path of the spatially-coded pattern generator, are a second diffraction grating grid 120 and a third lens L3 122. The third lens L3 122 has an X-axis focal length that is twice its Y-axis focal length (e.g., 25.4 mm and 50.8 mm, respectively).

[0070] A diffraction grating grid 120 (e.g., 300 lines per mm, although other gratings may have grating lines in the range of 200 to 2 / lambda (central illumination wavelength) per mm) is positioned at the X-axis focus of lens 116 and at the X-axis focus of lens L3 122.

[0071] The focal lengths (X, Y) of the lenses are not necessarily the same (in either the systems depicted in FIG. 2B or FIG. 3).

[0072] The spatially coded pattern projection produced in this configuration is two-dimensional as a result of the added optical elements.

[0073] Some embodiments of the present invention may utilize a discrete wavelength-coding pattern. Some embodiments of the present invention may utilize a continuous wavelength (band)-coding pattern.

[0074] The second grating grid G2 120 may be designed to meet the required functionality.

[0075] For example, for discrete wavelengths, G2 is

number

[0076] For a continuous wavelength band, a grid with a single frequency G2 is

number

[0077] Using the encoding pattern, introducing a set of laterally shifted patterns (e.g., a 2D image of the pattern shown in Figure 1B, a circle shifting the encoding by one pixel horizontally for each wavelength) enhances image reconstruction, and a coherence-gated signal can be obtained as described above.

[0078] A mathematical description of the optical configuration of the spatially coded pattern generator is provided below.

[0079] For the plane U(X0,Y0), if we assume that the wavefront is constant and tilted θ towards the grating, then

number

[0080] For a plane U(X1,Y1) behind a grating G1 with frequency ν0,

number

[0081] For the plane U(X2,Y2), the Fourier transform with scaling by f1*lambda is assumed to take only the first diffraction order,

number

[0082] For discrete wavelengths.

[0083] The lens has different foci so that the length between U(x1,y1) and the plane U(x2,y2) is fx=2*fy, and therefore can produce an image in the y plane and a Fourier transform in the x plane.

[0084] In the X plane, the lens has a limited diameter aperture D, so that in the plane U(x2,y2) there are enough positions to place the pattern and the variation in illumination intensity is minimal.

number

[0085] A spatially coded pattern element (coded mask) may be placed in front of the focal plane of L1 to obtain again a sine function of the same diameter.

[0086] Under these conditions, before encoding different color spots at discrete locations, it is possible to obtain different color spots centered around [f1·sinθ+f1ν0λ]. For each location, a coding pattern can be matched as shown in Figure 4. A laser source 402 in system 400 generates an imaging beam that traverses a lattice grid 404, a lens 406, and illuminates discretely separated spots of color (blue 410, green 412, and red 414) on a spatially-coding pattern element 408.

[0087] Plane X3 is multiplied by the encoding pattern.

number

[0088] The plane X4 is Fourier transformed by scaling by f2*lambda.

number

[0089] Introducing Grid 2.

[0090] To integrate the spots, Grid 2 is

number

number

[0091] The plane X6 is Fourier transformed.

number

[0092] This means that the grid deflects each wavelength to an optical axis position regardless of wavelength.

[0093] Another solution involves creating a continuous wavelength band, one frequency grating.

[0094] The lenses have different foci so that the length between U(x1,y1) and the plane U(x2,y2) is fx=2*fy, so we can obtain the y plane imaging and the Fourier transform in the x plane.

[0095] In the X plane, the aperture D may be opened so that in the plane U(x2,y2) there exists a delta function for each wavelength.

[0096] Plane X3 is multiplied by the encoding pattern. u3(x3,y3)= δ(x3-[f1·sinθ+f1ν0λ]B(x3-f1ν0λ min )) (11)

[0097] In the example given here, the coding pattern is N p Size of the individual ΔX pt that is, each pattern is constructed from L discrete pixels. pt =N p ΔX pt This means that the length of num If different patterns are desired, the size L num =N num L pt =N num N p ΔX pt It should be noted that more spots may be required.

[0098] This means that the laser spectral band is

number

[0099] The plane X4 is Fourier transformed with scaling by f2 * lambda.

number

[0100] A grid G2 with only one frequency is introduced.

[0101] Assuming f1=f2 and θ=0, we get:

number

[0102] where ΔΩ is currently undetermined.

[0103] Plane X5 is multiplied by grid 2.

number

[0104] The plane X6 is Fourier transformed.

number

[0105] For a single wavelength, Figure 5 demonstrates the convolution components of Equation 10 for a single wavelength. Above is the left component of the equation, below is the right component of the equation, and the final convolution per wavelength is shown in Figure 6.

[0106] FIG. 6 shows Equation 10 for the final convolution for a single wavelength.

[0107] Therefore, on the order of an infinite amount, the entire space can be covered with coding patterns, but a scaled Barker code may be required.

[0108] The minimum wavelength position is: x0=λ0f3ν0(11)

[0109] The next wavelength that overlaps with the first is: λ0f3ν0=λ1f3(ν0-ΔΩ)

[0110] In general, the nth overlap is:

number

[0111] To use the full bandwidth, the grid frequency must be exactly N num are taken so that replicas are obtained.

number

[0112] In the end, it looks like this:

number

[0113] If f1 ≠ f2 and θ = 0, and ν0 everywhere, then this means

number

number

[0114] In general, the nth overlap is as follows:

number

[0115] From equation (14), each pattern regime λ n -λ n-1Note that since the σ and σ have different spectral sizes, the patterns should be scaled in each pattern region.

[0116] Figure 7 shows an illustration of the spectral axis, where different spectral regions are marked. The wavelengths that start each region are marked with black dashed lines. Each region will eventually be shifted to the base spectral region.

[0117] The pattern pixels in each region are scaled to fit n equally spaced pixels in the base spectral region. Each pattern pixel is shown as a blue line at the bottom of the figure, and different patterns are indicated by filling the space inside the designated pattern pixel. The coding pattern placed at the x-axis focus of the L1 lens should consist of the entire coding pattern at these wavelength-corresponding locations, as shown by the sum pattern at the bottom.

[0118] Figure 8 shows the spectral regions and pattern pixels of Solution 2. The nth spectral regime has a different spectral size λ for each region. n -λ n-1 The pixels in the regime are marked with blue lines, and each pattern fills different spectral pixels differently. Ultimately, the coding mask contains the same patterns as shown here at corresponding positions in the spatial axis of a plane in the X-axis focal plane of lens L1.

[0119] To find the scale, Np pixels are equally spaced in the first regime. From equations (14) and (15), the overlap of the first pattern due to grid multiplication is:

number

[0120] The first regime also divides λ1-λ0 into Np equally spaced pixels, each with a pixel length of:

number

[0121] The starting spectral wavelength of each pixel is as follows:

number

[0122] Therefore, at each nth replica, the starting spectral wavelength of the mth pixel is:

number

[0123] Solution 3: Suggestion for continuous wavelength, multi-frequency gratings.

[0124] In the previous section, a grid G2 was shown containing one frequency that folds the projected illumination into the G1 deflection position of the smallest wavelength.

[0125] Instead, this can be done using different G2 gratings with multiple frequencies, each of which will deflect a different wavelength towards the desired location. The advantage of this method is that it deflects the imaging beam closer to the optical axis than the single frequency grid method.

[0126] To calculate the required frequency and wavelength at which to start each new pattern, the repeating junction may be thought of as follows:

number

[0127] In this case, the replica in the optical axis can be seen in Figure 8, which shows the deflection in the spatial axis plane for each new G2 grid frequency. Three example grid frequencies are shown. The thick lines (on the lambda (λ) axis) mark the wavelength separation between each of the different encoding pattern frequencies.

[0128] Applying the above iterative relationship, each new frequency in the grid deflects the wavelength to a known position, and the section within the laser source bandwidth remains between specific calculated wavelengths within that section. Note that in the first spatial section between (G1-ν0)λ0 and (G1-ν0)λ1, the spatial region can be expanded by acquiring additional wavelengths, shifting, or projecting at another time with wavelengths that reach the spatial location, while completing the sequence of spatially encoded patterns.

[0129] In reconstructing an image of an object, an image of each of the different coding patterns extracted from the coded imaging beam reflected from or transmitted through the object can be multiplied by the corresponding decoding pattern to obtain products, and all of the products can be summed to obtain a reconstructed image of the object.

[0130] According to some embodiments of the present invention, decoding in the above-described manner is suitable both for imaging through scattering media and for enhancing the imaging resolution to super-resolution.

[0131] 9 illustrates a multicore fiber endoscope 800 incorporating a system for imaging an object through a scattering medium, in accordance with some embodiments of the present invention. The endoscope 800 may include an elongated multicore fiber body 802 having one or more illumination fibers 804 and one or more imaging fibers 812. A spatially-coded pattern generator 806 may be provided optically coupled to the one or more illumination fibers 804, designed to direct a plurality of different spatially-coded patterns generated by the spatially-coded pattern generator 806 through the endoscope body 802 and out its distal end to illuminate an object 814 (e.g., tissue within a patient's body). The one or more imaging fibers 812 of the endoscope receive illumination light reflected from the object 814 and transmit it (e.g., via a beam splitter 808 to an imaging device 810 including an imaging sensor 816 and a processing unit 818).

[0132] 10 is a diagram of a method for imaging an object through a scattering medium in accordance with some embodiments of the present invention. Method 900 may include generating a light beam 902. Method 900 may also include encoding 904, using a spatially-coded pattern generator, the imaging beam to simultaneously illuminate the object with a plurality of different spatially-coded patterns, where each coding pattern of the different coding patterns is characterized by a distinct wavelength of the imaging pattern.

[0133] Method 900 may also include step 906 of receiving, using an imaging sensor, a coded imaging beam that has been transmitted through or reflected from the object, and step 908 of decoding, using a processor, image data from the imaging and reconstructing an image of the object.

[0134] Some embodiments of the present invention may be embodied in the form of a system, a method, or a computer program product. Likewise, some embodiments may be embodied as hardware, software, or a combination of both. Some embodiments may be embodied as a computer program product stored on one or more non-transitory computer-readable mediums in the form of computer-readable program code embodied thereon. Such non-transitory computer-readable mediums may include instructions that, when executed, cause a processor to perform method steps according to the embodiments. In some examples, the instructions stored on the computer-readable medium may be in the form of an installed application or an installation package.

[0135] Such instructions may, for example, be loaded and executed by one or more processors.

[0136] For example, the computer-readable medium may be a non-transitory computer-readable storage medium, which may be, for example, an electronic, optical, magnetic, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof.

[0137] The computer program code may be written in any suitable programming language and may be executed on a single computer system or on multiple computer systems.

[0138] Some embodiments are described above with reference to flowcharts and / or block diagrams that illustrate methods, systems and computer program products according to various embodiments.

[0139] Features of the various embodiments discussed herein may be used with other embodiments discussed herein. The foregoing description of the embodiments has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Those skilled in the art should appreciate that many modifications, variations, substitutions, changes, and equivalents are possible in light of the above teachings. It is therefore to be understood that the appended claims are intended to cover all such modifications and variations that fall within the true spirit of the invention.

Claims

1. 1. A lighting system comprising: a light source for generating a light beam; - a spatially-coding pattern generator comprising one or more optical elements for encoding an imaging beam to simultaneously illuminate an object with a plurality of different spatially-coding patterns, each spatially-coding pattern of the plurality of different spatially-coding patterns being illuminated at a wavelength that is distinct for that spatially-coding pattern; A lighting system comprising:

2. further comprising one or more optical elements for splitting the light beam into an imaging beam and a reference beam and directing the reference beam to an imaging sensor after the reference beam has been combined with the imaging beam.

10. The lighting system of claim 1.

3. The spatial coding pattern generator configured to illuminate the object with the plurality of different spatially-encoded patterns across a first axis perpendicular to a direction of propagation of the imaging beam; configured to apply a Fourier transform when illuminating the object with the plurality of different spatially-encoded patterns across a second axis perpendicular to both the first axis and a propagation direction of the imaging beam.

3. A lighting system according to claim 1 or 2.

4. the one or more optical elements that encode the imaging beam are aligned along an optical path in the following order: a diffraction grating grid, a first lens, a coding pattern element, and a second lens; 4. The lighting system according to claim 1.

5. the first lens is spaced from both the diffraction grating grid and the coding pattern elements by a distance equal to an X-axis focal length of the first lens; the second lens is spaced from the coding pattern element by a distance equal to an X-axis focal length of the second lens.

5. The lighting system of claim 4.

6. the X-axis focal length of each of the lenses is twice the Y-axis focal length of that lens; 6. A lighting system according to claim 4 or 5.

7. the one or more optical elements that encode the imaging beam define an optical path comprising, in this order, the diffraction grating grid, the first lens, the coding pattern element, the second lens, a second diffraction grating grid, and a third lens; 7. The lighting system according to claim 4.

8. the first lens is spaced from both the diffraction grating grid and the coding pattern elements by a distance equal to an X-axis focal length of the first lens; the second lens is spaced from the coding pattern element by a distance equal to an X-axis focal length of the second lens; the third lens is spaced from the second diffraction grating grid by a distance equal to an X-axis focal length of the third lens; 8. The lighting system of claim 7.

9. the X-axis focal length of each of the lenses is twice the Y-axis focal length of that lens; 9. The lighting system of claim 8.

10. the light source is a laser generator; 10. The lighting system according to any one of claims 1 to 9.

11. the laser source is a pulsed laser source; 11. The lighting system of claim 10.

12. Incorporated into endoscopes, 12. The lighting system according to any one of claims 1 to 11.

13. Built into the imaging system, the imaging system, an imaging sensor for receiving a coded imaging beam transmitted through or reflected from the object; a processor for decoding image data from the imaging and reconstructing an image of the object; Further provided with 13. A lighting system according to any one of claims 1 to 12.

14. to reconstruct an image of the object, the processor is configured to multiply an image of each spatially-coding pattern of the plurality of different spatially-coding patterns obtained from the reflected or transmitted coded imaging beam by a corresponding decoding pattern to obtain products, and to sum all of the products to obtain a reconstructed image of the object.

14. The lighting system of claim 13.

15. 1. A decoding system comprising: an imaging sensor for receiving a coded imaging beam that simultaneously illuminates an object with a plurality of different spatially-coding patterns, each spatially-coding pattern of the plurality of different spatially-coding patterns illuminated at a wavelength that is distinct for that spatially-coding pattern transmitted through or reflected from the object; a processor for decoding image data from the imaging and reconstructing an image of the object; A decoding system comprising:

16. to reconstruct an image of the object, the processor is configured to multiply an image of each spatially-coding pattern of the plurality of different spatially-coding patterns obtained from the reflected or transmitted coded imaging beam by a corresponding decoding pattern to obtain products, and to sum all of the products to obtain a reconstructed image of the object.

16. The decoding system of claim 15.

17. generating a light beam; encoding an imaging beam using a spatially-coding pattern generator to simultaneously illuminate an object with a plurality of different spatially-coding patterns, each spatially-coding pattern of the plurality of different spatially-coding patterns being illuminated with a wavelength distinct for that spatially-coding pattern; A method comprising:

18. and encoding the imaging beam includes applying a time gate.

18. The method of claim 17.

19. the time gating is applied using one of the following techniques from the group of techniques: short optical pulse gating, coherence gating, and interference patterns generated by diffraction grating grids; 20. The method of claim 18.

20. a spatially coded pattern generator comprising one or more optical elements for coding the imaging beam, the one or more optical elements being aligned along the optical path in the following order: a diffraction grating grid, a first lens, a coded pattern element, and a second lens; 20. The method according to any one of claims 17 to 19.

21. encoding the imaging beam includes applying a time gate; the time gate is realized by splitting the light beam into an imaging beam and a reference beam, and directing the reference beam to an imaging sensor after the reference beam is combined with the imaging beam; 21. The method of claim 20.

22. the first lens is spaced from both the diffraction grating grid and the coding pattern elements by a distance equal to an X-axis focal length of the first lens; the second lens is spaced from the coding pattern element by a distance equal to an X-axis focal length of the second lens.

22. The method of claim 20 or 21.

23. the X-axis focal length of each of the lenses is twice the Y-axis focal length of that lens; The method according to any one of claims 20 to 22.

24. the one or more optical elements that encode the imaging beam define an optical path comprising, in this order, the diffraction grating grid, the first lens, the coding pattern element, the second lens, a second diffraction grating grid, and a third lens; The method according to any one of claims 20 to 23.

25. the first lens is spaced from both the diffraction grating grid and the coding pattern elements by a distance equal to an X-axis focal length of the first lens; the second lens is spaced from the coding pattern element by a distance equal to an X-axis focal length of the second lens; the third lens is spaced from the second diffraction grating grid by a distance equal to an X-axis focal length of the third lens; 25. The method of claim 24.

26. the X-axis focal length of each of the lenses is twice the Y-axis focal length of that lens; 26. The method of claim 25.

27. the light beam is generated by a laser source; The method according to any one of claims 17 to 26.

28. the laser source is a pulsed laser source; 28. The method of claim 27.

29. receiving, using an imaging sensor, a coded imaging beam transmitted through or reflected from the object; using a processor to decode image data from the imaging and reconstruct an image of the object; further comprising: The method according to any one of claims 17 to 28.

30. multiplying an image of each spatially-coding pattern of the plurality of different spatially-coding patterns obtained from the reflected or transmitted coded imaging beam by a corresponding decoding pattern to reconstruct an image of the object; obtaining products and summing all of the products to obtain a reconstructed image of the object.

30. The method of claim 29.

31. using an imaging sensor to receive an encoded imaging beam that simultaneously illuminates an object with a plurality of different spatially-coding patterns, each spatially-coding pattern of the plurality of different spatially-coding patterns illuminated at a wavelength distinct for that spatially-coding pattern and transmitted through or reflected from the object; using a processor to decode image data from the imaging and reconstruct an image of the object; A method comprising:

32. reconstructing an image of the object comprises: multiplying an image of each spatially-coding pattern of the plurality of different spatially-coding patterns obtained from the coded imaging beam, either reflected or transmitted, by a corresponding decoding pattern; obtaining products and summing all of said products to obtain a reconstructed image of said object.

32. The method of claim 31 .

Images