Imaging system for reallocating photons of dynamic samples
The photon reallocation imaging system addresses the challenge of imaging dynamic samples by using a polychromatic light source and optical deflectors to form spectral lines, achieving high-resolution images without sample modification, suitable for biomedical and industrial applications.
Patent Information
- Application Number
- PCT/EP2026/059302
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-09
- Filing Date
- 2026-03-31
- Publication Date
- 2026-11-12
AI Technical Summary
Existing photon reallocation imaging systems struggle to acquire super-resolution and high-contrast images of dynamic samples, particularly at high speeds, and require complex synchronization or fluorescent probes, which are detrimental for applications like in-situ characterization in non-destructive testing and biomedical imaging.
A photon reallocation imaging system using a polychromatic light source, first and second dispersive optical devices, and optical deflectors to form spectral lines, allowing samples to move relative to the spectral lines with predefined speeds, enabling optical reallocation of photons on a matrix sensor to create high-resolution images without sample modification.
The system achieves high-resolution or super-resolution imaging of dynamic samples without compromising image quality, facilitating real-time imaging in biomedical research and industrial applications like microfluidic systems, and enabling cost-effective, online quality control without production interruptions.
Smart Images

Figure EP2026059302_12112026_PF_FP_ABST
Abstract
Description
DESCRIPTION Dynamic Sample Photon Reallocation Imaging System Technical Domain
[0001] The present invention relates generally to the field of optical microscopy, and in particular to a photon reallocation imaging system for imaging moving samples.
[0002] In existing photon reallocation imaging systems (Sheppard 1988, York 2013), for example, a confocal microscope coupled with a matrix detector is known to acquire multiple point-by-point elementary images of a sample through two-dimensional optical scanning in at least one direction perpendicular to the microscope's object focal plane. The final image of the sample is then generated by integrating the successively acquired elementary images, each shifted by one scan step relative to the previous image. Photon reallocation techniques are implemented either digitally or optically through optical scan synchronization.These known solutions require the use of fluorescent probes on the one hand and acquisition times on the other hand which are detrimental, or even prohibitive, for certain applications such as in-situ characterization in non-destructive testing for rapid diagnosis, for example in the biomedical industry, materials and micro- and nanotechnologies.
[0003] Improved photon reallocation imaging systems have been proposed to overcome this drawback of the prior art—see, for example, (Ta 2013) and WO2022 / 122981. These known systems use the dispersion of a light beam in one direction to form a spectral line that simultaneously illuminates a plurality of points on the sample to be imaged with different wavelengths. A portion of the sample surface can then be imaged by scanning only in a second direction.
[0004] However, these existing systems cannot acquire super-resolution and / or high-contrast images of dynamic samples, i.e., samples in motion, particularly at high sample speeds relative to image acquisition time. Imaging systems based on photon reassignment with a chromatic line can scan a static sample or one whose movement during the exposure time is negligible compared to the field of view.
[0005] Document WO2024153440 (equivalent to FR3145214) discloses an embodiment in which a sample moves relative to a stationary chromatic line. In this case, however, the reallocation of photons is performed digitally, by processing images acquired by a matrix sensor, which requires complex synchronization between the movement of the sample and said matrix sensor.
[0006] In the field of optical imaging, the use of stroboscopic lighting and reduced camera acquisition time are solutions implemented in systems for imaging dynamic samples. These solutions are not suitable if high contrast or high resolution is required, especially when the sample is moving at very high speeds.
[0007] Furthermore, there is a growing need for solutions in the biomedical field, for example, or for industrial solutions for quality control through imaging of moving samples in a production line, for example, enabling resolution down to nanometers. Conventional sample quality control solutions, for industrial applications for example, involve the implementation of static imaging of samples from the production line, either after the fact or following a production line stoppage, in order to perform high-resolution characterization (or imaging). These static imaging solutions result, at a minimum, in a physical slowdown of the production line, and thus in losses of time and productivity.
[0008] There is therefore a need for a dynamic sample imaging system, and particularly a super-resolution one. Summary of the invention
[0009] To this end, a photon reallocation imaging system is proposed comprising: a polychromatic light source configured to generate at least one spatially coherent illumination beam in a range of illumination wavelengths; a first optical system, comprising a first dispersive optical device, configured to spectrally disperse said illumination beam and focus it on a sample in an object focal plane so as to form a first spectral line oriented along a first direction; a second optical system, comprising a second dispersive optical device, configured to collect a light beam scattered elastically by said sample, called the signal beam, and to spectrally disperse said signal beam, and focus it in an image focal plane so as to form a second spectral line oriented along a second direction;an image matrix sensor arranged in said image focal plane; characterized in that said imaging system further comprises a means for moving said sample configured to make said sample travel a path between a starting point and an ending point in a third direction perpendicular to the first direction, said path passing through said object focal plane with a predefined scanning speed v^ so as to induce a relative speed v^ between the sample and the first spectral line; and in that said second optical system comprises a first optical deflector configured to apply an optical scan, in a scanning speed v^ in a fourth direction perpendicular to the second direction, of said signal beam in said image focal plane, and to form an image of the sample by optical reallocation of photons from one or more images acquired by said image matrix sensor;said first optical deflector being adapted to impose a value of said scanning speed v^ with respect to the value of said relative speed v^ between the sample and the first spectral line, of the global magnification y of the imaging system, and of a first photon reallocation factor sx, such that |; v^| = s x xyx |v^|, said first photon reallocation factor sx being between 1.5 and 4 and preferably between 1.8 and 2.2.
[0010] According to specific embodiments:
[0011] - Said light source can be pulsed and configured to operate according to a repetition period T, said light source being adapted for dx impose a value for said repetition period such that T < 2x |^, dx being the percussion response of the first optical system, corresponding to the size of the illumination beam in an object focal plane along the third direction, and | v^| the value of said relative velocity between the sample and the first spectral line.
[0012] - Said second optical system may include at least one optical element configured to focus into an image focal plane, said spectrally dispersed signal beam by the second dispersive optical device, and in which said first optical deflector includes a variable orientation mirror configured to apply an angular sweep from an angular velocity so as to induce said sweep velocity of said signal beam on said image matrix sensor, with respect to the focal length formed by said at least one optical element.
[0013] - Said first optical system may include: a first collimator system, configured to collimate said illumination light beam; a focusing optical system configured to receive as input the illumination light beam dispersed by said first dispersive device and focus it into said object focal plane; and the second optical system may further include: said or another focusing system to collect said signal beam, collimate it and direct it to said first dispersive optical device, or another dispersive optical device, so that it is spectrally recombined; a second collimator system, configured to collimate said signal beam and comprising a pinhole arranged in a plane conjugate with an object focal plane so as to perform confocal filtering.
[0014] - Said first optical system may include: a second optical deflector configured to apply an optical scan, according to a scan speed in the third direction, of said illumination light beam in said object focal plane; and said second optical deflector may be adapted to impose a value of said scan speed so as to adjust said value of the relative speed between the sample and the first spectral line as a function of said sample speed along the path.
[0015] - The optical scanning of said illumination beam in said object focal plane may be applied in the direction of travel of said sample along the path, so as to induce a relative velocity between the sample and the first spectral line lower than the speed of the sample's movement along the path. More specifically, said optical scanning of said illumination beam in said object focal plane may be applied in the opposite direction of travel of said sample along the path, so as to induce a relative velocity between the sample and the first spectral line higher than the speed of the sample's movement along the path.The image matrix sensor can then be configured to acquire at least two images of said sample, each image being acquired during an acquisition time between two latency times, said first optical deflector being characterized by an operation including scanner return times, and the scanning speed of said illumination light beam can be applied such that said optical scanning of said illumination light beam in the reverse direction of the sample's path, during said acquisition time, induces an advance of the optical scanning of the sample to compensate for said scanner return time of the first optical deflector, the scanning speed of the signal beam being synchronized with said scanning speed of said illumination light beam.
[0016] - The length of the second spectral line along the second direction may be greater than that of the first spectral line along the first direction by a second photon reallocation factor greater than 1, defined as a function of the overall magnification of the imaging system and representing the ratio between the dimension of the first spectral line in the object focal plane and the dimension of the second spectral line in the image focal plane. This second photon reallocation factor may, in particular, be between 1.8 and 2.2.
[0017] Another object of the invention is a physical processing system characterized in that it comprises an imaging system configured as indicated above, the physical processing system further comprising at least one processing device configured to apply at least one physical processing on said sample; said means of movement being an unwinding / rewinding system comprising a starting reel at the starting point and an ending reel at the ending point, the path formed between the point and the point passing through said at least one processing device, and said unwinding / rewinding system being configured to continuously unwind and rewind said means of movement of said sample between the point and the point, so that said speed of movement of said sample is defined as a function of said at least one physical processing to be applied.
[0018] The embodiments of the invention thus provide an imaging system for a dynamic (moving) sample with the principle of photon reallocation based on a chromatic line to obtain a 2D image created instantly on a matrix sensor.
[0019] The result is a high-resolution, or even super-resolution, but not necessarily high-resolution imaging solution - without compromising image quality and without any modification of the dynamic sample to perform the imaging.
[0020] Such a "dynamic" imaging solution without modification of the sample can thus be easily used for imaging biological elements, for example in a microfluidic system, in which cells, bacteria or viruses move in a predetermined direction, thus opening up new opportunities in biomedical research.
[0021] Various embodiments of the invention advantageously provide a compact and affordable solution in terms of cost and manufacturing. These embodiments also facilitate and accelerate certain material processing methods, for example, through online (i.e., real-time) imaging quality control without interrupting dynamic samples in production / processing systems, thus significantly impacting cost reduction and improving production / processing quality and efficiency.
[0022] It should be noted that various embodiments of the invention advantageously provide an image acquisition rate up to ten times faster than that of a traditional "line scan" type imaging system with a potentially twofold improved resolution.
[0023] They also provide a solution that does not require image processing (the image of the dynamic sample is formed in an analog way), nor prior knowledge of the moving sample.
[0024] The embodiments of the invention advantageously provide an adaptive solution for imaging dynamic samples with very high movement speeds, without requiring an effective reduction in the sample movement rate, and optionally applying only a virtual reduction in this rate to create an image on the system's sensor. Description of the figures
[0025] Other features, details and advantages of the invention will become apparent from the description provided with reference to the accompanying figures given by way of example, which represent, respectively:
[0026] [Fig.1], a diagram of a photon reallocation imaging system according to a first embodiment of the invention;
[0027] [Fig. 2], a simplified and perspective diagram of a photon reallocation imaging system illustrating the operation of said first embodiment of the invention;
[0028] [Fig. 3], a diagram of a photon reallocation imaging system according to a second embodiment of the invention;
[0029] [Fig. 4], a simplified and perspective diagram of a photon reallocation imaging system illustrating a first operating mode of said second embodiment of the invention;
[0030] [Fig. 5], a simplified and perspective diagram of a photon reallocation imaging system illustrating a second operating mode of said second embodiment of the invention;
[0031] [Fig. 6], a chronogram temporally characterizing elements of the photon reallocation imaging system according to said second operating mode of said second embodiment of the invention; and
[0032] [Fig. 7], a diagram of a processing system comprising a photon reallocation imaging system according to a third embodiment of the invention.
[0033] Identical reference numerals are used in the figures to designate identical or analogous elements. For clarity, the elements shown are not to scale. Detailed description
[0034] Figure 1 schematically represents a 10-photon reallocation imaging system (also called '10 imaging system') comprising a polychromatic light source SL, a first optical system SO1, a second optical system SO2, and a matrix image sensor CMI, according to embodiments of the invention.
[0035] The imaging system 10 is a confocal microscope configured to project an image of the polychromatic light source SL onto a moving sample E (also called a 'dynamic sample') to be observed in an object focal plane f of the confocal microscope via the first optical system SO1. The imaging system 10 is further configured, via the second optical system SO2, to form an image of the sample E by optical reallocation of photons on the CMI image matrix sensor arranged in an image focal plane ' of the confocal microscope.
[0036] The imaging system 10, in particular the first optical system SO1 and the sample E, can be defined in a first orthogonal coordinate system (x,y,z) centered at a point. The object focal plane f can then correspond to the plane (x,y) of the first coordinate system (X,Y,Z). The imaging system 10, in particular the second optical system SO2 and the CMI image matrix sensor, can also be defined in a second orthogonal coordinate system (x',y',z') centered at a point. The image focal plane ' can then correspond to the plane (x',y') of the second coordinate system (x',y',z').
[0037] The polychromatic light source SL (also called 'SL source') is configured to generate at least one FE illumination light beam (also called 'FE illumination beam') that is spatially - but generally not temporally - coherent in a range of illumination wavelengths.
[0038] In some embodiments, and as schematically represented in [Fig. 1], the SL source may comprise a broad-spectrum SLS source, for example, an arc lamp, a light-emitting diode, or a pulsed laser. The SL source may further comprise a spectral filter (not shown in the figures) configured to select a portion of the SLS source's spectrum.
[0039] The first optical system SO1, designed to illuminate the sample E, comprises a first dispersive optical device Gi configured to spectrally disperse the illumination beam FE from the source SL. The first optical system SO1 is further configured to focus the spectrally dispersed illumination beam FE into the object focal plane f so as to form a first spectral line LS1 oriented along a first direction. This first direction can correspond, for example, to the orientation of the y-axis of the first coordinate system (x,y,z).
[0040] Advantageously, the first optical system SO1 is configured to disperse the FE illumination beam with a first angular dispersion DAi. The wavelength range selected by the FSC filter of the SL source, together with the angular dispersion DAi, determines the extent Dy of the first spectral line LS1 along the first direction (y) in the object focal plane f. The sizing of the first spectral line LS1 results from a compromise: a large spectral range reduces the constraints on the angular dispersion DAi and allows a greater fraction of the total light intensity emitted by the SLS source to be utilized, but makes it more difficult to compensate for chromatic aberrations in the imaging system (axial and longitudinal chromatic aberration). The resolution across the field of view in the object focal plane f also becomes variable with a large spectral range (optical resolution is proportional to the local wavelength).
[0041] The first dispersive optical device Gi can be a diffraction grating exhibiting angular dispersion DAi along a first direction y.
[0042] In the embodiment of [Fig. 1], the FE illumination beam exiting the source SL is reflected by a beam splitter BS, which directs it towards the first dispersive optical device Gi of the first optical system SO1. The FE illumination beam, diffracted by the grating Gi, passes through a first collimator system, forming an afocal system consisting of two converging lenses Li and L2, and configured to collimate the FE illumination beam and advantageously image the plane of G1 in the pupil of the focusing optical system MO. The FE illumination beam is then reflected by a mirror M1 before being focused onto the sample E by a focusing optical system MO. The focusing optical system can be a microscope objective configured to receive the FE illumination beam as input and focus it onto the object focal plane f.The spectral dispersion operated by the G1 grating and the focusing by the MO focusing optical system (also called 'MO objective') lead to the formation of the first spectral line LS1 on the sample E, that is to say an elongated deformed focal spot, oriented along the first y direction, in which the wavelength of the light varies monotonically with the position along said first y direction.
[0043] The primary function of the first collimator system, Li and L2, is to systematically position the diffraction grating G1 in a conjugate plane to the pupil of the objective lens MO, located at the rear of the lens. Furthermore, it allows for adjustment of the illumination beam size.
[0044] The second optical system SO2 is configured to collect a light beam elastically scattered by the sample (also called the 'signal beam FS') – that is, scattered without a change in wavelength. The second optical system SO2 includes, in particular, a second dispersive optical device G2 and is configured to spectrally disperse the signal beam FS in an image focal plane ', and to form a second spectral line LS2 on the CMI image matrix sensor. The second spectral line LS2 is oriented along a second direction. This second direction can correspond to the orientation of the (y') axis of the second coordinate system (x',y',z').
[0045] The second dispersive optical device G2 can be a diffraction grating exhibiting angular dispersion DA2 along a second direction y'.
[0046] In the embodiment of [Fig. 1], the imaging system 10 can operate in reflection mode, allowing for the sharing of optical elements between the first and second optical systems SO1 and SO2. More specifically, all the elements of the first optical system SO1 can also belong to the second optical system SO2, which also includes additional components. Furthermore, the light backscattered by the sample E is collected and collimated by the objective MO and spectrally recombined by the same diffraction grating G1 that had scattered it during its initial path (in the first optical system SO1). The signal beam FS then passes through the beam splitter BS, which had reflected the illumination beam FE from the source SL.
[0047] Advantageously, the second optical system SO2 can be a second collimator system, forming an afocal system consisting of two converging lenses L3 and L4, and configured to collimate the signal beam FS. The second optical system SO2 can also include a pinhole camera P arranged in the common focal plane of these lenses to perform spectral filtering, ensuring the spatial coherence of the signal beam FS entering the second optical system SO2 and reaching the second dispersive optical device G2. This second collimator system allows the second dispersive optical device G2 to be placed in a conjugate plane to the pupil of the objective lens OM. Furthermore, the second optical system SO2 can include a lens L5 forming the second spectral line LS2 oriented along the second y' direction on the CMI image matrix sensor.
[0048] The overall magnification of the imaging system 10, denoted y, can be defined as a function of the focal lengths of the optical elements of the first and second optical systems SO1 and SO2. In particular, this overall magnification y can thus be defined by the following equation (1), as a function of the focal lengths f of each of the optical elements MO, Li, L2, L3, L4 and Ls, such that:
[0049] y = (1)
[0050] In some embodiments, the source SL may include an additional collimator system, formed by two further converging lenses and represented simply by lens Le in [Fig. 1], configured to collimate the illumination beam FE. This additional collimator system may further include a pinhole arranged in the common focal plane of these lenses so as to perform spatial filtering, ensuring the spatial coherence of the illumination beam FE at the input of the first optical system SO1. The illumination beam FE can thus exit the collimated additional collimator system and be directed to the first dispersive optical device G1 via a mirror MSL.
[0051] The imaging system 10 further includes a means 200 for moving the sample E, configured to make the sample travel a path T between a starting point A and an ending point B defined along a third direction. This third direction can correspond to the orientation of the x-axis of the first coordinate system (x,y,z). The path T can thus be defined by a unit displacement vector x of the first coordinate system (x,y,z).
[0052] The path T passes through the object focal plane f of the imaging system 10. The means of movement 200 is then characterized by a speed of movement of the sample E in the first coordinate system (x,y,z). The speed of movement is denoted v^ (it is a vector oriented along the third direction x, as shown in [Fig. 1]). The speed of movement is predefined so as to induce a relative velocity between the sample E and the first spectral line LS1 from the first optical system SO1. The relative velocity is then denoted v^, a vector also oriented along the third direction x.
[0053] The second optical system SO2 also includes a first optical deflector DO1, configured to apply an optical scan of the signal beam FS in the image focal plane ' (i.e. of the second spectral line LS2 on the CMI image matrix sensor), thus to form an image of the sample E by optical reallocation of photons from one or more images acquired by the CMI image matrix sensor.
[0054] The optical scanning of the FS signal beam is performed, in particular, according to a first scanning speed of the second spectral line LS2 in a fourth direction on the CML image matrix sensor. This fourth direction can correspond to the orientation of the axis (x') of the second coordinate system (x',y',z'), perpendicular to the second direction (y'). The first scanning speed is v^Z, a vector oriented along the fourth direction y'.
[0055] Advantageously, and as schematically represented in [fig. 1], the first optical deflector DOi can include an oscillating scanning mirror SCi of the second spectral line LS2 and a first means Ci for controlling the mirror SCi.
[0056] In particular, the first optical deflector DOi is adapted to impose an optical scan of the second spectral line LS2 according to a predetermined first scan rate v^. In particular, the control of the first scan rate v^ via the first control means Ci is performed with respect to the relative velocity VR' (and in particular the value of the norm of the relative velocity |v^|) of the sample E with respect to the first spectral line LS1, the global magnification Y of the imaging system 10, and a first photon reallocation factor, denoted Sx.
[0057] The magnitude of the first sweep speed |v^| can in particular be defined by the following equation (2): [ 0058] | = Sx x Y x | v^| (2)
[0059] The first control means Ci thus allows obtaining an optical scan of the signal beam FS synchronized with the relative displacement of the sample E with respect to the first spectral line LS1.
[0060] Advantageously, the value of the first-scan velocity norm |v^| of the second spectral line LS2 can be greater than the value of the relative velocity norm |v^| of the sample E with respect to the first spectral line LS1, such that the product s x xy of equation (2) is strictly greater than 1.
[0061] In some embodiments, the photon reallocation factor Sx is in particular between 1.5 and 4, preferably between 1.8 and 2.2, and ideally has a value of 2.
[0062] Advantageously, according to equation (2) and the value of the photon reallocation factor Sx, it can be noted that the second spectral line LS2 moves about twice as fast on the CMI image matrix sensor as the first spectral line LS1 on the sample E.
[0063] In some embodiments, the oscillating scanning mirror SCi (i.e., a one-dimensional scanner) – or more generally, one with a variable orientation – can be arranged before the focusing lens Ls for the signal beam FS onto the matrix image sensor CMI. The first optical deflector DOi can be adapted to impose an angular scan on the variable-orientation mirror SCi, characterized by a first angular velocity, denoted θ. a-1; defined as a function of the first scanning speed v^ of the second spectral line LS2 to be obtained on the CMI image matrix sensor and the focal length f of the lens Ls.
[0064] The first angular velocity can thus be expressed by the following equation (3): [ 0065] = | v^7| / f L5 (3)
[0066] The CMI image matrix sensor of the imaging system 10 can be made, for example, in CMOS or CCD technology. It has a number of pixels in the second direction y' which is determined by the spatial extent of the second spectral line LS2 which can be obtained by the second optical system SO2, typically on the order of a few hundred.
[0067] The number of pixels in the CMI image matrix sensor in the fourth direction x' can be determined by the amplitude of the optical scan of the second spectral line LS2 in the image focal plane. For example, the number of pixels in the fourth direction x' can be on the order of a few dozen to a few hundred. Advantageously, this number of pixels can typically be of the same order of magnitude as the number of pixels in the second direction y'.
[0068] In some embodiments, the SL source can be a pulsed optical source defined according to a given repetition frequency of the FE illumination beam pulses. For example, and without limitation, the broad-spectrum SLS source can be an electronically pulsed laser diode, a mode-locked laser, or possibly a nanosecond, sub-nanosecond, or even picosecond laser, combined with a fiber adapted to generate a supercontinuum. Advantageously, the imaging system 10 (and in particular the source SL) can include a second control means C2 configured to control the pulse repetition frequency. Such a repetition frequency is characterized by a duration denoted T between each of the pulses of the illumination beam FE.
[0069] The SL source can be adapted to impose a predefined pulse duration T (i.e., a repetition rate) based on the ratio between the size dx (defined, for example, by the full width at half maximum intensity) of the FE illumination beam in an object focal plane f along the third direction x and the relative velocity v^ (and in particular the value of the magnitude of the relative velocity |v^|) between the sample E and the first spectral line LS1. It should be noted that the size dx of the FE illumination beam in an object focal plane f corresponds, in particular, to the percussion response of the first optical system SO1.
[0070] For example, in order to satisfy the Nyquist-Shannon sampling condition, the time interval T between pulses can advantageously satisfy the following condition (4): [° 071 L l £ ïh (4)
[0072] In some embodiments, the position of the first spectral line LS1 can be fixed; this is the case, in particular, when the imaging system 10 includes a fixed planar mirror M1 positioned before the objective MO as shown in [Fig. 1]. In these embodiments, the relative velocity v^ between the sample E and the first spectral line LS1 is equal to the speed v^ of the sample E along the path T.
[0073] Figure 2 schematically illustrates the (fixed) focusing, at two distinct instants arbitrarily denoted ti and t2, of the first spectral line LS1 directed in the first direction y, orthogonal to the displacement of the sample along the third direction x. The spectral lines, denoted LS1(ti) and LS1(t2), relating to the two instants ti and t2 respectively, are therefore spatially superimposed. Furthermore, Figure 2 schematically illustrates the focusing (according to an optical scan - |v^Z|), at two other distinct instants t'i and t'2, of the second spectral line LS2 directed in the second direction y' on the CMI image matrix sensor. The spectral line denoted LS2(t'i) corresponds to the elastic scattering by the sample E of the spectral line LS1 (ti) and collected by the second optical system SO2 (the time lag between ti and t'i being small and defined as a function of the optical path of the light in the second optical system SO2).Similarly, the spectral line, denoted LS2(t'2), corresponds to the elastic scattering by sample E of the spectral line LS1(t2) transmitted via the second optical system. Due to the optical scanning applied to the signal beam FS (particularly between the distinct times t'i and t'2), the spectral lines LS2(t'i) and LS2(t'2) are spatially shifted.
[0074] Alternatively, the position of the first spectral line LS1 is spatially variable. In this case, the imaging system 10 may include a second optical deflector DO2 configured to apply an optical scan of the illumination beam FE in the object focal plane f, according to a second scan rate of the first spectral line LS1 on the sample E in the third direction x. The second scan rate is denoted v b-2 , or along the vector of the scanning speed defined along the third direction x.
[0075] Advantageously, and as schematically represented in [fig. 3], the second optical deflector DO2 can include an oscillating scanning mirror SC2 of the first spectral line LS1 and a third means C3 for controlling the mirror SC2.
[0076] The oscillating scanning mirror SC2 or variable orientation mirror (i.e. 1-dimensional scanner) can be arranged before the MO objective in the first optical system SO1, between the MO objective and the lens Li as shown in [Fig. 3], or differently between lenses L2 and L3 for example.
[0077] The second optical deflector DO2 can be configured to apply an angular scan to the oscillating scanning mirror SC2 characterized by a second angular velocity, denoted o> a-2 This second angular velocity <z> a-2 can be related to the second scanning speed v^ of the first spectral line LS1 and to the focal length f of the lens Ls, for example according to the following equation (5):
[0078] r a-2 = |v b-2 | / f M0 (5)
[0079] The second optical deflector DO2 is adapted to impose optical scanning of the first spectral line LS1, and in particular of the second scanning velocity v^Zj (via control of the second angular velocity a> a-2 for example). In particular, the second optical deflector DO2 may include the third optical scanning control means C3.
[0080] In certain embodiments of the invention, the optical scanning of the first spectral line LS1 can be applied (via the third control means C3) in the direction of travel (+x) of the sample E along the path T (i.e., 'movements' of the first spectral line LS1 and of the sample E in the same direction). Such an optical scanning can be schematically represented in [Fig. 4], for example, illustrating a focusing (according to an optical scanning - |v^|), at two distinct instants t1 and t2, and in which the spectral lines LS1(t1) and LS1(t2) are spatially shifted in the direction of the unit displacement vector x. In this case, optical scanning is applied in such a way as to induce a relative velocity v^ lower than the speed of movement v^ of the sample E along the path T (i.e., a value of the magnitude of the relative velocity |v^| lower than the value of the magnitude of the speed of movement |v^| of the sample E along the path T).
[0081] Thus, the magnitude of the relative velocity |v^| can be defined by the following equation (6): [ 0082] | v^| = | v^| - | v^| (6)
[0083] Such a scenario makes it possible to slow down the relative movement of the first spectral line LS1 with respect to the sample E.
[0084] A reduction in the relative displacement between the first spectral line LS1 and the sample E can be applied in the case of a very high scan speed of the sample E. This reduction in relative displacement compensates for a potential mechanical limitation of the first optical deflector DO1. Indeed, a decrease in the value of the magnitude of the relative velocity v^ compared to the magnitude of the scan speed v allows for a lower value for the magnitude of the first scan speed |v^| and therefore for the first angular velocity – as illustrated by equations (2) and (3).
[0085] For example, and without limitations, the first optical deflector DOi can be characterized by a maximum value of the norm of the first scanning speed Ivb^il(max) ( et therefore P our la value of maximum angular velocity <» a-1(max) ), and the second optical deflector DO2 can be configured to apply an optical scan of the illumination beam FE in the direction of travel (+x) of the sample E, according to a minimum value of the norm of the second scanning speed |Vb^2l (min) defined by the following equation (7):
[0086] |v^Z7| (min| = | vg| - (7)
[0087] In some embodiments, the relative displacement can be zero so that the first spectral line LS1 'follows' the displacement of the sample E (i.e., v E equals v b-2 ). In this case, there is technically no scanning of the sample surface by the first spectral line LS1 and only a single second spectral line LS2 directed in the second direction y' is imaged on the CMI image matrix sensor.
[0088] In other embodiments of the invention, the optical scanning of the first spectral line LS1 can be applied in the opposite direction of the path (=x) of the sample E along the path T (i.e., of the first spectral line LS1 in the opposite direction to the 'movement' of the sample E). Such an optical scanning can be schematically represented in [Fig. 5], for example, illustrating a focusing (according to an optical scanning - Iv^Z^I), at two distinct instants ti and t2, and on which the spectral lines LS1 (ti) and LS1 (t2) are spatially shifted in the opposite direction to the unit displacement vector x. In this case, optical scanning is applied in such a way as to induce a relative velocity VR' greater than the speed of movement of the sample E along the path T (i.e., a value of the norm of the relative velocity |v^| greater than the value of the norm of the speed of movement |v^| of the sample E along the path T).
[0089] Thus, the magnitude of the relative velocity |v^| can be defined by the following equation (8):
[0090] | v^| = | v^| + | v^| (8)
[0091] Such a scenario allows for accelerating the relative movement of the first spectral line LS1 with respect to the sample E.
[0092] Furthermore, the operation of the CMI matrix image sensor can be characterized temporally by an image acquisition time, denoted dta, and a sensor latency time, denoted dti_, as schematically represented on the timing diagram in [fig. 6]. Similarly, the operation of the first and second optical deflectors DO1 and DO2 can be characterized temporally by scanning operating times, denoted dtt>, to perform, for example, a scan between a first position of the spectral lines in their respective coordinate systems (x^ and x^ respectively) and a second position (x2 and x2 respectively), as schematically represented on the timing diagram in [fig. [6]. The operation of the first and second optical deflectors DO1 and DO2 can also be characterized temporally by the return times of the oscillating scanning mirrors SC1 and SC2, called 'scanner return times' and denoted dtr, to perform the return scan from the second position of the spectral lines (i.e., final positions - x2 and x2) to the first position (i.e., initial positions - Xi and xi), as schematically represented on the timing diagram in [Fig. 6]. These scanner return times correspond to "dead times" (or possibly 'latency') in the operation of the first and second optical deflectors DO1 and DO2.
[0093] In embodiments, the relative velocity acceleration VR' can be applied so that the displacement of the first spectral line LS1 (between an initial position and a final position) in the opposite direction of the path (-x) of the sample E, during an image acquisition time dta, induces an advance of the optical scanning of the sample E - moving along the path T according to (+x) - to compensate for the dead time (dtr) in the operation of the optical deflectors, and in particular of the first optical deflector DO1 (during the return of the oscillating scanning mirror SCi).
[0094] In other words, the various control methods of the imaging system 10 can be configured to apply:
[0095] - at an initial arbitrary time, and for a scanning duration dtb equal to an image acquisition duration dta:
[0096] * a second scanning speed v^, such that the value of the relative speed |v^| is greater than the value of the scanning speed |v^| of the sample E, to induce an optical scanning of the first spectral line LS1 (between an initial position Xi and a final position x2) in the reverse direction of the path (-x) of the sample E,
[0097] * a first scanning speed |v^| to induce an optical scanning of the second spectral line LS2 (between an initial position x^ and a final position x2) along the fourth direction x', and
[0098] * the acquisition of an image by the CMI matrix image sensor;
[0099] - at a second arbitrary given time, and for a scanner return time dtr equal to the latency time of the sensor dti_:
[0100] * First and second scan speeds to perform the return scan of spectral lines from the respective final positions (x2 and x2) to the initial positions and xi);
[0101] * the latency of the CMI image matrix sensor.
[0102] In other words, the various control means of the imaging system 10 can be configured on the one hand to adapt the first and second scanning speeds v^ and (and in particular the scanning operating times dtb of the two optical deflectors DOi and DO2) with the image acquisition operation of the CMI image matrix sensor (i.e. acquisition time dta of the CMI image matrix sensor)
[0103] This adaptation of scanning speeds (or synchronization) can therefore refer to a coordination of optical scanning duration, and a temporal coordination of the triggering of the optical scanning of each of the optical deflectors DO1 and DO2, with the triggering of the acquisition of the matrix image sensor CMI.
[0104] The various control means of the imaging system 10 can be configured on the other hand to adapt the scanner return times dtr of the two optical deflectors DO1 and DO2 with the latency time dti_ of the matrix image sensor CMI.
[0105] For example, and without limitations, the first control means Ci of the optical scanning of the second spectral line LS2 and the third control means C3 of the optical scanning of the first spectral line LS1 can be configured to adapt the first and second angular velocities And <z> a-2 Mirrors with variable orientation during the 'scanner return', in response to mirrors reaching the end of their travel (for the final positions - x2 and x2), are used to obtain scanner return times (dtr) equal to the sensor latency (dti_). The CMI image matrix sensor operation can also be adapted to match the sensor latency (dti_) (i.e., no acquisition) to the minimum scanner return times (dtr).
[0106] In this context, an increase in the relative displacement between the first spectral line LS1 and the sample E allows for the complete imaging of the sample E, via the synchronization of the optical deflectors DO1 and DO2 and the matrix image sensor CMI, and the compensation of their different respective technical latencies.
[0107] Furthermore, to achieve good spatial resolution, it can be noted that the second spectral line LS2 may have a length Dy' in the second direction y' greater than the first spectral line LS1, which has a length Dy in the first direction y. For example, the length Dy' may be greater than the length Dy of a second photon reallocation factor s y between 1.5 and 4, and preferably between 1.8 and 2.2 (ideally equal to 2). This second photon reallocation factor y can be defined as a function of the overall magnification y of the imaging system 10. This elongation can be obtained by using a second dispersive optical device G2 having an angular dispersion DA2 greater than that - DA1 - of the first dispersive optical device G1. For example, the second dispersive optical device G2 can have an angular dispersion DA2 (approximately) equal to twice the angular dispersion DAi of the first dispersive optical device Gi.
[0108] Advantageously, the two optical deflectors DO1 and DO2 can be made on two opposite faces of a single variable-orientation support (not shown in the figures), and by adapting the configuration of the optical elements of the first and second optical systems SO1 and SO2. In embodiments associated with an acceleration of relative displacement of the first spectral line LS1 with respect to the sample E, this can, for example, eliminate the synchronization requirements of the two optical deflectors DO1 and DO2, and facilitate the use of a high single scanning frequency - on the order of kilohertz - obtained, for example, by means of a resonant SPO support or a polygonal scanner.
[0109] The imaging system 10, according to embodiments of the invention, can be used in various fields of application. For example, and without limitation, the imaging system 10 can be implemented as an in-situ characterization device for non-destructive testing and rapid diagnostics in the fields of biomedicine, sterilization, medicine, cosmetics, manufacturing and / or materials processing, micro- and nanotechnologies, etc.
[0110] Figure 7 schematically represents a physical processing system 1 comprising the photon reallocation imaging system 10, according to embodiments of the invention.
[0111] The physical processing system 1 may further include one or more physical processing devices 30 for a sample E, implemented according to the application area considered. For example, and without limitation, a processing device 30 may be a device for manufacturing a sample E, a device for processing materials by surface functionalization, a machining device, etc.
[0112] Advantageously, the means of moving sample E 200 is configured to apply a path T through the processing device(s) 30 of system 1. The physical processing system 1 can notably be a system defined by a production line, such that each processing device 30, following one another along the path T, is configured to apply at least one physical treatment to the sample E moving along the path T. For example and without limitation, the physical processing system 1 can include a single imaging system 10 arranged at the end of the production line, or a plurality of imaging systems 10 arranged after several or each processing device 30 within the production line.In this case, the main application of the imaging system(s) 10 corresponds to a metrology or quality control (and evolution) function of the sample E on the production line, thus making it possible not to slow down a high-speed production process for example.
[0113] In some embodiments, the means of moving the sample E 200 can be a roll-to-roll system comprising a starting reel 210 at the starting point A and an ending reel 220 at the ending point B, as shown in [Fig. 7]. Sample E can, for example, be a material suitable for winding onto a starting reel 210 and a finishing reel 220, such as a fiber, wire, tube, ribbon, or capillary. The means 200 for moving sample E is thus configured to continuously unwind and rewind the sample E between point A and point B, so that the speed of movement v^ of sample E is defined according to the different physical treatments to be applied to sample E.
[0114] According to certain embodiments of the invention, the photon reallocation imaging system 10 can be implemented in systems for characterizing or detecting biological elements, such as cells, biological micro-tissues (e.g., organoids), viruses, etc.
[0115] In some embodiments, the means of moving sample E 200 may in this case include at least one microfluidic channel in which the biological elements corresponding to the dynamic sample E to be imaged move (at constant speed).
[0116] In some embodiments, the means of moving the sample E 200 can be a translation plate on which the sample is mounted and which allows it to be translated along the third direction x along the path T, as shown schematically in [fig. 1] and [fig. 3].
[0117] It should be noted that certain features of the invention may offer advantages when considered in combination or separately.
[0118] Furthermore, the invention has been described with reference to a number of embodiments, but variations are possible. For example:
[0119] - The internal structure of the SL source is given only as an example; other structures are possible.
[0120] - All or some of the converging lenses can be replaced by other optical elements such as concave mirrors, diffractive systems such as holographic lenses, etc.
[0121] - Diffraction gratings, or some of them, can be replaced by other dispersive systems, for example three-dimensional diffractive structures, or even by refractive systems such as prisms.
[0122] - The microscope objective(s) can be replaced by other types of focusing devices, for example concave mirrors or f-theta lenses. In this case, the dispersive elements will not necessarily be placed in a plane conjugate to a pupil of the focusing system but, more generally, in a plane conjugate to the Fourier plane of the sample.
[0123] - The directions x and y, as well as x' and y', do not necessarily have to be perpendicular, although this is advantageous. It is sufficient that they are not parallel.
[0124] - In embodiments in which the two optical deflectors DO and DO2 are carried by the same variable orientation structure, it is not necessary for them to be arranged on opposite faces of the structure.
[0125] - The concept of a mirror or support "with variable orientation" covers both structures that oscillate resonantly and structures whose orientation varies in a controlled manner, continuously or in discrete steps. References
[0126] (Sheppard 1988): CJR Sheppard, “Super-resolution in Confocal Imaging”, Optik 80, No. 2, pages 53, 54.
[0127] (York 2013): AG York et al. “Instant super-resolution imaging in live cells and embryos via analog image processing”, Nat. Methods 2013, November, 10(11), pages 1122 - 1126.
[0128] (Ta 2013) DM Ta, A. Aguilar, P. Bon “Label-free image scanning microscopy for kHz super-resolution imaging and single particle tracking >>, Optics Express 2023, 31 (22), 36420-36428.< / z> < / z>
Claims
DEMANDS 1. Photon reallocation imaging system (10) comprising: a polychromatic light source (SL) configured to generate at least one spatially coherent illumination light beam (FE) in a range of illumination wavelengths; a first optical system (SO1), comprising a first dispersive optical device (Gi), configured to spectrally disperse said illumination light beam (FE) and focus it on a sample (E) in an object focal plane ( ) so as to form a first spectral line (LS1) oriented along a first direction (y); a second optical system (SO2), comprising a second dispersive optical device (G2), configured to collect a light beam elastically scattered (FS) by said sample (E), called signal beam, and to spectrally disperse said signal beam (FS), and focus it into an image focal plane ( ') so as to form a second spectral line (LS2) oriented along a second direction (y'); an image matrix sensor (IMS) arranged in said image focal plane ( '); characterized in that said imaging system (10) further comprises a means for moving said sample (E) configured to make said sample travel a path (T) between a starting point (A) and an ending point (B) along a third direction (x) perpendicular to the first direction (y), said path (T) passing through said object focal plane ( ) with a predefined speed v^ so as to induce a relative speed v^ between the sample (E) and the first spectral line (LS1); and in that said second optical system (SO2) comprises a first optical deflector (DO1) configured to apply an optical scan, at a scan rate v^ in a fourth direction (x') perpendicular to the second direction (y'), of said signal beam (FS) in said image focal plane (i'), and to form an image of the sample (E) by optical reallocation of photons from one or more images acquired by said image matrix sensor (IMS); said first optical deflector (DO1) being adapted to impose a value of said scan rate v^ with respect to the value of said relative rate v^ between the sample (E) and the first spectral line (LS1), of the overall magnification y of the imaging system (10), and of a first photon reallocation factor Sx such that | v^Z7l = s x xyx |v^|, said first photon reallocation factor Sx being between 1.5 and 4 and preferably between 1.8 and 2.
2.
2. Imaging system (10), according to claim 1, wherein said light source (SL) is pulsed and configured to operate according to a repetition period T, said light source (SL) being adapted to impose a value of said dx repetition period such that T < 2X | | , dx being the percussion response of the first optical system (SO1), corresponding to the size (dx) of the illuminating light beam (FE) in an object focal plane ( ) along the third direction (x), and |v^| the value of said relative velocity between the sample (E) and the first spectral line (LS1).
3. Imaging system (10), according to claim 1 or 2, wherein said second optical system (SO2) comprises at least one optical element (Ls) configured to focus in an image focal plane (L'), said signal beam (FS) spectrally dispersed by the second dispersive optical device (G2), and wherein said first optical deflector (DO1) comprises a variable orientation mirror configured to apply an angular scan from an angular velocity so as to induce said scan velocity (v^Z) of said signal beam (FS) on said image matrix sensor (IMS), with respect to the focal length formed by said at least one optical element (L5).
4. Imaging system (10), according to claim 3, wherein the first optical system (SO1) comprises: a first collimator system (Li, L2), configured to collimate said lighting light beam (FE); an optical focusing system (MO) configured to receive as input the illumination light beam (FE) dispersed by said first dispersive device and focus it into said object focal plane ( ); and the second optical system (SO2) further comprises: said or another focusing system (MO) to collect said signal beam (FS), collimate it and direct it to said first dispersive optical device, or another dispersive optical device, so that it is spectrally recombined; a second collimator system (L3, l ), configured to collimate said signal beam (FS) and comprising a pinhole (P) arranged in a plane conjugate with an object focal plane ( ) so as to perform confocal filtering.
5. Imaging system (10), according to any one of claims 1 to 4, wherein said first optical system (SO1) comprises a second optical deflector (DO2) configured to apply an optical scan, according to a scan speed (v^Zj) in the third direction (x), of said illuminating light beam (FE) in said object focal plane ( ); and in which said second optical deflector (DO2) is adapted to impose a value of said scanning speed (v^Zj) so as to adjust said value of the relative speed (v^) between the sample (E) and the first spectral line (LS1) as a function of said scrolling speed (v ) of the sample (E) on the path (T).
6. Imaging system (10), according to claim 5, wherein said optical scanning of said illumination light beam (FE) in said object focal plane ( ) is applied in the direction of travel of said sample (E) on the path (T), so as to induce a relative velocity (v^) between the sample (E) and the first spectral line (LS1) lower than the speed of travel (v ) of the sample (E) on the path (T).
7. Imaging system (10), according to claim 5, wherein said optical scanning of said illumination light beam (FE) in said object focal plane ( ) is applied in the opposite direction of the path of said sample (E) on the path (T), so as to induce a relative velocity (v^) between the sample (E) and the first spectral line (LS1) greater than the speed of movement (v ) of the sample (E) on the path (T).
8. Imaging system (10), according to claim 7, wherein said image matrix sensor (IMS) is configured to acquire at least two images of said sample (E), each image being acquired during an acquisition time (dta) between two latency times (dti_), said first optical deflector (DO1) being characterized by an operation comprising scanner return times (dtr), and wherein the scanning speed (v^) of said illumination light beam (FE) is applied such that said optical scanning of said illumination light beam (FE) in the reverse direction of travel (-x) of the sample (E), during said acquisition time (dta), induces an advance of the optical scanning of the sample (E) enabling compensation of said scanner return time (dtr) of the first optical deflector (DO1), the scanning speed (v^Z) of the signal beam (FS) being synchronized with said scanning speed (v^) of said illumination light beam (FE).
9. Imaging system (10), according to any one of claims 1 to 8, wherein the length of the second spectral line (LS2) along the second direction (y') is greater than that of the first spectral line (LS1) along the first direction (y) by a second photon reallocation factor (s y ) greater than 1 and defined as a function of the overall magnification (y) of the imaging system (10) and representing the ratio between the dimension of the first spectral line (LS1) in the object focal plane ( ) and between the dimension of the second spectral line (LS2) in the image focal plane ( / ')■ 10. Imaging system (10), according to claim 9, wherein said second photon reallocation factor (s y ) is between 1.8 and 2.
2.
11. Physical processing system (1) characterized in that it comprises an imaging system (10) configured according to any one of claims 1 to 10, the physical processing system (1) further comprising at least one processing device (30) configured to apply at least one physical treatment to said sample (E), said means of movement (200) being a winding / rewinding system comprising a starting reel (210) at the starting point (A) and an ending reel (220) at the ending point (B), the path (T) formed between the point (A) and the point (B) passing through said at least one processing device (30), and said winding / rewinding system being configured to continuously unwind and rewind said means of movement (200) of said sample (E) between the point (A) and the point (B), such that said speed of movement (v^) of said sample (E) is defined as a function of said at least one physical processing to be applied.
