Method of determining an arrangement of a number of point sources
The method uses a probe signal with a spatial intensity minimum to determine the arrangement of point sources at sub-diffraction distances, overcoming limitations of existing technologies by enabling high-precision localization and simultaneous tracking without switchable fluorophores, applicable to fluorescence and Raman scattering.
Patent Information
- Application Number
- PCT/EP2025/051695
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-10-18
- Filing Date
- 2025-01-23
- Publication Date
- 2025-07-31
AI Technical Summary
Existing methods for determining the arrangement of equal point sources, such as fluorophores, in a sample are limited by the diffraction barrier, requiring switchable fluorophores or multiple wavelengths, which introduce noise, cross-talk, and inefficiencies in resolving distances less than A/(2n sinα, and cannot track multiple sources simultaneously.
The method involves scanning point sources with a probe signal having a spatial intensity distribution with a local minimum, registering measurement intensities at different positions of this minimum, and using previous knowledge of the point source arrangement to determine their positions without switchable sources, allowing for high-precision localization even at small distances.
Enables high-precision determination of point source arrangements at sub-diffraction distances, improving resolution and reducing noise, and allowing simultaneous tracking of multiple sources without the need for state transitions, applicable to conventional optics and various types of optical scattering.
Smart Images

Figure EP2025051695_31072025_PF_FP_ABST
Abstract
Description
[0001] METHOD OF DETERMINING AN ARRANGEMENT OF A NUMBER OF POINT SOURCES
[0002] TECHNICAL FIELD OF THE INVENTION
[0003] The invention relates to a method of determining an arrangement of equal point sources in a sample at a high precision. More particularly, the invention relates to a method according to the preamble of claim 1.
[0004] Many embodiments of the method will belong to the field of microscopy and more particularly to the field of ultra-high resolution light microscopy. Other embodiments of the method will belong to the field of sonography and more particularly to the field of ultrasonography.
[0005] PRIOR ART
[0006] In, for example, investigating biological processes, a determination of arrangements of different or equal structures or parts of structures, and particularly a determination of temporal developments of such arrangements are of interest. The structures or parts of structures may, for example, be different proteins and / or different areas of one protein or any other larger molecule. In order to determine the arrangement of interest, the structures may be marked with point sources or the structures may inherently comprise point sources providing a measurement signal, and, using the measurement signal, the arrangement of these point sources may be determined as an image of the arrangement of the structures of interest.
[0007] One group of point sources used for this purpose are fluorophores. Fluorophores can be probed or, more particularly, excited with excitation light, and they can be localized based on fluorescence light emitted in response to their excitation by the excitation light. However, the fluorescence light can only be assigned to an individual fluorophore, if its distance to neighboring fluorophores is at least about A / (2n sina), A being the wavelength of the fluorescence light, n being the refractive index of an optical material between a sample and an objective used for imaging the fluorescence light, and a being a half angle of an aperture of the objective. This is a strong limitation to the arrangement of structures which may be determined using equal fluorophores as point sources.
[0008] This limitation may be overcome by using different fluorophores for neighboring structures which can be probed with excitation light of different wavelengths and / or which emit fluorescence light of different wavelengths. However, this concept is limited by a cross talk between the excitation cross sections of the different fluorophores and an overlap of the emission spectra of the different fluorophores. This particularly applies if more than two different fluorophores are needed to mark more than two structures arranged at smaller distances than A / (2n sina). Further, this concept requires additional expenditures for the excitation and / or registration at different wavelengths, and the number of otherwise similar fluorophores which can be excited and / or which emit at easily distinguishable wavelengths is strongly limited.
[0009] Another concept of separately localizing fluorophores arranged at a very close distance makes use of switchable fluorophores, i.e. of fluorophores that can be switched between an on-state in which they are excitable for emission of fluorescence light, and an off-state in which they are nor excitable for emission of fluorescence light. If only one fluorophore of an arrangement of a number of fluorophores is in its on-state at a certain point in time, its position can be determined at a high precision from the fluorescence light emitted by it as this fluorescence light exclusively stems from this fluorophore. Once all positions of all fluorophores are determined in this fashion, the arrangement of the fluorophores is known. However, this concept inherently does not allow for determining the positions of all fluorophores at a same point in time. Further, a switching signal always affects all fluorophores of the arrangement. Thus, it is not possible to switch the fluorophores on one after the other. Instead, which fluorophore will actually be switched on is a matter of transition probabilities. With a higher number of fluorophores it takes some additional time to really determine the positions of all fluorophores, i.e. much more time than the time needed for determining the position of one fluorophore multiplied by the number of fluorophores. Further, some switchable fluorophores tend to blink, i.e. to change between their on- and off-states in an uncontrolled fashion.
[0010] US 9719928 B2 discloses a method of high-resolution fluorescence microscopy using a structured beam of excitation light. In order to determine the locations of individual fluorescent molecules in a sample, which keep a minimum distance with regard to each other, the individual fluorescent molecules are excited for emission of fluorescence light by means of excitation light. The fluorescence light is registered for different positions of a zero point of an intensity distribution of the excitation light. The distance between these positions is at least half the minimum distance of the fluorescent molecules. The locations of the fluorescent molecules are derived from the course of the intensity of the fluorescence light over the positions of the zero of the excitation light. Actually, the distances between the individual fluorescent molecules are adjusted to keep a minimum value d=A / (2n sin a - (1 +l / ls)), wherein A is a wave length of the excitation light, n is the refraction index of an optical material in which the intensity distribution of the excitation light with the at least one minimum is formed, a is a half angle of an aperture of an optical arrangement by which the excitation light is directed on to the sample, I is a maximum intensity of the excitation light within the sample, and Is is a substance-dependent fluorescence excitation saturation intensity of the excitation light. The adjustment of the distances between the individual fluorescent molecules to the minimum value d is achieved either by a low concentration of the fluorescent molecules in the sample or by using molecules which are transferable or switchable between a non-fluorescent state and a fluorescent state. By means of this known method, an arrangement of fluorescent molecules used as equal point sources can be determined without switching only if the point sources keep the minimum distance d. In this case, the course of the intensity of the fluorescent light over the positions of the zero point of the excitation light comprises a separate local minimum for each of the fluorescent molecules, i.e. at each position corresponding to the position of the respective fluorescent molecule in the sample. However, there are many arrangements of structures of interest which do not keep the minimum distance d. These arrangements may only be determined using different fluorescent molecules or switchable fluorescent molecules with all the drawbacks explained above.
[0011] US 10962479 B2 discloses a method of high spatial resolution determining a position of a singularized molecule which is excitable for emission of luminescence light, in n spatial dimensions in a sample. The excitation light is directed onto the sample with an intensity distribution which has a zero point and intensity increasing regions adjoining the zero point on both sides in each of the n spatial dimension. The zero point is arranged at not more than nx3 different positions. The luminescence light emitted by the singularized molecule is separately registered for each of the different positions of the zero point. The position of the singularized molecule in the n spatial dimensions in the sample is deduced from intensities of the luminescence light separately registered for the not more than nx3 different positions of the zero point. A singularized molecule has a minimum distance to other similar molecules which are excitable with the same excitation light for emission of fluorescence light in a same wavelength range. This minimum distance is safely kept if the distances of the singularized molecules do such similar molecules are at least as high as the diffraction barrier at the wave length of the luminescence light, i.e. at least A / (2n sina), see above. Thus, this known method is only suitable for determining the arrangements of equal point sources arranged at clearly smaller distances, if different or switchable molecules are used, and if the associated problems, see above, are accepted. On the other hand, this known method which is also known as MINFLUX (minimal photon fluxes)-microscopy allows for determining the position of an individual molecule at a very high precision without needing many photons emitted by the molecule.
[0012] Matthew P. Gordon et al.: Single-molecule high-resolution imaging with photobleaching, PNAS 101 (17) 6462-6465, April 19, 2004, https: / / doi.org / 10.1073 / pnas.0401638101, disclose how to locate the position of two dyes and determine their separation with 5-nm precision, using the quantal photobleaching behavior of single fluorescent dye molecules. By fitting images both before and after photobleaching of one of the dyes, both dyes can be localized simultaneously and their separation can be computed.
[0013] WO 2011 / 106 323 A2 discloses a method of photobleaching and intermittency localization microscopy (PhILM). A movie of fluorophores transitioning between fluorescent and dark states is processed by sequentially subtracting frame from frame to obtain a "backwards-subtracted movie". Dark and bright spots are detected in the backwards-subtracted movie, wherein bright spots correspond to transitions from fluorescing-states-to-dark-states ("photobleaching" events), and dark spots correspond to transitions from dark-states-to-fluorescing-states ("blinking" events), and corresponding frame numbers and positions of these photobleaching or blinking events are stored. Positions of the fluorophore transition events are localized with sub-pixel resolution; and a high resolution image is created by plotting the positions of the localized fluorophore transition events in a final image.
[0014] OBJECT OF THE INVENTION
[0015] It is the object of the present invention to provide a method of determining an arrangement of equal point sources in a sample at a high precision, which does without switchable point sources even if the point sources are arranged at very small distances. SOLUTION
[0016] According to the present invention, the object of the invention is solved by the method of independent claim 1.
[0017] Preferred embodiments of the method according to the invention are defined in the dependent claims.
[0018] DESCRIPTION OF THE INVENTION
[0019] In the method of determining an arrangement of point sources in a sample according to the present invention, the point sources are scanned with a probe signal comprising a probe signal intensity. A spatial intensity distribution of the probe signal intensity has a local probe signal intensity minimum that is, in at least one spatial direction, delimited on both sides by probe signal intensity maxima. During the step of scanning the point sources with the probe signal, the local probe signal intensity minimum is positioned at different probe signal minimum positions at distances in the at least one spatial direction. Further, a measurement intensity of a measurement signal coming from the point sources is registered for each of the different probe signal minimum positions. The measurement signal registered may be any measurement signal whose measurement intensity depends on the probe signal intensity at point source positions of the point sources. The point sources whose arrangement is to be determined are limited both to a known point source number of at least 2, and to such a small spatial area of the sample that a spatial course of the registered measurement intensity over the different probe signal minimum positions of the local probe signal intensity minimum has one measurement signal minimum only. The arrangement of the point sources is determined from the spatial course of the registered measurement intensities over the different probe signal minimum positions utilizing previous knowledge of the arrangement of the point sources.
[0020] The course of the registered measurement intensities is spatial in that the measurement intensities are registered for the spatially different probe signal minimum positions.
[0021] The previous knowledge preferably includes at least one of an expected contribution to the measurement intensity per point source, the actual point source number, a plurality of different possible basic geometries of the arrangement of the point sources, or, at least with a point source number above 4, a geometry of the arrangement of the point sources. The actual point source number may, for example, be known due to the fact that a protein comprising a known fixed number of point sources is investigated. The point sources may, for example, be fluorophores that are coupled to all of a fixed number of coupling sites introduced in the protein in a generally known way of protein engineering. In this embodiment, the coupling sites introduced at certain positions of the protein may also inherently limit the different possible basic geometries of the arrangement of the point sources to certain basic geometries, i. e. provide further previous knowledge usable in determining the arrangement of the point sources from the spatial course of the registered measurement intensities over the different probe signal minimum positions.
[0022] The previous knowledge has to be known prior to determining the arrangement of the point sources from the spatial course of the registered measurement intensities over the different probe signal minimum positions. However, there is no need to know the previous knowledge prior to registering the measurement intensity of the measurement signal coming from the point sources for each of the different probe signal minimum positions. Instead, the actual point source number may, for example, be obtained by evaluating at least one of an overall measurement intensity of the measurement signal using the expected contribution to the measurement intensity per point source, or discrete decreases of an overall measurement intensity of the measurement signal due to successively bleaching the fluorescent point sources one after the other. The total number of these discrete decreases indicates the actual point source number. Additionally, the magnitudes of these discrete decreases indicate the contributions of the individual point sources to the intensity of the measurement signal. Discrete increases and decreases of the measurement signal due to blinking fluorescent point sources may also be evaluated for determining the contributions of the individual point sources to the intensity of the measurement signal. These contributions may depend on various factors, like orientation or local environment of the individual point sources, and they can be used as further previous knowledge in determining the arrangement of the point sources from the spatial course of the registered measurement intensities over the different probe signal minimum positions.
[0023] Further, the position of that fluorescent point source which is bleached at last may precisely be determined from a spatial course of registered measurement intensities of a measurement signal only coming from that point source bleached at last over different probe signal minimum positions, or by localization, and used as previous knowledge in determining the arrangement of the point sources from the spatial course of the registered measurement intensities over the different probe signal minimum positions. More particular, the position of that fluorescent point source bleached at last which has been determined at a high accuracy can be used as previous knowledge in determining the position of that fluorescent point source which is bleached second to last at an increased accuracy. For example, the position of that fluorescent point source which is bleached second to last can be determined from a spatial course of registered measurement intensities of a measurement signal only coming from the two point sources bleached at last and second to last over different probe signal minimum positions, and from the position of that fluorescent point source bleached at last used as previous knowledge. Then, the positions of that fluorescent point sources bleached at last and second to last can be used as previous knowledge in determining the position of that fluorescent point source which is bleached third to last at an increased accuracy, and so on. For example, the position of that fluorescent point source which is bleached third to last can be determined from a spatial course of registered measurement intensities of a measurement signal only coming from the three point sources bleached at last, second to last and third to last over different probe signal minimum positions, and from the two positions of that fluorescent point sources bleached at last and second to last used as previous knowledge. At least, the position of that fluorescent point source bleached at last which has precisely been determined from a spatial course of registered measurement intensities of a measurement signal only coming from that point source bleached at last over different probe signal minimum positions, or by localization can be used to counter-check the arrangement of the point sources determined from the spatial course of the registered measurement intensities over the different probe signal minimum positions.
[0024] Further, with blinking fluorophores, PhILM can be used to separately determine the exact position of one or more of the point sources at a high accuracy. However, with a varying arrangement of the point sources whose variations are determined from varying spatial courses of consecutively registered measurement intensities over different probe signal minimum positions, a bleaching based counter-check is only possible for the final arrangement of the point sources at the very end of determining these variations, if possible at all. On the other hand, with blinking fluorophores, tracking the variations of the entire arrangement of the point sources will become difficult. Thus, most of the actual arrangements of the point sources have to be, and will be, determined from the spatial course of the registered measurement intensities of the measurement signal coming from all point sources over the different probe signal minimum positions without previous knowledge of the exact positions of one or more of the point sources, which have been separately determined at a high accuracy.
[0025] Another indication of the actual point source number may be obtained by analyzing photon statistics, i. e. the timing of individual photons emitted by the point sources. The distances of the different probe signal minimum positions in the at least one spatial direction are to be selected such that the shape of the one local measurement signal minimum can be determined from the measurement intensities registered at these different probe signal minimum positions. For two point sources, the shape of the one local measurement signal minimum can typically be determined from the measurement intensities registered at just three different probe signal minimum positions in the at least one spatial direction, wherein one of the probe signal minimum position is arranged on both sides of the arrangement of interest and the third probe signal minimum position is within the arrangement of interest. The distances of these different probe signal minimum positions will be of a typical order of one or some tenth of a FWHM of the probe signal minimum. The FWHM of any minimum is determined as that width of the course of the respective intensity at half the depth of the local minimum as compared to neighboring maxima. Thus, the FWHM will actually be a "full width at half minimum".
[0026] The fact that the measurement signal registered depends on the probe signal intensity at point source positions of the point sources, implies that all point sources whose arrangement is to be determined continuously contribute to the measurement signal unless their point source position is identical to the present probe signal minimum position, i. e. that all point sources are in an ON state with regard to providing the measurement signal in response to the probe signal.
[0027] The measurement intensity may be linearly depending on the probe signal intensity at the respective point source position, and it may be starting from zero or a measurement intensity noise at a probe signal intensity of zero. However, there may also be a non-linear dependency of the measurement intensity on the probe signal intensity. Particularly, there may be such a nonlinearity at higher probe signal intensities. In the area of the probe signal intensity minimum, there will only be very small probe signal intensities, and, at the small probe signal intensities, there will, normally, be a linear dependency of the measurement intensity on the probe signal intensity. If, however, the probe signal excites the point sources for emitting the measurement signal via a two or multiple photon process, there is a non-linear dependency of the measurement intensity on the probe signal intensity even at low probe signal intensities.
[0028] Further, with a same depth of the local probe signal intensity minimum, the background or base line of the measurement signal will be strongly reduced, if the probe signal excites the point sources for emitting the measurement signal via a two or multiple photon process as compared to a single photon process. This allows for a higher precision in determining the arrangement of the point sources in the sample, see below. On the other hand, the excitation probability is much lower, and the excitation light intensity needed to obtain a certain intensity of the measurement signal from the point sources which is needed to reduce statistical errors is much higher, if the probe signal excites the point sources for emitting the measurement signal via a two or multiple photon process as compared to a single photon process. As a result, the danger of photo- chemically bleaching the point sources is much higher when utilizing a two or multiple photon process.
[0029] Thus, in an embodiment of the method of determining the arrangement of the point sources in the sample, a further probe signal is utilized that excites the point sources for emitting the measurement signal via a single photon process, and the arrangement of the point sources in the sample is successively or alternately determined or monitored at a lower precision using the further probe signal and determined at a higher precision using the probe signal which excites the point sources for emitting the measurement signal via a two or multiple photon process. For example, the probe signal may be used for determining a static arrangement of the point sources in the sample at the higher precision, i. e. at a higher spatial resolution, but at a lower temporal resolution, whereas the further probe signal may be used for tracking or monitoring changes of the arrangement of the point sources in the sample at the lower precision, i. e. at a lower spatial resolution, but at a higher temporal resolution.
[0030] More generally, the method of determining the arrangement of the point sources in the sample according to the present invention may be combined with any other known method of determining or imaging the arrangement of the point sources in the sample in another way and / or at another precision, particularly at a lower precision to, for example, at first, localize the arrangement of the point sources to be determined in the sample. The other known methods of determining or imaging the arrangement of the point sources in the sample, for example, include epi fluorescence microscopy, laser scanning microscopy, STED microscopy and other kinds of RESOLFT microscopy compatible with the point sources.
[0031] In the method according to the present invention, at least some previous knowledge of the arrangement of the point sources is utilized. The minimum previous knowledge of the point sources is the actual point source number. The actual point source number may be known due to the nature of the arrangement of the equal point sources of interest. In another embodiment, the point source number may be known from a measurement of a total intensity of the measurement signal. For example, the measured total intensity of the measurement signal may be divided by a known expected contribution to the measurement intensity per point source. The known point source number is not just known to be within the range from 2 to, for example, 32. Instead, the exact point source number is a previous knowledge utilized in the method according to the present invention.
[0032] At least with a point source number above 4, the previous knowledge may further include the basic geometry of the arrangement of the point sources. This known basic geometry may be the arrangement of the point sources at equal distances to be determined along a straight line or along a circle or in a grid. With a point source number of not more than 4, and particularly with a point source number of not more than 3, the geometry of the arrangement of the point sources is inherently limited and may often also be determined from the spatial course of the registered measurement intensities over the different probe signal minimum positions. With a point source number of 2, the geometry of the arrangement of the point sources is inherently known, as two point sources are always arranged at a distance to be determined along a straight line. In testing the method of the invention, it could be shown that even with a point source number of 3 the geometry of the arrangement of the point sources can be determined from the spatial course of the registered measurement intensities over the different probe signal minimum positions at a high precision, see below.
[0033] Alternatively, the previous knowledge may include a plurality of different possible basic geometries of the arrangement of the point sources, and these different possible basic geometries may even include known arrangements of different but fixed numbers of the point sources.
[0034] The fact, that the spatial course of the registered measurement intensities over the different probe signal minimum positions has one local measurement signal minimum only means that the point sources are arranged in a really small spatial area of the sample as compared to the FWHM of the local probe signal intensity minimum. Further, the measurement signals from all point sources contribute to this spatial course of the registered measurement intensities. Thus, a rather high overall measurement signal is available without the need of high contributions by the individual point sources.
[0035] The spatial course of the registered measurement intensities over the different probe signal minimum positions from which the arrangement of the point sources is determined is a shape of the one local measurement signal minimum. Using the previous knowledge, the arrangement of the point sources in the at least one spatial direction can be determined from a depth and / or a width of the one local measurement signal minimum. The parameters depth and width of the one local measurement signal minimum are correlated. They both strongly respond to an increase of the distance of the point sources starting from zero. The depth of the one local measurement signal minimum decreases, and its width increases with increasing distance of the point sources. Because this decrease of the depth and increase of the width are particularly strong with the distance of the point sources increasing from zero, the method according to the invention is particularly well suited to determine very small distances of the point source close to zero, whereas prior art methods need a minimum distance of the point sources.
[0036] In one embodiment of the method according to the invention, the one local measurement signal minimum is compared with the local probe signal intensity minimum or with a comparative local measurement signal minimum that corresponds to a comparative arrangement of the point sources in which all point source positions of all the point sources are identical in the at least one spatial direction, i.e. in which the point sources positions are arranged at zero distances in the at least one spatial direction. Each difference noted in this comparison is indicative of a distance of the actual point source positions. With many probe signals, the local probe signal intensity minimum which may be easily determined by scanning a single gold bead with the probe signal intensity distribution and registering the probe signal reflected by the gold bead. Alternatively or additionally, the one local measurement signal minimum may be compared with at least one comparative local measurement signal minimum that corresponds to a certain basic geometry of the arrangement of the point sources in order to determine whether, or at which probability, the actual basic geometry of the arrangement of the point sources is the respective certain basic geometry.
[0037] The step of determining the arrangement of the point sources may comprise fitting a curve to the registered measurement intensities. More particularly, at least one fit variable that is tuned in fitting the curve to the registered measurement intensities may directly be a parameter that describes the arrangement of the point sources. For example, this parameter may be the distance of the point sources in the at least one spatial direction.
[0038] In one embodiment of the method according to the invention in which the previous knowledge includes a plurality of different possible basic geometries of the arrangement of the point sources, the spatial course of the registered measurement intensities over the different probe signal minimum positions is compared with each of a plurality of different comparative spatial courses in order to determine the arrangement of the point sources. Each of the different comparative spatial courses corresponds to one of the plurality of the different possible basic geometries of the arrangement of the point sources, and it may be generated by computational simulation using a measured or estimated or hypothesized arrangement of the point sources. For example, the measured arrangement of the point sources may include a position of each of the point sources previously measured at a high precision by localization using switchable fluorophores. In another embodiment, the arrangement of the point sources used in the computational simulation may be purely hypothetical. It is to be understood that, in any computational simulation, the spatial intensity distribution of the probe signal in the sample has to be considered.
[0039] In the method according to the invention, all steps of comparing may be implementing automatically by utilizing at least one of artificial intelligence, a neural network, an artificial neural network, or machine learning. These techniques are well known powerful tools for pattern recognition, and they may particularly be used to determine the correct basic geometry of the arrangement of the point sources from a plurality of different possible basic geometries. The technique actually used may be trained with actually measured and / or simulated data.
[0040] In the method of the present invention it may be preferred that the point source number is not more than 32 or 16 or 8 or 4, and with 3 or 2 point sources, their arrangement may be most easily be determined without any further previous knowledge at a high precision from the spatial course of the registered measurement intensities over the different probe signal minimum positions. Alternatively or additionally to a low number of point sources, further previous knowledge of the arrangement of the point sources is to be utilized in determining the arrangement of the point sources from the spatial course of the registered measurement intensities over the different probe signal minimum positions. This previous knowledge includes a certain basic geometry of the arrangement of the point sources. For example, the point sources may be arranged on a ring, and the parameters of the arrangement of the point sources to be determined may be the diameter of this ring or distances of the point sources along the circumference of the ring.
[0041] Further, the previous knowledge of the arrangement of the point sources may include relative scattering cross sections of the individual point sources. Preferably, these relative scattering cross sections of the individual point sources are equal, i. e. all point sources may be identical. Nevertheless, the method according to the present invention may be carried out in parallel with two or more sets of different point sources that can be probed with different probe signals and / or provide distinguishable measurement signals. These different sets of different point sources may, for example, be used to mark different subsets of structures of a macromolecule. Thus, in a two channel embodiment of the method of the present invention, a further arrangement of further point sources is determined in addition to the arrangement of the point sources. The further point sources are selected such as to provide a further measurement signal distinguishable from the measurement signal, and / or to be selectively probed by a further probe signal different from the probe signal. For example, the further measurement signal and the measurement signal may be light of different wavelengths, and / or the further probe signal and the probe signal may be light of different wavelengths such that the further point sources and the point sources can be separately probed by the further probe signal and the probe signal, respectively.
[0042] Further, although, the point sources used in the method according to the present invention will as a rule not be switchable, see below, they may be deactivatable by, for example, photo-chemical bleaching. Then, the sample may include further activatable point sources that are also limited to a known point source number of at least 2, and to such a small spatial area of the sample that the spatial course of the registered measurement intensities over the different probe signal minimum positions has one local measurement signal minimum. The further point sources may, for example, be fluorophores that can be activated by uncaging them. Suitable fluorophores may, for example, be selected from caged quantum dots. Once the arrangement of the point sources has been determined and the point sources have been deactivated, the further point sources may be activated and their arrangement may be determined according to the method of the present invention to obtain further information on the sample. Here, the activation of the totality of the further point sources is no stochastically determined process. Instead, all of the further point sources will be activated before their arrangement is determined.
[0043] As already pointed out before, the arrangement of the point sources may be determined with regard to their point source distances in the at least one spatial direction. If the arrangement of the point sources is further determined with regard to their center of mass in the at least one spatial direction, all point source positions in the sample are known.
[0044] The method according to the present invention does completely without switchable point sources which can be transferred between an on-state providing the measurement signal and an off-state not providing the measurement signal, and which, as a rule, are hydrophobic. Thus, the point sources may also be easily selected for not being blinking, i.e. transferring between an on-state and an off-state in an uncontrolled fashion. Instead, the point sources may easily be selected from point sources having a fixed dependency on the measurement intensity on the probe signal intensity at the respective point source position. Further, the point sources may easily be selected from hydrophilic point sources suitable for biomolecular labeling.
[0045] In general, the probe signal will be of wavy nature, i.e. have a wavelength. Thus, the local probe signal intensity minimum may be formed using destructive interference of the probe signal. Such a formation of the local probe signal intensity minimum allows for a small FWHM of the local probe signal intensity minimum. Further, the spatial area of the sample to which the point sources are limited may preferably be not larger than 1 / 10 of the wavelength in the at least one spatial direction. Optionally, the spatial area of the sample to which the point sources are limited may be not more than 1 / 25 or not more than 1 / 50 or even not more than 1 / 75 of the wavelength in the at least one spatial direction. Thus, the dimensions of the spatial area of the sample to which the point sources are limited may be far below the diffraction barrier of A / (2n sina).
[0046] Most preferably, the local probe signal intensity minimum comprises a zero of the probe signal intensity. In this case, there is a maximum dependency of the shape of the at least one local measurement signal minimum on the distance of the point sources differing from zero in the at least one spatial direction. In fact, in this case, the spatial resolution or precision of the method according to the present invention in the at least one spatial direction only depends on the background or base line of the measurement signal. Particularly, there is rather no statistical noise as there would be no measurement signal with all point sources being positioned in the zero of the probe signal intensity minimum. This is a big difference to all methods utilizing a probe signal maximum for scanning an arrangement of point sources of interest. With a maximum of the probe signal intensity there will be a maximum measurement signal and a maximum absolute statistical measurement signal noise, when all point sources are located in the probe signal maximum.
[0047] As already pointed out before, the method according to the present invention is particularly well suited for determining small distances of the point sources in the at least one spatial direction. Thus, the spatial area of the sample to which the point sources are limited is preferably not larger than 1 / 2 or 1 / 3 or 1 / 5 of a FWHM of the local probe signal intensity minimum. Optionally, the spatial area of the sample to which the point sources are limited is not larger than 1 / 10 or even not larger than 1 / 20 of a FWHM of the local probe signal intensity minimum.
[0048] In many embodiments of the method according to the invention, the probe signal will be an electromagnetic signal. Very often, the electromagnetic signal will be light. The light may have a wavelength in the infrared, the visible or the UV range. In another embodiment, the electromagnetic signal comprises x-rays. In a further embodiment, the probe signal is a sound signal or any other pressure signal of wavy nature.
[0049] The measurement signal may be fluorescence light and the point sources may be fluorophores. In another embodiment, the measurement signal is any light or other electromagnetic signal inelastically scattered by the point sources. For example, the measurement signal may be Raman-scattered light from the point sources. Further, the measurement light may be elastically scattered light, like, for example, light scattered by latex beads used as point sources, or any other electromagnetic signal elastically scattered by the point sources. In even another embodiment, the measurement signal may be sound, optionally ultrasound, scattered by the point sources.
[0050] In all embodiments the point sources act as point sources of the measurement signal, i. e. as sources whose dimensions are very small as compared to a wavelength of the measurement signal. Generally, these dimensions will not be more than 1 / 16 or 1 / 32 or 1 / 64 or 1 / 128 or 1 / 256 or 1 / 512 of the wavelength of the measurement signal.
[0051] In the method according to the present invention, the steps of scanning the point sources with a probe signal, registering the measurement intensity of the measurement signal coming from the point sources, and determining the arrangement of the point sources from a spatial course of the registered measurement intensities over the different probe signal minimum positions will most typically not only be executed once but repeatedly. The repetition of the steps may be made to determine the arrangement of other point sources. In other embodiments, the above steps are repeated in order to track variations of the arrangement of the point sources. The variations may be tracked to investigate the effect of external influences on the sample, like, for example, physical or chemical influences, including drugs. Further, the variations may be tracked together with movements of an entity, to which the point sources are attached, within the sample. This movement may lead the entity into different areas of the sample in which it is subject to different external influences.
[0052] In an embodiment of the method of the present invention, the point sources may be attached to different sites of one object that is selected from a group consisting of macromolecules, proteins, complexes, drug candidates and potential drug targets. Thus, the point source positions will be the actual positions of the sites to which the point sources are attached. Determining the arrangement of the point sources will then provide information on the conformational state of the respective object, and tracking variations of the arrangement of the point sources will provide information on changes of this conformational state, e. g. in response to a certain external influence or an interaction with a certain other object. This embodiment of the method of the present invention may be utilized in drug screening in which various drug candidates are to be tested for their ability to interact with and change the conformational state of a certain drug target.
[0053] The method of the present invention may utilize many measures known from MINFLUX- microscopy to decrease the measurement signal base line or background and / or to enhance the spatial resolution or precision by reducing the dimensions of the local probe signal intensity minimum over which the intensity of the probe signal increases to a maximum value in the at least one spatial direction. For example, the measurement signal may be registered confocally with regards to the local probe signal intensity minimum. Further, an overall intensity of the probe signal may be increased, once the arrangement of the point sources has already been determined at such a precision that new probe signal minimum positions may be selected that ensure that no point source of the arrangement will be subjected to more probe signal intensity than the maximum value despite the increased overall intensity of the probe signal.
[0054] The local probe signal intensity minimum may be delimited in one, two or all three spatial directions by probe signal intensity maxima. All techniques known from STED- and MINFLUX- microscopy of forming a local intensity minimum may be applied. These techniques include, but are not limited to, forming a donut- or bottle-shaped spatial intensity distribution comprising a central zero; shaping wavefronts of the probe signal into a 2K or higher order phase vortex; directing the probe signal onto the sample out of different or even opposite directions, like, for example, in 4Pi-microscopy.
[0055] If the local probe signal intensity minimum is delimited in one spatial direction only, the point sources may be scanned at first in a first spatial direction with the local probe signal intensity minimum, i. e. the one spatial direction in which it is limited, being oriented in this first spatial direction, and, then, once again in a second spatial direction with the local probe signal intensity minimum, i. e. the one spatial direction in which it is limited, being oriented in this second spatial direction which may be orthogonal to the first spatial direction. Additionally, the point sources may be scanned in a third spatial direction with the local probe signal intensity minimum, i. e. the one spatial direction in which it is limited, being oriented in this third spatial direction which may be at 45° to the first and second spatial directions, and also in a fourth spatial direction with the local probe signal intensity minimum, i. e. the one spatial direction in which it is limited, being oriented in this fourth spatial direction which may be orthogonal to the third spatial direction. Each spatial course of the measurement intensities of the measurement signal which is registered during each scan in an additional spatial direction provides additional usable information on the arrangement of the point sources of interest. Further, characteristics of the individual fluorophores, like, for example, their spatial orientations, may be obtained from the spatial courses of the measurement intensities of the measurement signal which are registered during several scans in different spatial directions.As such, scanning of a region of interest of a sample with a probe signal intensity minimum or maximum only being delimited in one spatial direction is well known from prior art methods.
[0056] If the local probe signal intensity minimum is delimited in one spatial direction only, a three- dimensional sample may be scanned in at least three spatial scanning directions, wherein the local probe signal intensity minimum, i. e. the one spatial direction in which it is limited, will be oriented in the respective scanning direction, and wherein the three scanning directions may be orthogonal to each other.
[0057] Further, a probe signal intensity minimum only delimited in one or two spatial directions may be rotated during scanning the arrangement of the point sources, as also generally known from prior art methods, see, for example, WO 2016 / 156541 A1. For example, the probe signal intensity minimum may be rotated about each of the different probe signal minimum positions such as to register the measurement intensity of the measurement signal from the point sources for some or all different spatial orientations of the probe signal intensity minimum.
[0058] Further, the arrangement of the point sources can be scanned with the probe signal in that a ringshaped probe signal intensity minimum is circled around the arrangement of the point sources, and a center of the circular motion is adjusted after at least one full circle. Thus, multiple projections of the distances of the fluorophores to the center of the ring-shaped minimum are recorded as the registered measurement intensities over the different probe signal minimum positions. This can be understood as a radon transformation convolved with the PSF of the spatial intensity distribution of the probe signal, and allows for reconstructing the arrangement of the point sources via a deconvolution and backtransformation (inverse radon transformation) of the spatial course of the registered measurement intensities over the different probe signal minimum positions. The directions in which the point sources are scanned, i. e. in which the different probe signal minimum positions follow to one another, may be defined in any coordinate system including cartesian coordinates, polar coordinates, cylindrical coordinates and spherical coordinates. Further, the point sources may be scanned along any straight or curved lines. Alternatively, the point sources may be scanned by heading for the individual different probe signal minimum positions in any order, i.e. without a particular scanning direction. The number of the different probe signal minimum positions may be rather small in order to register more measurement signal coming from the point sources, like for example more photons of fluorescence light, for each of the different probe signal minimum positions. The minimum number of the different probe signal minimum positions is 3 with a two-dimensional arrangement of the point sources to be determined, and 4 with a two-dimensional arrangement of the point sources to be determined. Typically, the number of the different probe signal minimum positions will be at least 4 with a two- dimensional arrangement of the point sources to be determined, and at least 5 or 6 with a two- dimensional arrangement of the point sources to be determined. Often, the number of the different probe signal minimum positions will be higher than 6. However, with an increasing number of different probe signal minimum positions more measurement signal is needed from the point sources. If the local probe signal intensity minimum is delimited in one spatial direction only, the measurement signal from the point sources may be registered at each probe signal minimum position with a first orientation of the local probe signal intensity minimum, and with at least one further orientation of the local probe signal intensity minimum, which, with regard to the one spatial direction in which the local probe signal intensity minimum is limited, is different to the first orientation and may be orthogonal to the first orientation.
[0059] The measurement intensity of the measurement signal coming from the point sources may be registered with a point detector confocally arranged with regard to the local probe signal intensity minimum.
[0060] In an embodiment, the amount of previous knowledge needed to determine the arrangement of the point sources from the spatial course of the registered measurement intensities over the different probe signal minimum positions is reduced by modifying the detection of the measurement signal in order to obtain more information on the arrangement of the point sources from the measurement signal. In a first step, not just one measurement intensity but a spatial measurement intensity distribution of the measurement signal coming from the point sources is registered for each of the different probe signal minimum positions. In other words, the measurement signal coming from the point sources is registered with a spatially resolving detector array, like, for example, a digital camera. The spatially resolving detector array may be confocally arranged with regard to the local probe signal intensity minimum or fixed with regard to the arrangement of the point sources.
[0061] In a second step, a spatial pattern is imprinted on the measurement signal coming from the point sources, and the resulting spatial measurement intensity distribution is registered with the spatially resolving detector array for each of the different probe signal minimum positions. The spatial pattern is imprinted in a same way on all components of the measurement signal coming from the individual point sources, and the resulting spatial measurement intensity distribution registered is a superposition of the patterned components of the measurement signal from all the point sources. The intensities of these components and, thus, their superpositions, i. e. the resulting spatial measurement intensity distribution registered, depend on the present distances of the individual point sources to the local probe signal intensity minimum. As these distances change during scanning the point sources with the local probe signal intensity minimum, the spatial measurement intensity distributions registered change as well. Thus, with a suitable spatial pattern imprinted on the measurement signal coming from the point sources, additional information on the arrangement of the point sources can be derived from the spatial measurement intensity distributions registered and their changes.
[0062] For example, if the point sources are fluorophores, if the probe signal is fluorescence excitation light, if the measurement signal is fluorescence light, and if a scanning fluorescence light microscope is used, the detection path of the microscope may be modified. Instead of a simple confocal point or bucket detector, like, for example, an APD, for collecting photons of the fluorescence light, a phase mask is placed in the back aperture or any other Fourier plane of the microscope, and a camera is placed in the image plane of the microscope. The phase mask placed in the Fourier plane allows for imprinting the same pattern on the fluorescence light emitted by all fluorophores, which results in a superposition of spatially shifted copies of the pattern on the camera. In conjunction with the spatial intensity distribution of the excitation light having the local probe signal intensity minimum, this allows for determining the positions and brightnesses of more than two fluorophores, e.g. three, four or five fluorophores. This has been demonstrated by simulations under realistic conditions and photon budgets. The basic idea is that the local probe signal intensity minimum modulates the differences of the emission intensities between the fluorophores, and that the phase mask in the Fourier plane of the microscope allows for imprinting additional information on the positions of the fluorophores which can be extracted by evaluating the continuous spatial mixture of their images with a distribution determined by the phase mask in the detection path. The camera image changes with scanning the fluorophores with the local probe signal intensity minimum, and the fluorescence light intensity differences between fluorophores are modulated. This can be understood as a series of superpositions of spatially shifted images of the phase mask in the detection path. This series of superpositions uniquely encodes the arrangement of the fluorophores.
[0063] The phase mask may imprint a pattern with a strongly spatially limited local intensity minimum, like, for example, a line-shaped intensity minimum, on the camera. With a single fluorophore, the position of the local intensity minimum on the camera indicates the position of the fluorophore emitting the patterned fluorescence light. In the spatial fluorescence light intensity distribution registered by the camera, the superposition of the spatially shifted copies of the pattern results in a deformed local intensity minimum of a reduced depth. However, it is the deformation of the local intensity minimum of the spatial fluorescence light intensity distributions registered with the camera and its spatial course over the spatially different probe signal minimum positions which include the additional information on the arrangement of the fluorophores.
[0064] If a pattern with a line-shaped intensity minimum is imprinted, the point sources may be scanned with one fixed orientation of the line-shaped intensity minimum or, one after the other, with more than one orientations of the line-shaped intensity minimum of the pattern. Each orientation of the line-shaped intensity minimum of the pattern may be parallel to or at any angle to a line-shaped local intensity minimum of the probe signal. For example, a half-moon phase mask with a phase step of 7t may be placed in the back aperture of the microscope to imprint a pattern with a lineshaped intensity minimum on the camera.
[0065] Advantageous developments of the invention result from the claims, the description and the drawings.
[0066] The advantages of features and of combinations of a plurality of features mentioned at the beginning of the description only serve as examples and may be used alternatively or cumulatively without the necessity of embodiments according to the invention having to obtain these advantages.
[0067] The following applies with respect to the disclosure - not the scope of protection - of the original application and the patent: Further features may be taken from the drawings, in particular from the illustrated designs and the dimensions of a plurality of components with respect to one another as well as from their relative arrangement and their operative connection. The combination of features of different embodiments of the invention or of features of different claims independent of the chosen references of the claims is also possible, and it is motivated herewith. This also relates to features which are illustrated in separate drawings, or which are mentioned when describing them. These features may also be combined with features of different claims. Furthermore, it is possible that further embodiments of the invention do not have the features mentioned in the claims which, however, does not apply to the independent claims of the granted patent.
[0068] The number of the features mentioned in the claims and in the description is to be understood to cover this exact number and a greater number than the mentioned number without having to explicitly use the adverb "at least". For example, if a local probe signal intensity minimum is mentioned, this is to be understood such that there is exactly one local probe signal intensity minimum or there are two local probe signal intensity minimums or more local probe signal intensity minimums. (However, the feature of the one local measurement signal minimum only refers to the different probe signal minimum positions of one local probe signal intensity minimum.) Additional features may be added to these features listed in the claims, or these features may be the only features of the respective product.
[0069] The reference signs contained in the claims are not limiting the extent of the matter protected by the claims. Their sole function is to make the claims easier to understand.
[0070] BRIEF DESCRIPTION OF THE DRAWINGS
[0071] In the following, the invention is further explained and described with respect to preferred exemplary embodiments illustrated in the drawings.
[0072] Figs. 1a to 1d illustrate utilizing a diffraction maximum vs. a minimum of light to resolve two inelastic point scatterers.
[0073] Figs. 2a to 2c illustrate a theoretical localization precision of two point scatterers probed with a diffraction maximum (max) or a diffraction minimum (min) for N=100 detected photons. Figs. 3a to 3i illustrate a measurement of distances between two simultaneously emitting fluorescence molecules by (x,y-) scanning with an illumination intensity minimum.
[0074] Figs. 4a to 4f illustrate resolving two constantly emitting fluorophores at distances down to 8 nm.
[0075] Figs. 5a to 5h illustrate an uninterrupted resolution and localization of two moving fluorophores.
[0076] Figs. 6a to 6h illustrate a sub-diffraction localization of multiple simultaneously scattering point sources.
[0077] Figs. 7a to 7c illustrate a distance measurement via line-scans and control measurement via bleaching steps.
[0078] Fig. 8a to 8c indicate the correlation of measurement uncertainty and production variability.
[0079] Fig. 9 is a flow chart of a method of determining an arrangement of equal point sources in a sample according to the present invention.
[0080] Fig. 10a and 10b compare an arrangement of three equal point sources in a two-dimensional sample determined in a computational simulation of the method of the present invention to the actual arrangement of the three equal point sources from which the computational simulation started.
[0081] Fig. 11a and 11 b compare another arrangement of three equal point sources in a two- dimensional sample determined in a computational simulation of the method of the present invention to the actual other arrangement of the three equal point sources from which the computational simulation started; and
[0082] Fig. 12a and 12b compare yet another arrangement of three equal point sources in a two- dimensional sample determined in a computational simulation of the method of the present invention to the actual other arrangement of the three equal point sources from which the computational simulation started. DESCRIPTION OF EMBODIMENT EXAMPLES
[0083] Discerning two or more identical and constantly scattering point sources using freely propagating waves is thought to be limited by diffraction. This disclosure shows, both theoretically and experimentally, that by employing a diffraction minimum rather than a maximum for resolution, a given number of point sources can be discerned at tiny fractions of the employed wavelength. Specifically, an 8 nm distance between two constantly emitting (non-blinking, non-switchable) fluorescent molecules, corresponding to 1 / 80 of the wavelength, was identified. Moreover, the present disclosure shows that, contrary to naive expectations, the measurement precision improves with decreasing distance between the point sources and may even improve with increased point source density, thus opening up the prospect of resolving clusters of (optical) point sources at tiny fractions of the wavelength.
[0084] A prominent question in physics is how small the distance d between two simultaneously scattering point sources can be in order to still be separable by focused (light) waves of a wavelength A. Separating two inelastic optical scatterers or two other similar point sources, and measuring their distance is important in many fields, particularly in fluorescence microscopy, which is the most widely applied imaging modality in the life sciences. Fluorescent molecules, also known as fluorophores, are treated as inelastic optical scatterers here, because by dissipating a part of the absorbed photon energy and emitting a photon of longer wavelength, these molecules annihilate any phase information of the incoming light field. In any case, the textbook answer to the question of the minimally resolvable distance is the Rayleigh criterion, see Refs. 1 and 2. It states that the distance between the diffraction maxima of the scatterers in an image should not be smaller than d = 0.61 A / (n sina), with n and sina denoting the refractive index of the immersion medium and the sine of the half-aperture angle of the lens, respectively. While introduced for widefield microscopy, Rayleigh’s limit also applies to popular scanning optical microscopy, where the object is scanned with a focused beam of wavelength A and the image given by the number of photons registered per scanning position, see Ref. 3.
[0085] Unlike many other microscopy methods, fluorescence microscopy does not map out the molecules of interest per se, such as the proteins in a cell, but the fluorophores that have been linked to those molecules as labels. Although disadvantageous at first glance, this aspect is critical in superresolution fluorescence microscopy or nanoscopy because to obtain subdiffraction resolution, these methods manipulate fluorophore states. Specifically, fluorophores that reside closer than the diffraction barrier are discerned by transiently transferring a fraction of them into a molecular state that emits photons (ON), whereas the remaining fraction is kept in a state that does not (OFF). Placing fluorophores in different states for a brief period of detection instantly provides separability, rendering separation by focusing to a tiny spot obsolete, see Refs. 4 and 5. This ON / OFF state transition is a key physical element of all diffraction-unlimited fluorescence microscopy methods known to date, including those called STED, PALM / STORM, and the more recently introduced approaches called MINFLUX, see Ref. 6, and DNA-PAINT, see Ref. 7. If this element were to be removed, none of them could provide nanoscale resolution.
[0086] Unfortunately, the separation by ON / OFF molecular states comes with fundamental limitations that preclude extending superresolution beyond fluorescence, e.g. to other types of (inelastic) optical scattering such as Raman, let alone to other areas of physics resolving with diffracted waves. Even within the realm of fluorescence microscopy, the ON / OFF principle inevitably demands that neighboring fluorophores must be recorded sequentially. This drawback is intolerable if adjacent fluorophores need to be observed and resolved at the same time, a situation that is commonly encountered in biophysical experiments involving molecular tracking. Hence, motivated by both fundamental and practical reasons, as well as the recent success of MINFLUX, see Ref. 6, the ability of optical microscopy to resolve individual scatterers that remain identical, i.e. ON, throughout the observation process has been reinvestigated.
[0087] The present disclosure shows that scanning with a focused light field having a (central) diffraction minimum - rather than a maximum - allows for measuring the distances between a known number of optically identical fluorophores down to single-digit nanometers. By measuring the positions of two fluorophores situated only 8 nm (A / 80) apart, it can be shown that Rayleigh’s criterion grossly overestimates the minimal distance at which two inelastic scatterers can be resolved in practice. The underlying physical reason is that probing the scatterers with a diffraction intensity minimum modulates the scattered signal without modulating their state, whilst precluding the modulation from being drowned by noise. As a result, the continuous tracking of (at least) two fluorophores at nanometer distances becomes viable.
[0088] This disclosure also shows that for a given signal to noise ratio (SNR) and background, the precision in separability in fact increases with decreasing distance between the scatterers. Defying naive expectations, this arguably surprising characteristic also allows for extending the method to a larger number of scatterers, which holds great potential for the optical investigation of dynamic (re)arrangements and conformational changes of individual proteins and other molecules with conventional optics at the nanoscale. Diffraction maxima representing two fluorophores located at distance d<2 / 2 overlap considerably in the image of an optical microscope. This holds both for those formed by diffracted fluorescence photons on a camera, as well as for the maxima gained by scanning a focused excitation beam across the focal plane and registering the fluorescence photons with a confocal point detector. In both cases, the identification of each individual fluorophore is heavily contingent upon the noise in the image, which is usually Poissonian, see Figs. 1a and 1 b. If the signal-to-noise ratio (SNR) was infinite and the point-spread-function (PSF) of the imaging system perfectly known, the fluorophores could always be resolved by deconvolution with the PSF. In practice, however, the knowledge of the PSF is compromised by aberrations and the SNR is by far too low for resolving the fluorophores reliably, see Refs. 8 and 9.
[0089] In general, changing d between two inelastic point scatterers modulates the spatial distribution and amplitude of their joint image signal / (d). For overlapping diffraction maxima, see Fig. 1c, the noise adds up and the modulation is noticeable only for about d > 2 / 2. Fortunately, the modulation is easier to detect by contrasting the joint image signal with a zero-signal baseline. Harnessing this idea, the scanning of an excitation beam with a focal light field having a central intensity minimum (Fig. 1b) is investigated. Since the resulting fluorescence signal is proportional to the illumination intensity, the signal of each individual fluorophore is minimal (zero) at the central node. Moreover, as the signal of inelastic scatterers adds up (incoherently), scanning over two scatterers with d < 2 / 2 also yields a joint signal / (d) with a single minimum (Fig. 1d). In the absence of background this minimum is truly zero only for d = 0. Hence any deviation of the fluorescence minimum from zero is indicative of a finite d.
[0090] First consider a sinusoidal excitation (fringe) pattern that is scanned over two fluorophores at distance d over a full period along the x-axis, see Fig. 1 d, for simplicity. The resulting joint signal is given by / (d, = a0+ a d) cos(^ - ^0), with a0denoting a constant offset and a being an amplitude varying with d. The parameter <f>Qgives the phase difference of the joint signal with respect to the phase <f> = n x / of the sinusoidal illumination pattern. a0and depend on a number of parameters, including the brightness of the fluorophores, their separation, background, and the (usually finite) initial fringe contrast of the illumination. Furthermore, the modulation visibility is denoted with v(d) = ^(d) / ^.
[0091] A finite d causes the sinusoidal fluorescence signals of the individual fluorophores to be spatially shifted with respect to each other, changing the visibility v(d) of the joint modulation. Interestingly, contrary to the case of separation by maxima, reducing d increases v(d), implying that measuring d with minima actually excels at small d. In the limiting case of d = 0 and zero background, the joint signal equals zero, meaning that even tiny d can be measured due to the intrinsically low noise at the minimum. By contrast, for overlapping maxima at d = 2 / 4, v(d) approaches zero and the separation is maximally challenged by noise. In any case, sampling I d, <f>) at three positions suffices to determine a0, and < / >0and to resolve at d.
[0092] A lower bound on the precision with which the position of the two emitters can be estimated is provided by the Cramer-Rao Bound (CRB), see Ref. 10. The CRB is directly related to the Fisher Information (Fl), which provides a measure on how much information can be inferred about the parameters of a model for I d, ^), including the position of the fluorophores, given a statistical sample of their signal and a / (d, model. The inelastically scattered signal may be regarded as an inhomogeneous Poisson process with an underlying mean specified by the convolution of the illumination pattern with the PSF of the imaging system.
[0093] For a Poisson process, the Fl is proportional to the ratio of the model gradient (squared) VI(d, and the absolute model value I d, ^). This relationship maximizes the Fl for scattered photons from the minimum and renders them more informative than those near the maximum. For two sources with separation d, the CRB as the precision a of the distance estimate scales approximately as o <x ^=, and o <x -±= for the minimum and the maximum, respectively. Consequently, a constant relative error of the estimate of d for the minimum, but a diverging relative error for the maximum at small distances (Fig. 2a) are obtained. This holds true only in the limit of an infinitesimally small scanning interval L -> 0 and perfect contrast v0= 1 of the illumination pattern. A larger (finite) scanning range L > 0 and an imperfect initial contrast v0< 1 degrade the quality of the estimate, see Figs. 2a to 2 c. Yet, the estimate of d provided by a minimum is at least two orders of magnitude more precise compared to that afforded by a maximum (Fig. 2a). It should be noted that this finding is irrespective of the shape of I(d, since the decisive element is the minimum of the illumination beam, which, in first approximation, has a parabolic spatial intensity profile.
[0094] The CRB does not guarantee the existence of an estimator that attains this precision bound. However, among a range of options, it has been found that a polynomial maximum likelihood estimator of the parameters and < / >0is sufficient to retrieve a d estimate from the photons near the minimum with a constant relative error. This advantage also remains amid non-negligible background and non-vanishing intensities at the illumination diffraction minima, see Fig. 2b.
[0095] To experimentally find the minimal distance at which two inelastic scatterers can be distinguished, two fluorophores (Atto647N molecules) were placed at controlled distances 6 nm < d < 90 nm, that is, at distances that are definitely considered not resolvable due to Rayleigh’s limit. This spatial arrangement was realized by attaching the fluorophores to a DNA origami structure, a so- called nanoruler, see Ref. 11. The DNA structure served as a scaffold for attaching the fluorophores at a given d. Next, a line-shaped interference pattern in the focal plane of a scanning confocal microscope was obtained by illuminating opposing halves of the entrance pupil of its 1.4 numerical aperture oil immersion lens with two interfering excitation beams (Fig. 3a). Initially used for MINFLUX, see Ref. 12, this setup was detailed previously. In brief, the line-shaped focal interference pattern was oriented either in the x- or the y-direction and could be quickly interchanged by changing the x-and y-orientation of the two beams using an electro-optic device (Fig. 3b). Destructive interference at the focal point provided a central line-shaped diffraction minimum, whereas constructive interference a maximum. Changing the phase difference linearly between the beams allowed for scanning the pattern over the fluorophores (along the x- or the y- axis, Fig. 3c) so that the separation results provided by the minimum could be readily compared with that by the maximum.
[0096] These line-scans were consecutively repeated for both the x- and the y-axis until both molecules bleached; the stack of all x- or y- line-scans constituted an x- or y- trace, respectively (Fig. 3d). Thus, each trace allowed for considering all photons or just those originating near the diffraction minimum. For both cases a projection of the distance between the fluorophores to each axis was determined and d was calculated. The sudden bleaching of individual fluorophores during the measurement has also been recorded (Fig. 3e). The ensuing sudden shift of the center of mass of the signal allowed for extracting d as well (Figs. 3f to 3i). Pioneered in camera-based single molecule localization, see Ref. 13, this ON / OFF-based separation provided an independent control of the d measurement.
[0097] The experiments show that separating by scanning the entire interference pattern over the sample becomes inaccurate for d < 30 nm, whereas selecting photons from a region just near the minimum of a stacked line scan (trace) resolves the fluorophores down to d of 10 nm. Moreover, the results nicely agree with those obtained by the bleaching control (Fig. 7). In accordance with theory, this finding demonstrates that the photons registered from the minimum excel at resolving fluorophores at small d. Perhaps more strikingly, using additional photons not only consumes time and the limited fluorescence budget, but also compromises resolution.
[0098] Consequently, the two fluorophores were next probed just with an excitation minimum. Like in previous MINFLUX recordings, three positions were sampled at %_ = xC0M~ ^,x0= xC0M, x+=XCOM + 1 in each axis whereby the size of L was iteratively reduced. The center of mass (xC0M) of the two fluorophores was subsequently estimated using the fluorescence minimum. To estimate d, a number of such triples of positions and counts is combined into a bin of a certain number of photons. This procedure allows for reaching single-digit nanometer accuracy for the d estimate with about 5000 photons (Fig. 4). Besides, it paves the way to resolving in dynamic settings, where distance and location of two fluorophores have to be determined continually, i.e. , without interruption by an ON / OFF state transition.
[0099] To demonstrate tracking of two moving emitting fluorophores, the sample stage was translated on a defined trajectory. As they were attached to a nanoruler, each of the fluorophores produced a slightly shifted copy of the trajectory of their counterpart. The time-resolved distance between the fluorophores can be extracted by tracking their center of mass and evaluating the signal for given points in time. Distance estimates for fluorophores at d = 30 nm (moving along a circle with 30 nm of diameter) and at d = 15 nm (moving on a higher-order Lissajous trajectory with 15 nm amplitude) are readily obtained (Fig. 5). These results, which are clearly not possible with popular camera-based tracking, demonstrate time-resolved distance measurement of spectrally identical and constantly emitting fluorophores far below the diffraction barrier. In other words, for establishing the nanometer scale distance as a function of time, ON / OFF switching or separation by excitation / emission wavelengths are not needed. This finding greatly relaxes the requirements on the fluorophores, since stable non-switching and non-blinking fluorophores can be used. Stable fluorophores generally bring about higher photon emission rates and much larger photon emission budgets. Moreover, individual fluorophores vary much less in emission which improves the precision of the distance estimates. Also, from a practical standpoint, ON / OFF-switchable and activatable fluorophores are usually hydrophobic which greatly limits their usefulness in biomolecular labeling. By abandoning the ON / OFF requirement, the wide range of stable, hydrophilic dyes is automatically opened for nanoscale resolution.
[0100] As a next important step, it has been investigated whether scanning with a diffraction minimum can also identify the position of three or more identical scatterers located in a given geometric constellation and distance within regions « 2 / 2. Hence, measurements on DNA scaffolds with three and four labeled sites have been performed. The fluorophores were arranged either in a line, a triangle or a square. The expected scaling parameters were recovered such as the length of the edges and distances of the nearest fluorophores (Figs. 6a to 6f), ranging around 20 nm.
[0101] In order not to be limited by the samples at hand and to explore the generality of our concept, we also simulated other constellations of equally bright fluorophores (Fig. 6, g and h). The arrangements are parametrized by a single scaling parameter d. For a linear arrangement of scatterers, d corresponds to a nearest-neighbor distance or it is the diameter of the circle circumscribing m scatterers forming a regular polygon. It was found that the advantageous scaling of the relative error a / d = RMSE(d) / d remains valid for more than two scatterers. Conceptually, a smaller distance parameter d allows for discerning a larger number of scatterers. In practice, the attainable precision is lower-bounded by experimental imperfections such as finite background, variation of individual source brightness, and reduced initial contrast of the illumination pattern, i.e., finite ‘depth’ of the intensity minimum. Yet, the numerical data shows that for d « 2 / 2 and commonly encountered SNR, the position of individual inelastic scatterers can be identified for various geometrical arrangements. For scatterers arranged along a line at a given recurring distance d, the relative error increases with d as the ensemble substantially extends into areas of larger intensity outside the probing minimum. Interestingly, not only linear but also polygonal or grid-like arrangements of a known number of identical scatterers allow for the identification of their mutual distance with a given number of detected photons.
[0102] In a nutshell, employing diffraction minima instead of maxima allows for, in principle, diffraction- unlimited separation of two spectrally identical incoherent point scatterers - even at finite photon numbers. This finding holds also for an arrangement of a known number of scatterers that are confined to sub- diffraction regions at distances d « 2 / 2, provided the geometrical form of the arrangement is by and large known. As the structure of many proteins is known by now either from X-ray crystallography, nuclear magnetic resonance, cryo-electron microscopy or computational predictions, and since labeling with the best stable fluorophores is now possible at multiple protein sites, the present disclosure presents radically new opportunities for probing dynamic (re)arrangements of proteins with visible light and conventional lenses. In fact, the present disclosure has the potential to quantify the inner mechanics of single proteins directly and with minimal invasion for the first time. The physical reason for this arguably surprising outcome is that scanning an illumination minimum across point scatterers at a distance «M2 automatically modulates the signal of each scatterer, so that separation is possible without modulating the signal by a state transition. This modulation is easily detectable because it is expressed in a minimum of the scattered signal, where Poissonian noise levels are inherently low. As the modulation vanishes for larger sub-diffraction distances, d>A / 4, our method excels just at small sub-diffraction scales, which for visible light happens to be at the size of individual biological macromolecules (1-50 nm) where other optical and non-optical methods have failed so far. For resolving fluorophores at larger sub-diffraction distances and for imaging large fields of views, ON / OFF based methods currently remain the methods of choice.
[0103] Since the method of the present disclosure exclusively relies on the interaction of the patterned illumination light with the scatterer, for investigating groups of fluorophore only their absorption matters. The ensuing (pattern of) emission is irrelevant. In other words, as long as the detected signal is proportional to the illumination intensity, it does not matter which of the fluorophores was the actual source of the detected signal. Therefore, energy transfer between fluorophores (FRET), frequently occurring at distances <10 nm, does not affect our results. This is another major reason why the method of the present disclosure is powerful at the nanometer scale. By contrast, in popular camera-based superresolution methods relying on the evaluation of fluorescence emission patterns, any energy transfer leads to position misrepresentations. Besides, the large noise of overlapping diffraction maxima of fluorescence light necessitates ON / OFF transitions for separation, rendering time-continuous separation impossible.
[0104] Another aspect is that the spatial intensity profile near the minimum is parabolic. Hence, the effect of aberrations on the parabolic function is more easily identified in the method of the present disclosure. In comparison, popular deconvolution approaches employing diffraction maxima require detailed knowledge of the aberrated PSF of the system and need to identify these details amid the shot noise of the maximum. Since there is no fundamental difference between fluorescence and other types of inelastic optical scattering, e.g. Raman scattering, given similar signal and background conditions, the method of the present disclosure is transferrable to these important fields of optics.
[0105] Moreover, the present disclosure highlights that, owing to the wide acceptance of the Rayleigh criterion, the ability of resolving individual scatterers with freely propagating light waves has been profoundly underestimated. This may partially be due to the fact that when employing diffraction maxima, resolution becomes increasingly harder with decreasing d, rendering the vision of extracting dimensions d « A / 2 with propagating (light) waves unrealistic. In stark contrast, the present disclosure shows that measuring with a diffraction minimum instantly opens up a measurement window in the d « A / 2 range resolving distances at 1 / 80 of the wavelength.
[0106] Besides the lower noise level at the minimum, a major component to the success of the method of the present disclosure is the robustness of the minimum with respect to aberrations. The spatial intensity profile of the minimum is approximately parabolic and is sampled only in the vicinity of the minimum, which makes it less prone to distortions. In comparison, popular deconvolution approaches employing diffraction maxima require detailed knowledge of the (aberrated) PSF of the system and need to identify these details amid the shot-noise at the maximum. Since there is no fundamental difference between fluorescence and other types of inelastic optical scattering, e.g. Raman scattering, given similar signal and background conditions, the present results should also be transferrable to these important fields of optics.
[0107] Last but not least, the principle of separating with minima is also applicable to elastic scatterers at small distances, where distance-dependent phase differences between the light scattered by different sources will be negligible. Equally intriguing is the fact that by avoiding state transitions of the investigated material for separation, the approach of identifying the position of point scatterers with a diffraction minimum will be applicable to any type of point scatterers of any type of propagating wave, thus opening up superresolution to many other wave-based imaging modalities.
[0108] Now referring in greater detail to the drawings, Fig. 1 illustrates utilizing a diffraction maximum vs. a minimum of light to resolve two inelastic point scatterers. Fig. 1a: When probed with a diffraction maximum of focused illumination light of certain Full-Width-Half-Maximum (FWHM), two closely spaced scatterers (illustrated as stars) cannot be resolved for separations below the diffraction limit of d « 1 FWHM « 280 nm. For separations below this limit, changing the positions of the scatterers only marginally alters the combined emission (note the similarity of the difference images for two separation values d = 0.03 FWHM and d2= 0.3 FWHM shown in the panel row below). For each image, N = 106detected photons are considered in the calculation. Fig. 1 b: When probed with a minimum, the same disparity in d notably alters the joint signal; note the signal increase 6 in the pertinent difference images. Fig. 1c: 1 D Intensity profile of scattered light when illuminating the scatterers with a diffraction maximum. Changing d yields an intensity modulation of the joint signal that remains within the (Poisson) noise band of the mean signal for both d, i.e. , the two sources cannot be resolved amid noise. Fig. 1d: When illuminating the same scatterers with a diffraction minimum, the modulation at the minimum of the resulting signal is outside the noise bands, allowing separation. Decreasing d results in a deeper minimum of the joint signal. The insets in panels c and d show the profile of the individual average intensity profiles scattered by each point scatterer as well as their joint signal.
[0109] Fig. 1 illustrates a theoretical localization precision of two point scatterers probed with a diffraction maximum (max) or a diffraction minimum (min) for N=100 detected photons. Fig. 2a: Cramer Rao-bound (CRB) divided by separation d, i.e., relative CRB (<TCRB / d), for different initial visibilities v0. When probing with a minimum the relative CRB for the resolution remains constant, while it diverges for the maximum. Imperfect contrast of the minimum of the illumination light (v0=0.95) deteriorates the precision, yet the relative CRB is improved by roughly two orders of magnitude over its counterpart employing a maximum. Fig. 2b: Impact of the visibility v0on the resolvable distance d. Measuring small distances requires a high contrast of the illumination pattern, i.e. a minimum with sufficient ‘depth’. Here, a successful distance measurement (‘resolved’) is required to exhibit a relative CRB < 0.5. The inset table provides exemplary values of required minimum visibility to measure d ( = 640 nm). Fig. 2c: Relative CRB with respect to scanning range L near the minimum of the combined signal, exemplified for various d. The precision improves with decreasing L, which implies that probing as close to the minimum of the joint signal improves the distance estimate.
[0110] Fig. 2 illustrates a measurement of distances between two simultaneously emitting fluorescence molecules by (x,y-) scanning with an illumination intensity minimum. Fig. 3a: Scanning fluorescence microscope with photon-counting detection (APD) of fluorescence passing the dichroic mirror (DM) and a confocal pinhole (PH). The interference of two beams with adjustable phase difference <p entering the pupil of the objective lens creates an illumination intensity pattern in the focal plane featuring x- or y-oriented line-shaped diffraction minima and maxima (MINFLUX setup). Two fluorophores sketched as stars Fig. 3b: Changing <p scans the line-shaped minima in the y-and x-direction. c: Top: Line-scan principle: linear ramp of <p over 2n shifts the minimum across the scatterers, producing a sinusoidal line profile of fluorescence (or scattered signal). Bottom: The continuous line-scan is adequately replaced by probing three points near the scatterers with the minimum (MINFLUX recording). Fig. 3d: Normalized counts measured during repeated line-scans. The absolute number of counts decreases over time in a stepwise manner as individual fluorophores bleach. Repeated ramping of <p over 2n in x- and y direction across the scatterers yields a line-scan stack. Fig. 3e: Averaged counts per line, normalized over the whole stack. Two bleaching steps are clearly visible, marking transitions from two molecules, to one, to zero (background). Fig. 3f: Exemplary lines from two and a single molecule show the sinusoidal profile of the fluorescence counts and the spatial center of mass shift after the first bleaching step. Each line allows for extracting information based on the photons just near the minimum, the maximum, or from the entire line. Fig. 3g: Heat map of localizations of the fluorescence center of mass for two fluorophores at 20 nm distance. Inset: Two clusters of localizations are visible showing the center of mass shift after one fluorophore bleached. Fig. 3h: Averaged counts per 3-points MINFLUX measurement for x and y axis normalized over the whole measurement. The bleaching steps and fluctuations in fluorophore brightness are clearly visible. Fig. 3i: Normalized counts for each segment. A second order polynomial fit shows a change of the shape of the parabola after the bleaching step as well as a shift of the position of the minimum. Measurement of d relies only on photons from the first (two molecule) segment; the bleaching steps are considered just for an independent control.
[0111] Fig. 4 illustrates resolving two constantly emitting fluorophores at distances down to 8 nm. Fig. 4a: Measured distances d with respect to the expected distance (line as specified by the manufacturer of the DNA nanoruler scaffold). Recording the photons originating near the illumination minimum suffices to separate simultaneously emitting fluorophores down to d=8.4 nm within the uncertainty specified by the manufacturer (shaded area). Circles indicate the medians of distances, error bars indicate twice the median absolute deviation (MAD) from the median. Fig. 4b: Exemplary localizations of two fluorophores attached to individual nanorulers with expected distances 8.4 nm, 10.4 nm and 14.8 nm. The mean distance d as well as the average single molecule localization precision (standard deviation of localizations) oxyis indicated. Fig. 4c: Corresponding histograms of the distance estimates. The standard deviation is indicated for each nanoruler. Fig. 4d: Boxplot of obtained standard errors of the mean (SEM) for all nanorulers. The box extends from the lower to upper quartile values of the data. Error bars mark the interval from the median (line within box) to the last point within a 1.5 interquartile range (IQR). Outliers are shown as dots. Number of independent measurements per box for 8.4 nm: 307; 10.2 nm: 322; 14.3 nm: 218; 20.1 nm: 272; 25 nm: 231 ; 31.8 nm: 283. The median SEM is below 0.5 nm for all investigated systems, and the 1.5 IQR is always <1 nm. Fig. 4e: Boxplot of the measured distances d over the expected distance 7 as specified by the manufacturer of the DNA nanoruler scaffold. Recording the photons originating near the illumination minimum (see inset) suffice to separate simultaneously emitting fluorophores down to d = 8.4 nm within the uncertainty 8 specified by the manufacturer. The box 9 extends from the lower to upper quartile values of the data. Error bars mark the interval from the median 10 within box to the last point within a 1.5 interquartile range (IQR). Outliers are shown as dots. Independent measurements per box: 8.4 nm: 307; 10.2 nm: 322; 14.3 nm: 218; 20.1 nm: 272; 25 nm: 231 ; 31.8 nm: 283. Fig. 4f: Histogram of the distances obtained for the 8.4 nm fluorophore separation overlaid with the scaled probability density function 11. The corresponding box plot from Fig. 4e is shown above. Comparing the total spread of the obtained deviations and the vastly different means of individual nanorulers within a batch indicates that the total spread may be partitioned into low measurement uncertainty and high production variability of the nanorulers (Figs. 7 and 8).
[0112] Fig. 5 illustrates an uninterrupted resolution and localization of two moving fluorophores. Fig. 5a: Schematic of the measurement: A nanoruler with two fluorophores is moved on a pre-defined trajectory (circle) using the microscope stage. The center of mass of the two fluorophores is tracked with an illumination intensity minimum 12. Distances d2are estimated in a bootstrapping approach along the obtained traces. Fig. 5b: The subsequent positions of the fluorophores are calculated relative to the current center of mass coordinate. This results in the trajectories of the individual fluorophores 13. Fig. 5c: Exemplary trace of a d2= 32 nm nanoruler moving along a circle with d = 30 nm diameter. Time-averaged image of the two fluorophores results in two displaced circles. Fig. 5d: Nanoruler with d2= 15 nm moving along a Lissajous-figure with amplitudes 15 nm and 20 nm in x and y direction, respectively. Fig. 5e: The trajectories of the individual fluorophores result in shifted copies of the center of mass movement. Fig. 5f: Exemplary trace of a d2= 15 nm nanoruler moving along the Lissajous figure. Time-averaged image of the two fluorophores results in two displaced copies of the Lissajous figure. Fig. 5g: Time series of measured distances (thick line) for 50 ms time-bins. Error bands correspond to a moving standard deviation (200 ms window). For each bin, the respective tuples according to their time-stamp are selected and the distance and orientation of the fluorophores are estimated. Fig. 5h: Histogram of measured distances (no averaging) yields clearly distinguishable populations for nanorulers of d = 32 nm (red) and d = 15 nm (blue). The histograms are overlaid with the scaled probability density function.
[0113] Fig. 6 illustrates a sub-diffraction localization of multiple simultaneously scattering point sources. Fig. 6a: Experimental localization of four emitters arranged in a square with 22 nm edge length. Fig. 6b: Three emitters arranged along a line with next neighbor distance 18 nm. Fig. 6c: Three emitters arranged in a triangular shape with 18 nm edge length. Individual fluorophores are clearly distinguishable. Fig. 6d to 6f: Histograms of all pairwise distances between localizations of individual fluorophores. Histograms are overlaid with a Gaussian mixture model fitted to the data. Histograms exhibit either a single mode, as in the case of the triangle, or two modes, as for the square and the line. For the square, the expected modes are d and d^2, while the expected modes for the line are d and 2d. Obtained mean distances of the components of the Gaussian mixture model are indicated in the respective panels. Fig. 6g: Numerical simulation. Spatial arrangement of up to m=5 point scatterers (fluorophores): lines and regular polygon. The scaling parameter d denotes the nearest-neighbor distance between point sources on a line or, in case of the polygon, the diameter of the circle circumscribing all sources. Fig. 6h: Numerical simulation of the relative distance error a / d = RMSE {dp) / d for the arrangements shown in a same grey shade coding 14 to 17. Note that at fixed distances d < 0.018A, five scatters in a line can be resolved more precisely than two, indicating that the resolution favourably depends on the number of scatterers as long as the ensemble does not significantly extend beyond the minimum (d > 0.02 A) of the probing intensity beam (compare line 14 and Iine16). In case of the regular polygon, adding a scatterer increases the emitter density i.e., does not change the spatial extent of the ensemble, and hence improves the accuracy of the d estimate at small d (line 15 with line 17). Again, this implies that over small distances d, for example d < 20 nm, localization and measurement of distance between a larger number of scatterers is advantageous over a smaller number. The numerical distance values are obtained for N = 500 detected photons, a realistic probing range of L = 30 nm, an average background emission equivalent to p = 0.1 emitting molecules in the background and A = 640 nm.
[0114] Fig. 7 illustrates a distance measurement via line-scans and control measurement via bleaching steps. Fig. 7a: Boxplot of the distance estimates obtained from line-scan experiments with respect to expected distances up to 90 nm. Here, the distance of two fluorophores is determined by selecting photons near the minimum of a line-scan (Min, see inset). The box extends from the lower to upper quartile values of the data. Error bars mark the interval from the median (black line within box) to the last point within a 1.5 interquartile range. Outliers are shown as dots. The experiment agrees with the expected d down to 10 nm. For d < 10 nm, the estimation saturates and fails to distinguish between shorter and longer nanorulers; this can be attributed to experimental imperfections, such as a non-zero minimum intensity of the probing pattern. Fig. 7b: Correlation between obtained distance estimates and the control by center of mass shift due to bleaching of one molecule. While the methods agree well on the separation estimation, the method of the present disclosure relying on the minimum is more precise than the control and uses only a fraction of the available photons (5 %) of a full line-scan. The inset depicts how the center of mass shift allows for determining d via a bleaching step. Fig. 7c: Half-violin plot of the deviation of obtained distance estimates from the expected distance. Distance estimates obtained by utilizing all photons available from a full line-scan 18 are compared with estimation utilizing only photons near the emission minimum 19. Considering more photons does not improve the co-localization accuracy or precision, since photons from the maxima do not add information. On the contrary, longer measurement sequences and exposure to higher illumination intensities increase blinking of the molecules and deteriorate the measurement, for example by saturation of the emission.
[0115] Fig. 8 illustrates the correlation of measurement uncertainty versus production variability. Fig. 8a: Violin plot of the deviations of mean distances obtained from individual nanorulers. The black box marks the interquartile range, the white dot indicates the median deviation, whiskers extend to the adjacent points within a 1.5 inter quartile range (IQR) from the median. Fig. 8b: Comparison of standard deviations of obtained distance estimates of mean distances within a batch (“x”, standard deviation of i-th batch, considering the mean distance of j nanorulers by averaging over k estimates on the individual nanoruler), to that of individual nanorulers (standard deviation of the individual k estimates on the j-th nanoruler in the i-th batch). Batch-wise deviations are much larger than the spread of consecutive distance estimates on individual nanorulers. Fig. 8c: Results of the analysis of variances (ANO A). The high F-score in the last column indicates that the total spread of the estimates can be partitioned into a spread of the means (“production variability”) and spread of estimates on a single nanoruler (“measurement uncertainty”). Comparable spread of the control measurements (Fig. 7) as well as the spread observed by the manufacturer, see Ref. 11 , further support this finding.
[0116] In the method 1 of determining an arrangement of equal point sources in a sample according to the present disclosure, which is illustrated in Fig. 9 as a flow chart, the point sources are limited 2 both to a known point source number of at least two and of not more than 32, i. e. of not more than 25, and to a small spatial area of the sample. Then, the point sources are scanned 3 with a probe signal comprising a probe signal intensity. A spatial intensity distribution of the probe signal intensity has a local probe signal intensity minimum that is, in at least one spatial direction, delimited on both sides by probe signal intensity maxima. The local probe signal intensity minimum is positioned at different probe signal minimum positions at distances in the at least one spatial direction. A measurement intensity of a measurement signal coming from the point sources is registered 4 for each of the different probe signal minimum positions. The measurement intensity depends on the probe signal intensity at point source positions of the point sources. The arrangement of the point sources is determined 5 from a spatial course of the registered measurement intensities over the different probe signal minimum positions. In the step of limiting 2 the point sources has been limited to such a small spatial area of the sample that the spatial course of the registered measurement intensities over the different probe signal minimum positions only has one local measurement signal minimum.
[0117] Fig. 10, 11 and 12 each compare an arrangement of three equal point sources in a two- dimensional sample which has been determined in a computational simulation of the method of the present invention starting from a voluntary actual arrangement of the three equal point sources (Fig. 10a, 11a, or 12a, respectively) to the actual arrangement of the three equal point sources (Fig. 10b, 11 b, or 12b, respectively). The assumptions of the computational simulations include that the two-dimensional sample is scanned with a line-shaped probe signal intensity minimum of a standard shape in x- and y-directions. No further previous knowledge than the actual number 3 of the point sources being equal fluorophores has been used in determining the arrangement of the point sources from the computationally simulated spatial course of the registered measurement intensities over the different probe signal minimum positions, and, of course, the actual arrangement of the three equal point sources was not known when determining the arrangement. The arrangements of the point sources obtained by the method of the present invention according to Fig. 10a, 11a and 12a which are shown as heat maps of the probability of the positions of the three individual point sources very precisely image their actual positions and distances di, d2 and da which are indicated in Fig. 10b, 11 b and 12. Fig. 10 to 12 are only examples of a larger series of corresponding simulations for other distances di, da and da of the point sources and other orientations of the arrangements with regards to the x- and y-directions. Thus, it has been shown that, with three point sources, there is no need for an additional previous knowledge than the actual number of equal point sources.
[0118] References
[0119] 1. Rayleigh, Lord. On the Theory of Optical Images, with special reference to the Microscope. Journal of the Royal Microscopical Society 23, 474-482 (1903).
[0120] 2. Abbe, E. Beitrage zur Theorie des Mikroskops und der mikroskopischen Wahrnehmung. Archivf. mikrosk. Anatomie 9, 413-468 (1873).
[0121] 3. Wilson, T. & Sheppard, C. Theory and practice of scanning optical microscopy. London: Academic Press (1984).
[0122] 4. Hell, S. W. Far-Field Optical Nanoscopy. Science 316, 1153-1158 (2007).
[0123] 5. Hell, S. W. Nobel Lecture: Nanoscopy with freely propagating light. Rev. Mod. Phys. 87, 1169-1181 (2015).
[0124] 6. Balzarotti, F. et al. Nanometer resolution imaging and tracking of fluorescent molecules with minimal photon fluxes. Science (2017).
[0125] 7. Jungmann, R. et al. Single-Molecule Kinetics and Super-Resolution Microscopy by Fluorescence Imaging of Transient Binding on DNA Origami. Nano Lett. 10, 4756-4761 (2010).
[0126] 8. Carrington, W. A. et al. Superresolution Three-Dimensional Images of Fluorescence in Cells with Minimal Light Exposure. Science 268, 1483-1487 (1995).
[0127] 9. Pawley, J. Handbook of Biological Confocal Microscopy. (Springer Science & Business Media, 2013).
[0128] 10. Ram, S., Ward, E. S. & Ober, R. J. Beyond Rayleigh's criterion: A resolution measure with application to single-molecule microscopy. Proceedings of the National Academy of Sciences 103, 4457-4462 (2006).
[0129] 11. Raab, M. et al. Using DNA origami nanorulers as traceable distance measurement standards and nanoscopic benchmark structures. Sci Rep 8, 1780 (2018).
[0130] 12. Wolff, J. O. et al. MINFLUX dissects the unimpeded walking of kinesin-1. Science 379, 1004-1010 (2023).
[0131] 13. Gordon, M. P., Ha, T. & Selvin, P. R. Single-molecule high-resolution imaging with photobleaching. Proceedings of the National Academy of Sciences 101, 6462-6465 (2004).
[0132] 14. Hensel, T. A. Diffraction minima resolve point scatterers at tiny fractions (1 / 80) of the wavelength - Datasets. (2024) doi:10.5281 / zenodo,10625021.
[0133] 15. Hensel, T. A. Diffraction minima resolve point scatterers at tiny fractions (1 / 80) of the wavelength - Software and documentation. (2024) doi:10.5281 / zenodo.10639211.
[0134] 16. Truong, C., Oudre, L. & Vayatis, N. Selective review of offline change point detection methods. Signal Processing 167, 107299 (2020).
Claims
CLAIMS1. A method of determining an arrangement of point sources in a sample, comprising scanning (3) the point sources with a probe signal comprising a probe signal intensity, a spatial intensity distribution of the probe signal intensity having a local probe signal intensity minimum that is, in at least one spatial direction, delimited on both sides by probe signal intensity maxima, and the local probe signal intensity minimum being positioned at different probe signal minimum positions at distances in the at least one spatial direction, registering (4) a measurement intensity of a measurement signal coming from the point sources for each of the different probe signal minimum positions, the measurement intensity depending on the probe signal intensity at point source positions of the point sources, determining (5) the arrangement of the point sources from a spatial course of the registered measurement intensities over the different probe signal minimum positions, characterized by limiting (2) the point sources whose arrangement is determined from the spatial course of the registered measurement intensities over the different probe signal minimum positions to a point source number of at least 2, and to such a small spatial area of the sample that the spatial course of the registered measurement intensities over the different probe signal minimum positions has one local measurement signal minimum, and utilizing previous knowledge of the arrangement of the point sources in determining the arrangement of the point sources from the spatial course of the registered measurement intensities over the different probe signal minimum positions.
2. The method of claim 1 , wherein the previous knowledge includes at least one of an expected contribution to the measurement intensity per point source, the point source number, a plurality of different possible basic geometries of the arrangement of the point sources, or at least with a point source number above 4, a basic geometry of the arrangement of the point sources.
3. The method of claim 1 or 2, wherein the arrangement of the point sources is determined from at least one of a shape of the one local measurement signal minimum, or at least one of a depth or a width of the one local measurement signal minimum.
4. The method of claim 2 or 3, further comprising comparing the one local measurement signal minimum with at least one of a comparative local measurement signal minimum that corresponds to a comparative arrangement of the point sources in which the point source positions of the point sources are identical in the at least one spatial direction, the local probe signal intensity minimum, or at least one comparative local measurement signal minimum that corresponds to a certain basic geometry of the arrangement of the point sources.
5. The method of any of the preceding claims, wherein the step of determining the arrangement of the point sources comprises fitting a curve to the registered measurement intensities.
6. The method of claim 5, wherein at least one fit variable that is tuned in fitting the curve to the registered measurement intensities is a parameter, optionally a distance, that describes the arrangement of the point sources.
7. The method of any of the preceding claims, the previous knowledge including a plurality of different possible basic geometries of the arrangement of the point sources, further comprising, in determining the arrangement of the point sources, comparing the spatial course of the registered measurement intensities over the different probe signal minimum positions with each of a plurality of different comparative spatial courses, wherein each of the different comparative spatial courses corresponds to one of the plurality of the different possible basic geometries of the arrangement of the point sources.
8. The method of claim 7, wherein each of the different comparative spatial courses are generated by simulation using a measured or estimated arrangement of the point sources9. The method of claim 4, 7 or 8, further comprising automatically implementing the step of comparing with the aid of at least one of artificial intelligence, a neural network, an artificial neural network, or machine learning.
10. The method of any of the preceding claims, wherein the point source number is not more than 32 or not more than 16 or not more than 8 or not more than 4, and / or the previous knowledge of the arrangement of the point sources includes relative scattering cross sections of the individual point sources, wherein, optionally, the relative scattering cross sections of the individual point sources are equal.11 . The method of any of the preceding claims, wherein the arrangement of the point sources is determined with regard to their point source distances in the at least one spatial direction, and, optionally, with regard to their center of mass in the at least one spatial direction.
12. The method of any of the preceding claims, wherein the point sources are neither switchable nor blinking with regard to the dependence of the measurement intensity on the probe signal intensity at the point source positions.
13. The method of any of the preceding claims, wherein the point sources are hydrophilic.
14. The method of any of the preceding claims, wherein the probe signal has a wavelength, and wherein the local probe signal intensity minimum is formed using destructive interference of the probe signal, and / or the spatial area of the sample to which the point sources are limited is not larger than 1 / 10 of the wavelength or 1 / 25 of the wavelength or 1 / 50 of the wavelength or 1 / 75 of the wavelength in the at least one spatial direction.
15. The method of any of the preceding claims, wherein the local probe signal intensity minimum comprises a zero of the probe signal intensity.
16. The method of any of the preceding claims, wherein the local probe signal intensity minimum is delimited in one spatial direction only,the point sources are scanned at first in a first spatial direction, wherein the one spatial direction, in which the local probe signal intensity minimum is limited, is oriented in the first spatial direction, and the point sources are scanned in a second spatial direction, which is orthogonal to the first spatial direction, wherein the one spatial direction, in which the local probe signal intensity minimum is limited, is oriented in the second spatial direction.
17. The method of any of the claims 1 to 15, wherein the local probe signal intensity minimum is ring-shaped, and the arrangement of the point sources is scanned with the probe signal in that the ringshaped probe signal intensity minimum is moved around the arrangement of the point sources in a circular motion, wherein, optionally, a center of the circular motion is adjusted after at least one full circle.
18. The method of any of the preceding claims, wherein a spatial pattern is imprinted on the measurement signal coming from the point sources, wherein a resulting spatial measurement intensity distribution of the measurement signal, which comprises the measurement intensity, is registered with spatial resolution for each of the different probe signal minimum positions, and wherein the registered spatial measurement intensity distributions and their spatial course over the different probe signal minimum positions are evaluated for determining the arrangement of the point sources, wherein, optionally, the spatial pattern comprises a line-shaped local intensity minimum of the measurement signal.
19. The method of any of the preceding claims, wherein the spatial area of the sample to which the point sources are limited is not larger than 1 / 2 or 1 / 3 or 1 / 5 or 1 / 10 or 1 / 20 of a FWHM of the local probe signal intensity minimum.
20. The method of any of the preceding claims, wherein the probe signal is an electromagnetic signal or a sound signal.21 . The method of any of the preceding claims, wherein the measurement signal is fluorescence light, the point sources being fluorophores, or inelastically scattered light, optionally Raman-scattered light, or elastically scattered light, or scattered sound, optionally scattered ultrasound.
22. The method of any of the preceding claims, wherein the probe signal excites the point sources for emitting the measurement signal via a two or multiple photon process, wherein, optionally, a further probe signal excites the point sources for emitting the measurement signal via a single photon process, and wherein the arrangement of point sources in the sample is successively or alternately determined or monitored at a lower precision using the further probe signal and determined at a higher precision using the probe signal.
23. The method of any of the preceding claims, wherein the steps of scanning the point sources with the probe signal, registering the measurement intensity of the measurement signal coming from the point sources, and determining the arrangement of the point sources from a spatial course of the registered measurement intensities over the different probe signal minimum positions, are repeated in order to track variations of the arrangement of the point sources, optionally with regard to at least one of external influences on the sample or movements of an entity, to which the point sources are attached, within in the sample.
24. The method of any of the preceding claims, further comprising attaching the point sources to different sites of one object selected from a group consisting of macromolecules, proteins, complexes, drug candidates and potential drug targets.
25. The method of any of the preceding claims, further comprising determining a further arrangement of further point sources that are also limited to a known point source number of at least 2, and to such a small spatial area of the sample that the spatial course of the registered measurement intensities over the different probe signal minimum positions has one local measurement signal minimum, wherein the further point sources provide a further measurement signal distinguishable from the measurement signal and / or wherein the further point sources can selectively be probed by a further probe signal different from the probe signal and / or wherein the point sources are deactivatable, and wherein the further point sources are activatable.
Citation Information
Patent Citations
Method of high spatial resolution determining a position of a singularized molecule which is excitable for emission of luminescence light
US10962479B2
High-resolution fluorescence microscopy using a structured beam of excitation light
US9719928B2
Photobleaching and intermittency localization microscopy
WO2011106323A2
Method and scanning fluorescence microscope for multidimensional high-resolution imaging of a structure or a path of a particle in a sample
WO2016156541A2
Optical measurement method and device
US9739993B2