Methods for accelerated, high-resolution scanning microscopy

The method addresses artifacts in high-resolution scanning microscopy by correcting local blurring functions and redistributing pixel data, resulting in accelerated and artifact-free image reconstruction.

DE102018104693B4Active Publication Date: 2024-11-07CARL ZEISS MICROSCOPY GMBH
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
DE102018104693
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2018-03-01
Publication Date
2024-11-07
Estimated Expiration
2038-03-01

AI Technical Summary

Technical Problem

Existing high-resolution scanning microscopy methods suffer from artifacts and inefficiencies in image reconstruction, particularly when oversampling is combined with coarse scanning, leading to distorted images.

Method used

A method involving redistribution and demixing steps to correct the local variation of the point image blurring function, allowing for increased scanning distances and accelerated image generation without artifacts, by using a spatially resolved area detector and calculating intensity redistribution from multiple detector pixels.

Benefits of technology

The method achieves high-resolution imaging with reduced scanning overlap, accelerating the process while preventing artifacts, and enabling faster image capture without the need for hardware changes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for high-resolution scanning microscopy of a sample (P) comprising the following steps: a) Focusing illumination radiation to an illumination spot in or on the sample (P) and stimulating the emission of detection radiation at a sample spot (14) coincident with the illumination spot, wherein the illumination spot and thus also the sample spot (14) are not diffraction-limited in at least one first spatial direction, b) Imaging the sample spot (14) into an image (17) resting on a spatially resolving area detector (18) having pixels (32) of a size that spatially resolves the image (17), wherein the optical imaging has a resolution limit and a point image blurring function that varies spatially for the pixels (32), c) Raster-shifting of the illumination spot and the coincident sample spot (14) over the sample (P) in a scanning operation, wherein lines extend along the first spatial direction and a distance between adjacent lines corresponds to the extent of the sample spot (14) in the first spatial direction, d) Reading data from the pixels (32) of the area detector (18) during the scanning process for each scan position, e) Generating an image of the sample (P) that has a resolution increased above the resolution limit of the image, wherein e1) a redistribution step is performed in which, for each scan position, data from several pixels (32) of the area detector (18) spaced apart in the first spatial direction are combined to generate a temporary data set comprising data from combined pixels for each scan position, e2) a demixing step is performed in which the temporary datasets are corrected with respect to the local variation of the dot image blur function assigned to each aggregated pixel, so that the same dot image blur function applies within each temporary dataset, e3) the image of the sample (P) is generated from the data of the pixels (32) and the scan positions assigned to them, processed in this way.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method for high-resolution scanning microscopy of a sample. This method involves focusing illumination radiation into an illumination spot in or on the sample and stimulating the emission of detection radiation at a sample spot coincident with the illumination spot. The sample spot is imaged onto a spatially resolving area detector having detector pixels with a size that spatially resolves the image, with the image having a resolution limit. The sample is acquired as a whole by scanning the illumination spot and the coincident sample spot across the sample in a single scan. From the pixel data for each scan position, an image of the sample is generated with a resolution that exceeds the resolution limit of the image.

[0002] Such a high-resolution microscopy technique is known from the publication by C. Müller and J. Enderlein, Physical Review Letters, 104, 198101 (2010), or EP 2 317362 A1, which also provides further evidence of the state of the art. It images the coincident sample spot in a diffraction-limited manner and scans its structure. This oversampling of the sample, combined with image reconstruction, achieves high resolution (i.e., beyond the resolution limit of optical imaging).

[0003] DE 10 2013 015 933 A1 aims to accelerate this process. In the section "Laterally Speed-Optimized Illumination PSF," DE 10 2013 015 933 A1 describes an embodiment that aims to increase image acquisition speed by using a sampling technique that is actually too coarse for oversampling. The image information missing due to coarse sampling is to be reconstructed from the detector pixel data. However, the publication provides no details on how this reconstruction is to be performed. Conceivable reconstruction approaches, such as spatially mapping the signals from the detector array to the target image, lead to disturbing artifacts.

[0004] DE 10 2016 110 433 A1 discloses a microscope and a microscopy method for imaging an object. US 2014 / 0 361 154 A1 discloses a device for generating confocal images. WO 2016 / 135 178 A1 relates to a method for improving the dynamic range of a device for detecting light, and WO 2016 / 156 541 A2 relates to a method and scanning fluorescence light microscope for multidimensional, high-resolution imaging of a structure or a path of a particle in a sample. JP 2006-221 190 A describes a confocal scanning microscope system.

[0005] The invention is based on the object of providing an accelerated, high-resolution microscopy method that avoids artifacts and thus achieves a better reconstruction of the image.

[0006] The invention is defined in the independent claims. The dependent claims relate to advantageous developments.

[0007] High-resolution scanning microscopy of a sample involves several steps. Illumination radiation is focused into an illumination spot in or on the sample. This stimulates the sample to emit detection radiation at a sample spot coincident with the illumination spot. The illumination spot, and thus also the sample spot, are not diffraction-limited in size in at least one first spatial direction. In the other spatial direction, they can be diffraction-limited or non-diffraction-limited, depending on the design. The sample spot is imaged. This imaging is diffraction-limited in some embodiments. It occurs so that the image rests on a spatially resolving area detector. This has pixels sized to spatially resolve the structure of the image. The optical imaging, preferably diffraction-limited, has a resolution limit.It also has a point image blurring function that varies locally for the pixels. The illumination spot and thus the coincident sample spot are moved raster-wise across the sample in a scanning process. Lines of the scanning process extend along the first spatial direction. The distance between adjacent lines corresponds to the extent of the sample spot in the first spatial direction. During the scanning process, the data of the pixel of the area detector is read out for each scanning position. Based on this data, an image of the sample is generated which has a resolution that exceeds the resolution limit of the image. This involves, among other things, a redistribution step. In this redistribution step, data from several pixels of the area detector that are spaced apart in the first spatial direction are combined for each scanning position. In this way, a temporary data set is generated for each scanning position that contains data from the respectively combined pixels.A further unmixing step is performed in which the temporary data sets are corrected for the local variation of the point spread function associated with each combined pixel. The correction is performed such that, within each temporary data set, the same point spread function applies to the location information present in the temporary data sets. The sample image is then generated from the temporary data sets and their associated scan positions.

[0008] The redistribution and demixing steps allow the distances between the scan positions to be increased, at least in the first spatial direction, during scanning. While the high-resolution microscopy method, as described in the aforementioned publications by Müller and Enderlein and EP 2 317 362 A1, required a large overlap between adjacent scan positions in each spatial direction, the invention reduces this requirement, at least in the first spatial direction. As a result, a region of the sample to be captured is scanned more quickly, thus accelerating the high-resolution microscopy process. At the same time, the redistribution and demixing steps prevent the creation of artifacts.

[0009] The demixing step and the generation of the sample image can be combined into a deconvolution operation. For this purpose, a system of equations is set up and solved, for example. The system of equations links the intensities of the detection radiation to the signal intensities of the detector pixels via the location-dependent point spread function. The detection radiation is emitted from locations on the sample.

[0010] For redistribution and unmixing, it is preferred in embodiments to determine an intensity of the detection radiation from the sample spot that falls on one of the detector pixels by calculating a sum over several locations on the sample. Addends are added. Each addend is the product of the location-dependent point-image blurring function and the intensity of the radiation originating from the respective location. The basis for this is that portion of the location-dependent point-image blurring function that is assigned to the mapping of the respective location onto the corresponding detector pixel. Preferably, only a portion of the neighboring locations in the first spatial direction is taken into account. This portion can be half, for example. When generating the image, the location-dependent point-image blurring function is replaced by a location-independent point-image blurring function.By inverting this function, the intensity of the radiation originating from each location is calculated from the intensities of the detection radiation.

[0011] The illumination spot, and thus also the sample spot, can also be diffraction-limited in a second spatial direction that is perpendicular to the first spatial direction. The sample spot is then imaged in a diffraction-limited manner.

[0012] Alternatively, the illumination spot, and thus also the sample spot, can be non-diffraction-limited in the second spatial direction perpendicular to the first spatial direction. During raster scanning, sample spots overlap in adjacent scan positions.

[0013] In the first spatial direction, sample spots in adjacent scan positions preferably overlap by less than half of the sample spot extent in the corresponding spatial direction.

[0014] It is understood that the features mentioned above and those to be explained below can be used not only in the combinations indicated, but also in other combinations or in isolation, without departing from the scope of the present invention.

[0015] The invention is explained in more detail below using exemplary embodiments with reference to the accompanying drawings, which also disclose features essential to the invention. These exemplary embodiments are for illustrative purposes only and are not to be interpreted as restrictive. For example, a description of an embodiment with a large number of elements or components should not be interpreted to mean that all of these elements or components are necessary for implementation. Rather, other embodiments may also contain alternative elements and components, fewer elements or components, or additional elements or components. Elements or components of different exemplary embodiments may be combined with one another unless otherwise stated. Modifications and variations described for one of the exemplary embodiments may also be applicable to other exemplary embodiments.To avoid repetition, identical or corresponding elements in different figures are designated by the same reference numerals and are not explained more than once. The figures show: Fig. 1 a schematic representation of a laser scanning microscope for high-resolution microscopy, Fig. 2a-c views illustrating PSF, Fig. 3a-c views illustrating redistribution and demixing steps in line-scan, Fig. 4 an illustration similar to the Fig. 3 for the case of a spot-shaped scan and Fig. 5a-c Images to explain the effect of image reconstruction.

[0016] Fig. 1 schematically shows a laser scanning microscope 20 configured for microscopy of a sample P. The laser scanning microscope (hereinafter abbreviated as LSM) 20 is controlled by a control unit C and comprises an illumination beam path B and an imaging beam path D. The illumination beam path illuminates a spot in the sample P, and the imaging beam path D images this spot in a diffraction-limited manner for detection.

[0017] Illumination beam path B and imaging beam path D share many elements. However, this is not mandatory.

[0018] The sample P is illuminated in the LSM 20 by an illuminating light beam provided by a light source 6, which is coupled to a mirror 8 via a deflection mirror 8 (not required for any further functionality) and a lens 7. The mirror 8 ensures that the light beam falls onto a main color splitter 9 at a reflection angle. For clarity, only the main axis of the light beam is shown.

[0019] After reflection at the main color splitter 9, the light beam is deflected biaxially by a scanner 10 and focused by lenses 11 and 12 through an objective 13 into a spot 14 in the sample P. The spot 14 is shown in the illustration of the Fig. 1 is linear, but a rotationally symmetric spot is also possible. Fluorescence radiation excited in spot 14 passes through objective 13, lenses 11, and 12 back to scanner 10, after which a stationary light beam is again present in the imaging direction. This beam passes through main color splitter 9 and emission filter 15, which have the function of selecting the fluorescent radiation in spot 14 according to its wavelength and, in particular, separating it from the illumination radiation, which can serve as excitation radiation, for example. A lens 16 ensures that the entire spot 14 is imaged into an image 17, which lies in a detection plane. The detection plane is a conjugate plane to the plane in which spot 14 lies in sample P. The image 17 of spot 14 is recorded in the detection plane by a detector device 18, which has non-relevant elements 23-25.What is essential here is that the detector device 18 spatially resolves the image 17 of the spot 14 in the detection plane. The intensity distribution of the spot relative to the line direction (Gaussian distribution) is shown as 18a in . Fig. 1. The spot 14 is imaged in a diffraction-limited manner in some embodiments. In the embodiment of the Fig. 1 is linear. The illumination radiation is expanded along the line more than the diffraction limit would allow. Transverse to the line direction, the illumination spot is preferably diffraction-limited. In modified embodiments, an illumination spot and, accordingly, a spot 14 are imaged on the sample P that is larger in both directions than the diffraction limit would allow. Nevertheless, the image in image 17 is diffraction-limited, i.e., without additional expansion.

[0020] The illumination is based on an illumination point image blurring function (PSF). Because fluorescent radiation is excited in certain embodiments, this function is also referred to as an excitation point image blurring function. The imaging in image 17 is performed by an imaging point image blurring function, which is also referred to as a detection point image blurring function.

[0021] The control unit C controls all components of the LSM 20, in particular the scanner 10 and the detector device 18. The control unit C records the data of each individual image 17 for different scanning positions, analyzes its diffraction structure, and generates a high-resolution overall image of the sample P.

[0022] The detector device 18 implements a detector array having individual pixels that resolve the diffraction structure of the image 17. The use of a detector array offers the advantage over the use of a single detector, as is common in conventional LSMs, that, on the one hand, the small area of ​​the pixels allows for a very high-resolution image of the sample P to be generated. On the other hand, the entire extent of the detector array allows a very large amount of detection light to be collected from the sample P, thus ensuring high light sensitivity. The LSM 20 can be sensitive and generate high-resolution images at the same time. With a conventional LSM with only one detector element, both requirements could not be met simultaneously. To image the sample, it is scanned in a raster-like manner in a scanning process by the scanner 10 adjusting the position of the illumination spot and the spot 14 on the sample P accordingly.Each pixel of the detector array 18 receives a complete image of the sample P by scanning it. The images generated from the individual pixels differ from one another. Due to the position of the pixels relative to the sample P and relative to the excitation PSF, the individual images are shifted relative to one another. Furthermore, spatial frequencies of the sample are transmitted to the pixels with different amplitudes and phases.

[0023] With the described microscope, an image of the sample P is generated by scanning the entire detector array 18. The extent of the detector array 18 is larger than a line spacing in the image. To speed up the process, only every nth line is scanned, and the image information from the non-scanned lines is generated from the signals of the individual pixels. As long as the line spacing of the scanned lines is not larger than the extent of the detected area in the same dimension, reconstruction of the image from the pixel data is still possible. The advantage is an n-fold increase in image acquisition speed.

[0024] However, there are now n row groups that can have different imaging properties. Specifically, n rows, each with different imaging properties, follow one another, and then this pattern repeats. These periodically repeating imaging properties of the image lines can result in periodic artifacts in the form of stripes. To understand the problem, let's first Fig. 2a to 2c are considered. Fig. Figure 2a shows the detector array 19 with a total of sixteen detector pixels 32. The illumination light spot 31 is designed such that it covers the detector pixels 32 - theoretically transferred to the detection plane. The signal of each detector pixel is influenced by the PSF of the imaging system through the imaging beam path, so that, for example, a detection PSF 33a as in Fig. 2b. Sample P is scanned with a confocal PSF, which can be mathematically understood as the product of the excitation and detection PSFs in spatial space. The result is a confocal PSF 34a, which has a smaller extension than the excitation and detection PSFs. This property increases the resolution.

[0025] Through appropriate processing, a high-resolution image can be derived from the individual images. To do this, the positions and phases of the individual images are generally compensated, and these compensated images are combined. By weighting and adjusting the spatial frequency amplitudes, an image can be determined that corresponds as closely as possible to the original sample P. The correction of the spatial frequency amplitudes and phases is called deconvolution.

[0026] The shape and intensity of the confocal PSF 34a is location-dependent with respect to the sample and the detector pixels. It depends on the relative position between the excitation and detection PSF. For example, the Fig. 2c for a detector pixel, confocal PSF 34b has different properties than the one in Fig. 2b, which applies to a different detector pixel. The reason is the different position of the detector pixel 32 and thus the relative position of the detection PSF to the excitation PSF. Thus, the confocal PSF 34b is Fig. 2c, for example, will be less intense because it is located at the edge of the excitation PSF. The slope of the PSF will also be different. Consequently, an image scanned with this PSF 34b would also have a different contrast and / or image sharpness than an image scanned with PSF 34a. The differences between PSFs 34a and 34b are symbolized by different hatching.

[0027] In Fig. Figures 3a and b again illustrate the rasterization situation for a line group with n lines. Specifically, four lines 36a are to be scanned at once. The detector array has sixteen pixels. Each detector pixel generates a line, each with its own confocal PSF 34a, 34b, as indicated for two detector pixels. These sixteen lines are now to be combined into four lines. A first reconstruction step consists of assigning the detector lines to target lines 36a of the image. This assignment can be done spatially, so that target lines are always composed of the nearest source lines. Interpolating the source lines to multiple target lines is also conceivable. The process of spatially assembling the target lines from the source lines is a reassignment.

[0028] The following description refers to four lines as an example. However, the method works with any number of lines, up to a maximum of as many lines as the number of detector pixels available (32).

[0029] It is clear that each target row is composed of different source rows, or rather, of different portions of the source rows. However, because the source rows have different PSFs, the target rows also have different PSFs 37a. This is symbolized by the different hatching of the PSFs 37a.

[0030] As a result of these different PSFs, the image has a spatially varying PSF after reordering. As a result, image content would be transmitted differently in the lines, leading to artifacts. The consequences of these artifacts are described in Fig. 5. On the left is a Siemens star 70u. Fig. Figure 5b shows the image of star 70a as it appears after rasterization and detector pixel reassignment. The peripheral regions with low spatial frequencies are reproduced unaltered. However, to the left and right of the center, distinct artifacts in the form of moiré patterns appear. These are a direct result of the periodically changing PSF, which overlaps with the periodic pattern of the star.

[0031] During processing, a homogeneous PSF is achieved, as in Fig. 3c. There, all rows 36 have the same PSF 37. Sampling only every nth row results in an information loss, which is characterized in the frequency domain of the image (which is linked to the spatial domain by a Fourier transform) by a superposition of spatial frequencies. This can be expressed as the formula: D^h(kx, ky, kz)=1n∑j=0n−1[O(kx, ky+jnky max, kz)⋅Sh(kx, ky+jnky max, kz)], ky≤ky maxn

[0032] D̂h the image of a detector pixel h, k x , k y , k z are the spatial frequency coordinates, n is the number of lines acquired simultaneously. 0 is the sample, S h the confocal PSF of the detector pixel h (h is to be understood as a counting index). The formula shows that in the image of the detector pixel h, each k y of n components. At the same time, the spatial frequency spectrum only extends to ky maxn.

[0033] The redistribution can be calculated in the frequency domain by multiplying with a phase Sh h One then obtains for the composite image D⃛: D⃛m(kx, ky, kz)= ∑j=0n−1∑h=1hmaxSh(kx, ky+jnky max, kz)⋅cc[Shh(kx, ky+mnky max, kz)]⋅O(kx, ky+jnky max, kz), ky≤ky maxn

[0034] The spectrum is for ky≤ky maxn. In the picture D⃛ The higher frequencies are denoted by the index m. The sum over j describes the superposition of the spatial frequencies, h the sum over all detector pixels.

[0035] The terms including the summation over h can be understood as a matrix SF with n n components: SFm,j=∑h=1hmaxSh(kx, ky+jhky max, kz)⋅cc[Shh(kx, ky+mnky max, kz)]

[0036] This matrix describes the convolution of sample 0 with the PSF and also takes into account the crosstalk of the frequencies jnky max, j=0…n−1.

[0037] The matrix can be completely determined from the microscope parameters: The confocal PSFs S h are given by the excitation and detection PSF of the optical system and are therefore known. The phases Sh required for the re-assignment h depend only on the confocal PSF S h and are therefore also known. Consequently, for SF an inverse matrix SF -1This matrix is ​​used to calculate the proportions D⃛m of the composite image, the sample spectrum 0 is reconstructed. The matrix SF -1 demixes the superimposed frequencies. The process is therefore a demixing process.

[0038] The multiplication of D⃛m with SF -1 would also D⃛m with the inverse PSF S h This inverse filtering can be problematic because it can cause noise components of D⃛m As a countermeasure, one can optionally calculate a modified matrix that describes only the crosstalk of the frequencies, but not the convolution with the confocal PSFs. To do this, the SFs are divided by the confocal PSFs, yielding a "pure" crosstalk matrix: Fm,j=∑h=1hmaxSh(kx, ky+jnky max, kz)⋅cc[Shh(kx, ky+mnky max, kz)]∑h=1hmaxSh(kx, ky+jnky max, kz)⋅cc[Shh(kx, ky+jn ky max, kz)]

[0039] F is undefined in frequency ranges where the denominator approaches zero. This is not a problem, however, because these frequency ranges are outside the transmission bandwidth, i.e., beyond the resolution of the system. The calculation of the demixed image D in matrix notation is simply F¯−1⋅D⃛=D¯

[0040] D can be subjected to further deconvolution. State-of-the-art technology for this is, for example, a filter of the following type, which is based on a Wiener filter and produces a deconvolved image Õ: O˜(kx, ky, kz)=D¯⋅cc[SSh(kx, ky, kz)]|SSh(kx, ky, kz)|2+w

[0041] SSh is the effective PSF of the demixed image D⃛.

[0042] In Fig. Figure 5c shows the demixed and deconvolved image 70, as it is created by demixing the associated image 70a. It is virtually identical to the original image 70u, and the moiré effects are compensated.

[0043] The following generalizations are possible: The phase factors Sh used for the composite image h can be obtained using various approaches. A simple approach is the spatial redistribution mentioned above, which leads to linear phase factors. This creates an image that is already close to the demixed image with PSFs that are not too inhomogeneous. Another possibility is to use the phase of the PSF S as phase factors. hThis creates an image in which all frequency components interfere constructively. It is thus optimized in terms of signal components and thus also the signal-to-noise ratio. However, the combined image is then even more affected by artifacts and is difficult to use, for example, as a preview image. Only after the unmixing step does an artifact-free image emerge. Other phase factors are possible.

[0044] The above explanation describes unmixing and deconvolution as sequential steps. However, the calculation of the unmixed / deconvolved image can also be performed in fewer or even just one step without going through the composite image. To do this, the system of equations is directly calculated using the individual images of the detector pixels D̂ h on: D^0=S0,0⋅O+⋯+S0, n−1⋅On−1⋮⋱⋮Dh max=Sh max,0⋅O+⋯Sh max, n−1⋅On−1

[0045] The crosstalk and convolution matrix composed of the confocal PSF now has h max rows and n columns. The inverse of the system for calculating O from all D̂ h is overdetermined. Measures must also be taken to avoid inverse filtering with diverging components, as described above. However, a usable approximate solution can be obtained even then, analogous to the above procedure.

[0046] A further variation is that subsampling is performed not only in one spatial direction, but in another or several spatial directions simultaneously. In this case, the calculation expands accordingly, but does not fundamentally change. In any case, superimposed spatial frequency components arise, which can be unmixed to reconstruct the original image.

[0047] Fig.Figure 4 shows an example of a 2-fold subsampling in the x and y directions. The excitation PSF 31r is round in this case, as is the case with conventional sampling. The confocal PSFs are reassigned into an image 36f and subsequently unmixed, resulting in an image with a homogeneous PSF 36g.

[0048] Rasterizing only every other line results in a frame rate that is only twice as high. Omitting every other pixel in x does not increase the image acquisition speed unless the frame rate is limited by the data transmission speed. On the other hand, this method does not require a modified excitation PSF; instead, the excitation PSF typically available in a high-resolution microscope can be used. This means that the acquisition time can be accelerated simply by changing the image acquisition control and processing, without requiring any further hardware changes. Thus, it is possible to achieve the acceleration simply by adapting the software of an existing LSM 20.

Claims

[1] Method for high-resolution scanning microscopy of a sample (P), comprising the following steps: a) focusing illumination radiation to form an illumination spot in or on the sample (P) and stimulating the emission of detection radiation at a sample spot (14) coincident with the illumination spot, wherein the illumination spot and thus also the sample spot (14) are not diffraction-limited in at least one first spatial direction, b) imaging the sample spot (14) into an image (17) resting on a spatially resolving area detector (18) having pixels (32) of a size that spatially resolve the image (17), wherein the optical image has a resolution limit and a point image blurring function that varies locally for the pixels (32), c) scanning the illumination spot and the coincident sample spot (14) over the sample (P) in a scanning process, wherein lines extend along the first spatial direction and a distance between adjacent lines corresponds to the extent of the sample spot (14) in the first spatial direction, d) reading data from the pixels (32) of the area detector (18) during the scanning process for each scanning position, e) generating an image of the sample (P) having a resolution that is increased beyond the resolution limit of the image, wherein e1) a redistribution step is carried out in which, for each scanning position, data from a plurality of pixels (32) of the area detector (18) which are spaced apart in the first spatial direction are combined to generate a temporary data set comprising data of combined pixels for each scanning position, e2) a demixing step is carried out in which the temporary data sets are corrected with regard to the local variation of the point image blurring function associated with the respective combined pixels, so that the same point image blurring function applies within each temporary data set, e3) the image of the sample (P) is generated from the data of the pixels (32) thus processed and the scan positions assigned to them. [2] Method according to claim 1, characterized by that steps e2) and e3) are combined in a deconvolution operation, wherein a system of equations is set up and solved which links intensities of detection radiation emitted from locations of the sample (P) to the signal intensities of the pixels (32) via the location-dependent point image blurring function. [3] Method according to claim 1 or 2, characterized bythat step e2) is carried out in such a way that the same point image blurring function applies to all temporary data sets. [4] Method according to claim 1, 2 or 3, characterized by , that - an intensity of the detection radiation from the sample spot (14) falling on one of the pixels (32) is determined by calculating a sum over several locations, wherein the summands are each the product of the location-dependent point spread function, with which the respective location is mapped onto this one of the pixels (32), with the intensity of the radiation originating from the respective location, and - when generating the image of the sample (P), the location-dependent point spread function is replaced by a location-independent point spread function and, by inverting the location-independent point spread function, the intensity of the radiation originating from each location is calculated from the intensities. [5] Method according to claim 4, characterized by that when calculating the sum only a part of the neighboring locations in the first spatial direction is taken into account. [6] Method according to claim 4 or 5, characterized by , that - the illumination spot and thus also the sample spot (14) are diffraction-limited in a second spatial direction lying transversely to the first spatial direction, and - the sample spot (14) is imaged in a diffraction-limited manner into the image (17), [7] Method according to claim 4 or 5, characterized by , that - the illumination spot and thus also the sample spot (14) are also not diffraction-limited in a direction transverse to the first spatial direction, - the sample spot (14) is imaged in a diffraction-limited manner into the image (17), and - during the raster shifting in step c), sample spots (14) overlap in adjacent scanning positions. [8] Method according to one of the above claims, characterized bythat during the raster displacement in step c), in adjacent scanning positions the sample spots (14) on the sample (P) overlap in the first spatial direction by less than half of the sample spot extent in this spatial direction.

Citation Information

Patent Citations

  • High-resolution scanning microscopy

    DE102013015933A1

  • microscope and microscopy methods

    DE102016110433A1

  • Microscopic method and microscope with improved resolution

    EP2317362A1

  • Confocal scanning microscope system

    JP2006221190A

  • Confocal image generation apparatus

    US20140361154A1