17 results about "Light field microscopy" patented technology

A device for light field microscopy, comprising: a two-dimensionally spatially resolving detector for detecting light radiated by a sample; a detection beam path having at least one microscope objective lens; and at least one multi-lens array for imaging the light radiated by the sample onto the detector, wherein the multi-lens array is arranged in a plane which is optically conjugated with respect to a rear focal plane of the microscope objective lens, or in the vicinity of such a plane; and a control and evaluation unit for activating the detector and for evaluating the measurement data from the detector. The device also includes an adjustable relay optical system in order to image the rear focal plane of the microscope objective lens into the plane in which the multi-lens array is arranged, or in the vicinity of this plane. A method for light field microscopy is also provided.

This efficiently provides a wide range of transfer functions for light-field microscopy. [Solution] A sample volume to be imaged with multiple sub-images (1~12xy) from different capture angles (Φ) is captured, and for the sub-images (1~12xy) intended for 3D reconstruction, the respective point image distribution function (PSF) is identified. The sub-images (1~12xy) are examined for optical symmetry, the symmetry is captured, and stored along with a calculation rule. The calculation rule can start with the point image distribution function (PSF) and / or processed point image distribution function of the first sub-image (1~12) and generate the corresponding point image distribution function (PSF) and / or processed point image distribution function of further sub-images (2x~12xy) that are symmetric with respect to the first sub-image (1~12), and the point image distribution function (PSF) or processed point image distribution function of further sub-images (2x~12xy) is generated only when necessary.

The invention relates to a method for providing a transfer function in light field microscopy, in which a sample volume to be imaged is determined using a plurality of sub-images; determining a corresponding point image transfer function for the sub-image, and distributing the point image transfer function to the sub-image; checking the symmetry of the basic optical technical data of the sub-image; the confirmed symmetry is detected and saved along with a calculation rule that allows a point image transfer function and / or a processed point image transfer function of a further sub-image symmetrical to the first sub-image to be generated from the point image transfer function and / or the processed point image transfer function of the first sub-image. The invention also relates to a reconstruction method for virtually reconstructing a sample volume detected using a plurality of sub-images from different detection angles in light field microscopy.

The invention discloses a large-view-field light field microscopic image distortion correction method and system, and belongs to the technical field of computer vision, and the method comprises the steps: obtaining a calibration image, and extracting a center coordinate of a central micro lens as a feature point; constructing an ideal circle center grid and an actual circle center grid according to the feature points, and obtaining grid coordinates; the two-dimensional nonlinear distortion model comprises an external parameter matrix, an internal parameter matrix, radial distortion and tangential distortion, and elements in the external parameter matrix comprise image rotation angle parameters and translation parameters; elements in the internal reference matrix comprise scaling parameters and optical center position parameters; substituting the normalized ideal circle center grid coordinates and the actual circle center grid coordinates into the two-dimensional nonlinear distortion model, and solving to obtain distortion parameters of the light field microscope; and performing correction and remapping based on the obtained distortion parameters. According to the method and the system, the distortion correction precision of the large-view-field light field microscopic image is improved.

The invention relates to a method for providing an overview image of an object to be imaged in light-field microscopy, in which image data of at least one image of a region of the object is detected by means of a detection optics and a detector; and from the image data, reconstructing a plurality of z-planes of the region to be detected in a computational manner, using a portion of the detected image data for reconstruction, and / or reducing the number of z-planes to be reconstructed. A z-section around and above and below the focal plane is defined along the z-direction. A channel is assigned to each z-section, and image data of the structure of the object detected in the respective z-section is stored in correspondence with the respective channel. According to the invention, a control command is generated by the control device, by means of which the output device is controlled, the structure being output in accordance with the associated channel in each case with a different, however, graphic feature specific to the channel. The invention also relates to a light field microscope for carrying out the method according to the invention.

The invention relates to a light-field microscope and a light-field microscopy image capturing method, including the steps of providing an illumination radiation from at least one light source; modulating the illumination radiation by virtue of adjusting the intensity distribution thereof; generating a dynamic light sheet in a sample space, in which a sample to be imaged can be arranged; scanning a region of the sample to be imaged using the light sheet; collecting a detection radiation and detecting image signals using light-field technology. The illumination radiation is modulated by virtue of the light source being controlled and an intensity of the illumination radiation provided by the light source being altered, especially in a controlled fashion over time. Image recordings of the sample are triggered for different positions of the light sheet.

A method provides an overview image of an object in light field microscopy, in which image data of at least one image of a region of the object are acquired by a detection optical unit and a detector and, on the basis of the image data, a number of z planes (Zn) of the region are computationally reconstructed. Z sections (uhF, F, ohF) around and above and below the focal plane (F) are defined in a z direction and a channel is assigned to each of the z sections (Zn) and image data of structures of the object detected in the respective z sections (Zn) are stored assigned to the respective channel. By a controller, control commands by which an output device is activated are generated, the structures being output according to the respectively assigned channels with different, but channel-specific graphical characteristics. A light field microscope carries out the method.

A method for automatically determining whether to perform denoising includes the following steps: S1: scanning a sample using a light field microscopy system to obtain a light field microscopic image containing 4-dimensional information, where the sample is a sample to be 3D reconstructed; S2: rearranging the light field microscopic image to obtain a multi-view rearranged image; S3: calculating a cleanliness score of the multi-view rearranged image; and determining whether to perform denoising process on the multi-view rearranged image, based on the cleanliness score of the multi-view rearranged image.

This invention provides a light field microscopy imaging system based on rare-earth upconversion materials, comprising: a first light source, a second light source, a third light source, a spatial filtering module, a first dichroic mirror, a second dichroic mirror, a third dichroic mirror, an aperture, a multi-channel filtering module, an objective lens, a tube lens, a microlens array, and a sensor. Light of different wavelengths emitted from the first, second, and third light sources is transmitted through the spatial filtering module to the corresponding first, second, and third dichroic mirrors. The first, second, and third dichroic mirrors are spatially aligned and beam-combined through the aperture. The combined three-color light sources are focused into the objective lens to achieve wide-field illumination. The rare-earth upconversion material-labeled sample is excited and transmitted through the multi-channel filtering module to the tube lens to form an image. The microlens array is located at the focal point of the tube lens, and the sensor is located at the focal length of the microlens array for recording the three-color imaging of the sample.

A method for automatically determining whether to perform denoising includes the following steps: S1: scanning a sample using a light field microscopy system to obtain a light field microscopic image containing 4-dimensional information, where the sample is a sample to be 3D reconstructed; S2: rearranging the light field microscopic image to obtain a multi-view rearranged image; S3: calculating a cleanliness score of the multi-view rearranged image; and determining whether to perform denoising process on the multi-view rearranged image, based on the cleanliness score of the multi-view rearranged image.

The invention concerns a method for the provision of transfer functions in the field of light field microscopy, where a sample volume to be imaged is captured using a multitude of partial images (1 bis 12xy) from different angles of capture (Φ) and for which the respective point spread functions (PSF) for the partial images (1 through 12xy) intended for a 3D reconstruction of the sample volume are determined and assigned to the partial images (1 through 12xy).A characteristic is that the partial images (1 through 12xy) are examined for existing symmetries of the optical-technical data they are based on and any found symmetries are captured and stored together with a computation formula. The computation formula makes it possible, starting from a point spread function (PSF) and / or a processed point spread function of a first partial image (1 through 12), to generate corresponding point spread functions (PSF) and / or processed point spread functions of other partial images (2x through 12xy) that are symmetric relative to the first partial image (1 through 12), where the point spread functions (PSF) and the processed point spread functions (PSF), respectively, of the other partial images (2x through 12xy) are only generated if needed and are only stored temporarily. A processed point spread function is obtained by executing at least one mathematical operation on the relevant point spread function. In addition, or alternatively, further symmetric subsets within the transmission function of at least one partial image (1 through 12xy) can be generated based on a first subset of the transmission function of a partial image (1 through 12xy), when and if needed.

Light field microscope-based image acquisition apparatuses and methods are provided. The light field microscope-based image acquisition apparatus includes a lenslet synthesis processing unit configured to acquire a virtual lenslet image using a multi-lenslet image group; a sub-aperture image conversion unit configured to convert the virtual lenslet image generated in the lenslet synthesis processing unit into a sub-aperture image; and a 3D conversion unit configured to convert the sub-aperture image generated in the sub-aperture image conversion unit into a focal-stack image.

A method including the following: a) a light field microscope records at least one image of a sample, said image consisting of a set of partial images, b) at least one aberration of the imaging system of the light field microscope is specified by a user and / or established from a set of partial images recorded in step a), c) one or both of steps d) and e) are performed using the aberrations of the imaging system specified and / or established in step b): d) reconstructing a three-dimensional image of the sample from the set of partial images, wherein the aberrations of the imaging system which are specified and / or established in step b) are at least partially corrected; e) establishing improved settings of adjustable components of the imaging system which influence wavefronts of the propagated light, on the basis of the aberrations specified and / or established in step b). The invention also relates to a microscopy apparatus.

This invention relates to the field of computational optical imaging and microscopic image processing technology, and discloses a method and system for joint reconstruction and denoising of light field microscopy based on self-supervised learning. In the pre-training stage, the method performs random masking operations in the spatial and angular domains on large-scale light field data, guiding the encoder to learn general features through a completion task. In the model training stage, the acquired light field images are randomly divided into input and supervision viewpoints. Features are extracted using the encoder and aligned in three-dimensional space using a physical point spread function. A three-dimensional volume is generated through viewpoint pooling and a decoding network, and a self-supervised loss is established using the supervision viewpoint, achieving implicit denoising based on the independence of noise distribution between viewpoints. In the testing stage, high signal-to-noise ratio three-dimensional reconstruction results can be obtained by inputting all viewpoints. This invention does not rely on noise-free ground truth images, can adapt to different optical system configurations, and improves the reconstruction quality and denoising capability of light field microscopy imaging.

The invention relates to a method for providing an overview image of an object (1) to be imaged in light field microscopy, in which image data of at least one image of an area of ​​the object (1) are acquired by means of a detection optic (3) and a detector (11); and on the basis of the image data a number of z-planes (Zn) of the acquired area are computationally reconstructed. According to the invention, a portion of the acquired image data is used for reconstruction and / or the number of z-planes (Zn) to be reconstructed is reduced. In a z-direction extending towards an optical axis of the detection optics (3), z-segments (uhF, F, ohF) are defined around the focal plane (F) as well as above and below the focal plane (F). Each of the z-segments (Zn) is assigned a channel, and image data of structures (2) of the object (1) detected in the respective z-segments (Zn) are stored and assigned to the respective channel. Control commands are generated by means of a controller (6), which actuates an output device (4), whereby the structures (2) are output with different, but channel-specific, graphic features corresponding to the respective assigned channels. The invention also relates to a light field microscope (5) for carrying out the method according to the invention.

The invention relates to a method for providing transfer functions in light field microscopy, in which a sample volume to be imaged is captured with a plurality of partial images (1 to 12xy) from different acquisition angles (Φ), and the respective point image transfer functions (PSF) are determined for the partial images (1 to 12xy) intended for a 3D reconstruction of the sample volume and are assigned to the partial images (1 to 12xy). A key feature is that the sub-images (1 to 12xy) are examined for existing symmetries in their underlying optical-technical data, and any symmetries found are recorded and stored along with a calculation formula. This formula allows the generation of corresponding point image transfer functions (PSFs) and / or processed point image transfer functions for further sub-images (2x to 12xy) that are symmetrical to the first sub-image (1 to 12), starting from a point image transfer function (PSF) and / or a processed point image transfer function of a first sub-image (1 to 12). The point image transfer functions (PSFs) or the processed point image transfer functions (PSFs) of the further sub-images (2x to 12xy) are generated only when needed and are stored temporarily.A processed point-image transfer function is obtained by subjecting each point-image transfer function to at least one mathematical operation. Additionally or alternatively, if required, symmetric subsets within the transfer function of at least one sub-mapping (1 to 12xy) can be generated from a first subset of the transfer function of that sub-mapping.

The application discloses a snapshot type light field microscope with large depth of field and a preparation method thereof, and belongs to the technical field of photoelectric devices and microscopic imaging, and comprises the following steps: design of a large-depth curved micro-lens array; femtosecond laser direct writing preparation of the curved micro-lens array; assembly and integration of the curved micro-lens array; preparation and image calibration of the snapshot type light field microscope; the method of the application is to replace the plane configuration with the curved micro-lens array to enhance the parallax, and replace the conventional spherical lens with a specially designed lens surface to expand the depth of focus, thus fundamentally solving the baseline limitation problem of the conventional plane micro-lens array, greatly improving the imaging depth of field and depth perception ability of the optical microscope, and retaining the imaging resolution at the level of the diffraction limit. The high-precision preparation of the special function surface curved micro-lens array can be realized by using the femtosecond laser additive manufacturing technology, and the prepared curved micro-lens array is integrated with a commercial objective through a customized mechanical adapter, so that the preparation of the snapshot type light field microscope with large depth of field is finally realized.