30 results about "Light field microscopy" patented technology

A light field microscope incorporating a lenslet array at or near the rear aperture of the objective lens. The microscope objective lens may be supplemented with an array of low power lenslets which may be located at or near the rear aperture of the objective lens, and which slightly modify the objective lens. The result is a new type of objective lens, or an addition to existing objective lenses. The lenslet array may include, for example, 9 to 100 lenslets (small, low-power lenses with long focal lengths) that generate a corresponding number of real images. Each lenslet creates a real image on the image plane, and each image corresponds to a different viewpoint or direction of the specimen. Angular information is recorded in relations or differences among the captured real images. To retrieve this angular information, one or more of various dense correspondence techniques may be used.

Methods and systems are provided for enhancing the imaging resolution of three dimensional imaging using light field microscopy. A first approach enhances the imaging resolution by modeling the scattering of light that occurs in an imaging target, and using the model to account for the effects of light scattering when de-convolving the light field information to retrieve the 3-dimensional (3D) volumetric information of the imaging target. A second approach enhances the imaging resolution by using a second imaging modality such as two-photon, multi-photon, or confocal excitation microscopy to determine the locations of individual neurons, and using the known neuron locations to enhance the extraction of time series signals from the light field microscopy data.

An optical tomography system includes a light field microscope including an objective lens, a computer-controlled light source, a condenser lens assembly and a microlens array aligned along an optical axis. A carrier containing a specimen is coupled to a rotational driver for presenting varying angles of view of the specimen. A photosensor array disposed to receive photons from the objective lens. A computer is linked to control the computer-controlled light source and condenser lens assembly and the rotational driver, and coupled to receive images from the photosensor array where the light field microscope simultaneously captures a continuum of focal planes in the specimen for each of a set of the varying angles of view of the specimen.

The invention discloses a reconstruction method for a microscopic light field body imaging and forward process and back projection acquisition method thereof, and the method comprises the steps: step1, decomposing a 3D body image into layer images, wherein each layer image is composed of a plurality of 2D sub-images, and the pixel value of each 2D sub-image except coordinates (i, j) is zero; step2, extracting pixels at the coordinates (i, j) on each layer image so as to rearrange the pixels into single-channel images, and stacking all the single-channel images into a multi-channel image; step 3, rearranging the 5D point spread function of the light field microscope into a 4D convolution kernel; step 4, taking the multi-channel image obtained in the step 2 as network input of a convolutional neural network, taking the 4D convolution kernel obtained in the step 3 as a weight of the convolutional neural network, carrying out convolution on the multi-channel image by adopting the 4D convolution kernel, and outputting a multi-channel image; and step 5, rearranging the multi-channel image output in the step 4 into a light field image. The convolution calculation speed can be greatly improved, so that the image reconstruction speed is improved.

Methods and systems are provided for enhancing the imaging resolution of three dimensional imaging using light field microscopy. A first approach enhances the imaging resolution by modeling the scattering of light that occurs in an imaging target, and using the model to account for the effects of light scattering when de-convolving the light field information to retrieve the 3-dimensional (3D) volumetric information of the imaging target. A second approach enhances the imaging resolution by using a second imaging modality such as two-photon, multi-photon, or confocal excitation microscopy to determine the locations of individual neurons, and using the known neuron locations to enhance the extraction of time series signals from the light field microscopy data.

A system and method for ophthalmic surgery in which a light field camera is used to capture a digital image of the surgical field including the eye. The digital image is used to create image information and directional information, which is then used to from a three dimensional (3D) image with motion parallax.

The present invention is directed toward the early detection of harmful algal blooms. The system employs the ability of whole cell non-contact micro Raman spectroscopy to detect cell pigmentation in such a way that distinct patterns or fingerprints can be assembled. Light field microscopy will provide a fundamentally innovative increase in image and sample volume. Furthermore, darkfield microscopy is employed to capture high-resolution, color images of the detected plankton to increase the accuracy of species identification and classification. Together, this new instrument will provide a powerful yet elegantly simple solution to detection of HAB cells and characterization of environmental conditions.

The invention discloses a light-field microscope three-dimensional reconstruction method and device based on a deep learning algorithm, wherein the method comprises: building a light-field microscope imaging system; obtaining the point diffusion of the imaging system by simulating the light-field microscope imaging system function; generate a simulated sample volume distribution data set; generate a simulated light field data set through the point spread function and the corresponding sample data, and correct the possible noise and background model; build a deep convolutional neural network to simulate the light field data As the input of the network, the simulated sample body distribution data is used as the output of the network, and the network is trained according to the microscopic sample design loss function; after the model training is completed, the light field microscopic data to be reconstructed is input into the model for testing. Obtain the predicted value of the corresponding sample body distribution data. The method can achieve fast, high-resolution, and less artifact three-dimensional reconstruction of light field data while maintaining the advantage of the light field for fast collection of three-dimensional information.

An optical field microimaging-based micro-scale three dimensional industrial detection system belonging to the machine vision technology field disclosed by the present invention comprises an optical field microcamera system and a data processing system, the optical field microcamera system is composed of an optical field microcamera, an annular light source and a camera calibration plate, and thedata processing system comprises a GPU high-speed image parallel processing unit, an optical field camera-based depth estimation algorithm and an optical filed microscope-based three-dimensional reconstruction algorithm. An optical field imaging technology of the present invention can measure the three-dimensional configurations of the complex objects via a single device and the individual shooting, is very suitable for substituting for a conventional industrial detection camera in the micro-scale measurement, and measures the three-dimensional sizes of the micro-scale objects while simplifying a hardware system and reducing the cost.

The invention provides an optical module used for an optical field microscope. The optical module comprises a microscopic objective and a microlens array arranged on a back focal plane of the microscopic objective, wherein the microlens array comprises a plurality of microlenses, the plurality microlenses are used for projecting real images of a sample under the microscope objective at different viewing angles onto a sensor located on an image plane of the optical field microscope, the plurality of microlenses are divided into at least two microlens groups, all the microlenses in each microlens group have the same optical parameters and axial positions, and the different microlens groups are configured to optically conjugate object planes under the microscope objective at different axial positions to the image plane on which the sensor is located.

The invention discloses a microscopic method based on wide field stimulated emission difference. The method comprises the steps of firstly, carrying out wide field illumination and image formation on a sample, and then forming two beams of vertically polarized light (s light) and two parallel polarized light (p light) by utilizing laser and through two Wollaston prisms; carrying out illumination and image formation on the fluorescent sample by the interference light spot formed by line polarization focus of the four beams of light; carrying out differential treatment on the image obtained under the wide field and the image obtained under the interference light spot like a field emission display (FED), wherein the size of the dark spot is smaller than the diffraction limit, so that the image can be obtained in the dark spot by super-resolution; finally, controlling the interference light spot to move on the sample by a scanning galvanometer to obtain the whole microscopic image of the sample. The invention also discloses a microscopic device based on wide field stimulated emission difference; the device is simple in structure and convenient to operate, and rapid super-resolution microscopic imaging based on wide field stimulated emission difference can be realized, so that the device can be used for the field of optical microscopic imaging.

A microscope imaging optical system has an entrance pupil on an object side and includes, in order from the object side, a first lens group including a biconvex lens and a negative lens having a concave surface on the object side, a second lens group including a negative lens having a concave surface on the object side, and a third lens group including a meniscus lens and a positive lens having a convex surface on an image side. The microscope imaging optical system satisfies conditional expressions 0.05<dp1 / f<0.15 and 0.5<TT / f<0.9, where dp1 is the spacing between a lens, closest to the object, of the first lens group and the entrance pupil, f is the focal length of the microscope imaging optical system, and TT is the distance from the entrance pupil to the object image plane.

This application proposes a correction method and device for a large-field high-resolution light field microscope system, which relates to the technical fields of computer graphics and computer vision, wherein the method includes: collecting light field images at multiple axial positions of the calibration plate ;Collect the white light field image without adding the calibration board; collect the noise image; process the white light field image and the noise image to obtain the light field decoding parameters; use the light field decoding parameters to decode the light field image to obtain 4-dimensional light field data; Imaging system distortion is corrected using 4D light field data corresponding to light field images at multiple axial positions. Using the above scheme, this application utilizes the light field images of calibration plates at different axial positions to realize large field of view light field correction, which alleviates the influence of imaging distortion in the large field of view light field, and improves the results of microscopic three-dimensional reconstruction of large field of view and high resolution light field .

The invention discloses a three-dimensional microscopic imaging method and system based on a light field microscopic system, wherein the method includes: S1, in the optical system, acquiring the first point diffusion of the three-dimensional sample from the object plane to the sensor plane of the main camera function and the second point spread function from the object surface to the secondary camera sensor plane, generate the first forward projection matrix and the second forward projection matrix according to the first point spread function and the second point spread function; S2, acquire the three-dimensional sample in The light field intensity image taken by the main camera in the optical system and the high-resolution intensity image taken by the secondary camera; S3, the light field intensity image and the first forward projection matrix, the high-resolution intensity image and the second The forward projection matrix performs 3D reconstruction to generate a 3D reconstruction result of the 3D sample. In this method, by adding one acquisition optical path, the signal-to-noise ratio of focal plane reconstruction is enhanced under the same number of iterations, and the reconstruction effect of light field microscopic imaging is greatly improved.

A light field microscopy method based on FPM, comprising the steps of: building a light field microscopy platform based on FPM; collecting images with high resolution and wide field of view with the light field microscopy platform based on FPM; The field of view image is separated from the view angle; the result of the view separation is used to refocus to obtain the desired result. The present invention uses a light field microscope based on the FPM algorithm to collect light field information, improves the imaging resolution of each microlens in the light field microscope, improves the angular resolution, thereby enriches the collected light field information, and enables objects to Rebuild better 3D structures.

The invention discloses a method for reconstructing volumetric imaging in a microscopic light field and its forward process and back-projection acquisition method. Composed of 2D sub-images, the pixel value of each 2D sub-image is zero except for coordinates (i, j); step 2, extract the pixels at coordinates (i, j) on each layer image to rearrange into a single channel image, stack all single-channel images into multi-channel images; step 3, rearrange the 5D point spread function of the light field microscope into a 4D convolution kernel; step 4, use the multi-channel images obtained in step 2 as the convolutional neural network Network input, use the 4D convolution kernel obtained in step 3 as the weight of the convolutional neural network, use the 4D convolution kernel to convolve the multi-channel image, and output the multi-channel image; step 5, rearrange the multi-channel image output in step 4 is the light field image. The invention can greatly increase the convolution calculation speed, thereby improving the image reconstruction speed.

The invention provides an optical module used for an optical field microscope. The optical module comprises a microscopic objective and a microlens array arranged on a back focal plane of the microscopic objective, wherein the microlens array comprises a plurality of microlenses, the plurality microlenses are used for projecting real images of a sample under the microscope objective at different viewing angles onto a sensor located on an image plane of the optical field microscope, gaps are reserved between the plurality of microlenses, and the gaps are filled with a light shielding material.

The present application proposes a light field deconvolution method and device in the Fourier domain, which relate to the technical field of computer photography, wherein the method includes: acquiring light field microscopic data, and combining the light field microscopic data through random angles Two-by-two combination is performed to form multiple groups of angle subgroups; multiple groups of angle subgroups are input into the Fourier domain for reconstruction iterative processing to obtain a reconstructed image. Compared with the prior art, the present application combines the obtained light field microscopic data in pairs by means of random angle combination to form multiple sets of angle subgroups, and the formed multiple sets of angle subgroups in the Fourier domain The solution for 3D reconstruction realizes artifact-free reconstruction, reduces computing cost, and speeds up the reconstruction speed of 3D imaging.