82 results about "Coded aperture" patented technology

A pharmaceutical hyperspectral reconstruction method based on a coded aperture snapshot spectral imaging (CASSI) system includes: collecting and processing original pharmaceutical hyperspectral images to obtain augmented pharmaceutical hyperspectral images; performing simulated spatial encoding on the augmented pharmaceutical hyperspectral images to obtain encoded measurement images; performing spectral inverse shift on the encoded measurement images, then performing inverse encoding to obtain inversely encoded three-dimensional hyperspectral images, using the augmented pharmaceutical hyperspectral images as target images, and constructing a training set and a testing set according to the inversely encoded three-dimensional hyperspectral images and the target images; constructing a deep symmetric neural reconstruction network, and training and testing the deep symmetric neural reconstruction network; and deploying a tested deep symmetric neural reconstruction network onto the CASSI system, real-time collecting pharmaceutical measurement images using the snapshot coded imaging system, and performing computational reconstruction on the pharmaceutical measurement images to obtain reconstructed three-dimensional hyperspectral images.

The invention discloses a phase recovery method based on non-interference coding aperture holography, and belongs to the field of computational optical imaging. According to the technology, phase information of an object is directly extracted from a single hologram through a physically-driven numerical optimization framework in combination with Wiener inverse filtering and an improved G-S (Gerchberg-Saxton) algorithm. A frequency domain inverse filter is constructed based on system modeling of a point diffusion hologram, noise interference is effectively suppressed, meanwhile, a historical gradient acceleration strategy is provided, a convergence path is optimized by dynamically adjusting an iteration step length, and the calculation efficiency is improved. The technology has the core advantages that the limitation of a traditional interference light path is broken through, precise optical alignment or multi-time out-of-focus surface data acquisition is not needed, the system architecture is simplified, the environmental adaptability is enhanced, and quantitative phase distribution reconstruction of transparent and weak scattering samples can be realized through single exposure.

The invention provides a polarization camera imaging system based on aperture coding. The polarization camera imaging system comprises an imaging lens, a polarization dimension coding aperture and a polarization detector. The imaging lens comprises a front-group lens and a rear-group lens, the front-group lens is arranged in front of an aperture diaphragm of the imaging lens, and the rear-group lens is arranged behind the aperture diaphragm of the imaging lens; the polarization dimension coding aperture is arranged at an aperture diaphragm of the imaging lens, and the polarization detector is arranged at an image surface of the imaging lens; the front group of lenses consists of a plurality of lenses and is used for transmitting the collected target light information to the polarization dimension coding aperture; the polarization dimension coding aperture is used for modulating the polarization dimension of the incident light; the rear group of lenses consists of a plurality of lenses and is used for collecting target light information modulated by a polarization dimension coding aperture and transmitting the collected signal to a polarization detector; and the polarization detector is used for imaging according to the incident signal of the rear group of lenses, and the system can improve the upper limit of the dynamic range of the imaging camera by inserting a polarization dimension coding aperture at the diaphragm of the lens.

The invention discloses an underwater polarization imaging device and method based on interference-free coded aperture correlation holography, and belongs to the field of computational optical imaging. According to the technical scheme, on the basis of an interference-free coded aperture correlation holographic system, two light paths are utilized, a target object hologram and a point spread function are synchronously collected through cross-polarization double light paths (0 degree and 90 degrees), after target information light is separated out through an underwater polarization imaging model, low-frequency background noise is filtered out through a nonlinear filtering reconstruction algorithm, and the target object hologram and the point spread function are obtained. And the phase-coded high-frequency object structure information is reserved, and the global estimation precision is optimized. According to the method, a complex optical path of traditional polarization imaging is simplified, the influence of local noise on polarization parameters is avoided, the image definition and the signal-to-noise ratio in a turbid underwater environment can be effectively improved, and the method is suitable for high-scattering scenes such as marine resource exploration, underwater robot navigation and military underwater target detection.

The invention provides a hyperspectral image reconstruction method based on ResCNT. The hyperspectral image reconstruction method comprises the following steps: acquiring a compressed two-dimensional measurement value through a coded aperture snapshot spectral imaging system; a ResCNT network is used for reconstruction, the network combines a convolutional layer, a residual module and a Transform structure, a multi-scale learning method is adopted, and a hyperspectral image is effectively recovered from compressed data. In order to enhance the detail recovery capability of the image, multi-residual jump connection is introduced in the method, and the convergence of the network is improved by optimizing a gradient path. In addition, the neighborhood attention module based on the self-attention mechanism dynamically adjusts the pixel weight in the reconstruction process, and local details and global consistency of the image are improved. And finally, training the network through a back propagation algorithm, minimizing an error between a reconstructed image and a real image, and finally realizing high-quality recovery of the hyperspectral image. The method has high detail recovery capability and global consistency, and the performance can be remarkably improved in the image reconstruction process.

The invention discloses a differential compression structured light illumination super-resolution imaging device based on time sequence multiplexing. The differential compression structured light illumination super-resolution imaging device is composed of a light source and beam expanding system, a structured light illumination imaging system, a coding aperture time domain compression imaging system, a time sequence control system and a data processing reconstruction system. According to the invention, the two digital micromirror devices are controlled through a time sequence, and wide-field and structured light compression imaging is realized respectively. In the wide-field mode, the two digital micromirror devices are switched to the total transmission mode, and fluorescence signals of the excitation sample are directly collected by the camera; in a structured light mode, the first digital micro-mirror device generates six time-varying stripe coding patterns, and dynamic space coding of the second digital micro-mirror device is combined, so that a camera obtains a compressed image through single exposure. Through differential processing of a wide field and a compressed image, background noise is suppressed, high-frequency information weight is enhanced, the bottleneck of high-frequency signal offset in traditional compressed imaging is broken through, image reconstruction quality is remarkably improved, and high-fidelity imaging of a high-speed dynamic scene is realized.

The invention provides a coding aperture snapshot spectral imaging system based on orthogonal double chromatic dispersion and a hyperspectral image reconstruction method, and the system obtains horizontal and vertical compression measurement images through the synchronous compression sampling of horizontal and vertical chromatic dispersion channels which are orthogonally arranged and a common spatial modulation mask. The reconstruction method comprises the following steps: in combination with an imaging mathematical model, establishing an optimization equation containing a priori item, constructing a double-color dispersion depth expansion framework (DDDU), and decomposing the optimization equation into a data sub-problem and a priori sub-problem. Data sub-problems are independently optimized through horizontal and vertical dispersion closed solutions, and a dual-channel complementary information structure is kept; according to the prior sub-problem, double-color scatter information fusion Transform (DDIFT) is adopted to carry out joint denoising and feature fusion. And high-fidelity hyperspectral image reconstruction is realized through iterative solution. According to the method, the sampling rate is improved by innovatively combining the orthogonal double-color dispersion channel design, and the imaging and reconstruction performance is improved by effectively utilizing complementary spectral information through an algorithm combining a physical model and deep learning.

Described are embodiments of a multi-layer giga-pixel plenoptic camera that enable three-dimensional (3D) light-field imaging, high resolution and large field-of-view. In embodiments, the camera includes a radiation conversion array layer, an optics array layer, a complementary metal-oxide-semiconductor (CMOS) image sensor array layer, and a memory layer. Depending on the embodiment, the sequence of the radiation conversion array layer and the optics array layer may be reversed, and / or additional isolation layers may be provided between some of the layers. Applications can span the visible light spectrum, and can include ultraviolet (UV) and infrared (IR) spectra. In an embodiment, applications can span x-ray spectra and gamma ray spectra. Radiation converters in the radiation conversion array layer can be filters or scintillation converters. Optics in the optics array layer can be lenses or pinholes and / or coded apertures.

The application discloses a long-wave infrared dynamic space modulation device and method based on double coding apertures, and belongs to the technical field of optics. The application avoids the diffraction effect in the long-wave infrared space modulation process by selecting a large-size coding pixel coding aperture, adopts a double coding aperture space light modulation structure, separately performs space modulation on target light beams, and realizes coding effect superposition through beam combination, so that the space modulation resolution of the large-size coding pixel coding aperture is improved. On the premise of guaranteeing the space modulation resolution requirement and without increasing the coding aperture area, the diffraction effect in the long-wave infrared space modulation process is avoided by selecting the large-size coding pixel coding aperture. The application introduces the use of a displacement table, and the position of the moving coding template is transformed for multiple times within the single information acquisition time of the system, so that the effective coding area in the optical path is transformed, more coding superposition effects are generated, and the coding resolution and the coding gray scale are further improved.

The invention discloses a convolutional neural network sparse reconstruction method for coded aperture imaging and a related device, and the method comprises the steps: carrying out the imaging of a source region, and obtaining an actual coded image; inputting the actual coding image into a trained convolutional neural network model to obtain a preliminary source image; and optimizing the initial source image to obtain a final source image, and the method and the related device can realize image reconstruction quickly and with high precision.

The invention discloses a coding aperture joint optimization method and system of a broadband compression calculation imaging system. According to the coding aperture joint optimization algorithm based on gradient descent, the image reconstruction quality of the two subsystems is improved at the same time by optimizing the pattern of the common coding aperture. A multi-target joint optimization function of a coding aperture is constructed based on a compressed sensing theory so as to minimize column coherence of sensing matrixes of the two subsystems. Reasonable constraint is carried out on the spatial range of a target solution by introducing a quadratic regular term, so that the quantization error of the optimization algorithm is reduced. In addition, coding apertures among different snapshots are optimized, complementation of the coding apertures is realized, and the spatial perception capability of the system is enhanced. By optimizing the pattern form of the coding aperture, high-precision image reconstruction of the target object in the visible light wave band and the short wave infrared wave band can be realized at the same time, so that the detection and identification capability of the target in a complex environment can be improved.

The sensing system includes a focal plane array, a detector dual input circuit, a detector selector circuit, and a selection module. The focal plane array includes a plurality of detectors. The detector dual input circuit combines outputs from the detectors received on a first input channel without using outputs received on a second input channel. The detector selector circuit establishes a first signal path between the detectors and the first input channel and a second signal path between the detectors and the second input channel. The detector selector circuit includes a mask that maps the detectors to a first detector group or a second detector group. Based on the mask assignment, the selection module connects one or more of the detectors to the first signal path to establish the first detector group and connects one or more of the detectors to the second signal path to establish the second detector group.

This invention discloses an end-to-end spectral reconstruction method, comprising the following steps: S1, reconstructing a hyperspectral image; S2, using the obtained hyperspectral image as input to an optimized neural network, training the neural network parameters according to the end-to-end spectral reconstruction model, and calculating the loss function; S3, backpropagating errors to the coding template to be designed, changing the design parameters of the coding template, and continuing to train the model until a high-quality hyperspectral image is reconstructed. By employing the above technical solution, the design of the optical system is combined with the reconstruction method. Based on the coded aperture snapshot system, an adaptive coding template is added according to the end-to-end spectral reconstruction method, replacing the traditional random coding template, thereby improving the quality of spectral reconstruction.

A depth is estimated regardless of an imaging target and an imaging condition. An imaging device with a three-dimensional information measurement function includes: a pattern projection unit including a light source and a pattern forming unit that forms a projection pattern of a light beam; an imaging unit including a lens group including at least one lens, a coded aperture that limits external light passing through the lens group in a predetermined coded pattern, a shutter, and an image sensor; and a depth calculation unit configured to obtain, based on a pattern image imaged by the imaging unit and a known point spread function related to the coded pattern, a depth distribution of an image imaged by the imaging unit.

The invention relates to the technical field of radiation detection, in particular to a coding plate imaging detector which comprises a crystal unit which is of a polyhedral structure, and at least one end face of the crystal unit is of an uneven structure. An opening structure and a closed structure of the coding plate are constructed through the uneven shape of the end face, under the imaging condition, the concave position of the uneven structure does not have sub-pixels correspondingly, the convex position of the uneven structure has sub-pixels correspondingly, whether the sub-pixels arranged on the surface of the uneven structure exist or not correspond to the opening and the closed opening of the coding plate, and an autologous coding plate of the detector is formed. The whole self-coded detector is represented as a three-dimensional sub-pixel array. According to the invention, the three-dimensional position and the deposition energy of the reaction of the rays in the detection medium are obtained through one detector, so that the coding plate imaging detection of the medium and low energy rays can be carried out, the system is simple, and the imaging field of view is expanded. Compton imaging of 360-degree medium-energy and high-energy rays can also be carried out.

The invention discloses a hyperspectral compression imaging method and system, a terminal and a storage medium in the technical field of hyperspectral image processing, and aims to solve the problem of low reconstruction precision caused by loss of high-frequency details, weak spectral correlation and poor anti-noise capability in a compression imaging process in the prior art. The method comprises the following steps: acquiring compression measurement and a sensing mask of a coded aperture snapshot spectral imaging system, and acquiring an initial feature map according to the compression measurement and the sensing mask; inputting the initial feature map into a pre-constructed U-Net model to obtain a decoded feature map; performing convolutional mapping on the decoded feature map, and obtaining a reconstructed hyperspectral image in combination with the initial feature map; according to the method, long-sequence data are efficiently processed through the spectrum-space state synchronizer, local and global features of the image can be effectively captured through multi-scale decomposition of the wavelet variance modulation block, and the problem that reconstruction precision is not high due to loss of high-frequency details, weak spectrum correlation and poor anti-noise capacity in the traditional compression imaging process is solved.

The present invention relates to the field of radiation imaging technology, and discloses a fast radiation imaging system and method integrating optical imaging and coded aperture technology. The system includes a spectral imaging subsystem and a gamma-ray imaging subsystem. Among them, the spectral imaging subsystem and the gamma-ray imaging subsystem share a coded aperture plate. The gamma-ray imaging subsystem further includes a radiation detector, and the spectral imaging subsystem further includes a first lens, a second lens, a dispersion prism, a third lens and a CCD detector. In the direction from the object to be measured towards the radiation detector and the CCD detector, the arrangement order is successively the first lens, the coded aperture plate, the second lens, the dispersion prism and the third lens. The present invention can perform spectral imaging and radiation imaging simultaneously, reduce the system complexity and cost, and improve the working efficiency and safety.

The invention discloses a color image dual encryption method based on orthogonal frequency domain scrambling and phase steganography, and belongs to the technical field of optical information encryption. According to the method, orthogonal frequency domain scrambling and phase steganography are fused, an orthogonal projection-phase reconstruction cross-domain collaborative encryption framework is constructed, and deep fusion of mathematical irreversibility and physical unclonability is realized. In a mathematical encryption layer, designing a high-dimensional orthogonal matrix to perform global linear transformation on RGB three-channel combined two-dimensional discrete cosine transform coefficients, and eliminating correlation between a frequency domain statistical law and the channels; in a physical encryption layer, orthogonal encryption data is coded into a phase image, secondary modulation is carried out through a non-interference coding aperture correlation holographic optical system, spatial domain plaintext information is destroyed by using physical unclonability of speckle noise, and a joint protection mechanism of a mathematical key and a physical key is formed. The method is suitable for scenes with extremely high requirements on encryption strength and anti-attack capability, such as secret communication and medical image security storage.

A depth map generation system generates a depth map based on a plurality of captured images acquired by using an imaging device including a diaphragm unit in which a coded aperture is formed by a liquid crystal panel. The plurality of captured images including at least a first frame, a second frame acquired after acquisition of the first frame, and a third frame acquired after acquisition of the second frame. The depth map generation system includes: a combination unit configured to acquire a combined frame based on the first frame and the third frame; and a depth map generation unit configured to generate a depth map based on the combined frame and the second frame.

The present invention relates to a spectral imaging method based on high-order mathematical modeling and fitting calibration, belonging to the technical field of spectral imaging. An equivalent correction code is set in the established high-order mathematical model, and while implementing the encoding operation, it characterizes the response non-uniformity. Before and after the equivalent correction code of the established high-order mathematical model, a group or multiple groups of two-dimensional convolution kernels are set to comprehensively characterize non-ideal factors such as aberration, pixel mismatch, high-order dispersion, and assembly error, improving the coincidence degree between the mathematical model and the actual projection measurement process. The calibration process of the high-order mathematical model parameters is constructed as an inverse optimization problem, training sample data is collected, and an optimization algorithm is used to solve the constructed optimization problem to complete the calibration of the high-order mathematical model parameters, improving the practicability of the calibration method. After the spectral data cube is modulated by the coded aperture and the dispersion prism, it is imaged onto the detector. Finally, based on the established high-order mathematical model, a reconstruction algorithm is used to reconstruct the spectral image.

A system and method for in vivo tomographic tissue imaging using coded aperture X-ray scatter tomography are disclosed. The imaging system includes a coded aperture for spatially encoding X-ray scatter originating from within a patient. An X-ray detector array records the modulated scatter signal, which is analyzed and used to generate a spatially resolved X-ray scatter spectral reconstruction of the tissue and produce a spatially resolved scatter tissue image of the irradiated tissue.

A multi-modality imaging system allows for selectable photoelectric effect and / or Compton effect detection. The camera or detector is a module with a catcher detector. Depending on the use or design, a scatter detector and / or a coded physical aperture are positioned in front of the catcher detector relative to the patient space. For low energies, emissions passing through the scatter detector continue through the coded aperture to be detected by the catcher detector using the photoelectric effect. Alternatively, the scatter detector is not provided. For higher energies, some emissions scatter at the scatter detector, and resulting emissions from the scattering pass by or through the coded aperture to be detected at the catcher detector for detection using the Compton effect. Alternatively, the coded aperture is not provided. The same module may be used to detect using both the photoelectric and Compton effects where both the scatter detector and coded aperture are provided with the catcher detector. Multiple modules may be positioned together to form a larger camera, or a module is used alone. By using modules, any number of modules may be used to fit with a multi-modality imaging system. One or more such modules may be added to another imaging system (e.g., CT or MR) for a multi-modality imaging system.

The application discloses a kind of based on coding aperture technology and laser radar's radioactive source quantification imaging method, its steps include: 1) using coding aperture gamma camera obtains the coding projection and energy spectrum of radioactive source in target area, and decoding calculation is carried out to coding projection to obtain coding reconstruction image O;2) obtaining the radiation hot spot in image O, generates radiation hot spot image;3) according to energy spectrum, the full energy peak E of radioactive source is identified, and the dose rate at the position where camera is calculated;4) by laser radar, the three-dimensional point cloud information of the target area is acquired, and the optical video information of target area is acquired by optical camera;Then according to azimuth, the pixels in radiation hot spot image, optical video information, three-dimensional point cloud information are matched and fused;5) find the three-dimensional point cloud pixel corresponding to radiation hot spot in fusion map;According to the three-dimensional point cloud pixel corresponding to radiation hot spot, the distance between radiation source and camera is obtained;6) inversion calculation obtains the activity value of radioactive source.

The application relates to the technical field of image processing, and provides a hyperspectral image compression and recovery method and device thereof, the method comprising the following steps: obtaining compressed two-dimensional detection values by using a dual-camera spectral imaging system; the compressed two-dimensional detection values are obtained by spatially modulating incident light through a preset coded aperture mask; inputting the compressed two-dimensional detection values into an initial recovery model to obtain an initial recovery result; the initial recovery model adopts a deep neural network architecture and is used for extracting image features from the compressed two-dimensional detection values to obtain the initial recovery result; inputting the initial recovery result into an optimization model based on an alternating direction multiplier method to obtain a target recovery image; wherein the optimization model introduces non-local low rank, total variation regularization and a depth image priori. The initial recovery result is optimized based on multiple priori information, the authenticity and accuracy of the initial recovery result are significantly improved, and a high-quality image recovery effect is realized.

The invention discloses a perovskite imaging system and method based on high-brightness X-ray light source coupling. The system sequentially comprises a high-performance X-ray radiation source, an optical divergence element, a coding aperture, an object plane, a detector array based on a perovskite material and a processing unit according to a radiation propagation sequence, emitting X-ray radiation by an X-ray radiation source; intercepting X-ray radiation by using an optical diverging element, and generating a diverging beam emitted from the virtual focus; modulating the divergent beam through the coding aperture and irradiating the divergent beam to an object to be imaged; capturing radiation interacted with the object to be imaged by using a detector array to generate a measured value; the processing unit solves the inverse problem of reversely deducing real physical information of the to-be-imaged object from the coding measurement value according to a preset coding aperture pattern, a system forward model and the measurement value, and reconstructs a high-resolution and high-fidelity image of the to-be-imaged object; the imaging effects of high resolution, high sensitivity, low radiation dose and high fidelity can be realized.

A coded sensor gamma imager module includes a scintillation crystal layer for detecting photons and a spatial-encoding sensor element positioned above the scintillation crystal layer. The spatial-encoding sensor element includes scintillator material arranged to form a nonuniform structure in at least one dimension above the scintillation crystal layer providing coded-aperture functionality and having at least one outer edge.

The invention relates to the technical field of image processing, and provides a hyperspectral image compression and recovery method and device, and the method comprises the steps: obtaining a compressed two-dimensional detection value through a dual-camera spectral imaging system; the compressed two-dimensional detection value is obtained by spatially modulating the incident light through a preset coding aperture mask; inputting the compressed two-dimensional detection value into an initial recovery model to obtain an initial recovery result; the initial recovery model adopts a deep neural network architecture and is used for extracting image features from the compressed two-dimensional detection value to obtain an initial recovery result; inputting the initial recovery result into an optimization model based on an alternating direction multiplier method to obtain a target recovery image; wherein non-local low rank, total variation regularization and depth image prior are introduced into the optimization model. According to the method, the initial recovery result is optimized based on multiple prior information, the authenticity and accuracy of the initial recovery result are remarkably improved, and the high-quality image recovery effect is achieved.

The invention relates to a lensless coding lamination quantitative phase imaging system and method, in particular to a lensless coding lamination quantitative phase imaging system and method based on multi-angle illumination. The system comprises a laser light source, a barrel lens and a coding sensor, the laser light source is arranged at the focal plane of the barrel lens and is used for scanning the barrel lens to different transverse positions and generating incident plane waves with different angles; the coding sensor is arranged on an emergent light path of the barrel lens and is used for image acquisition; a coding layer is arranged above the photosensitive surface of the coding sensor; and a sample to be imaged is arranged between the barrel lens and the coding sensor during imaging. According to the method, the problems that low-frequency phase information is lost and quantitative reconstruction of a plurality of 2pi wrapped phase samples is difficult to realize in the traditional quantitative phase imaging technology can be solved; and the system has large field of view, high resolution and quantitative phase imaging capability, and is highly suitable for related applications such as biomedicine, pathological analysis and telemedicine.

The application discloses a method and system for on-chip integrated coded aperture cone-beam computed tomography, and relates to the field of cone-beam computed tomography, comprising: designing a coded mask plate according to the scale of an X-ray image sensor and an expected magnification, and integrating the coded mask plate on the X-ray image sensor; and constructing an on-chip integrated coded aperture X-ray image sensor imaging model. A two-dimensional high-resolution image is obtained by reconstructing a collected two-dimensional coded image through an SCI algorithm, and a three-dimensional high-resolution voxel image is obtained by reconstructing through an FDK algorithm. The application reconstructs a cone-beam computed tomography device, constructs an X-ray imaging model for mapping a two-dimensional image to a three-dimensional space, and can use natural images or X-ray images for training, reconstruct a two-dimensional high-resolution image from a two-dimensional coded image, and finally obtain a three-dimensional high-resolution voxel image through an FDK algorithm. The application has the characteristics of compact structure, high reconstruction quality, good generalization, high robustness and the like.

To provide a lens assembly that enables an encoding aperture is realized using a liquid crystal aperture.SOLUTION: In a lens assembly, a front lens 510 having a first lens is disposed on a first surface side of a liquid crystal diaphragm 600, a rear lens 520 having a second lens is disposed on a second surface side opposite to the first surface side of the liquid crystal diaphragm 600, and the rear lens 520 is stored in a lens barrel 530. The rear lens 520 has an upper surface and a side wall, the side wall of the rear lens 520 is stored in the lens barrel 530, and a liquid crystal diaphragm 600 is disposed on the upper surface of the rear lens 530. The liquid crystal diaphragm 600 may be connected to a flexible wiring board 700 for supplying an electric signal and a power, the side wall of the rear lens 530 may be formed with a notch at a position corresponding to the flexible wiring board 700, and the flexible wiring board 700 may pass through a notch and be drawn out from an upper part of the lens barrel 530.SELECTED DRAWING: Figure 15