58 results about "Coded aperture" patented technology

A pharmaceutical hyperspectral reconstruction method based on a coded aperture snapshot spectral imaging (CASSI) system includes: collecting and processing original pharmaceutical hyperspectral images to obtain augmented pharmaceutical hyperspectral images; performing simulated spatial encoding on the augmented pharmaceutical hyperspectral images to obtain encoded measurement images; performing spectral inverse shift on the encoded measurement images, then performing inverse encoding to obtain inversely encoded three-dimensional hyperspectral images, using the augmented pharmaceutical hyperspectral images as target images, and constructing a training set and a testing set according to the inversely encoded three-dimensional hyperspectral images and the target images; constructing a deep symmetric neural reconstruction network, and training and testing the deep symmetric neural reconstruction network; and deploying a tested deep symmetric neural reconstruction network onto the CASSI system, real-time collecting pharmaceutical measurement images using the snapshot coded imaging system, and performing computational reconstruction on the pharmaceutical measurement images to obtain reconstructed three-dimensional hyperspectral images.

The invention provides a coding aperture snapshot spectral imaging system based on orthogonal double chromatic dispersion and a hyperspectral image reconstruction method, and the system obtains horizontal and vertical compression measurement images through the synchronous compression sampling of horizontal and vertical chromatic dispersion channels which are orthogonally arranged and a common spatial modulation mask. The reconstruction method comprises the following steps: in combination with an imaging mathematical model, establishing an optimization equation containing a priori item, constructing a double-color dispersion depth expansion framework (DDDU), and decomposing the optimization equation into a data sub-problem and a priori sub-problem. Data sub-problems are independently optimized through horizontal and vertical dispersion closed solutions, and a dual-channel complementary information structure is kept; according to the prior sub-problem, double-color scatter information fusion Transform (DDIFT) is adopted to carry out joint denoising and feature fusion. And high-fidelity hyperspectral image reconstruction is realized through iterative solution. According to the method, the sampling rate is improved by innovatively combining the orthogonal double-color dispersion channel design, and the imaging and reconstruction performance is improved by effectively utilizing complementary spectral information through an algorithm combining a physical model and deep learning.

Described are embodiments of a multi-layer giga-pixel plenoptic camera that enable three-dimensional (3D) light-field imaging, high resolution and large field-of-view. In embodiments, the camera includes a radiation conversion array layer, an optics array layer, a complementary metal-oxide-semiconductor (CMOS) image sensor array layer, and a memory layer. Depending on the embodiment, the sequence of the radiation conversion array layer and the optics array layer may be reversed, and / or additional isolation layers may be provided between some of the layers. Applications can span the visible light spectrum, and can include ultraviolet (UV) and infrared (IR) spectra. In an embodiment, applications can span x-ray spectra and gamma ray spectra. Radiation converters in the radiation conversion array layer can be filters or scintillation converters. Optics in the optics array layer can be lenses or pinholes and / or coded apertures.

The application discloses a long-wave infrared dynamic space modulation device and method based on double coding apertures, and belongs to the technical field of optics. The application avoids the diffraction effect in the long-wave infrared space modulation process by selecting a large-size coding pixel coding aperture, adopts a double coding aperture space light modulation structure, separately performs space modulation on target light beams, and realizes coding effect superposition through beam combination, so that the space modulation resolution of the large-size coding pixel coding aperture is improved. On the premise of guaranteeing the space modulation resolution requirement and without increasing the coding aperture area, the diffraction effect in the long-wave infrared space modulation process is avoided by selecting the large-size coding pixel coding aperture. The application introduces the use of a displacement table, and the position of the moving coding template is transformed for multiple times within the single information acquisition time of the system, so that the effective coding area in the optical path is transformed, more coding superposition effects are generated, and the coding resolution and the coding gray scale are further improved.

The sensing system includes a focal plane array, a detector dual input circuit, a detector selector circuit, and a selection module. The focal plane array includes a plurality of detectors. The detector dual input circuit combines outputs from the detectors received on a first input channel without using outputs received on a second input channel. The detector selector circuit establishes a first signal path between the detectors and the first input channel and a second signal path between the detectors and the second input channel. The detector selector circuit includes a mask that maps the detectors to a first detector group or a second detector group. Based on the mask assignment, the selection module connects one or more of the detectors to the first signal path to establish the first detector group and connects one or more of the detectors to the second signal path to establish the second detector group.

This invention discloses an end-to-end spectral reconstruction method, comprising the following steps: S1, reconstructing a hyperspectral image; S2, using the obtained hyperspectral image as input to an optimized neural network, training the neural network parameters according to the end-to-end spectral reconstruction model, and calculating the loss function; S3, backpropagating errors to the coding template to be designed, changing the design parameters of the coding template, and continuing to train the model until a high-quality hyperspectral image is reconstructed. By employing the above technical solution, the design of the optical system is combined with the reconstruction method. Based on the coded aperture snapshot system, an adaptive coding template is added according to the end-to-end spectral reconstruction method, replacing the traditional random coding template, thereby improving the quality of spectral reconstruction.

A depth is estimated regardless of an imaging target and an imaging condition. An imaging device with a three-dimensional information measurement function includes: a pattern projection unit including a light source and a pattern forming unit that forms a projection pattern of a light beam; an imaging unit including a lens group including at least one lens, a coded aperture that limits external light passing through the lens group in a predetermined coded pattern, a shutter, and an image sensor; and a depth calculation unit configured to obtain, based on a pattern image imaged by the imaging unit and a known point spread function related to the coded pattern, a depth distribution of an image imaged by the imaging unit.

The invention discloses a hyperspectral compression imaging method and system, a terminal and a storage medium in the technical field of hyperspectral image processing, and aims to solve the problem of low reconstruction precision caused by loss of high-frequency details, weak spectral correlation and poor anti-noise capability in a compression imaging process in the prior art. The method comprises the following steps: acquiring compression measurement and a sensing mask of a coded aperture snapshot spectral imaging system, and acquiring an initial feature map according to the compression measurement and the sensing mask; inputting the initial feature map into a pre-constructed U-Net model to obtain a decoded feature map; performing convolutional mapping on the decoded feature map, and obtaining a reconstructed hyperspectral image in combination with the initial feature map; according to the method, long-sequence data are efficiently processed through the spectrum-space state synchronizer, local and global features of the image can be effectively captured through multi-scale decomposition of the wavelet variance modulation block, and the problem that reconstruction precision is not high due to loss of high-frequency details, weak spectrum correlation and poor anti-noise capacity in the traditional compression imaging process is solved.

A depth map generation system generates a depth map based on a plurality of captured images acquired by using an imaging device including a diaphragm unit in which a coded aperture is formed by a liquid crystal panel. The plurality of captured images including at least a first frame, a second frame acquired after acquisition of the first frame, and a third frame acquired after acquisition of the second frame. The depth map generation system includes: a combination unit configured to acquire a combined frame based on the first frame and the third frame; and a depth map generation unit configured to generate a depth map based on the combined frame and the second frame.

A multi-modality imaging system allows for selectable photoelectric effect and / or Compton effect detection. The camera or detector is a module with a catcher detector. Depending on the use or design, a scatter detector and / or a coded physical aperture are positioned in front of the catcher detector relative to the patient space. For low energies, emissions passing through the scatter detector continue through the coded aperture to be detected by the catcher detector using the photoelectric effect. Alternatively, the scatter detector is not provided. For higher energies, some emissions scatter at the scatter detector, and resulting emissions from the scattering pass by or through the coded aperture to be detected at the catcher detector for detection using the Compton effect. Alternatively, the coded aperture is not provided. The same module may be used to detect using both the photoelectric and Compton effects where both the scatter detector and coded aperture are provided with the catcher detector. Multiple modules may be positioned together to form a larger camera, or a module is used alone. By using modules, any number of modules may be used to fit with a multi-modality imaging system. One or more such modules may be added to another imaging system (e.g., CT or MR) for a multi-modality imaging system.

The application discloses a kind of based on coding aperture technology and laser radar's radioactive source quantification imaging method, its steps include: 1) using coding aperture gamma camera obtains the coding projection and energy spectrum of radioactive source in target area, and decoding calculation is carried out to coding projection to obtain coding reconstruction image O;2) obtaining the radiation hot spot in image O, generates radiation hot spot image;3) according to energy spectrum, the full energy peak E of radioactive source is identified, and the dose rate at the position where camera is calculated;4) by laser radar, the three-dimensional point cloud information of the target area is acquired, and the optical video information of target area is acquired by optical camera;Then according to azimuth, the pixels in radiation hot spot image, optical video information, three-dimensional point cloud information are matched and fused;5) find the three-dimensional point cloud pixel corresponding to radiation hot spot in fusion map;According to the three-dimensional point cloud pixel corresponding to radiation hot spot, the distance between radiation source and camera is obtained;6) inversion calculation obtains the activity value of radioactive source.

The application relates to the technical field of image processing, and provides a hyperspectral image compression and recovery method and device thereof, the method comprising the following steps: obtaining compressed two-dimensional detection values by using a dual-camera spectral imaging system; the compressed two-dimensional detection values are obtained by spatially modulating incident light through a preset coded aperture mask; inputting the compressed two-dimensional detection values into an initial recovery model to obtain an initial recovery result; the initial recovery model adopts a deep neural network architecture and is used for extracting image features from the compressed two-dimensional detection values to obtain the initial recovery result; inputting the initial recovery result into an optimization model based on an alternating direction multiplier method to obtain a target recovery image; wherein the optimization model introduces non-local low rank, total variation regularization and a depth image priori. The initial recovery result is optimized based on multiple priori information, the authenticity and accuracy of the initial recovery result are significantly improved, and a high-quality image recovery effect is realized.

The invention discloses a perovskite imaging system and method based on high-brightness X-ray light source coupling. The system sequentially comprises a high-performance X-ray radiation source, an optical divergence element, a coding aperture, an object plane, a detector array based on a perovskite material and a processing unit according to a radiation propagation sequence, emitting X-ray radiation by an X-ray radiation source; intercepting X-ray radiation by using an optical diverging element, and generating a diverging beam emitted from the virtual focus; modulating the divergent beam through the coding aperture and irradiating the divergent beam to an object to be imaged; capturing radiation interacted with the object to be imaged by using a detector array to generate a measured value; the processing unit solves the inverse problem of reversely deducing real physical information of the to-be-imaged object from the coding measurement value according to a preset coding aperture pattern, a system forward model and the measurement value, and reconstructs a high-resolution and high-fidelity image of the to-be-imaged object; the imaging effects of high resolution, high sensitivity, low radiation dose and high fidelity can be realized.

A coded sensor gamma imager module includes a scintillation crystal layer for detecting photons and a spatial-encoding sensor element positioned above the scintillation crystal layer. The spatial-encoding sensor element includes scintillator material arranged to form a nonuniform structure in at least one dimension above the scintillation crystal layer providing coded-aperture functionality and having at least one outer edge.

The invention relates to the technical field of image processing, and provides a hyperspectral image compression and recovery method and device, and the method comprises the steps: obtaining a compressed two-dimensional detection value through a dual-camera spectral imaging system; the compressed two-dimensional detection value is obtained by spatially modulating the incident light through a preset coding aperture mask; inputting the compressed two-dimensional detection value into an initial recovery model to obtain an initial recovery result; the initial recovery model adopts a deep neural network architecture and is used for extracting image features from the compressed two-dimensional detection value to obtain an initial recovery result; inputting the initial recovery result into an optimization model based on an alternating direction multiplier method to obtain a target recovery image; wherein non-local low rank, total variation regularization and depth image prior are introduced into the optimization model. According to the method, the initial recovery result is optimized based on multiple prior information, the authenticity and accuracy of the initial recovery result are remarkably improved, and the high-quality image recovery effect is achieved.

The invention relates to a lensless coding lamination quantitative phase imaging system and method, in particular to a lensless coding lamination quantitative phase imaging system and method based on multi-angle illumination. The system comprises a laser light source, a barrel lens and a coding sensor, the laser light source is arranged at the focal plane of the barrel lens and is used for scanning the barrel lens to different transverse positions and generating incident plane waves with different angles; the coding sensor is arranged on an emergent light path of the barrel lens and is used for image acquisition; a coding layer is arranged above the photosensitive surface of the coding sensor; and a sample to be imaged is arranged between the barrel lens and the coding sensor during imaging. According to the method, the problems that low-frequency phase information is lost and quantitative reconstruction of a plurality of 2pi wrapped phase samples is difficult to realize in the traditional quantitative phase imaging technology can be solved; and the system has large field of view, high resolution and quantitative phase imaging capability, and is highly suitable for related applications such as biomedicine, pathological analysis and telemedicine.

The application discloses a method and system for on-chip integrated coded aperture cone-beam computed tomography, and relates to the field of cone-beam computed tomography, comprising: designing a coded mask plate according to the scale of an X-ray image sensor and an expected magnification, and integrating the coded mask plate on the X-ray image sensor; and constructing an on-chip integrated coded aperture X-ray image sensor imaging model. A two-dimensional high-resolution image is obtained by reconstructing a collected two-dimensional coded image through an SCI algorithm, and a three-dimensional high-resolution voxel image is obtained by reconstructing through an FDK algorithm. The application reconstructs a cone-beam computed tomography device, constructs an X-ray imaging model for mapping a two-dimensional image to a three-dimensional space, and can use natural images or X-ray images for training, reconstruct a two-dimensional high-resolution image from a two-dimensional coded image, and finally obtain a three-dimensional high-resolution voxel image through an FDK algorithm. The application has the characteristics of compact structure, high reconstruction quality, good generalization, high robustness and the like.

To provide a lens assembly that enables an encoding aperture is realized using a liquid crystal aperture.SOLUTION: In a lens assembly, a front lens 510 having a first lens is disposed on a first surface side of a liquid crystal diaphragm 600, a rear lens 520 having a second lens is disposed on a second surface side opposite to the first surface side of the liquid crystal diaphragm 600, and the rear lens 520 is stored in a lens barrel 530. The rear lens 520 has an upper surface and a side wall, the side wall of the rear lens 520 is stored in the lens barrel 530, and a liquid crystal diaphragm 600 is disposed on the upper surface of the rear lens 530. The liquid crystal diaphragm 600 may be connected to a flexible wiring board 700 for supplying an electric signal and a power, the side wall of the rear lens 530 may be formed with a notch at a position corresponding to the flexible wiring board 700, and the flexible wiring board 700 may pass through a notch and be drawn out from an upper part of the lens barrel 530.SELECTED DRAWING: Figure 15

Regarding tomography, more radiation is detected. To detect a large number of radiations and provide better resolution than that provided by a parallel hole collimator, the collimator is replaced by an attenuator having outer and inner edges. Instead of forcing directivity, large holes having different shapes are used to enable detection of more radiation. By operating the attenuator, differences in shadows on the sensor are used as time-coded apertures to reconstruct the radiation source with higher resolution and sensitivity than when a fixed parallel hole collimator is used.

The present invention addresses the problem of reducing the weight of a head-mounted display to lower its cost. A head-mounted display system (100) includes: a lens; a coded aperture that narrows external light passing through the lens, to a predetermined coded pattern through a liquid crystal panel; a camera (14) having an image sensor; a depth calculation unit (20) that obtains the depth distribution of an image, which is captured by the camera (14), from the image and a known blur function related to the coded pattern; a stereoscopic image generation unit (21) that generates, on the basis of the image and the depth distribution, an image for a right eye and an image for a left eye; and a stereoscopic display (13) that displays the image for the right eye and the image for the left eye such that the images correspond to the wearer's right and left eyes, respectively.

The application provides an image reconstruction method, system and medium of a compressive sensing lens based on a coded aperture, the method comprising: acquiring an original scene image, performing projection modulation to obtain an image received by a sensor; constructing a sensing matrix and a projection matrix, mapping a transfer function of a mask based on the sensing matrix, performing spatial coding sampling on the image received by the sensor through the projection matrix to obtain a compressed measurement result; constructing a deep learning reconstruction network, processing the compressed measurement result based on the deep learning reconstruction network to obtain a two-dimensional feature map; capturing different subspace information based on the two-dimensional feature map through a multi-head attention mechanism, restoring the image resolution based on the different subspace information, and outputting a reconstructed image; and using the mask to realize physical compression, greatly reducing the data acquisition amount, restoring information through the deep learning reconstruction network, improving the image reconstruction efficiency and sensing quality, and adapting to multiple scene environments.

The application discloses a hyperspectral compression imaging method, system, terminal and storage medium in the technical field of hyperspectral image processing, and aims to solve the problem of low reconstruction accuracy caused by high-frequency detail loss, weak spectral correlation and poor noise resistance in the compression imaging process in the prior art. It comprises obtaining the compression measurement and the perception mask of the coded aperture snapshot spectral imaging system, obtaining the initial feature map according to the compression measurement and the perception mask; inputting the initial feature map into the pre-constructed U-Net model to obtain the decoding feature map; and performing convolution mapping on the decoding feature map to obtain the reconstructed hyperspectral image in combination with the initial feature map; the spectral-space state synchronizer efficiently processes long sequence data, and the wavelet variance modulation block can effectively capture the local and global features of the image through multi-scale decomposition, thereby solving the problem of low reconstruction accuracy caused by high-frequency detail loss, weak spectral correlation and poor noise resistance in the traditional compression imaging process.

The application discloses a hyperspectral snapshot compressive imaging reconstruction and classification integrated method and system, which comprises a training stage and a test stage: in the training stage, a compressed measurement map is generated by using a hyperspectral image and coded aperture mask information, and a training sample composed of the compressed measurement map and a corresponding multi-label vector is constructed; the compressed measurement map is input into an end-to-end network composed of a shared feature encoder, an image reconstruction branch and a multi-scale fusion classification branch, and a joint loss function with dynamic weights is used to learn network parameters; in the test stage, the compressed measurement map collected by a snapshot compressive imaging system is input into the trained network, and a multi-label ground object classification result is directly output. Compared with a serial scheme of first reconstruction and then classification, the application reduces repeated calculation and parameter size, reduces inference delay, improves remote sensing interpretation efficiency, and is suitable for fast ground object identification scenes.

An imaging system module includes a first lens, a second lens disposed on an optical axis of the first lens, a liquid crystal panel disposed between the first lens and the second lens, and a cylindrical member having a cylindrical shape and supporting the first lens, the second lens, and the liquid crystal panel inside a cylinder. The liquid crystal panel is controlled externally to form an aperture having a designated pattern such as a coded aperture. A panel surface of the liquid crystal panel has an N-polygonal shape or a circular shape. Here, N is a natural number greater than four.

The present application relates to the technical field of nuclear power plant radiation monitoring, and particularly relates to a nuclear power plant radiation heat source three-dimensional visualization method, aiming at the problems of low positioning efficiency of radiation hot spots in complex scenes and high-precision scanning of laser radar in multi-modal data fusion in the prior art, the present application synchronously collects three-dimensional point cloud and radiation image data through laser radar and coded aperture gamma camera, realizes accurate alignment of cross-modal data by using a feature point coordinate system transformation algorithm, fuses optical images, radiation intensity and three-dimensional space depth information, and generates a three-dimensional visualized scene with color gradient. The method can present the position, distribution and environmental relationship of the radiation hot spot in real time, and the positioning accuracy reaches millimeter level, and is suitable for complex scenes such as dense pipelines. The present application solves the defects of high dependence on the precision of a single device and insufficient real-time performance of the traditional scheme, and provides efficient and intuitive technical support for safe operation of nuclear power.

The application discloses a kind of training-free snapshot photometric stereo vision methods based on spectral compression imaging, comprising: (1) setting multiple different wavelength monochromatic light sources to simultaneously irradiate object from different directions, form high-dimensional spectral-angle data cube;(2) the spectral-angle data cube is modulated in space by coded aperture, along the spectrum dimension is sheared translation by using optical dispersion element, finally integrates on single-channel image sensor, generates single two-dimensional gray compressed measurement image;(3) inverse problem model is constructed, and multiple illumination image sequence is decoupled and recovered from single two-dimensional gray compressed measurement image using iterative optimization algorithm based on physical drive;(4) the surface normal map of the measured object is predicted by inputting multiple illumination image sequence into pre-trained photometric stereo vision network module.The application can realize low-cost, high data efficiency and high physical fidelity three-dimensional reconstruction by single snapshot.

The present disclosure relates to the technical field of material test apparatuses, and in particular to an X-ray reciprocal space multi-scale imaging system. An X-ray collimation and grating integration device is configured to modulate a cone beam X-ray to obtain a fan beam X-ray; a grating device is configured to perform preliminary modulation on an X-ray small-angle scattering signal generated after the fan beam X-ray irradiates a sample under test; a grating and coded aperture integration device is provided with a third grating and coded apertures, and the third grating is configured to modulate the preliminarily modulated X-ray small-angle scattering signal again to obtain a modulated X-ray small-angle scattering signal; the coded apertures are configured to modulate X-ray diffraction signals generated after the fan beam X-ray irradiates said sample to obtain modulated X-ray diffraction signals; and a detector is configured to receive the modulated X-ray small-angle scattering signal and the modulated X-ray diffraction signals. According to the present disclosure, integrated and automated tomography of a sample under test is realized, and the crystal structure and mesoscale information of internal voxels can be efficiently obtained.

A multi-modality imaging system allows for selectable photoelectric effect and / or Compton effect detection. The camera or detector is a module with a catcher detector. Depending on the use or design, a scatter detector and / or a coded physical aperture are positioned in front of the catcher detector relative to the patient space. For low energies, emissions passing through the scatter detector continue through the coded aperture to be detected by the catcher detector using the photoelectric effect. Alternatively, the scatter detector is not provided. For higher energies, some emissions scatter at the scatter detector, and resulting emissions from the scattering pass by or through the coded aperture to be detected at the catcher detector for detection using the Compton effect. Alternatively, the coded aperture is not provided. The same module may be used to detect using both the photoelectric and Compton effects where both the scatter detector and coded aperture are provided with the catcher detector. Multiple modules may be positioned together to form a larger camera, or a module is used alone. By using modules, any number of modules may be used to fit with a multi-modality imaging system. One or more such modules may be added to another imaging system (e.g., CT or MR) for a multi-modality imaging system.

The invention provides a multimode iterative reconstruction method and device, and relates to the technical field of nuclear radiation detection. The method comprises the following steps: acquiring event information of interaction between gamma photons and a three-dimensional position sensitive semiconductor detection unit in a panoramic gamma camera system; based on the prior energy, the Compton scattering event count in the event information and the photoelectric absorption event count in the event information, obtaining an information amount, and calculating a weight according to the information amount; compton sequence reconstruction is carried out based on prior energy, and a multimode system transmission matrix is constructed according to the reconstructed Compton sequence; and performing multi-mode iteration reconstruction based on the weight and the multi-mode system transmission matrix, outputting a stable high signal-to-noise ratio image, and determining the spatial distribution of the radioactive source. According to the multi-mode iteration reconstruction method based on the coding aperture combined with the Compton and non-collimation technology, the problems that in traditional multi-mode gamma imaging, the reconstruction resolution ratio is poor, and the imaging signal-to-noise ratio is unstable are solved, and the imaging energy range, the imaging view field and the resolution ratio are effectively improved.