Multi-aperture imaging detection device and method for moving target in low-illumination environment
Through multi-aperture imaging mode and image processing technology, the problem of low signal-to-noise ratio and resolution of detection imaging in low illumination environments is solved, and high resolution and large field of view are achieved in low illumination environments are taken into consideration, thereby improving target detection Accuracy.
Patent Information
- Application Number
- CN202410999694.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-24
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2044-07-24
AI Technical Summary
Existing detection and imaging devices are difficult to effectively image in low illumination environments, especially in motion target detection, and cannot meet the detection requirements throughout the day, especially in the morning and evening and star-level environments.
Using multi-aperture imaging mode, K sub-aperture cameras are arranged side by side, and the parallel optical path mode and stitching mode are switched by the mode switching control unit to realize synchronous exposure and image stitching, and combining the image processing unit for denoising, enhancement, cloud detection and super resolution. Reconstruct and obtain high-resolution images.
Solve the contradiction between large field of view and high resolution in low-illumination environments, improve the target detection accuracy, improve image clarity and signal-to-noise ratio, and avoid loss of moving targets. It is suitable for day and night in low-illumination environments. Detection.
Smart Images

Figure CN118945465A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of aerospace optical multi-aperture imaging, and in particular to a multi-aperture imaging detection device and method for moving targets in a low-illumination environment. Background Art
[0002] Space remote sensing optical detector technology provides a new means of detecting targets from a bird's-eye view of space. In particular, with the improvement of optical platforms and detector capabilities, remote sensing satellites can achieve short-term multi-frame continuous shooting, which makes super-phase technology possible. The concept of super-phase can be traced back to Amit Kumar's monograph "Surface Classification Method Based on Super-Phase Images" published in 2011. The book defines that images with a revisit period of less than 1 day are called super-phase images. Therefore, using the continuous shooting mode of remote sensing satellites, multiple low-resolution images with high overlap rates can be obtained in a short time (minutes or even seconds). The image reconstruction is performed using different high-frequency component information in multiple frames of images to further improve the ground spatial resolution and imaging quality of the camera, thereby improving the accuracy of target detection.
[0003] However, most existing detection imaging devices use single-aperture remote sensing detectors. Based on single-aperture remote sensing detectors, an algorithm that combines image quality improvement and target detection can improve the detection accuracy of targets, and has achieved good results in the detection of stationary targets and slowly moving targets. However, when the target moves faster, this method will cause the loss of the moving target.
[0004] At the same time, single visible light detection cannot meet the needs of all-day detection, especially the detection of targets under conditions of dawn and dusk and starlight. Compared with visible light detectors, low-light detectors have obvious advantages for nighttime environment detection. Low-light imaging technology can convert near-infrared radiation, extremely weak starlight and other scene images into visible light images with enhanced brightness through low-light detectors through spectral and photoelectric conversion, which can extend the effective working time of optical remote sensors. However, even with low-light imaging technology, the resulting image will still have problems of low signal-to-noise ratio and low resolution in a weak light environment.
[0005] Therefore, there is an urgent need for a detection method that can meet the requirements of low-light detection. Summary of the invention
[0006] In order to solve the technical problems existing in the above-mentioned prior art, the purpose of the present invention is to provide a multi-aperture imaging detection device and method for moving targets in a low-light environment, which adopts a multi-aperture imaging mode and utilizes a number of smaller aperture subsystems arranged in an array in a certain form to collect light beams emitted by distant objects, and can obtain multiple time-lapse images in one exposure. At the same time, based on the characteristics of simultaneous exposure of multi-aperture imaging, by using two modes of simultaneous imaging of multiple optical apertures in a parallel light path mode and splicing sub-images, the contradiction between large field of view and high resolution can be solved.
[0007] To achieve the above-mentioned object of the invention, the present invention provides a multi-aperture imaging detection device for moving targets in a low-light environment, comprising:
[0008] K sub-aperture cameras are arranged side by side in a 1×K configuration, where K is an odd number;
[0009] An imaging unit, equipped with a low-light detection chip, for acquiring images;
[0010] A synchronous exposure control unit, used for controlling the synchronous exposure of the K sub-aperture cameras;
[0011] A mode switching control unit, used for controlling the switching of imaging modes of the K sub-aperture cameras, wherein the imaging modes include a parallel light path mode and a stitching mode;
[0012] Image processing unit, used to obtain high-resolution images and target information.
[0013] According to a technical solution of the present invention, the image processing unit at least includes an image stitching unit, an image denoising and enhancement unit, a cloud detection and fusion unit, a target detection unit and a super-resolution reconstruction unit.
[0014] According to a technical solution of the present invention, the image stitching unit is used to stitch images acquired by sub-apertures;
[0015] The image denoising and enhancement unit is used to denoise and enhance the spliced image;
[0016] The cloud detection and fusion unit is used to perform cloud detection and fusion removal on the denoised and enhanced image;
[0017] The target detection unit is used to perform target detection on the image after the cloud detection and fusion removal processing;
[0018] The super-resolution reconstruction unit is used to obtain a high-resolution image containing the target and obtain target information.
[0019] According to one aspect of the present invention, an imaging detection method is proposed using a multi-aperture imaging detection device for moving targets in a low-illuminance environment as described in any of the above technical solutions. The detection mode is determined based on the current illumination to obtain target information. The detection mode includes daytime detection and nighttime detection.
[0020] According to a technical solution of the present invention, the night detection comprises the following steps:
[0021] Step S101, using a parallel light path mode to obtain a first time series remote sensing image taken by K sub-aperture cameras at the same time;
[0022] Step S102: Detect moving targets based on the K first time series remote sensing images to obtain target information.
[0023] According to a technical solution of the present invention, the daytime detection comprises the following steps:
[0024] Step S201, using a stitching mode to obtain a plurality of second time series remote sensing images;
[0025] Step S202: detecting moving targets based on the plurality of second time series remote sensing images;
[0026] Step S203, using a mode switching control unit to switch from the splicing mode to the parallel light path mode, and then sequentially executing the steps S101 and S102.
[0027] According to a technical solution of the present invention, in step S201, K apertures acquire K×J pieces of the second time series remote sensing images, and the resolution of the sub-aperture is M×N, where K is an odd number and J represents different moments.
[0028] According to a technical solution of the present invention, the step S202 specifically includes:
[0029] The image stitching unit is used to stitch the second time series remote sensing images acquired at the K apertures at the J moment based on the sub-aperture camera position to obtain a j-th image. i The second stitched image at time t has a resolution of M×(K×N-(K-1)t), where t is the length of the overlapping area and j=1,2,…,J;
[0030] Using the image denoising and enhancement unit to perform image denoising and image enhancement processing on the J second stitched images;
[0031] Using the cloud detection and fusion unit to perform cloud detection and fusion removal on the denoised and enhanced images to obtain a sequence of remote sensing images after cloud removal;
[0032] Based on J cloud-removed sequence remote sensing images, feature analysis is performed on the target and the target is extracted.
[0033] According to a technical solution of the present invention, the degradation model of the super-resolution reconstruction unit is used to reconstruct the original high-resolution image z, and the degradation model is expressed as:
[0034] g k =τDH k M k z+n k ,k=1,...,K
[0035] Among them, g k is the observed low-resolution image of the kth sub-aperture camera; τ represents the integration factor; D represents the downsampling matrix; H k represents a block circulant matrix used to represent the blur degradation process, including at least blur caused by defocus, motion blur or optical system transfer function; M k is a matrix representing the position dislocation and geometric deformation of the kth image relative to the reference image, M k is a constant; z is the original high-resolution image; n k represents additive noise; Q is the number of low-resolution images.
[0036] According to a technical solution of the present invention, the degradation model is solved by minimizing the objective function, and then:
[0037]
[0038] Using the maximum a posteriori probability method to solve formula (1), we have:
[0039]
[0040] Among them, θ is the prior model parameter, λ is the weight parameter;
[0041] The reconstruction method based on Huber Markov random field model is used to solve formula (2) to obtain a high-resolution image containing the target.
[0042] Compared with the prior art, the present invention has the following beneficial effects:
[0043] The present invention discloses a multi-aperture imaging detection device and an imaging detection device and method for moving targets in a low-illuminance environment. K sub-aperture cameras are arranged side by side, and a mode switching control unit is used to control the switching of the K sub-aperture cameras between a parallel light path mode and a stitching mode. When the stitching mode is used, the detection range can be expanded to achieve large field of view detection. When the parallel light path mode is used, high-resolution imaging is achieved through a synchronous exposure control unit, so that a high-resolution image of the target is obtained by using super-resolution technology, which solves the contradiction between a large field of view and a high resolution, and can take into account a large field of view while improving the resolution.
[0044] The use of multi-aperture high-resolution imaging mode can solve the problem that traditional super-resolution technology uses multiple frames of continuous images to improve quality while causing the loss of moving targets, thereby improving the detection accuracy of targets.
[0045] It adopts multi-aperture imaging mode and based on the image characteristics of the weak light detection chip, the image processing unit is equipped with a multi-frame image quality improvement algorithm that is synchronously exposed at the same time to improve image clarity and signal-to-noise ratio. It can also image in low-light environments and solve the problems of low signal-to-noise ratio and clarity faced by weak light imaging. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0047] Figure 1 A flowchart schematically showing an imaging detection method implemented by a multi-aperture imaging detection device for a moving target in a low-light environment according to an embodiment of the present invention;
[0048] Figure 2 A schematic diagram of a large field of view imaging mode of a multi-aperture imaging detection device for a moving target in a low illumination environment according to an embodiment of the present invention;
[0049] Figure 3 A schematic diagram of a high-resolution imaging mode of a multi-aperture imaging detection device for a moving target in a low-light environment according to an embodiment of the present invention;
[0050] Figure 4 A schematic diagram schematically shows a multi-aperture imaging detection device for a moving target in a low-illumination environment according to an embodiment of the present invention. DETAILED DESCRIPTION
[0051] The description of the embodiments of this specification should be combined with the corresponding drawings, which should be considered as part of the complete specification. In the drawings, the shape or thickness of the embodiments may be enlarged and indicated for simplification or convenience. Furthermore, the parts of each structure in the drawings will be described separately. It is worth noting that the elements not shown in the drawings or not described in words are in a form known to ordinary technicians in the relevant technical field.
[0052] The description of the embodiments herein and any reference to directions and orientations are only for the convenience of description and are not to be construed as any limitation on the scope of protection of the present invention. The following description of the preferred embodiments may involve combinations of features, which may exist independently or in combination, and the present invention is not particularly limited to the preferred embodiments. The scope of the present invention is defined by the claims.
[0053] like Figures 1 to 4 As shown, a multi-aperture imaging detection device for a moving target in a low-light environment of the present invention comprises:
[0054] K sub-aperture cameras are arranged side by side in a 1×K configuration, where K is an odd number;
[0055] The imaging unit consists of a CMOS detection chip and a lens, and is used to acquire images;
[0056] A synchronous exposure control unit, used for controlling the synchronous exposure of the K sub-aperture cameras;
[0057] A mode switching control unit, used for controlling the switching of imaging modes of the K sub-aperture cameras, wherein the imaging modes include a parallel light path mode and a stitching mode;
[0058] Image processing unit, used to obtain high-resolution images and target information.
[0059] By arranging K sub-aperture cameras side by side, a mode switching control unit is used to control the switching of the K sub-aperture cameras between a parallel light path mode and a stitching mode. When the stitching mode is adopted, the detection range can be expanded to achieve large field of view detection. When the parallel light path mode is adopted, high-resolution imaging is achieved through a synchronous exposure control unit, so that a high-resolution image of the target is obtained by using super-resolution technology, and the contradiction between a large field of view and high resolution is resolved. The large field of view can be taken into account while the resolution is improved.
[0060] The use of multi-aperture high-resolution imaging mode can solve the problem that traditional super-resolution technology uses multiple frames of continuous images to improve quality while causing the loss of moving targets, thereby improving target detection accuracy.
[0061] It adopts multi-aperture imaging mode and based on the image characteristics of the weak light detection chip, the image processing unit is equipped with a multi-frame image quality improvement algorithm that is synchronously exposed at the same time to improve image clarity and signal-to-noise ratio. It can also image in low-light environments and solve the problems of low signal-to-noise ratio and clarity faced by weak light imaging.
[0062] Among them, the mode switching control unit can use large-area fast-reflection mirror cascade splicing technology or relay switches to control the switching of parallel light path mode and splicing mode.
[0063] In some embodiments of the present invention, the image processing unit includes at least an image stitching unit, an image denoising and enhancement unit, a cloud detection and fusion unit, a target detection unit and a super-resolution reconstruction unit.
[0064] Wherein, the image stitching unit is used to stitch the images acquired by the sub-apertures;
[0065] The image denoising and enhancement unit is used to denoise and enhance the spliced image;
[0066] The cloud detection and fusion unit is used to perform cloud detection and fusion removal on the denoised and enhanced image;
[0067] The target detection unit is used to perform target detection on the image after the cloud detection and fusion removal processing;
[0068] The super-resolution reconstruction unit is used to obtain a high-resolution image containing the target and obtain target information.
[0069] According to one aspect of the present invention, an imaging detection method is proposed using a multi-aperture imaging detection device for moving targets in a low-illuminance environment as described in any of the above technical solutions. The detection mode is determined based on the current illumination to obtain target information. The detection mode includes daytime detection and nighttime detection.
[0070] Based on the current illumination (light intensity), determine whether the current illumination is low illumination. In the low illumination state, select the night detection mode, otherwise, select the daytime detection mode.
[0071] During daytime detection, the mode switching control unit is first used to adopt the stitching mode, which can expand the detection range and realize large field of view detection. After determining the target, the mode switching control unit is used to switch to the parallel light path mode, and the synchronous exposure control unit is used to achieve high-resolution imaging to obtain target information; in night mode, the mode switching control unit is used to directly adopt the parallel light path mode, and the synchronous exposure control unit is used to achieve high-resolution imaging to detect the target and obtain target information.
[0072] For example, the sub-aperture camera array of the multi-aperture imaging detection device is 512×1024 in size, the sub-apertures are arranged in a row in a 1×5 configuration, and the overlapping area between the sub-apertures is 100.
[0073] In some embodiments of the present invention, the nighttime detection comprises the following steps:
[0074] Step S101, using a parallel light path mode to obtain a first time series remote sensing image taken by K sub-aperture cameras at the same time;
[0075] Step S102: Detect moving targets based on the K first time series remote sensing images to obtain target information.
[0076] During nighttime detection, the high-resolution mode of the multi-aperture camera is directly used to obtain a high-resolution image z. Target detection is performed based on the acquired sequence of high-resolution images z to obtain target information. The background image can be eliminated by using the correlation of multiple frames of images, and the moving objects in the air can be separated from the ground background based on the background registration principle. Clustering analysis, template matching and other methods are used to further extract the target of interest from the moving objects. For example, a similarity learning method is used to classify pixels with high similarity into one category by aggregation means, and then the accumulated value or mean estimation method of this category is used to detect whether the samples of this category are the target of interest.
[0077] Directly using the high-resolution mode in night mode can avoid the problem of low target detection rate due to low signal-to-noise ratio, thereby improving detection accuracy and solving the problems of low signal-to-noise ratio and clarity faced by weak light imaging.
[0078] In some embodiments of the present invention, the daytime detection comprises the following steps:
[0079] Step S201, using a stitching mode with the characteristic of large field of view detection to obtain a plurality of second time series remote sensing images;
[0080] K apertures are used to obtain K×J pieces of the second time series remote sensing images, and the resolution of the sub-aperture is M×N, where K is an odd number and J represents different moments. Figure 2 As shown, 5×J second time series remote sensing images are obtained, and the sub-aperture resolution is 512×1024.
[0081] For the subaperture in j 1 The acquired images are stitched, and the length of the overlapping area is 100, so the resolution of the stitched image is 512×(5×1024-400), that is, 512×4720.
[0082] Step S202, detecting a moving target based on the plurality of the second time series remote sensing images, specifically includes:
[0083] The image stitching unit is used to stitch the second time series remote sensing images acquired at the K apertures at the J moment based on the sub-aperture camera position to obtain a j-th image. i The second stitched image at time t has a resolution of M×(K×N-(K-1)t), where t is the length of the overlapping area and j=1,2,…,J;
[0084] Using the image denoising and enhancement unit to perform image denoising and image enhancement processing on the J second stitched images, including: obtaining j 2 , j 3 , …, j J images, assuming J = 8, perform image denoising and image enhancement on the obtained images to preliminarily improve the image quality. A low-illumination image enhancement method based on the Retinex model is selected, and constraints are imposed on the illumination component and reflection component of the image. The objective function is solved by the optimization method.
[0085] The cloud detection and fusion unit is used to perform cloud detection and fusion removal on the denoised and enhanced images to obtain a sequence of remote sensing images after cloud removal, including:
[0086] The obtained images are subjected to cloud detection and fusion removal. A method based on the U-Net network model is used to map the remote sensing image with clouds into a cloud-free image and a cloud map. The Robust Principal Component Analysis (RPCA) method is used to utilize the sparsity characteristics of clouds due to dynamic changes in time series and combine the cloud detection results of the U-Net deep learning model to achieve cloud removal.
[0087] Performing feature analysis on the target based on J cloud-removed sequence remote sensing images and extracting the target, including: performing spatiotemporal feature analysis on the target based on J cloud-removed sequence remote sensing images and extracting the target, eliminating the background image by using the correlation of multiple frames of images, separating the aerial moving object from the ground background based on the background registration principle, and further extracting the target of interest from the moving object by using cluster analysis, template matching and other methods, such as using a similarity learning method, using aggregation means to classify pixels with high similarity into one category, and then using the cumulative value or mean estimation method of this category to detect whether the sample of this category is the target of interest;
[0088] Step S203, using a mode switching control unit to switch from the splicing mode to the parallel light path mode, and then sequentially executing the steps S101 and S102.
[0089] During daytime detection, the large field of view mode is first used to detect moving targets, and then the mode is switched (if no moving target is detected, the mode is not switched), and the high-resolution mode is used to obtain target information and improve detection accuracy.
[0090] In some embodiments of the present invention, in step S102, the degradation model of the super-resolution reconstruction unit is used to reconstruct the original high-resolution image z, and the degradation model is expressed as:
[0091] g k =τDH k M k z+n k ,k=1,...,K
[0092] Among them, g k is the observed low-resolution image of the kth sub-aperture camera; τ represents the integration factor; D represents the downsampling matrix; H k represents a block circulant matrix used to represent the blur degradation process, including at least blur caused by defocus, motion blur or optical system transfer function; M k is a matrix representing the position dislocation and geometric deformation of the kth image relative to the reference image, M k is a constant; z is the original high-resolution image; n k represents additive noise; Q is the number of low-resolution images.
[0093] In some embodiments of the present invention, in step S102, the degradation model is solved by minimizing the objective function, and then:
[0094]
[0095] Using the maximum a posteriori probability method to solve formula (1), we have:
[0096]
[0097] Among them, θ is the prior model parameter, λ is the weight parameter;
[0098] P represents probability. The reconstruction method based on Huber Markov random field model is used to solve formula (2) to obtain a high-resolution image containing the target.
[0099] The present invention discloses a multi-aperture imaging detection device and method for moving targets in a low-light environment. K sub-aperture cameras are arranged side by side, and a mode switching control unit is used to control the switching of the K sub-aperture cameras between a parallel light path mode and a stitching mode. When the stitching mode is used, the detection range can be expanded to achieve large field of view detection. When the parallel light path mode is used, high-resolution imaging is achieved through a synchronous exposure control unit, so that a high-resolution image of the target is obtained by using super-resolution technology, which solves the contradiction between a large field of view and a high resolution, and can take into account a large field of view while improving the resolution.
[0100] The use of multi-aperture high-resolution imaging mode can solve the problem that traditional super-resolution technology uses multiple frames of continuous images to improve quality while causing the loss of moving targets, thereby improving the detection accuracy of targets.
[0101] It adopts multi-aperture imaging mode and based on the image characteristics of the weak light detection chip, the image processing unit is equipped with a multi-frame image quality improvement algorithm that is synchronously exposed at the same time to improve image clarity and signal-to-noise ratio. It can also image in low-light environments and solve the problems of low signal-to-noise ratio and clarity faced by weak light imaging.
[0102] The imaging mechanism of a multi-aperture structure is used to solve the motion blur problem caused by the long integration time of a single aperture. The imaging detection device of the present application collects light beams emitted by distant objects using several smaller aperture subsystems arranged in an array in a certain form, and obtains multiple images through a single exposure, thereby observing rapidly changing targets.
[0103] The above shows and describes the basic principles, main features and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited by the above embodiments. The above embodiments and descriptions are only preferred examples of the present invention and are not intended to limit the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention. The scope of protection of the present invention is defined by the attached claims and their equivalents.
Claims
1. A multi-aperture imaging detection device for moving targets in a low-light environment, characterized in that: include: K sub-aperture cameras are arranged side by side in a 1×K configuration, where K is an odd number; An imaging unit, equipped with a low-light detection chip, for acquiring images; A synchronous exposure control unit, used for controlling the synchronous exposure of the K sub-aperture cameras; A mode switching control unit, used for controlling the switching of imaging modes of the K sub-aperture cameras, wherein the imaging modes include a parallel light path mode and a stitching mode; Image processing unit, used to obtain high-resolution images and target information.
2. The multi-aperture imaging detection device for moving targets in a low-light environment according to claim 1, characterized in that: The image processing unit at least includes an image stitching unit, an image denoising and enhancement unit, a cloud detection and fusion unit, a target detection unit and a super-resolution reconstruction unit.
3. The multi-aperture imaging detection device for moving targets in a low-light environment according to claim 2, characterized in that: The image stitching unit is used to stitch images acquired by sub-apertures; The image denoising and enhancement unit is used to denoise and enhance the spliced image; The cloud detection and fusion unit is used to perform cloud detection and fusion removal on the denoised and enhanced image; The target detection unit is used to perform target detection on the image after the cloud detection and fusion removal processing; The super-resolution reconstruction unit is used to obtain a high-resolution image containing the target and obtain target information.
4. An imaging detection method using a multi-aperture imaging detection device for a moving target in a low-light environment according to any one of claims 1 to 3, characterized in that: The detection mode is determined based on the current illumination to obtain target information, wherein the detection mode includes daytime detection and nighttime detection.
5. The imaging detection method according to claim 4, characterized in that: The night detection comprises the following steps: Step S101, using a parallel light path mode to obtain a first time series remote sensing image taken by K sub-aperture cameras at the same time; Step S102: Detect moving targets based on the K first time series remote sensing images to obtain target information.
6. The imaging detection method according to claim 5, characterized in that: The daytime detection comprises the following steps: Step S201, using a stitching mode to obtain a plurality of second time series remote sensing images; Step S202: detecting moving targets based on the plurality of second time series remote sensing images; Step S203, using a mode switching control unit to switch from the splicing mode to the parallel light path mode, and then sequentially executing the steps S101 and S102.
7. The imaging detection method according to claim 6, characterized in that: In the step S201, K apertures acquire K×J pieces of the second time series remote sensing images, and the resolution of the sub-aperture is M×N, where K is an odd number and J represents different moments.
8. The imaging detection method according to claim 7, characterized in that: The step S202 specifically includes: The image stitching unit is used to stitch the second time series remote sensing images acquired at the K apertures at the J moment based on the sub-aperture camera position to obtain a j-th image. i The second stitched image at time t has a resolution of M×(K×N-(K-1)t), where t is the length of the overlapping area and j=1,2,…,J; Using the image denoising and enhancement unit to perform image denoising and image enhancement processing on the J second stitched images; Using the cloud detection and fusion unit to perform cloud detection and fusion removal on the denoised and enhanced images to obtain a sequence of remote sensing images after cloud removal; Based on J cloud-removed sequence remote sensing images, feature analysis is performed on the target and the target is extracted.
9. The imaging detection method according to claim 8, characterized in that: In step S102, the original high-resolution image z is reconstructed using the degradation model of the super-resolution reconstruction unit, and the degradation model is expressed as: g k =τDH k M k z+n k ,k=1,...,K Among them, g k is the observed low-resolution image of the kth sub-aperture camera; τ represents the integration factor; D represents the downsampling matrix; H k represents a block circulant matrix used to represent the blur degradation process, including at least blur caused by defocus, motion blur or optical system transfer function; M k is a matrix representing the position dislocation and geometric deformation of the kth image relative to the reference image, M k is a constant; z is the original high-resolution image; n k represents additive noise; Q is the number of low-resolution images.
10. The imaging detection method according to claim 9, characterized in that: In step S102, the degradation model is solved by minimizing the objective function, and then: Using the maximum a posteriori probability method to solve formula (1), we have: Among them, θ is the prior model parameter, λ is the weight parameter; The reconstruction method based on Huber Markov random field model is used to solve formula (2) to obtain a high-resolution image containing the target.
Citation Information
Patent Citations
Phased-array laser radar system and method of dual-mode control
CN108897003A
Multi-aperture single-detector optical imaging system
CN111190285A
Multiple aperture video image enhancement system
US9380273B1
Scanning method and apparatus based on radar system that fuses image and laser
WO2023138697A1
