Aperture-coded imaging method and device based on depth echo prior
By constructing a metamaterial aperture coding imaging system and combining it with a U-shaped convolutional neural network, and utilizing deep echo prior technology, the imaging problem of metamaterial aperture coding imaging technology under sparsity and signal-to-noise ratio conditions was solved, achieving high-resolution reconstruction and quality improvement.
Patent Information
- Application Number
- CN202311228069.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-21
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2043-09-21
AI Technical Summary
Existing metamaterial aperture coding imaging techniques struggle to achieve high-resolution reconstruction of targets with varying sparsity under compressed measurements, and their imaging quality is poor under different signal-to-noise ratio conditions, especially at high frequencies and low signal-to-noise ratios.
A metamaterial aperture-coded imaging system was constructed. By dividing the imaging plane into grids, a reference signal matrix was constructed using a U-shaped convolutional neural network combined with depth echo priors, and iterative optimization was performed to achieve the optimal estimation of the target pattern.
It improves the high-resolution reconstruction capability of targets with different sparsity under compressed measurement, enhances imaging quality under different signal-to-noise ratio conditions, reduces the workload of dataset construction, and has good generalization ability.
Smart Images

Figure CN117289265B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of radar imaging technology, and in particular to an aperture-coded imaging method and apparatus based on depth echo prior. Background Technology
[0002] Metamaterial aperture-coded imaging, a method proposed in recent years based on metamaterial-coded antennas, involves a transmitter emitting radar signals to illuminate a reflective metamaterial-coded antenna. The antenna's coding control module applies different amplitude, phase, or frequency random modulation factors to the incident electromagnetic wave at different times, ultimately creating a temporally and spatially independent radiation field in the forward-looking target area. After reflection from the target, the radar echo is received by a receiving antenna, and the received signal is sent to a signal processing module. The target scattering coefficient is calculated using computational imaging, achieving high-resolution, forward-looking, staring, and all-weather imaging. Metamaterial aperture-coded imaging is a novel radar imaging technology that does not rely on relative motion to accumulate aperture and has a simple structure that is easy to integrate, offering numerous advantages. However, many challenges remain in its application, such as achieving high-resolution reconstruction of targets with different sparsity under compressed measurements and improving imaging quality at different signal-to-noise ratios. Therefore, further research into new imaging methods is needed.
[0003] There has been considerable research on metamaterial aperture-coded imaging technology, and various solutions have been proposed for different system errors. For example, a Chinese invention patent granted in 2020 can perform phase compensation on a reference signal matrix with phase errors, obtaining a compensated imaging model to improve imaging quality. Currently, there are two main target reconstruction methods in metamaterial aperture-coded imaging technology. One is a sparse reconstruction algorithm based on compressed sensing. A Chinese invention patent granted in 2019 describes a surface target imaging method based on terahertz aperture-coded imaging. This method divides the target plane into grids and determines the number of grids, selects a wavelet mother function, and uses MATLAB to determine the maximum number of decomposition layers. Based on the wavelet mother function, the number of grids, and the maximum number of decomposition layers, MATLAB is used to solve for the wavelet sparse basis matrix. For surface target imaging based on the sparse reconstruction algorithm, a dictionary matrix is formed by multiplying the reference signal matrix and the wavelet sparse basis matrix, constructing a new mathematical model for the surface target. This model is then effectively solved using the sparse reconstruction algorithm, and the surface target imaging result is obtained through inverse wavelet transform. This invention solves the target imaging problem under the aperture coding system in the terahertz band, achieving higher imaging model consistency, better imaging effect, and faster speed. Secondly, it is based on an end-to-end neural network reconstruction method. Another paper discloses an offline end-to-end imaging network developed using convolutional neural networks (CNNs) to address the problem of aperture coding's difficulty in distinguishing targets at low signal-to-noise ratios (SNR) and the time-consuming imaging process. This network is highly parallel and iterative, effectively solving the aforementioned problems. This imaging network can serve as a general and powerful mapping function; once well-trained and used for metamaterial aperture coding signal processing, it can immediately recover the target of interest from the echo signal. The paper also demonstrates a method for generating training data and uses simulation experiments to prove that the imaging network trained with simulated data has good robustness to noise and model errors.
[0004] Sparse reconstruction algorithms based on compressed sensing have made significant progress in metamaterial aperture-coded imaging technology. However, achieving high-resolution reconstruction of targets with different sparsities under compressed measurements remains challenging and is limited by poor noise resistance. This is because the method requires prior assumptions about the target sparsity, but in high-frequency bands, especially the terahertz band, where the frequency is high and the wavelength is short, the target will have dense scattering centers, which will severely degrade the imaging quality. Furthermore, the imaging process slows down due to the increased number of iterations. While methods based on end-to-end neural networks that directly estimate the target from the echo are fast and can improve imaging quality at low signal-to-noise ratios, training the network requires a large number of echo-image data pairs, which are difficult to obtain. Additionally, the imaging performance is affected by the accuracy of the dataset. Summary of the Invention
[0005] Therefore, it is necessary to provide an aperture-coded imaging method based on depth echo prior to address the above-mentioned technical problems, which can improve the imaging quality of target images under compressed measurement and different signal-to-noise ratio conditions.
[0006] An aperture-coded imaging method based on depth echo prior, the method comprising:
[0007] Construct a metamaterial aperture-coded imaging system; the metamaterial aperture-coded imaging system includes a metamaterial antenna driving module, a transceiver control module, a metamaterial aperture-coded antenna, and a receiving antenna;
[0008] The imaging plane in the target area is divided into grids to obtain multiple target grid units;
[0009] The linear frequency modulated signal transmitted by the radar is acquired in advance. The phase random modulation factor is loaded onto the metamaterial coded antenna using the metamaterial antenna driving module to modulate the phase of the linear frequency modulated signal, forming a spatiotemporally uncorrelated random radiation field in the forward-looking region. The reference signal of the target grid cell at any time is derived using the signal extrapolation method based on range time delay.
[0010] A reference signal matrix is constructed based on the reference signals of all grid cells at multiple times; a metamaterial aperture-coded imaging model is constructed using echo data, target scattering coefficient vector, reference signal matrix, and measurement noise vector;
[0011] Based on the acquired echo data, the optimal estimate of the target pattern is obtained by solving the metamaterial aperture encoding imaging model through iterative optimization of the parameters of the U-shaped convolutional neural network.
[0012] In one embodiment, the process of acquiring echo data includes: using a metamaterial antenna driving module to load different phase random modulation factors onto a metamaterial coded antenna at different times to perform phase modulation on a linear frequency modulated signal, thereby forming a spatiotemporally uncorrelated random radiation field in the forward-looking region; based on the random radiation field, forming a detection signal with significant spatiotemporally uncorrelated characteristics in the target region; and after the detection signal is reflected by the target, obtaining the corresponding echo data by a radar receiver through multiple sampling and reception.
[0013] In one embodiment, the linear frequency modulated signal is
[0014]
[0015] Among them, f c A is the center frequency, K is the signal amplitude, t is the frequency modulation, and j is the symbol for the imaginary unit.
[0016] In one embodiment, after loading a phase random modulation factor onto a metamaterial coded antenna using a metamaterial antenna driving module to perform phase modulation on a linear frequency modulated signal, a spatiotemporally uncorrelated random radiation field is formed in the forward-looking region. The reference signal of the target grid cell at any given time is derived using a range-delay-based signal extrapolation method, including:
[0017] By loading a phase random modulation factor onto a metamaterial coded antenna using a metamaterial antenna driving module to modulate the phase of a linear frequency modulated signal, a spatiotemporally uncorrelated random radiation field is formed in the forward-looking region. The reference signal of the target mesh cell at any given time is derived using a range-delay-based signal extrapolation method.
[0018]
[0019] Where Q represents the total number of modulation elements in the aperture-coded antenna. Is the q-th coding unit in t? m Phase modulation factor at time d Tx,q,n d represents the sum of the distance from the transmitter to the q-th coding unit and the distance from the q-th coding unit to the n-th imaging grid. n,Rx f represents the distance from the nth imaging grid to the receiver. c A is the center frequency, A is the signal amplitude, K is the frequency modulation frequency, t represents the time, j represents the symbol of the imaginary unit, and m represents the time sequence number.
[0020] In one embodiment, a reference signal matrix is constructed based on reference signals of all grid cells at multiple times, including:
[0021] The reference signal matrix is constructed based on the reference signals of all grid cells at multiple times.
[0022]
[0023] Where N represents the total number of target grid cells, and M represents the total number of time points.
[0024] In one embodiment, a metamaterial aperture-coded imaging model is constructed using echo data, a target scattering coefficient vector, a reference signal matrix, and a measurement noise vector, including:
[0025] A metamaterial aperture-coded imaging model is constructed using echo data, target scattering coefficient vector, reference signal matrix, and measurement noise vector.
[0026] S r =S·β+ω
[0027] Where, ω∈R M×1 It measures the noise vector, S r ∈R M×1This indicates that the radar receiver obtains the corresponding echo data after M samplings and receptions, β represents the target scattering coefficient vector, and S represents the reference signal matrix.
[0028] In one embodiment, based on the acquired echo data and through iterative optimization of the parameters of a U-shaped convolutional neural network, the metamaterial aperture-encoded imaging model is solved to obtain the optimal estimate of the target pattern, including:
[0029] The randomly initialized pattern is input into a U-shaped convolutional neural network (CNN). After processing by the CNN, a predicted pattern is obtained. A metamaterial aperture-coded imaging model is used to obtain the predicted echo. The acquired echo data and the predicted echo are then compared with the Adam algorithm under the constraint of minimizing the l2 norm. After multiple iterations, the network parameters θ of the CNN are updated based on the latest network parameters. The output of the U-shaped convolutional neural network is used to obtain the optimal estimate of the target pattern.
[0030] In one embodiment, the loss function used to update the network parameters θ of the U-shaped convolutional neural network using the Adam algorithm under the constraint of minimizing the l2 norm is:
[0031]
[0032] Where β0 is a randomly initialized pattern. This represents a U-shaped convolutional neural network with parameter θ. Indicates the predicted pattern. This indicates that the metamaterial aperture-coded imaging model yields the predicted echo, S r This represents the acquired echo data, and S represents the reference signal matrix.
[0033] An aperture-coded imaging device based on depth echo prior, the device comprising:
[0034] A metamaterial aperture-coded imaging system construction module is used to construct a metamaterial aperture-coded imaging system; the metamaterial aperture-coded imaging system includes a metamaterial antenna driving module, a transceiver control module, a metamaterial aperture-coded antenna, and a receiving antenna;
[0035] The phase modulation module is used to divide the imaging plane into grids in the target area to obtain multiple target grid cells. The linear frequency modulated signal transmitted by the radar is acquired in advance. The phase random modulation factor is loaded onto the metamaterial coded antenna using the metamaterial antenna driving module to modulate the phase of the linear frequency modulated signal, forming a spatiotemporally uncorrelated random radiation field in the forward-looking area. The reference signal of the target grid cell at any time is derived using a signal extrapolation method based on range time delay.
[0036] The metamaterial aperture-coded imaging model construction module is used to construct a reference signal matrix based on the reference signals of all grid cells at multiple times; and to construct a metamaterial aperture-coded imaging model using echo data, target scattering coefficient vector, reference signal matrix and measurement noise vector.
[0037] The target pattern optimal estimation module is used to solve the metamaterial aperture coding imaging model based on the acquired echo data and through iterative optimization of the parameters of the U-shaped convolutional neural network, so as to obtain the optimal estimate of the target pattern.
[0038] The aforementioned aperture-coded imaging method and apparatus based on depth echo priors first constructs a metamaterial aperture-coded imaging system. This system includes a metamaterial antenna driving module, a transceiver control module, a metamaterial aperture-coded antenna, and a receiving antenna. The imaging plane is divided into grids in the target area to obtain multiple target grid cells. A linear frequency modulated (LFM) signal transmitted by radar is pre-acquired. The LFM signal is then modulated by loading a phase random modulation factor onto the metamaterial coded antenna using the metamaterial antenna driving module, forming a spatiotemporally uncorrelated random radiation field in the forward-looking region. The reference signal of the target grid cell at any given time is derived using a signal derivation method based on range delay. A reference signal matrix is constructed based on the reference signals of all grid cells at multiple times. A metamaterial aperture-coded imaging model is constructed using echo data, target scattering coefficient vectors, the reference signal matrix, and measurement noise vectors. The model is solved using the acquired echo data and through iterative optimization of the parameters of a U-shaped convolutional neural network, yielding an optimal estimate of the target pattern. This application is based on a metamaterial aperture-coded imaging system. By borrowing from a depth image prior processing framework, it combines the metamaterial aperture-coded imaging model with a deep convolutional neural network. Under unsupervised learning mode, compared with traditional compressed sensing algorithms, it improves the imaging quality at different signal-to-noise ratios and achieves high-resolution reconstruction of targets with different sparsity under compressed measurement. Compared with collecting a large amount of target echo data and target scattering coefficient data to solve using a training-based end-to-end neural network (EENN) method, this application only uses a deep convolutional neural network to process a single echo data point, eliminating the need for dataset construction, greatly reducing workload, and also exhibiting generalization ability. Attached Figure Description
[0039] Figure 1 This is a flowchart illustrating an aperture-coded imaging method based on depth echo prior in one embodiment.
[0040] Figure 2 This is a structural block diagram of a metamaterial aperture-coded imaging system in one embodiment;
[0041] Figure 3This is a structural block diagram of an aperture-coded imaging device based on depth echo prior in one embodiment. Detailed Implementation
[0042] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0043] In one embodiment, such as Figure 1 As shown, an aperture-coded imaging method based on depth echo prior is provided, including the following steps:
[0044] Step 102: Construct a metamaterial aperture-coded imaging system; the metamaterial aperture-coded imaging system includes a metamaterial antenna driving module, a transceiver control module, a metamaterial aperture-coded antenna, and a receiving antenna.
[0045] In a metamaterial aperture-coded imaging system, under forward-looking imaging conditions, the radar transmitter emits a linear frequency modulated signal, which is modulated by a reflective metamaterial-coded antenna to illuminate the target area. After the detection signal is reflected by the target, the radar receiver obtains the corresponding echo data S through M sampling and reception. r ∈R M×1 The echo data serves as prior knowledge, which is then used for subsequent solution and optimization of the target image.
[0046] Step 104: Divide the imaging plane into grids in the target area to obtain multiple target grid cells; acquire the linear frequency modulated signal transmitted by the radar in advance, load the phase random modulation factor onto the metamaterial coded antenna using the metamaterial antenna drive module to perform phase modulation on the linear frequency modulated signal, and form a spatiotemporally uncorrelated random radiation field in the forward-looking area; derive the reference signal of the target grid cell at any time using the signal derivation method based on range time delay.
[0047] Step 106: Construct a reference signal matrix based on the reference signals of all grid cells at multiple times; construct a metamaterial aperture-coded imaging model using echo data, target scattering coefficient vector, reference signal matrix, and measurement noise vector.
[0048] By dividing the imaging plane into grids in the target area, multiple target grid cells are obtained. Then, the phase random modulation factor is loaded onto the metamaterial coded antenna using the metamaterial antenna driving module to modulate the linear frequency modulated signal, thereby obtaining the reference signal of the target grid cell at any time and constructing a reference signal matrix. The reference signal matrix is used to achieve accurate estimation of the radiation field distribution. After obtaining the reference signal matrix, the metamaterial aperture coded imaging model is constructed using echo data, target scattering coefficient vector, reference signal matrix and measurement noise vector, which can realize high-resolution reconstruction of targets with different sparsity under compressed measurement.
[0049] Step 108: Based on the acquired echo data and through iterative optimization of the parameters of the U-shaped convolutional neural network, the metamaterial aperture coding imaging model is solved to obtain the optimal estimate of the target pattern.
[0050] Compared to using a trained end-to-end neural network (EENN) method that collects large amounts of target echo and scattering coefficient data, this application uses a deep convolutional neural network to process a single echo data point, eliminating the need for dataset construction and significantly reducing workload, while also exhibiting generalization capabilities. By combining a metamaterial aperture-coded imaging model with a deep convolutional neural network in an unsupervised learning mode, this approach improves imaging quality at different signal-to-noise ratios compared to traditional compressed sensing algorithms, and enhances the accuracy of target scattering coefficient reconstruction.
[0051] In the aforementioned aperture-coded imaging method based on depth echo prior, a metamaterial aperture-coded imaging system is first constructed. This system includes a metamaterial antenna driving module, a transceiver control module, a metamaterial aperture-coded antenna, and a receiving antenna. The imaging plane is divided into grids in the target area to obtain multiple target grid cells. A linear frequency modulated (LFM) signal transmitted by the radar is pre-acquired. The LFM signal is then modulated by loading a phase random modulation factor onto the metamaterial coded antenna using the metamaterial antenna driving module, forming a spatiotemporally uncorrelated random radiation field in the forward-looking region. The reference signal of the target grid cell at any given time is derived using a signal extrapolation method based on range delay. A reference signal matrix is constructed based on the reference signals of all grid cells at multiple times. A metamaterial aperture-coded imaging model is constructed using echo data, target scattering coefficient vectors, the reference signal matrix, and measurement noise vectors. The model is then solved using the acquired echo data and through iterative optimization of the parameters of a U-shaped convolutional neural network, yielding an optimal estimate of the target pattern. This application is based on a metamaterial aperture-coded imaging system. By borrowing from a depth image prior processing framework, it combines the metamaterial aperture-coded imaging model with a deep convolutional neural network. Under unsupervised learning mode, compared with traditional compressed sensing algorithms, it improves the imaging quality at different signal-to-noise ratios and achieves high-resolution reconstruction of targets with different sparsity under compressed measurement. Compared with collecting a large amount of target echo data and target scattering coefficient data to solve using a training-based end-to-end neural network (EENN) method, this application only uses a deep convolutional neural network to process a single echo data point, eliminating the need for dataset construction, greatly reducing workload, and also exhibiting generalization ability.
[0052] In one embodiment, the process of acquiring echo data includes: using a metamaterial antenna driving module to load different phase random modulation factors onto a metamaterial coded antenna at different times to perform phase modulation on a linear frequency modulated signal, thereby forming a spatiotemporally uncorrelated random radiation field in the forward-looking region; based on the random radiation field, forming a detection signal with significant spatiotemporally uncorrelated characteristics in the target region; and after the detection signal is reflected by the target, obtaining the corresponding echo data by a radar receiver through multiple sampling and reception.
[0053] In a specific embodiment, such as Figure 2As shown, the radar transmitter emits a radar signal that illuminates the surface of a reflective metamaterial coded antenna. Simultaneously, the metamaterial antenna driving module loads different phase random modulation factors onto the metamaterial coded antenna at different times to modulate the phase of the linear frequency modulated signal from the radar transmitter, subsequently forming a spatiotemporally uncorrelated random radiation field in the forward-looking region. Furthermore, loading different phase random modulation factors onto the radar signal at different times ensures that the radiation field in the forward-looking region is time-independent. Ultimately, a detection signal with significant spatiotemporally uncorrelated characteristics is formed in the target area. After being reflected by the target, the detection signal is sampled and received multiple times by the radar receiver to obtain the corresponding echo data.
[0054] In one embodiment, the linear frequency modulated signal is
[0055]
[0056] Among them, f c A is the center frequency, K is the signal amplitude, t is the frequency modulation, and j is the symbol for the imaginary unit.
[0057] In one embodiment, after loading a phase random modulation factor onto a metamaterial coded antenna using a metamaterial antenna driving module to perform phase modulation on a linear frequency modulated signal, a spatiotemporally uncorrelated random radiation field is formed in the forward-looking region. The reference signal of the target grid cell at any given time is derived using a range-delay-based signal extrapolation method, including:
[0058] By loading a phase random modulation factor onto a metamaterial coded antenna using a metamaterial antenna driving module to modulate the phase of a linear frequency modulated signal, a spatiotemporally uncorrelated random radiation field is formed in the forward-looking region. The reference signal of the target mesh cell at any given time is derived using a range-delay-based signal extrapolation method.
[0059]
[0060] Where Q represents the total number of modulation elements in the aperture-coded antenna. Is the q-th coding unit in t? m Phase modulation factor at time d Tx,q,n d represents the sum of the distance from the transmitter to the q-th coding unit and the distance from the q-th coding unit to the n-th imaging grid. n,Rx f represents the distance from the nth imaging grid to the receiver. c A is the center frequency, A is the signal amplitude, K is the frequency modulation frequency, t represents the time, j represents the symbol of the imaginary unit, and m represents the time sequence number.
[0061] In one embodiment, a reference signal matrix is constructed based on reference signals of all grid cells at multiple times, including:
[0062] The reference signal matrix is constructed based on the reference signals of all grid cells at multiple times.
[0063]
[0064] Where N represents the total number of target grid cells, and M represents the total number of time points.
[0065] In one embodiment, a metamaterial aperture-coded imaging model is constructed using echo data, a target scattering coefficient vector, a reference signal matrix, and a measurement noise vector, including:
[0066] A metamaterial aperture-coded imaging model is constructed using echo data, target scattering coefficient vector, reference signal matrix, and measurement noise vector.
[0067] S r =S·β+ω
[0068] Where, ω∈R M×1 It measures the noise vector, S r ∈R M×1 This indicates that the radar receiver obtains the corresponding echo data after M samplings and receptions, β represents the target scattering coefficient vector, and S represents the reference signal matrix.
[0069] In one embodiment, based on the acquired echo data and through iterative optimization of the parameters of a U-shaped convolutional neural network, the metamaterial aperture-coded imaging model is solved to obtain an optimal estimate of the target pattern, including:
[0070] The randomly initialized pattern is input into a U-shaped convolutional neural network (CNN). After processing by the CNN, a predicted pattern is obtained. A metamaterial aperture-coded imaging model is used to obtain the predicted echo. The acquired echo data and the predicted echo are then compared with the Adam algorithm under the constraint of minimizing the l2 norm. After multiple iterations, the network parameters θ of the CNN are updated based on the latest network parameters. The output of the U-shaped convolutional neural network is used to obtain the optimal estimate of the target pattern.
[0071] In one embodiment, the loss function used to update the network parameters θ of the U-shaped convolutional neural network using the Adam algorithm under the constraint of minimizing the l2 norm is:
[0072]
[0073] Where β0 is a randomly initialized pattern. This represents a U-shaped convolutional neural network with parameter θ. Indicates the predicted pattern. This indicates that the metamaterial aperture-coded imaging model yields the predicted echo, S r This represents the acquired echo data, and S represents the reference signal matrix.
[0074] In a specific embodiment, β0 is a randomly initialized pattern. This represents a U-shaped convolutional neural network with parameters θ. The idea is to input a random pattern β0, which is then processed by the network. The predicted pattern is obtained after processing. Predicted echoes obtained using metamaterial aperture-coded imaging models Actual echo S r With predicted echo The network parameters θ are updated using the Adam algorithm under the L2 norm minimization constraint. After multiple iterations, the optimal estimate β' of the target pattern is obtained. At this point, the predicted echo signal is most similar to the actual echo signal under the l2 norm constraint. By continuously updating the network parameters θ, a higher quality target image can be obtained when solving the target pattern using the U-shaped convolutional neural network in the future.
[0075] It should be understood that, although Figure 1 The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figure 1 At least some of the steps in the process may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.
[0076] In one embodiment, such as Figure 3 As shown, an aperture-coded imaging device based on depth echo prior is provided, comprising: a metamaterial aperture-coded imaging system construction module 302, a phase modulation module 304, a metamaterial aperture-coded imaging model construction module 306, and a target pattern optimal estimation module 308, wherein:
[0077] Metamaterial aperture coding imaging system construction module 302 is used to construct a metamaterial aperture coding imaging system; the metamaterial aperture coding imaging system includes a metamaterial antenna driving module, a transceiver control module, a metamaterial aperture coding antenna, and a receiving antenna;
[0078] The phase modulation module 304 is used to divide the imaging plane into grids in the target area to obtain multiple target grid cells. The linear frequency modulated signal transmitted by the radar is acquired in advance. The phase random modulation factor is loaded onto the metamaterial coded antenna using the metamaterial antenna driving module to modulate the phase of the linear frequency modulated signal, and a spatiotemporally uncorrelated random radiation field is formed in the forward-looking area. The reference signal of the target grid cell at any time is derived using the signal extrapolation method based on range time delay.
[0079] The metamaterial aperture-coded imaging model construction module 306 is used to construct a reference signal matrix based on the reference signals of all grid cells at multiple times; and to construct a metamaterial aperture-coded imaging model using echo data, target scattering coefficient vector, reference signal matrix and measurement noise vector.
[0080] The target pattern optimal estimation module 308 is used to solve the metamaterial aperture coding imaging model based on the acquired echo data and through iterative optimization of the parameters of the U-shaped convolutional neural network, so as to obtain the optimal estimate of the target pattern.
[0081] Specific limitations regarding the aperture-coded imaging device based on depth echo priors can be found in the limitations of the aperture-coded imaging method based on depth echo priors mentioned above, and will not be repeated here. Each module in the aforementioned aperture-coded imaging device based on depth echo priors can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device in hardware form, or stored in the memory of a computer device in software form, so that the processor can call and execute the corresponding operations of each module.
[0082] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0083] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.
Claims
1. An aperture-coded imaging method based on depth echo prior, characterized in that, The method includes: A metamaterial aperture-coded imaging system is constructed; the metamaterial aperture-coded imaging system includes a metamaterial antenna driving module, a transceiver control module, a metamaterial aperture-coded antenna, and a receiving antenna; The imaging plane in the target area is divided into grids to obtain multiple target grid units; The linear frequency modulated signal transmitted by the radar is acquired in advance. The phase random modulation factor is loaded onto the metamaterial aperture coded antenna using the metamaterial antenna driving module to modulate the phase of the linear frequency modulated signal, forming a spatiotemporally uncorrelated random radiation field in the forward-looking region. The reference signal of the target grid cell at any time is derived using a signal extrapolation method based on range time delay. A reference signal matrix is constructed based on the reference signals of all grid cells at multiple times; a metamaterial aperture-coded imaging model is constructed using echo data, target scattering coefficient vector, reference signal matrix, and measurement noise vector; Based on the acquired echo data, the optimal estimate of the target pattern is obtained by solving the metamaterial aperture coding imaging model through iterative optimization of the parameters of the U-shaped convolutional neural network. The randomly initialized pattern is input into a U-shaped convolutional neural network. After processing by the U-shaped convolutional neural network, a predicted pattern is obtained. The predicted echo is obtained using a metamaterial aperture-coded imaging model. The acquired echo data is then compared with the predicted echo. Using the Adam algorithm to optimize the network parameters of a U-shaped convolutional neural network under norm minimization constraints Updates are performed, and after multiple iterations, based on the latest network parameters. The optimal estimate of the target pattern is obtained from the output of the U-shaped convolutional neural network. The acquired echo data and the predicted echo were compared. Using the Adam algorithm to optimize the network parameters of a U-shaped convolutional neural network under norm minimization constraints The loss function for updating is in, It is a pattern generated through random initialization. express U-shaped convolutional neural network under certain parameters Indicates the predicted pattern. This indicates that the metamaterial aperture-coded imaging model yields the predicted echo. This indicates the acquired echo data. This represents the reference signal matrix.
2. The method according to claim 1, characterized in that, The process of acquiring the echo data includes: By using the metamaterial antenna driving module to load different phase random modulation factors onto the metamaterial aperture coded antenna at different times to perform phase modulation on the linear frequency modulation signal, a spatiotemporally uncorrelated random radiation field is formed in the forward-looking region. Based on the random radiation field, a detection signal with significant spatiotemporally uncorrelated characteristics is formed in the target region. After the detection signal is reflected by the target, the radar receiver obtains the corresponding echo data through multiple sampling and reception.
3. The method according to claim 1, characterized in that, The linear frequency modulation signal is in, It is the center frequency. It is the signal amplitude. It's frequency adjustment. Indicates time, Represents the symbol for the imaginary unit.
4. The method according to any one of claims 1 to 3, characterized in that, After loading a phase random modulation factor onto the metamaterial aperture-coded antenna using the aforementioned metamaterial antenna driving module to perform phase modulation on the linear frequency modulated signal, a spatiotemporally uncorrelated random radiation field is formed in the forward-looking region. The reference signal of the target grid cell at any given time is derived using a range-delay-based signal extrapolation method, including: After loading a phase random modulation factor onto the metamaterial aperture-coded antenna using the aforementioned metamaterial antenna driving module to perform phase modulation on the linear frequency modulated signal, a spatiotemporally uncorrelated random radiation field is formed in the forward-looking region. The reference signal of the target grid cell at any given time is derived using a range-delay-based signal extrapolation method. in, This indicates the total number of modulation elements in the aperture-coded antenna. It is the first Each coding unit in Phase modulation factor at time, Indicates the transmitter to the number The distance between the and coding units The coding unit to the 1st The sum of distances across the imaging grids. Indicates the first The distance from each imaging grid to the receiver, It is the center frequency. It is the signal amplitude. It's frequency adjustment. Indicates time, The symbol represents the imaginary unit, and m represents the time sequence number.
5. The method according to claim 4, characterized in that, A reference signal matrix is constructed based on the reference signals of all grid cells at multiple times, including: The reference signal matrix is constructed based on the reference signals of all grid cells at multiple times. in, This represents the total number of target grid cells. M Indicates the total number of moments.
6. The method according to claim 1, characterized in that, A metamaterial aperture-coded imaging model is constructed using echo data, target scattering coefficient vector, reference signal matrix, and measurement noise vector, including: A metamaterial aperture-coded imaging model is constructed using echo data, target scattering coefficient vector, reference signal matrix, and measurement noise vector. in, It measures the noise vector. This indicates that the radar receiver obtains the corresponding echo data after M sampling and reception operations. Represents the target scattering coefficient vector. This represents the reference signal matrix.
7. An aperture-coded imaging device based on depth echo prior, characterized in that, The device includes: A metamaterial aperture-coded imaging system construction module is used to construct a metamaterial aperture-coded imaging system; the metamaterial aperture-coded imaging system includes a metamaterial antenna driving module, a transceiver control module, a metamaterial aperture-coded antenna, and a receiving antenna; The phase modulation module is used to divide the imaging plane into grids in the target area to obtain multiple target grid cells; the linear frequency modulated signal transmitted by the radar is acquired in advance to form a spatiotemporally uncorrelated random radiation field in the forward-looking area, and the reference signal of the target grid cell at any time is derived by using a signal extrapolation method based on range time delay; The metamaterial aperture-coded imaging model construction module is used to construct a reference signal matrix based on the reference signals of all grid cells at multiple times; and to construct a metamaterial aperture-coded imaging model using echo data, target scattering coefficient vector, reference signal matrix and measurement noise vector. The target pattern optimal estimation module is used to solve the metamaterial aperture-coded imaging model based on the acquired echo data and through iterative optimization of the parameters of a U-shaped convolutional neural network, thereby obtaining the optimal estimate of the target pattern. This includes: inputting a randomly initialized pattern into the U-shaped convolutional neural network; obtaining a predicted pattern after processing by the U-shaped convolutional neural network; obtaining a predicted echo using the metamaterial aperture-coded imaging model; and comparing the acquired echo data with the predicted echo. Using the Adam algorithm to optimize the network parameters of a U-shaped convolutional neural network under norm minimization constraints Updates are performed, and after multiple iterations, based on the latest network parameters. The optimal estimate of the target pattern is obtained by analyzing the output of the U-shaped convolutional neural network; the acquired echo data is then compared with the predicted echo. Using the Adam algorithm to optimize the network parameters of a U-shaped convolutional neural network under norm minimization constraints The loss function for updating is in, It is a pattern generated through random initialization. express U-shaped convolutional neural network under certain parameters Indicates the predicted pattern. This indicates that the metamaterial aperture-coded imaging model yields the predicted echo. This indicates the acquired echo data. This represents the reference signal matrix.
Citation Information
Patent Citations
Blind image super-resolution method based on depth prior
CN114202459A
