Multi-aperture array three-dimensional imaging compensation method and device
By dividing the observation areas and calculating the distance compensation factor in three-dimensional imaging, combined with the principle of equivalent phase center, the problems of large amount of calculations and image defocusing are solved, and the imaging efficiency and quality are improved.
Patent Information
- Application Number
- CN202210699014.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2022-05-19
- Filing Date
- 2022-06-20
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2042-06-20
AI Technical Summary
Traditional backward projection algorithms are highly computationally intensive in near-field three-dimensional imaging, especially for sparse plane arrays, resulting in low imaging efficiency and errors caused by phase center equivalents lead to image defocusing problems.
By dividing the observation area into multiple sub-regions, the distance compensation factor of each sub-regions is calculated, and the filter function is constructed for distance compression, reducing the distance phase process calculation in the dual-station equivalent process, combined with the principle of equivalent phase center, Simplify the repeated calculation of compensation function to solve the image defocusing problem.
The efficiency of three-dimensional imaging is improved, the calculation amount is reduced, the imaging quality is ensured, the image defocus is avoided, and the compensation process is simplified.
Smart Images

Figure CN114879186B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of radar three-dimensional imaging technology, and in particular to a multi-aperture array three-dimensional imaging compensation method and device, electronic equipment and storage medium. Background Art
[0002] Near-field 3D imaging algorithms are mainly divided into two categories: time domain imaging algorithms and frequency domain imaging algorithms. The most commonly used time domain imaging algorithm is the back-projection algorithm. The traditional back-projection algorithm uses a point-by-point and grid-by-grid approach to achieve target reconstruction during the imaging process. For a sparse planar array with separate transmitters and receivers, it is necessary to calculate the distance from each pixel to the transmitter and receiver array element, resulting in a huge amount of algorithm computation. Summary of the invention
[0003] The present invention discloses a multi-aperture array three-dimensional imaging compensation method and device that can reduce the amount of distance phase history calculation in a dual-station equivalent process and improve imaging efficiency.
[0004] According to one aspect of the present disclosure, a multi-aperture array three-dimensional imaging compensation method is provided, which includes:
[0005] Acquire echo signals based on sparse planar array three-dimensional imaging observation geometry model;
[0006] Divide an observation area containing multiple pixel points into multiple sub-areas;
[0007] Determine a sub-region distance compensation factor corresponding to the sparse planar array based on the size of the sub-region and the transceiver array elements on the sparse planar array;
[0008] constructing a filter function based on the regional distance compensation factor, multiplying the echo signal and the filter function to perform distance compression, compensating the echo signal, and determining the compensated echo signal;
[0009] The compensated echo signals are coherently superimposed to determine the three-dimensional image of the observed target.
[0010] In some possible implementations, dividing the observation area including the plurality of pixels into a plurality of sub-areas comprises the following steps:
[0011] S21: Divide the observation area into N sections along the distance direction, and calculate the number of sections in the observation area;
[0012] S22: Setting a counting variable n, where n is an integer greater than or equal to 1 and less than or equal to the number of sections in the observation area;
[0013] S23: Determine the maximum error point corresponding to the nth section;
[0014] S24: Calculate the maximum distance error from the maximum error point to the sparse planar array;
[0015] S25: Calculate the azimuth compensation factor corresponding to the point with the maximum error and the elevation compensation factor corresponding to the point with the maximum error;
[0016] S26: Calculating a distance error compensation factor corresponding to a section of the observation area based on the maximum distance error, the azimuth compensation factor corresponding to the point with the maximum error, and the elevation compensation factor corresponding to the point with the maximum error;
[0017] S27: Determine the size of the sub-region based on the maximum distance error and the distance error compensation factor;
[0018] S28: If n is less than or equal to the number of cross-sections in the observation area, n is increased by 1 and step S23 is executed; if n is greater than the number of cross-sections in the observation area, the process ends.
[0019] In some possible implementations, calculating the maximum distance error from the maximum error point to the sparse planar array includes:
[0020] S241: Calculate the vertical distance between the sparse plane array and the section taken at the point with the maximum error;
[0021] S242: Calculate the one-way distance from the transceiver array element to the point with the maximum error and the distance from the equivalent phase center to the point with the maximum error;
[0022] S243: Calculate the maximum distance error from the maximum error point to the sparse planar array according to the distance between the transceiver array element and the equivalent phase center to the maximum error point.
[0023] In some possible implementations, the calculating the azimuth compensation factor corresponding to the point with the maximum error and the elevation compensation factor corresponding to the point with the maximum error comprises the following steps:
[0024] S251: Calculate the one-way distance between the observation target point and the transceiver array element and the distance between the equivalent phase centers after stepping in the azimuth direction and the elevation direction respectively;
[0025] S252: Calculating the azimuth compensation factor coefficient corresponding to the maximum error point and the elevation compensation factor coefficient corresponding to the maximum error point through Taylor expansion;
[0026] S253: According to the azimuth compensation factor coefficient corresponding to the point with the maximum error and the elevation compensation factor coefficient corresponding to the point with the maximum error, respectively determine the azimuth compensation factor corresponding to the point with the maximum error and the elevation compensation factor corresponding to the point with the maximum error.
[0027] In some possible implementations, determining the size of the sub-region based on the maximum distance error and the distance error compensation factor includes the following steps:
[0028] S271: Calculating the distance between the observation target point and the transceiver array element and the equivalent phase center after stepping;
[0029] S272: determining a compensated distance error according to the distance between the observation target point and the transceiver array element, the equivalent phase center, and the distance error compensation factor after stepping;
[0030] S273: Determine the size of the sub-region according to the phase error condition.
[0031] In some possible implementations, determining the sub-region distance compensation factor corresponding to the sparse planar array based on the size of the sub-region and the transceiver array elements on the sparse planar array includes the following steps:
[0032] S31: Calculating the number of sub-regions of the observation area according to the size of the observation area and the size of the sub-regions;
[0033] S32: Setting a counting variable k, where k is an integer greater than or equal to 1 and less than or equal to the number of sub-regions;
[0034] S33: Determine the distance error corresponding to the pixel point in the kth sub-region;
[0035] S34: Calculate the azimuth compensation factor corresponding to the pixel points in the sub-region and the elevation compensation factor corresponding to the pixel points in the sub-region;
[0036] S35: If the product of the size of the pixel point in the azimuth direction and the number of steps in the azimuth direction is not greater than the size of the sub-region, iterate in the azimuth direction and execute step S33; if greater, execute step S36;
[0037] S36: If the product of the size of the pixel point in the elevation direction and the number of steps in the elevation direction is not greater than the size of the sub-region, iterate in the elevation direction and execute step S33; if greater, execute step S37;
[0038] S37: Calculating the sub-region distance compensation factor corresponding to the pixel point in the sub-region based on the distance error, azimuth compensation factor and elevation compensation factor corresponding to the pixel point in the sub-region;
[0039] S38: If k is not greater than the number of sub-regions, k is increased by 1 and step S33 is executed; if it is greater, step S39 is executed;
[0040] S39: Obtaining the regional distance compensation factor of the observation area.
[0041] In some possible implementations, determining the distance error corresponding to the pixel point in the kth sub-region includes the following steps:
[0042] S331: Determine the positional relationship between the pixel points in the sub-area and the pixel points after stepping;
[0043] S332: Calculate the distances between the pixel points in the sub-areas and the transceiver array elements and the equivalent phase center;
[0044] S333: Calculate the distance error corresponding to the pixel points in the kth sub-region.
[0045] In some possible implementations, determining the compensated echo signal includes:
[0046] Constructing a filter function based on the regional distance compensation factor;
[0047] Distance compression is performed based on the filter function to determine a compensated echo signal.
[0048] In some possible implementations, determining a three-dimensional image of the observed target includes:
[0049] Performing coherent superposition on the compensated echo signals;
[0050] Calculate the imaging result corresponding to each pixel;
[0051] The three-dimensional image of the observed target is determined based on the imaging result corresponding to each pixel point.
[0052] According to a second aspect of the present disclosure, a multi-aperture array three-dimensional imaging compensation device is provided, comprising:
[0053] An acquisition module, used for acquiring echo signals based on a sparse planar array three-dimensional imaging observation geometric model;
[0054] A division module, used for dividing an observation area containing a plurality of pixel points into a plurality of sub-areas;
[0055] A determination module, configured to determine a sub-region distance compensation factor corresponding to the sparse planar array based on the size of the sub-region and the transceiver array elements on the sparse planar array;
[0056] A compensation module, configured to construct a filter function based on the sub-region distance compensation factor, multiply the echo signal by the filter function to perform distance compression, compensate the echo signal, and determine the compensated echo signal;
[0057] The superposition module is used for coherent superposition of compensated echo signals to determine a three-dimensional image of the observed target.
[0058] In the disclosed embodiment, the back projection algorithm (BPA) is combined with the equivalent phase center principle, and the equivalent phase center is used to replace the transceiver array element. In the imaging process, only the distance between the equivalent phase center and each pixel point is calculated, which reduces the distance phase history calculation amount in the dual-station equivalent process and improves the imaging efficiency. In near-field imaging, the phase center equivalence causes errors, which causes image defocus. The disclosed method analyzes the phase error between the target point and the transceiver array element and the equivalent phase center, and proposes an imaging method with a built-in compensation function, which simplifies the repeated calculation process of the compensation function caused by the phase space variation, solves the image defocus problem, and ensures the imaging quality.
[0059] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
[0060] Further features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0061] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used to illustrate the technical solutions of the present disclosure together with the specification.
[0062] Figure 1 A schematic diagram of the geometric observation of sparse planar array three-dimensional imaging is shown;
[0063] Figure 2 A flowchart showing a multi-aperture array three-dimensional imaging compensation method according to an embodiment of the present disclosure;
[0064] Figure 3 A flowchart showing step S2 according to an embodiment of the present disclosure is shown;
[0065] Figure 4 A schematic diagram of phase error according to an embodiment of the present disclosure is shown;
[0066] Figure 5 A phase error analysis geometric diagram according to an embodiment of the present disclosure is shown;
[0067] Figure 6 A schematic diagram showing the division of the observation area into regions according to an embodiment of the present disclosure is shown;
[0068] Figure 7 A flowchart showing step S3 according to an embodiment of the present disclosure is shown;
[0069] Figure 8A block diagram showing a multi-aperture array three-dimensional imaging compensation device according to an embodiment of the present disclosure is shown;
[0070] Fig. 9 A block diagram of an electronic device according to an embodiment of the present disclosure is shown;
[0071] Fig.10 A block diagram of another electronic device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0072] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.
[0073] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.
[0074] The term "and / or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.
[0075] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present disclosure.
[0076] It can be understood that the above-mentioned various method embodiments mentioned in the present disclosure can be combined with each other to form a combined embodiment without violating the principle logic. Due to space limitations, the present disclosure will not go into details.
[0077] The execution subject of the multi-aperture array three-dimensional imaging compensation method may be an image processing device, for example, the image processing method may be executed by a terminal device or a server or other processing device, wherein the terminal device may be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. In some possible implementations, the multi-aperture array three-dimensional imaging compensation method may be implemented by a processor calling a computer-readable instruction stored in a memory.
[0078] Below, the specific embodiments of the present invention are described in detail in conjunction with the accompanying drawings, but they are not intended to limit the present invention. In order to enable those skilled in the art to better understand the technical solution of the present invention, the present invention is described in detail below in conjunction with the accompanying drawings and specific implementation methods. Below, the embodiments of the present invention are further described in detail in conjunction with the accompanying drawings and specific implementation methods, but they are not intended to limit the present invention.
[0079] All terms (including technical terms or scientific terms) used in the present disclosure have the same meanings as those understood by ordinary technicians in the field to which the present disclosure belongs, unless otherwise specifically defined. It should also be understood that terms defined in general dictionaries, such as general dictionaries, should be interpreted as having meanings consistent with their meanings in the context of the relevant technology, and should not be interpreted in an idealized or extremely formal sense, unless explicitly defined herein.
[0080] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.
[0081] See also Figure 1 The present invention provides a method for compensating three-dimensional imaging of a multi-aperture array with full aperture in different regions, which realizes three-dimensional reconstruction of the target by using a sparse planar array with separate transmitters and receivers. Figure 1 As shown in the figure, a spatial Cartesian rectangular coordinate system is established with the center position of the observed target as the coordinate origin. The X-axis, Y-axis, and Z-axis represent the azimuth, distance, and elevation directions, respectively. The size of the sparse planar array along the X-axis is L x , the size along the Z axis is L z , the total number of transmitting elements in the sparse planar array is N T , the total number of receiving array elements is N R , let the coordinates of the transmitting array element be (x t ,y t ,z t ), x t is the horizontal coordinate of the transmitting array element, y tis the ordinate of the transmitting element, z t is the vertical coordinate of the transmitting array element; the receiving array element coordinate is (x r ,y r ,z r ), x r is the horizontal coordinate of the receiving array element, y r is the ordinate of the receiving array element, z r is the vertical coordinate of the receiving array element; the equivalent phase center coordinate is (x e ,y e ,z e ), x e is the horizontal coordinate of the equivalent phase center, y e is the ordinate of the equivalent phase center, z e is the vertical coordinate of the equivalent phase center, and the size of the observation area is T x ×T y ×T z , where T x represents the size of the observation area along the X direction, T y Indicates the size of the observation area along the Y direction, T z Indicates the size of the observation area along the Z direction.
[0082] Figure 2 A flowchart of a multi-aperture array three-dimensional imaging compensation method according to an embodiment of the present disclosure is shown. Figure 2 As shown, the multi-aperture array three-dimensional imaging compensation method includes the following steps:
[0083] S1: Acquire echo signals based on the sparse planar array three-dimensional imaging observation geometry model;
[0084] S2: Divide the observation area containing multiple pixel points into multiple sub-areas;
[0085] S3: determining a sub-region distance compensation factor corresponding to the sparse planar array based on the size of the sub-region and the transceiver array elements on the sparse planar array;
[0086] S4: constructing a filter function based on the regional distance compensation factor, multiplying the echo signal and the filter function to perform distance compression, compensating the echo signal, and determining the compensated echo signal;
[0087] S5: The compensated echo signals are coherently superimposed to determine a three-dimensional image of the observed target.
[0088] In step S1, the echo signal is obtained using formula (1) according to the position coordinates of the pixel points, the transmitting array elements and the receiving array elements and the number of pixel point areas in the sparse planar array three-dimensional imaging observation geometric model;
[0089]
[0090] Among them, A t represents the transmitting array element, A r represents the receiving array element, M is the number of pixel areas, σ(x, y, z) is the backscatter coefficient of the target, k ω Represents the frequency wave number, R tI , R rI Respectively represent the distances between the transmitting array element, the receiving array element and the pixel point;
[0091] See also Figure 3 Step S2, dividing the observation area containing multiple pixel points into multiple sub-areas, comprises the following steps:
[0092] S21: Divide the observation area into N sections along the distance direction, and calculate the number of sections in the observation area using formula (2);
[0093]
[0094] Among them, T y Indicates the size of the observation area along the Y direction, Δn y Indicates the size of the pixel along the distance direction;
[0095] S22: setting a counting variable n, wherein n is an integer greater than or equal to 1 and less than or equal to the number of sections in the observation area; in this embodiment, the initial value of n is set to 1;
[0096] S23: Determine the maximum error point corresponding to the nth section;
[0097] The equivalent phase center at the maximum phase error corresponding to the sparse planar array is recorded as point Q. Based on this point, the observation area is analyzed and a phase error simulation experiment is performed. The simulation experiment parameters are shown in Table 1.
[0098] Table 1. Error analysis parameters.
[0099]
[0100]
[0101] According to the experimental parameters in Table 1, the equivalent phase center point Q coordinate where the maximum phase error is generated is (-0.1, 0.9, 0.1), and the vertical distance between the sparse planar array and the XOZ plane taken in the observation area is 0.9m. The phase error simulation experiment is carried out.
[0102] See also Figure 4, it can be seen that when the transceiver array elements are located at the two end points of the sparse planar array, the equivalent phase center is located at the center point of the sparse planar array. At this time, the phase error is the largest, and the position of the maximum error point is determined. S24: Calculate the maximum distance error from the maximum error point to the sparse planar array;
[0103] like Figure 5 As shown in the figure, "■" represents the transmitting array element, "▲" represents the receiving array element, and "○" represents the equivalent phase center. The XOZ section of the observation area is taken, and the initial vertical distance between the sparse planar array and the section taken from the observation area is recorded as y0. The coordinates of the transmitting array element with the largest phase error in the sparse planar array are A t (0,R0,z0), the receiving element coordinate is A r (-x0, R0, 0), the equivalent phase center point Q coordinate is A e (-x0 / 2, R0, z0 / 2), then the corresponding maximum error point P n The coordinates are (-x0 / 2, R0-y, z0 / 2), where x0 and z0 are the horizontal coordinates of the receiving array element and the vertical coordinates of the transmitting array element, respectively, and R0 represents the vertical distance of the sparse planar array from the origin;
[0104] S241: Calculate the vertical distance between the sparse plane array and the section taken at the point with the maximum error;
[0105] y=y0+(n-1)·Δn y Formula (3)
[0106] Where y represents the vertical distance between the sparse plane array and the slice taken from the observation area, y0 represents the initial vertical distance between the slice taken from the observation area and the sparse plane array, Δn y Indicates the size of the pixel along the distance direction;
[0107] S242: Calculate the one-way distance from the transceiver array element to the point with the maximum error and the distance from the equivalent phase center to the point with the maximum error;
[0108]
[0109] R app =y formula (5)
[0110] Among them, R real R represents the sum of the one-way distances from the transmitting and receiving array elements to the point with the maximum error. app represents the distance from the equivalent phase center to the point with the maximum error, y represents the vertical distance between the sparse planar array and the slice taken from the observation area, x0 and z0 are the horizontal coordinates of the receiving array element and the vertical coordinates of the transmitting array element respectively;
[0111] S243: Calculate the maximum distance error from the maximum error point to the sparse planar array according to the distance between the transceiver array element and the equivalent phase center to the maximum error point;
[0112] ΔR n =R real -2R app Formula (6)
[0113] Among them, ΔR n Represents the maximum distance error from the point with the maximum error to the sparse planar array, R real R represents the sum of the one-way distances from the transmitting and receiving array elements to the point with the maximum error. app Indicates the distance between the equivalent phase center and the point with the maximum error;
[0114] S25: Calculate the azimuth compensation factor corresponding to the point with the maximum error and the elevation compensation factor corresponding to the point with the maximum error;
[0115] S251: Calculate the sum of the one-way distances between the observed target point and the transmitting and receiving array element after stepping in the azimuth and elevation directions respectively using formulas (7) and (8), and calculate the distance between the observed target point and the equivalent phase center after stepping in the azimuth and elevation directions using formula (9).
[0116]
[0117]
[0118]
[0119] Among them, R′ real , R″ real Respectively represent the one-way distance between the observed target point and the transmitting and receiving array element after stepping along the azimuth and elevation directions, and R′ app , R″ app They represent the distance between the observed target point and the equivalent phase center after stepping in azimuth and elevation respectively. x0 and z0 represent the horizontal coordinate of the receiving array element and the vertical coordinate of the transmitting array element respectively. y represents the vertical distance between the sparse planar array and the section taken in the observation area. m x Indicates the number of steps along the X direction, Δn x Indicates the size of the pixel along the azimuth direction;
[0120] S252: Calculate the azimuth compensation factor coefficient corresponding to the maximum error point and the elevation compensation factor coefficient corresponding to the maximum error point respectively by using the Taylor expansion formula (9) and (10).
[0121]
[0122]
[0123] Among them, a nx 、b nx Indicates the azimuth compensation factor coefficient corresponding to the point with the maximum error, a nz 、b nz Indicates the compensation factor coefficient of the elevation corresponding to the point with the maximum error, R t Indicates the distance from the transmitting element to the point with the maximum error, Δn x , Δn z Respectively represent the size of the pixel point in azimuth and elevation, y represents the vertical distance between the sparse planar array and the section taken in the observation area, x0 and z0 represent the horizontal coordinate of the receiving array element and the vertical coordinate of the transmitting array element respectively;
[0124] S253: Determine the azimuth compensation factor corresponding to the point with the maximum error and the elevation compensation factor corresponding to the point with the maximum error according to the azimuth compensation factor coefficient corresponding to the point with the maximum error and the elevation compensation factor coefficient corresponding to the point with the maximum error, respectively.
[0125] A nx =a nx -2b nx Formula (12)
[0126] B nz =a nz -2b nz Formula (13)
[0127] Among them, A nx , B nz They represent the azimuth compensation factor corresponding to the point with the largest error and the elevation compensation factor corresponding to the point with the largest error, respectively. nx 、b nx Indicates the azimuth compensation factor coefficient corresponding to the point with the maximum error, a nz 、b nz Indicates the compensation factor coefficient in the elevation direction corresponding to the point with the maximum error;
[0128] S26: Calculate the distance error compensation factor corresponding to the section of the observation area based on the maximum distance error, the azimuth compensation factor corresponding to the point with the maximum error, and the elevation compensation factor corresponding to the point with the maximum error,
[0129]
[0130] Among them, ΔR com Represents the distance error compensation factor, ΔR n Indicates the maximum distance error from the point with the maximum error to the sparse planar array, A nx , B nzThey represent the azimuth compensation factor corresponding to the point with the largest error and the elevation compensation factor corresponding to the point with the largest error, m x Indicates the number of steps along the X direction, m z Indicates the number of steps along the Z direction;
[0131] S27: Determine the size of the sub-region based on the maximum distance error and the distance error compensation factor.
[0132] S271: Calculating the distance between the observation target point and the transceiver array element and the equivalent phase center after stepping;
[0133]
[0134]
[0135] Among them, R′ t , R′ r , R′ e They represent the distances between the transmitting array element, the receiving array element, the equivalent phase center and the observed target point after stepping, y represents the vertical distance between the sparse planar array and the section taken from the observation area, m x Indicates the number of steps along the X direction, m z Indicates the number of steps along the Z direction, Δn x Indicates the size of the pixel along the azimuth direction, Δn z Indicates the size of the pixel along the elevation direction;
[0136] S272: Determine the compensated distance error according to the distance between the observation target point and the transceiver array element, the equivalent phase center, and the distance error compensation factor after stepping.
[0137] ΔR new =R′ t +R′ r -(2R′ e +ΔR com ) Formula (17)
[0138] Among them, ΔR new Represents the compensated distance error corresponding to the observed target point after stepping, R′ t , R′ r , R′ e Respectively represent the distance between the transmitting array element, the receiving array element, the equivalent phase center and the observed target point after stepping, ΔR com Represents the distance error compensation factor;
[0139] S273: Determine the size of the sub-region according to the phase error condition.
[0140] like Figure 6As shown, the XOZ section is the observation area stepping m along the Y direction. y The observation area is divided into N sections. Take one of the XOZ sections in the observation area and divide it into K regions. Determine the size of the sub-regions.
[0141] M k_n =max(2m)·Δn x Formula (18)
[0142] Among them, M k_n Indicates the size of the observation area division area, Δn x Indicates the size of the pixel along the azimuth direction, and m indicates the number of steps in the azimuth direction and the number of steps in the elevation direction;
[0143] S28: If n is less than or equal to the number of cross-sections in the observation area, n is increased by 1 and step S23 is executed; if n is greater than the number of cross-sections in the observation area, the process ends.
[0144] See also Figure 7 Step S3: Determining the sub-region distance compensation factor corresponding to the sparse planar array based on the size of the sub-region and the transceiver array elements on the sparse planar array comprises the following steps:
[0145] S31: Calculating the number of sub-regions of the observation area according to the size of the observation area and the size of the sub-regions,
[0146]
[0147] Among them, K n Indicates the number of regions divided into observation areas, M k_n Indicates the size of the observation area division area, T x 、T z Respectively represent the size of the observation area along the X direction and along the Z direction;
[0148] S32: setting a counting variable k, where k is an integer greater than or equal to 1 and less than or equal to the number of sub-regions; in this embodiment, the initial value of k is set to 1;
[0149] S33: Determine the distance error corresponding to the pixel point in the kth sub-region;
[0150] S331: Determine the pixel point P in the sub-area k and the pixel point P after stepping s The positional relationship between
[0151]
[0152] Among them, x k ,y k 、zk They are pixel points P in the sub-areas respectively. k The horizontal coordinate, vertical coordinate, and vertical coordinate of x s ,y s 、z s They are the pixel points P after stepping. s The horizontal coordinate, vertical coordinate and vertical coordinate of the azimuth direction are shown in Figure 1. m represents the number of steps in the azimuth direction and the number of steps in the elevation direction, Δn represents the number of steps in the azimuth direction and the elevation direction, and x Indicates the size of the pixel along the azimuth direction, Δn z Indicates the size of the pixel along the elevation direction;
[0153] S332: Calculate pixel points P in each region k The distance from the transmitting and receiving array elements and the equivalent phase center,
[0154]
[0155] Among them, R kt , R kr , R ke They represent the transmitting array element, the receiving array element, the equivalent phase center and the pixel point P in the sub-region respectively. k The distance between k ,y k 、z k They are pixel points P in the sub-areas respectively. k The horizontal coordinate, vertical coordinate and vertical coordinate of the array are x0 and z0, respectively, and the horizontal coordinate and vertical coordinate of the receiving array element are z0 and z0, respectively, and R0 represents the vertical distance of the sparse planar array from the origin;
[0156] S333: Calculate the pixel point P in the kth sub-region k The corresponding distance error is
[0157] ΔR k =R kt +R kr -2R ke Formula (22)
[0158] Among them, ΔR k Represents the pixel point P in the sub-region k The corresponding distance error, R kt , R kr , R ke They represent the transmitting array element, the receiving array element, the equivalent phase center and the pixel point P in the sub-region respectively. k The distance between
[0159] S34: Calculate the azimuth compensation factor corresponding to the pixel points in the sub-region and the elevation compensation factor corresponding to the pixel points in the sub-region.
[0160]
[0161] Among them, A kx , B kz They represent the azimuth compensation factor corresponding to the pixel points in the sub-region and the elevation compensation factor corresponding to the pixel points in the sub-region, respectively. kx 、b kx Indicates the azimuth compensation factor coefficient corresponding to the pixel point in the sub-region, a kz 、b kz Indicates the elevation compensation factor coefficient corresponding to the pixel point in the sub-area. The azimuth compensation factor coefficient and elevation compensation factor coefficient satisfy
[0162]
[0163] Among them, a kx 、b kx Indicates the azimuth compensation factor coefficient corresponding to the pixel point in the sub-region, a kz 、b kz Indicates the compensation factor coefficient of the elevation corresponding to the pixel point in the sub-area, Δn x Indicates the size of the pixel along the azimuth direction, Δn z Indicates the size of the pixel along the elevation direction, y k 、z k They are pixel points P in the sub-areas respectively. k The ordinate and vertical coordinates, R kt Represents the transmitting array element and the pixel point P in the sub-region k The distance between
[0164] S35: If the product of the size of the pixel point in the azimuth direction and the number of steps in the azimuth direction is not greater than the size of the sub-region, iterate in the azimuth direction and execute step S33; if greater, execute step S36;
[0165] S36: If the product of the size of the pixel point in the elevation direction and the number of steps in the elevation direction is not greater than the size of the sub-region, iterate in the elevation direction and execute step S33; if greater, execute step S37;
[0166] S37: Calculate the sub-region distance compensation factor corresponding to the pixel point in the sub-region based on the distance error, azimuth compensation factor and elevation compensation factor corresponding to the pixel point in the sub-region,
[0167] ΔR p =ΔR k +A kx ·m 2 +B kz ·m 2 Formula (25)
[0168] Among them, ΔR pRepresents the pixel point P in the sub-region k The corresponding regional distance compensation factor, ΔR k Represents the pixel point P in the sub-region k The corresponding distance error, A kx Indicates the azimuth compensation factor corresponding to the pixel point in the sub-region, B kz Indicates the elevation compensation factor corresponding to the pixel point in the sub-area, m x Indicates the number of steps along the X direction, m z Indicates the number of steps along the Z direction;
[0169] S38: If k is not greater than the number of sub-regions, k is increased by 1 and step S33 is executed; if it is greater, step S39 is executed;
[0170] S39: Obtaining the regional distance compensation factor of the observation area,
[0171] ΔR m =[ΔR p ] N×K Formula (26)
[0172] Among them, ΔR m Represents the sub-region distance compensation factor of the observation area, ΔR p Represents the pixel point P in the sub-region k The corresponding sub-region distance compensation factor;
[0173] In step S4, a filter function is constructed based on the regional distance compensation factor. For example, the filter function is constructed using formula (27), the echo signal and the filter function are multiplied to perform distance compression, the echo signal is compensated, and the compensated echo signal is determined using formula (28).
[0174]
[0175]
[0176] Among them, E(A t ,A r ,m) represents the echo signal after compensation, s(A t ,A r ,k w ) represents the echo signal, H′ m (x e ,z e ,m) represents the filter function, k ω Indicates the frequency wave number, ΔR m Represents the regional distance compensation factor of the observation area, R eI Indicates the distance between the equivalent phase center and the pixel point;
[0177] In step S5: the compensated echo signals are coherently superimposed to determine a three-dimensional image of the observed target.
[0178]
[0179] Among them, σ(x n ,y n ,z n ) represents the three-dimensional image imaging result of the observed target, E(A t ,A r ,m) represents the echo signal after compensation, N T 、N R are the total number of transmitting array elements and the total number of receiving array elements in the sparse planar array respectively;
[0180] In the disclosed embodiment, BPA is combined with the equivalent phase center principle, and the equivalent phase center is used to replace the transceiver array element. In the imaging process, only the distance between the equivalent phase center and each pixel point is calculated, which reduces the amount of distance phase history calculation in the dual-station equivalent process and improves the imaging efficiency. In near-field imaging, the phase center equivalent causes errors, which causes image defocus. This disclosure analyzes the phase error between the target point and the transceiver array element and the equivalent phase center, and proposes an imaging method with a built-in compensation function, which simplifies the repeated calculation process of the compensation function caused by the phase space variation, solves the image defocus problem, and ensures the imaging quality.
[0181] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.
[0182] In addition, the present disclosure also provides a multi-aperture array three-dimensional imaging compensation device, an electronic device, a computer-readable storage medium, and a program, all of which can be used to implement any multi-aperture array three-dimensional imaging compensation method provided by the present disclosure. The corresponding technical solutions and descriptions are referred to the corresponding records in the method part and will not be repeated here.
[0183] See also Figure 8 , which shows a block diagram of a multi-aperture array three-dimensional imaging compensation device according to an embodiment of the present disclosure. The multi-aperture array three-dimensional imaging compensation device comprises:
[0184] An acquisition module 10 is used to acquire echo signals based on a sparse planar array three-dimensional imaging observation geometric model;
[0185] A division module 20, used to divide an observation area containing a plurality of pixel points into a plurality of sub-areas;
[0186] A determination module 30, configured to determine a sub-region distance compensation factor corresponding to the sparse planar array based on the size of the sub-region and the transceiver array elements on the sparse planar array;
[0187] A compensation module 40, configured to construct a filter function based on the sub-region distance compensation factor, multiply the echo signal by the filter function to perform distance compression, compensate the echo signal, and determine a compensated echo signal;
[0188] The stacking module 50 is used for coherently stacking the compensated echo signals to determine a three-dimensional image of the observed target.
[0189] In some possible implementations, the method for dividing an observation area including a plurality of pixel points into a plurality of sub-areas comprises the following steps:
[0190] S21: Divide the observation area into N sections along the distance direction, and calculate the number of sections in the observation area;
[0191] S22: Setting a counting variable n, where n is an integer greater than or equal to 1 and less than or equal to the number of sections in the observation area;
[0192] S23: Determine the maximum error point corresponding to the nth section;
[0193] S24: Calculate the maximum distance error from the maximum error point to the sparse planar array;
[0194] S25: Calculate the azimuth compensation factor corresponding to the point with the maximum error and the elevation compensation factor corresponding to the point with the maximum error;
[0195] S26: Calculating a distance error compensation factor corresponding to a section of the observation area based on the maximum distance error, the azimuth compensation factor corresponding to the point with the maximum error, and the elevation compensation factor corresponding to the point with the maximum error;
[0196] S27: Determine the size of the sub-region based on the maximum distance error and the distance error compensation factor;
[0197] S28: If n is less than or equal to the number of cross-sections in the observation area, n is increased by 1 and step S23 is executed; if n is greater than the number of cross-sections in the observation area, the process ends.
[0198] In some possible implementations, the method for determining the sub-region distance compensation factor corresponding to the sparse planar array based on the size of the sub-region and the transceiver array elements on the sparse planar array includes the following steps:
[0199] S31: Calculating the number of sub-regions of the observation area according to the size of the observation area and the size of the sub-regions,
[0200] S32: Setting a counting variable k, where k is an integer greater than or equal to 1 and less than or equal to the number of sub-regions;
[0201] S33: Determine the distance error corresponding to the pixel point in the kth sub-region;
[0202] S34: Calculate the azimuth compensation factor corresponding to the pixel points in the sub-region and the elevation compensation factor corresponding to the pixel points in the sub-region;
[0203] S35: If the product of the size of the pixel point in the azimuth direction and the number of steps in the azimuth direction is not greater than the size of the sub-region, iterate in the azimuth direction and execute step S33; if greater, execute step S36;
[0204] S36: If the product of the size of the pixel point in the elevation direction and the number of steps in the elevation direction is not greater than the size of the sub-region, iterate in the elevation direction and execute step S33; if greater, execute step S37;
[0205] S37: Calculating the sub-region distance compensation factor corresponding to the pixel point in the sub-region based on the distance error, azimuth compensation factor and elevation compensation factor corresponding to the pixel point in the sub-region;
[0206] S38: If k is not greater than the number of sub-regions, k is increased by 1 and step S33 is executed; if it is greater, step S39 is executed;
[0207] S39: Obtaining the regional distance compensation factor of the observation area.
[0208] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.
[0209] The embodiment of the present disclosure also provides a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the above method is implemented. The computer-readable storage medium may be a non-volatile computer-readable storage medium.
[0210] The embodiment of the present disclosure further proposes an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured as the above method.
[0211] The electronic device may be provided as a terminal, a server, or a device in other forms.
[0212] Fig. 9A block diagram of an electronic device 800 according to an embodiment of the present disclosure is shown. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.
[0213] Reference Fig. 9 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .
[0214] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.
[0215] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions, which can be executed by a processor 820 of an electronic device 800 to perform the above method.
[0216] Fig.10 1 is a block diagram of another electronic device 1900 according to an embodiment of the present disclosure. For example, the electronic device 1900 may be provided as a server. Fig.10 , the electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932 for storing instructions executable by the processing component 1922, such as an application. The application stored in the memory 1932 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.
[0217] The electronic device 1900 may also include a power supply component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input / output (I / O) interface 1958. The electronic device 1900 may operate based on an operating system stored in the memory 1932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™ or the like.
[0218] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the electronic device 1900 to perform the above method.
[0219] The present disclosure may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.
[0220] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of special hardware and computer instructions.
[0221] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.
Claims
1. A multi-aperture array three-dimensional imaging compensation method, characterized in that: The steps include: S1: Acquire echo signals based on the sparse planar array three-dimensional imaging observation geometry model; S2: Divide the observation area containing multiple pixel points into multiple sub-areas; S3: determining a sub-region distance compensation factor corresponding to the sparse planar array based on the size of the sub-region and the transceiver array elements on the sparse planar array; S4: constructing a filter function based on the regional distance compensation factor, multiplying the echo signal and the filter function to perform distance compression, compensating the echo signal, and determining the compensated echo signal; S5: coherently superimpose the compensated echo signals to determine a three-dimensional image of the observed target; The step of dividing the observation area including the plurality of pixels into a plurality of sub-areas comprises the following steps: S21: Divide the observation area into N sections along the distance direction, and calculate the number of sections in the observation area; S22: Setting a counting variable n, where n is an integer greater than or equal to 1 and less than or equal to the number of sections in the observation area; S23: Determine the maximum error point corresponding to the nth section; S24: Calculate the maximum distance error from the maximum error point to the sparse planar array; S25: Calculate the azimuth compensation factor corresponding to the point with the maximum error and the elevation compensation factor corresponding to the point with the maximum error; S26: Calculating a distance error compensation factor corresponding to a section of the observation area based on the maximum distance error, the azimuth compensation factor corresponding to the point with the maximum error, and the elevation compensation factor corresponding to the point with the maximum error; S27: Determine the size of the sub-region based on the maximum distance error and the distance error compensation factor; S28: If n is less than or equal to the number of cross-sections in the observation area, n is increased by 1 and step S23 is executed; if n is greater than the number of cross-sections in the observation area, the process ends; The step of calculating the maximum distance error from the point with the maximum error to the sparse planar array comprises the following steps: S241: Calculate the vertical distance between the sparse plane array and the section taken at the point with the maximum error; S242: Calculate the one-way distance from the transceiver array element to the point with the maximum error and the distance from the equivalent phase center to the point with the maximum error; S243: Calculate the maximum distance error from the maximum error point to the sparse planar array according to the distance between the transceiver array element and the equivalent phase center to the maximum error point.
2. The method according to claim 1, characterized in that The step of calculating the azimuth compensation factor corresponding to the point with the maximum error and the elevation compensation factor corresponding to the point with the maximum error comprises the following steps: S251: Calculate the one-way distance between the observation target point and the transceiver array element and the distance between the equivalent phase centers after stepping in the azimuth direction and the elevation direction respectively; S252: Calculating the azimuth compensation factor coefficient corresponding to the maximum error point and the elevation compensation factor coefficient corresponding to the maximum error point through Taylor expansion; S253: According to the azimuth compensation factor coefficient corresponding to the point with the maximum error and the elevation compensation factor coefficient corresponding to the point with the maximum error, respectively determine the azimuth compensation factor corresponding to the point with the maximum error and the elevation compensation factor corresponding to the point with the maximum error.
3. The method according to claim 2, characterized in that The step of determining the size of the sub-region based on the maximum distance error and the distance error compensation factor comprises the following steps: S271: Calculating the distance between the observation target point and the transceiver array element and the equivalent phase center after stepping; S272: determining a compensated distance error according to the distance between the observation target point and the transceiver array element, the equivalent phase center, and the distance error compensation factor after stepping; S273: Determine the size of the sub-region according to the phase error condition.
4. The method according to claim 1, characterized in that: The step of determining the sub-region distance compensation factor corresponding to the sparse planar array based on the size of the sub-region and the transceiver array elements on the sparse planar array comprises the following steps: S31: Calculating the number of sub-regions of the observation area according to the size of the observation area and the size of the sub-regions; S32: Setting a counting variable k, where k is an integer greater than or equal to 1 and less than or equal to the number of sub-regions; S33: Determine the distance error corresponding to the pixel point in the kth sub-region; S34: Calculate the azimuth compensation factor corresponding to the pixel points in the sub-region and the elevation compensation factor corresponding to the pixel points in the sub-region; S35: If the product of the size of the pixel point in the azimuth direction and the number of steps in the azimuth direction is not greater than the size of the sub-region, iterate in the azimuth direction and execute step S33; if greater, execute step S36; S36: If the product of the size of the pixel point in the elevation direction and the number of steps in the elevation direction is not greater than the size of the sub-region, iterate in the elevation direction and execute step S33; if greater, execute step S37; S37: Calculating the sub-region distance compensation factor corresponding to the pixel point in the sub-region based on the distance error, azimuth compensation factor and elevation compensation factor corresponding to the pixel point in the sub-region; S38: If k is not greater than the number of sub-regions, k is increased by 1 and step S33 is executed; if it is greater, step S39 is executed; S39: Obtaining the regional distance compensation factor of the observation area.
5. The method according to claim 4, characterized in that The step of determining the distance error corresponding to the pixel point in the kth sub-region comprises the following steps: S331: Determine the positional relationship between the pixel points in the sub-area and the pixel points after stepping; S332: Calculate the distances between the pixel points in the sub-areas and the transceiver array elements and the equivalent phase center; S333: Calculate the distance error corresponding to the pixel points in the kth sub-region.
6. The method according to claim 1, characterized in that The step of determining the compensated echo signal comprises: Constructing a filter function based on the regional distance compensation factor; Distance compression is performed based on the filter function to determine a compensated echo signal.
7. The method according to claim 1, characterized in that The step of determining a three-dimensional image of an observation target comprises: Performing coherent superposition on the compensated echo signals; Calculate the imaging result corresponding to each pixel; The three-dimensional image of the observed target is determined based on the imaging result corresponding to each pixel point.
8. A multi-aperture array three-dimensional imaging compensation device, characterized in that: include: An acquisition module, used for acquiring echo signals based on a sparse planar array three-dimensional imaging observation geometric model; A division module, used for dividing an observation area containing a plurality of pixel points into a plurality of sub-areas; A determination module, configured to determine a sub-region distance compensation factor corresponding to the sparse planar array based on the size of the sub-region and the transceiver array elements on the sparse planar array; A compensation module, configured to construct a filter function based on the sub-region distance compensation factor, multiply the echo signal by the filter function to perform distance compression, compensate the echo signal, and determine the compensated echo signal; A superposition module is used for coherent superposition of compensated echo signals to determine a three-dimensional image of the observed target; The step of dividing the observation area including the plurality of pixels into a plurality of sub-areas comprises the following steps: S21: Divide the observation area into N sections along the distance direction, and calculate the number of sections in the observation area; S22: Setting a counting variable n, where n is an integer greater than or equal to 1 and less than or equal to the number of sections in the observation area; S23: Determine the maximum error point corresponding to the nth section; S24: Calculate the maximum distance error from the maximum error point to the sparse planar array; S25: Calculate the azimuth compensation factor corresponding to the point with the maximum error and the elevation compensation factor corresponding to the point with the maximum error; S26: Calculating a distance error compensation factor corresponding to a section of the observation area based on the maximum distance error, the azimuth compensation factor corresponding to the point with the maximum error, and the elevation compensation factor corresponding to the point with the maximum error; S27: Determine the size of the sub-region based on the maximum distance error and the distance error compensation factor; S28: If n is less than or equal to the number of cross-sections in the observation area, n is increased by 1 and step S23 is executed; if n is greater than the number of cross-sections in the observation area, the process ends; The step of calculating the maximum distance error from the point with the maximum error to the sparse planar array comprises the following steps: S241: Calculate the vertical distance between the sparse plane array and the section taken at the point with the maximum error; S242: Calculate the one-way distance from the transceiver array element to the point with the maximum error and the distance from the equivalent phase center to the point with the maximum error; S243: Calculate the maximum distance error from the maximum error point to the sparse planar array according to the distance between the transceiver array element and the equivalent phase center to the maximum error point.
