Change detection device and change detection method

The change detection device enhances change detection by optimizing polarization states for multi-polarization SAR images, addressing the issue of unclear changes in displacement extraction targets through improved power difference calculations.

JP7595810B1Active Publication Date: 2024-12-06MITSUBISHI ELECTRIC CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024523558
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-08-04
Publication Date
2024-12-06
Estimated Expiration
2043-08-04

AI Technical Summary

Technical Problem

Existing change detection devices using single-polarized SAR images struggle to select an optimal combination of polarization states for transmitted and received radio waves, leading to unclear changes in displacement extraction targets due to varying polarization states.

Method used

A change detection device that acquires time-series multi-polarization SAR images, determines the optimal combination of polarization states by calculating power differences using the Lagrange undetermined multiplier method, and extracts polarization components to enhance change detection.

Benefits of technology

Enables clear detection of changes in observation targets by selecting polarization states that maximize power differences, improving the sensitivity and accuracy of change detection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007595810000028
    Figure 0007595810000028
  • Figure 0007595810000029
    Figure 0007595810000029
  • Figure 0007595810000030
    Figure 0007595810000030
Patent Text Reader

Abstract

The change detection device is configured to include an image acquisition unit (1) that acquires time-series polarized SAR images obtained by polarized SAR observation of the observation target at a plurality of different times, and a polarization state determination unit (2) that determines, based on the power of the polarized SAR images acquired by the image acquisition unit (1), a combination of the polarization state of a transmitted radio wave radiated toward the observation target and the polarization state of a received radio wave, which is a radio wave reflected by the observation target, as a polarization state to be used for detecting a change in the observation target.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a change detection device and a change detection method. [Background technology]

[0002] 2. Description of the Related Art There is a change detection device that detects changes in an observation target by comparing multiple Synthetic Aperture Radar (SAR) images, which are images of the observation target. As such a change detection device, for example, Patent Document 1 discloses a change detection device that compares a reference image, which is an image of a displacement extraction target region, with a target image, which is an image of the displacement extraction target region captured at a time different from that of the reference image, and detects a change in the displacement extraction target region based on the comparison result between the reference image and the target image. Each of the reference image and the target image is a single-polarized SAR image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2023-65066 A Summary of the Invention [Problem to be solved by the invention]

[0004] Depending on the combination of the polarization state of the transmitted radio wave related to the SAR image and the polarization state of the received radio wave related to the SAR image, the change in the displacement extraction target area may be clear or unclear. Specifically, when the polarization state of the transmitted radio wave related to the SAR image is, for example, vertical polarization, and the polarization state of the received radio wave related to the SAR image is, for example, horizontal polarization, the change in the displacement extraction target area may be clear. On the other hand, when the polarization state of the transmitted radio wave is, for example, horizontal polarization, and the polarization state of the received radio wave is, for example, vertical polarization, the change in the displacement extraction target area may be unclear. In the change detection device disclosed in Patent Document 1, the SAR image is a single-polarized SAR image, not a multi-polarized SAR image obtained by multi-polarized SAR observation. Therefore, the change detection device has a problem in that it cannot select a combination of the polarization state of the transmitted radio wave and the polarization state of the received radio wave that clearly shows a change in the displacement extraction target area.

[0005] The present disclosure has been made to solve the above-mentioned problems, and aims to provide a change detection device that can select a combination of polarization states that clearly indicates a change in the object being observed. [Means for solving the problem]

[0006] The change detection device according to the present disclosure includes an image acquisition unit that acquires time-series polarimetric SAR images obtained by observing an observation target with a polarimetric SAR (Synthetic Aperture Radar) at a plurality of different times, and a power difference ΔPli between the power values ​​of two polarimetric SAR images acquired by the image acquisition unit. n and a polarization state determination unit that determines a combination of a transmission polarization state and a polarization state of a received radio wave, which is a radio wave reflected by the observation target, while switching the polarization state of a transmission radio wave radiated toward the observation target based on the polarization state used to detect a change in the observation target, the polarization state determination unit, when selecting an arbitrary transmission polarization state, calculates a reception polarization state corresponding to the maximum value of the power value difference ΔPlin between the polarized SAR images at two times, and while switching the transmission polarization state, repeatedly performs a process of calculating the power value difference ΔPlin and a process of calculating the reception polarization state, and compares the differences ΔPlin for all combinations to determine an optimal combination of the transmission polarization state and the reception polarization state that maximizes the power value difference ΔPlin; The polarization state determination unit includes a polarization component extraction unit that extracts, from each of the multi-polarized SAR images acquired by the image acquisition unit, a polarization component that corresponds to the combination determined by the polarization state determination unit. Effect of the Invention

[0007] According to the present disclosure, it is possible to select a combination of polarization states that clearly indicates a change in an observation target. [Brief description of the drawings]

[0008] [Figure 1] 1 is a configuration diagram showing a change detection device according to a first embodiment. [Diagram 2]1 is a hardware configuration diagram showing hardware of a change detection device according to a first embodiment. [Diagram 3] FIG. 2 is a hardware configuration diagram of a computer in the case where the change detection device is realized by software, firmware, or the like. [Figure 4] 4 is a flowchart showing a change detection method which is a processing procedure of the change detection device. [Diagram 5] 1A and 1B are explanatory diagrams showing an orientation angle ψ and an ellipticity angle χ, respectively. [Figure 6] FIG. 6A is an explanatory diagram showing an example of the PS of Co-Pol with respect to a horizontal dipole, and FIG. 6B is an explanatory diagram showing an example of the PS of Cr-Pol with respect to a horizontal dipole. [Figure 7] FIG. 11 is a configuration diagram showing a change detection device according to a second embodiment. [Figure 8] FIG. 11 is a hardware configuration diagram showing hardware of a change detection device according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] In order to describe the present disclosure in more detail, embodiments of the present disclosure will be described below with reference to the accompanying drawings.

[0010] Embodiment 1 FIG. 1 is a configuration diagram showing a change detection device according to the first embodiment. FIG. 2 is a hardware configuration diagram showing hardware of the change detection device according to the first embodiment. The change detection device shown in FIG. 1 includes an image acquisition unit 1, a polarization state determination unit 2, a polarization component extraction unit 3, and a change detection unit 4.

[0011] The image acquisition unit 1 is realized by, for example, an image acquisition circuit 11 shown in FIG. The image acquisition unit 1 acquires time-series polarimetric SAR images obtained by observing an observation target with a polarimetric SAR (Synthetic Aperture Radar) at a plurality of mutually different times. A multi-polarized SAR image contains a polarization component (hereinafter referred to as "hh") when the polarization state of the transmitted radio waves is horizontally polarized and the polarization state of the received radio waves is horizontally polarized, and a polarization component (hereinafter referred to as "hv") when the polarization state of the transmitted radio waves is horizontally polarized and the polarization state of the received radio waves is vertically polarized. In addition, a multi-polarized SAR image contains a polarization component (hereinafter referred to as "vh") when the polarization state of the transmitted radio waves is vertically polarized and the polarization state of the received radio waves is horizontally polarized, and a polarization component (hereinafter referred to as "vv") when the polarization state of the transmitted radio waves is vertically polarized and the polarization state of the received radio waves is vertically polarized. The image acquisition unit 1 outputs time-series polarimetric SAR images to the polarization state determination unit 2 and the polarization component extraction unit 3, respectively.

[0012] The polarization state determining unit 2 is realized by, for example, a polarization state determining circuit 12 shown in FIG. The polarization state determining unit 2 acquires time-series polarimetric SAR images from the image acquiring unit 1 . Based on the power of the polarized SAR image, the polarization state determination unit 2 determines a combination of the polarization state of the transmitted radio waves emitted toward the observation target and the polarization state of the received radio waves, which are radio waves reflected by the observation target, as the polarization state to be used for detecting changes in the observation target. Specifically, the polarization state determination unit 2 assumes that the polarization state of the transmitted radio wave is one of a plurality of polarization states, and repeatedly calculates the power difference between any two of the time-series polarization SAR images. Then, the polarization state determination unit 2 compares the calculated differences with each other, and determines the polarization state of the transmitted radio wave based on the comparison result of the differences, and determines the combination of the polarization state of the transmitted radio wave and the polarization state of the received radio wave.

[0013] The polarized component extractor 3 is realized by, for example, a polarized component extractor circuit 13 shown in FIG. The polarized component extraction unit 3 acquires time-series polarized SAR images from the image acquisition unit 1. The polarization component extractor 3 extracts, from each of the polarimetric SAR images, the polarization components that correspond to the combinations determined by the polarization state determiner 2. The polarization component extraction unit 3 outputs each of the extracted polarization components to the change detection unit 4.

[0014] The change detection unit 4 is realized by, for example, a change detection circuit 14 shown in FIG. The change detection unit 4 acquires a plurality of polarization components from the polarization component extraction unit 3 . The change detection unit 4 compares the power of the multiple polarization components with each other. The change detection unit 4 detects a change in the observation target based on the result of the power comparison. The change detection unit 4 outputs the detection result of the change in the observation target to, for example, a monitoring device (not shown). An example of the monitoring device is a device that monitors the occurrence of disasters in a region.

[0015] In Fig. 1, it is assumed that each of the components of the change detection device, that is, the image acquisition unit 1, the polarization state determination unit 2, the polarization component extraction unit 3, and the change detection unit 4, is realized by dedicated hardware as shown in Fig. 2. In other words, it is assumed that the change detection device is realized by an image acquisition circuit 11, a polarization state determination circuit 12, a polarization component extraction circuit 13, and a change detection circuit 14. Each of the image acquisition circuit 11, the polarization state determination circuit 12, the polarization component extraction circuit 13 and the change detection circuit 14 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination of these.

[0016] The components of the change detection device are not limited to those realized by dedicated hardware, and the change detection device may be realized by software, firmware, or a combination of software and firmware. The software or firmware is stored as a program in the memory of a computer. The computer means hardware that executes the program, and includes, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a processor, or a DSP (Digital Signal Processor).

[0017] FIG. 3 is a hardware configuration diagram of a computer in the case where the change detection device is realized by software, firmware, or the like. When the change detection device is realized by software, firmware, or the like, a program for causing a computer to execute the respective processing procedures in the image acquisition unit 1, the polarization state determination unit 2, the polarization component extraction unit 3, and the change detection unit 4 is stored in the memory 21. Then, a processor 22 of the computer executes the program stored in the memory 21.

[0018] 2 shows an example in which each of the components of the change detection device is realized by dedicated hardware, and Fig. 3 shows an example in which the change detection device is realized by software, firmware, etc. However, this is merely one example, and some of the components in the change detection device may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.

[0019] First, polarimetric SAR observation of an observation target will be explained. For example, the power P of a received signal observed by a radar is expressed as a polarization state vector p →t and the polarization state vector p →rand the scattering matrix S expressed in the HV basis, it is expressed as the following equation (1). The received signal observed by the radar is a signal that indicates the radio wave reflected by the observation target. In the specification document, the symbol "→" cannot be placed above the letters due to electronic filing, so p →t , or p →r The HV basis represents a vector space with horizontal polarization h and vertical polarization v. Here, the polarization state vector p →t ,p →r is expressed in the HV basis. However, the basis can be any vector space with two mutually orthogonal polarized waves, and is not limited to the vector space with horizontal polarized wave h and vertical polarized wave v.

[0020] TIFF0007595810000001.tif47166In equations (1) to (3), all elements are complex numbers.

[0021] Antenna vector A of the antenna mounted on the radar → When is expressed as the following equation (5) and the covariance matrix C is expressed as the following equation (6), the power P of the received signal can be transformed into the following equation (4).

[0022] TIFF0007595810000002.tif72166In equations (4) to (6), T is a mathematical symbol indicating a transposed matrix, and * is a mathematical symbol indicating a conjugate.

[0023] The incoherent superposition of scattering from multiple scatterers can be expressed as an ensemble average by using the covariance matrix C, as shown in the following equation (7). The incoherent superposition of scattering from multiple scatterers is the state of a signal that is actually received.

[0024] TIFF0007595810000003.tif15166

[0025] Polarization state vector p →i can be expressed using the orientation angle ψ and the ellipticity angle χ as shown in the following equation (8).

[0026] TIFF0007595810000004.tif20166

[0027] If the orientation angle ψ and the ellipticity angle χ are defined on a general elliptical polarization as shown in FIG. 5, the angular ranges of the orientation angle ψ and the ellipticity angle χ are expressed by the following equations (9) and (10). -90deg≦ψ≦90deg (9) -45deg≦χ≦45deg (10) FIG. 5 is an explanatory diagram showing the orientation angle ψ and the ellipticity angle χ. In Fig. 5, h indicates the polarization direction of horizontally polarized waves, and v indicates the polarization direction of vertically polarized waves. The ellipse in Fig. 5 represents elliptical polarization.

[0028] When multiple scattering matrices S are obtained by performing polarimetric SAR observation, the covariance matrix C can be obtained by ensemble averaging the multiple scattering matrices S. For the covariance matrix C shown in formula (7), the scattering coefficient can be derived while changing the orientation angle ψ and the ellipticity angle χ within the angle ranges shown in formulas (9) to (10). In particular, a diagram showing the received power calculated for Co-Pol (Co-polarization), in which the transmission polarization state and the reception polarization state are the same, and Cr-Pol (Cross-polarization), in which the transmission polarization state and the reception polarization state are orthogonal, is called PS (Polarimetric Signature).

[0029] For example, the PS of Co-Pol with respect to a horizontal dipole is shown in FIG. 6A, and the PS of Cr-Pol with respect to a horizontal dipole is shown in FIG. 6B. FIG. 6A is an explanatory diagram showing an example of the PS of Co-Pol with respect to a horizontal dipole, and FIG. 6B is an explanatory diagram showing an example of the PS of Cr-Pol with respect to a horizontal dipole. PS is unique information that represents the state of the observed target, and its shape will not change unless the state of the observed target and the state of the radar sensor change. Currently, the bases widely used in polarimetric SAR observations are H and V polarizations, and their combinations are Co-Pol (HH and VV polarizations) and Cr-Pol (HV and VH polarizations), with the angles corresponding as follows: Co-Pol :HH@(ψ t ,χ t )=(0,0), VV@(ψ t ,χ t )=(±90,0) Cr-Pol :VH@(ψ t ,χ t )=(0,0), HV@(ψ t ,χ t )=(±90,0) (11)

[0030] Therefore, by using PS to represent the scattering conditions of the observed object, the sensitivity of the polarization to changes in the observed object can be defined as follows: Polarimetric sensitivity = Effect of changes in the observed object on the shape of the PS In addition, the orientation angle ψ and the ellipticity angle χ for transmission and reception, and the parameter p i Using (t), the polarization sensitivity can be expressed as the following equation (12).

[0031] TIFF0007595810000005.tif22166In equation (12), p iindicates observation conditions such as time or incidence angle, or a continuously changing physical quantity. Examples of a continuously changing physical quantity include the height of an observation target, or the growth state of an observation target.

[0032] The power P of the received signal shown in equation (7) can also be expressed as the following equation (13) by separating the transmission polarization state and the reception polarization state.

[0033] TIFF0007595810000006.tif46166

[0034] Optimization to maximize the power P of the received signal corresponds to maximizing the power P shown in equation (7) or the power P shown in equation (13), and can be performed by using the Lagrange undetermined multiplier method. If the Lagrange multiplier method is applied to equation (7), the eigenvalue problem shown in equation (15) below is obtained.

[0035] TIFF0007595810000007.tif14166In equation (15), λ is an eigenvalue.

[0036] Since <[C]> is a 4 × 4 matrix, four eigenvalues ​​and four eigenvectors are obtained. The eigenvector corresponding to the largest eigenvalue among the four eigenvalues ​​is the antenna vector that maximizes the power P of the received signal. If the Lagrange multiplier method is applied to equation (13), the eigenvalue problem shown in equation (16) below is obtained.

[0037] TIFF0007595810000008.tif12166

[0038] Since <[C']> is a 2 × 2 matrix, two eigenvalues ​​and two eigenvectors are obtained. The eigenvector corresponding to the largest eigenvalue among the two eigenvalues ​​is the receiving polarization state that maximizes the power P of the received signal.

[0039] The difference is that equation (15) optimizes both transmission and reception together, whereas equation (16) optimizes the reception polarization state for any transmission polarization state. The former is a purely mathematical optimization, and while it is expected to obtain higher received power than the latter, there is no guarantee that the orientation angle ψ and the ellipticity angle χ can be restored from the obtained antenna vector. In other words, there is a possibility that optimization will be performed in a physically impossible antenna state. On the other hand, the latter can always restore those angles and know the physical polarization state, but the maximization options are limited within those angle ranges. In equation (13), the transmit polarization state is designated ψ t and t On the other hand, as shown in the following equations (17) to (18), from the optimized receiving polarization state, ψ r and r and can be restored. By the above optimization, a pair of (ψ t ,χ t ), a pair of (ψ r ,χ r ) can be determined.

[0040] TIFF0007595810000009.tif59166

[0041] Next, the operation of the change detection device shown in FIG. 1 will be described. FIG. 4 is a flowchart showing a change detection method which is a processing procedure of the change detection device. The image acquisition unit 1 acquires time-series polarimetric SAR images obtained by performing polarimetric SAR observation of an observation target at a plurality of mutually different times (step ST1 in FIG. 4). The image acquisition unit 1 outputs time-series polarimetric SAR images to the polarization state determination unit 2 and the polarization component extraction unit 3, respectively. For ease of explanation, it is assumed here that the image acquisition unit 1 acquires polarimetric SAR images at two times as time-series polarimetric SAR images. In addition, the power value of the polarimetric SAR image observed before the event occurred is P before and the power value of the polarimetric SAR image observed after the event occurs is P after It is assumed that.

[0042] The polarization state determining unit 2 acquires polarimetric SAR images at two times from the image acquiring unit 1. Based on the power of the polarized SAR images at two times, the polarization state determination unit 2 determines a combination of the polarization state of the transmitted radio waves emitted toward the observation target and the polarization state of the received radio waves, which are radio waves reflected by the observation target, as the polarization state to be used for detecting changes in the observation target. Specifically, the polarization state determination unit 2 calculates the power value P after and the power value P of the polarimetric SAR image observed before the event occurred. before Difference ΔP lin (Step ST2 in FIG. 4). ΔP lin =P after -P before (20)

[0043] Here, the polarization state determination unit 2 acquires polarimetric SAR images at two times from the image acquisition unit 1, and calculates the power value P after and the power value of the polarimetric SAR image P before Difference ΔP lin However, this is merely an example. The polarization state determination unit 2 acquires polarimetric SAR images at multiple times from the image acquisition unit 1, and calculates the power difference ΔP between any two polarimetric SAR images among the polarimetric SAR images at multiple times. lin may be calculated.

[0044] The difference ΔP shown in equation (20) lincan be expressed as the following equation (21) by using equation (13).

[0045] TIFF0007595810000010.tif43166

[0046] The polarization state determination unit 2 determines an arbitrary transmission polarization state (ψ) by arbitrarily selecting the orientation angle ψ and the ellipticity angle χ within the ranges shown in equation (9) and equation (10). t ,χ t ). The polarization state determination unit 2 determines an arbitrary transmission polarization state (ψ t ,χ t ), and then by applying the Lagrange undetermined multiplier method to equation (16), the power difference ΔP is obtained as shown in the following equation (22). lin Calculate the maximum value of .

[0047] TIFF0007595810000011.tif16166

[0048] Since <[C']> is a 2x2 matrix, two eigenvalues ​​and two eigenvectors are obtained. In order to maximize the polarization sensitivity shown in equation (12), the polarization state determination unit 2 selects the eigenvector v corresponding to the eigenvalue with the largest absolute value. → is found as the optimal receiving polarization state. This makes it possible to handle cases where the power increases or decreases with the observation before and after.

[0049] Specifically, the polarization state determination unit 2 determines an arbitrary transmission polarization state (ψ t ,χ t ), the power difference ΔP is calculated as shown in the following equation (23). lin The receiving polarization state (ψ r ,χ r ) is calculated (step ST3 in FIG. 4).

[0050] TIFF0007595810000012.tif16166

[0051] Any transmission polarization state (ψ t ,χ t ) The difference in the maximized power value ΔP lin ΔP r (ψ t ,χ t ) is expressed by the received polarization state (ψ r ,χ r ) can be used to express it.

[0052] TIFF0007595810000013.tif17166

[0053] The polarization state determination unit 2 changes the orientation angle ψ and the ellipticity angle χ in the ranges shown in equation (9) and (10) while determining the power difference ΔP lin (step ST2 in FIG. 4) and the reception polarization state (ψ r ,χ r ) (step ST3 in FIG. 4) is repeatedly performed. That is, the polarization state determination unit 2 determines the reception polarization state (ψ r ,χ r ) is calculated (until step ST4 in FIG. 4 is YES), lin (step ST2 in FIG. 4) and the reception polarization state (ψ r ,χ r ) (step ST3 in FIG. 4) is repeated (if step ST4 in FIG. 4 is NO). The polarization state determination unit 2 calculates the difference ΔP r (ψ t ,χ t ) are compared with each other, and the difference with the largest absolute value, ΔP r (ψ t ,χ t ) to identify the The polarization state determination unit 2 determines the optimal transmission polarization state (ψ t opt ,χ t opt ) among multiple combinations, the identified difference ΔP r (ψ t ,χ t ) The orientation angle ψ included in the combination corresponding to t and ellipticity angle χ t The transmission polarization state (ψ t opt ,χ t opt ) is determined (step ST5 in FIG. 4). As a result, as shown in the following equations (25) and (26), the power difference ΔP lin The optimal polarization state (ψ t opt ,χ t opt , ψ r opt ,χ r opt ) is determined. The optimal polarization state (ψ t opt ,χ t opt , ψ r opt ,χ r opt ) is included in (ψ t opt ,χ t opt ) is the optimal transmit polarization state (ψ t opt ,χ t opt ) and the optimal polarization state (ψ t opt ,χ t opt , ψ r opt ,χ r opt ) is included in (ψ r opt ,χ r opt ) is the power difference ΔP lin The receiving polarization state (ψ r ,χ r). The polarization state determination unit 2 determines the optimal polarization state (ψ t opt ,χ t opt , ψ r opt ,χ r opt ) to the polarization component extraction unit 3.

[0054] TIFF0007595810000014.tif36166

[0055] The polarized component extraction unit 3 acquires time-series polarized SAR images from the image acquisition unit 1. The polarization component extractor 3 receives the optimal polarization state (ψ t opt ,χ t opt , ψ r opt ,χ r opt ) to obtain information indicating the The polarized component extractor 3 selects the optimal polarization state (ψ t opt ,χ t opt , ψ r opt ,χ r opt ) is extracted (step ST6 in FIG. 4). For example, ψ t opt =χ t opt =0 and ψ r opt =90,χ r opt = 0, the polarization component extraction unit 3 extracts the polarization component when the polarization state of the transmission wave is horizontal polarization and the polarization state of the received wave is vertical polarization. For example, ψ t opt ==90,χ t opt =0 and ψ r opt =χr opt = 0, the polarization component extraction unit 3 extracts the polarization component when the polarization state of the transmission wave is vertical polarization and the polarization state of the received wave is horizontal polarization. The polarized component extraction unit 3 outputs the polarized components extracted from each of the polarimetric SAR images to the change detection unit 4.

[0056] The change detection unit 4 acquires a plurality of polarization components from the polarization component extraction unit 3 . The change detection unit 4 compares the power of the multiple polarization components with each other. The change detection unit 4 detects a change in the observation target based on the result of the power comparison (step ST7 in FIG. 4). Specifically, if the difference between the power of a polarization component at time t1 and the power of a polarization component at time t2 among multiple polarization components is greater than or equal to a threshold value Th, the change detection unit 4 determines that a change has occurred in the object being observed between time t1 and time t2. If the difference between the power of the polarized component at time t1 and the power of the polarized component at time t2 is less than the threshold Th, the change detection unit 4 determines that no change has occurred in the observation target between time t1 and time t2. The threshold value Th may be stored in an internal memory of the change detection unit 4, or may be provided from outside the change detection device shown in FIG. The change detection unit 4 outputs the detection result of the change in the observation target to, for example, a monitoring device (not shown).

[0057] In the above-described first embodiment, the change detection device is configured to include an image acquisition unit 1 that acquires time-series polarized SAR images obtained by polarized SAR observation of an observation target at a plurality of different times, and a polarization state determination unit 2 that determines a combination of the polarization state of a transmitted radio wave radiated toward the observation target and the polarization state of a received radio wave, which is a radio wave reflected by the observation target, as a polarization state to be used for detecting a change in the observation target, based on the power of the polarized SAR image acquired by the image acquisition unit 1. Therefore, the change detection device can select a combination of polarization states that clearly indicates a change in the observation target.

[0058] In the change detection device shown in FIG. 1, the polarization state determination unit 2 assumes that the power values ​​of the polarimetric SAR images at two times are expressed in a linear space and calculates the power value P after and the power value of the polarimetric SAR image P before Difference ΔP lin is calculated. However, because radar signals have a wide dynamic range, the power values ​​of the polarized SAR images at two times may be expressed in logarithmic space (dB). In this case, the polarization state determination unit 2 assumes that the polarization state of the transmitted radio wave is one of a plurality of polarization states, and repeatedly calculates the power ratio of any two polarized SAR images among the time-series polarized SAR images. Specifically, the polarization state determination unit 2 calculates the power value P after and the power value P of the polarimetric SAR image. before Ratio to ΔP log Calculate.

[0059] TIFF0007595810000015.tif27166

[0060] In logarithmic space, the ratio of power values ​​ΔP log is the power value P after and power value P before It is expressed as a ratio to

[0061] TIFF0007595810000016.tif27166

[0062] The polarization state determination unit 2 determines an arbitrary transmission polarization state (ψ t ,χ t ), and then by applying the Lagrange multiplier method to equation (16), the power value ratio ΔP is obtained as shown in the following equation (29). log The evaluation function f is set by setting the Lagrange multiplier that optimizes the above.

[0063] TIFF0007595810000017.tif17166In equation (29), d is an arbitrary constant.

[0064] In this case, the polarization state determining unit 2 assumes that d is an arbitrary constant and maximizes the numerator of equation (28) under the premise that the following equation (30) holds. By differentiating equation (29) and setting it to 0, the following equation (31) is obtained.

[0065] TIFF0007595810000018.tif36166

[0066] <[C before ]> -1 <[C after The eigenvalue λ of is the power ratio P after / P before According to equation (28), all eigenvalues ​​λ are positive real numbers. As in the case where the power values ​​of the polarimetric SAR images at two times are expressed in a linear space, P after >P before Not only in the case of P after <P before Even in the case of the power ratio P after / P before To maximize the sensitivity of after / P before The inverse of must also be considered. Therefore, equation (31) is transformed into the following equation (32).

[0067] TIFF0007595810000019.tif29166

[0068] From equation (29), the eigenvalue λ' is expressed as in equation (33) below.

[0069] TIFF0007595810000020.tif18166

[0070] This results in a power ratio P after / P beforeThe receiving polarization state that maximizes the sensitivity of is given by the following equation (34): <[C before ]> -1 <[C after ]> and the eigenvalue λ of <[C before ]> -1 <[C after ]> and the inverse λ' of the eigenvalue λ of <[C before ]> -1 <[C after ]> and the eigenvalue λ of <[C before ]> -1 <[C after ]> and the inverse λ' of the eigenvalue λ of Here, the polarization state determination unit 2 determines, according to equation (31), that before ]> -1 <[C after However, this is merely an example, and the polarization state determination unit 2 does not directly calculate the inverse λ' of the eigenvalue λ of <[C before ]> -1 <[C after In this case, the polarization state determination unit 2 may calculate an eigenvalue λ′ of <[C before ]> -1 <[C after ]> and the eigenvalue λ of <[C before ]> -1 <[C after ]>, the larger eigenvalue λ' is selected, and the eigenvector corresponding to the larger eigenvalue is found.

[0071] TIFF0007595810000021.tif35166

[0072] In the change detection device shown in FIG. 1, the polarization state determination unit 2 calculates the power difference ΔP lin , or power ratio P after / P before However, this is only one example. The polarization state determination unit 2 physically optimizes the power difference ΔP lin , or power ratio P after / Pbefore may be mathematically optimized.

[0073] Difference in power value ΔP lin , or power ratio P after / P before When optimizing mathematically instead of physically, the polarization state determination unit 2 uses a 4×4 covariance matrix <[C]> instead of a 2×2 covariance matrix <[C']> as shown in the following equation (36) or equation (37). Also, the polarization state determination unit 2 uses a 2×1 R →* From 4×1 A →* This increases the number of eigenvalues ​​from 2 to 4.

[0074] TIFF0007595810000022.tif75166

[0075] In this case, the optimal vector A →* From the optimized receiving polarization state (ψ r ,χ r ) is obtained. Therefore, the polarization state determination unit 2 determines an arbitrary transmission polarization state (ψ t ,χ t ) does not need to be determined. t ,χ t ) processing loops associated with changes are no longer necessary.

[0076] Embodiment 2 In the second embodiment, a change detection device is described in which a change detection unit 6 compares the polarization states of a plurality of polarimetric SAR images determined by a polarization state determination unit 5 with each other, and detects a change in the observed object based on the comparison result of the polarization states.

[0077] Fig. 7 is a configuration diagram showing a change detection device according to embodiment 2. In Fig. 7, the same reference numerals as in Fig. 1 indicate the same or corresponding parts, and detailed description thereof will be omitted. Fig. 8 is a hardware configuration diagram showing the hardware of the change detection device according to embodiment 1. In Fig. 8, the same reference numerals as in Fig. 2 indicate the same or corresponding parts, and therefore detailed description thereof will be omitted. The change detection device shown in FIG. 7 includes an image acquisition unit 1, a polarization state determination unit 5, and a change detection unit 6.

[0078] The polarization state determining unit 5 is realized by, for example, a polarization state determining circuit 15 shown in FIG. The polarization state determining unit 5 acquires time-series polarimetric SAR images from the image acquiring unit 1. The polarization state determination unit 5 determines a combination of the polarization state of the transmitted radio waves and the polarization state of the received radio waves as the polarization state for each polarized SAR image, based on the power of each polarized SAR image.

[0079] The change detection unit 6 is realized by, for example, a change detection circuit 16 shown in FIG. The change detection unit 6 compares the polarization states for the multiple polarimetric SAR images determined by the polarization state determination unit 5 with each other. The change detection unit 6 detects a change in the observation target based on the comparison result of the polarization state.

[0080] In Fig. 7, it is assumed that each of the components of the change detection device, that is, the image acquisition unit 1, the polarization state determination unit 5, and the change detection unit 6, is realized by dedicated hardware as shown in Fig. 8. That is, it is assumed that the change detection device is realized by an image acquisition circuit 11, a polarization state determination circuit 15, and a change detection circuit 16. Each of the image acquisition circuitry 11, the polarization state determination circuitry 15 and the change detection circuitry 16 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.

[0081] The components of the change detection device are not limited to those realized by dedicated hardware, and the change detection device may be realized by software, firmware, or a combination of software and firmware. When the change detection device is realized by software, firmware, or the like, a program for causing a computer to execute the respective processing procedures in the image acquisition unit 1, the polarization state determination unit 5, and the change detection unit 6 is stored in a memory 21 shown in Fig. 3. Then, a processor 22 shown in Fig. 3 executes the program stored in the memory 21.

[0082] Also, Fig. 8 shows an example in which each of the components of the change detection device is realized by dedicated hardware, while Fig. 3 shows an example in which the change detection device is realized by software, firmware, etc. However, this is merely one example, and some of the components in the change detection device may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.

[0083] Next, the operation of the change detection device shown in FIG. 7 will be described. The image acquisition unit 1 acquires time-series polarimetric SAR images obtained by performing polarimetric SAR observation of an observation target at a plurality of mutually different times. The image acquisition unit 1 outputs time-series polarimetric SAR images to the polarization state determination unit 5.

[0084] The polarization state determining unit 5 acquires time-series polarimetric SAR images from the image acquiring unit 1. The polarization state determination unit 5 determines a combination of the polarization state of the transmitted radio waves and the polarization state of the received radio waves as the polarization state for each polarized SAR image, based on the power of each polarized SAR image. The process of determining the combination by the polarization state determining unit 5 will be specifically described below.

[0085] The power P of each polarimetric SAR image can be expressed as the following equation (38) by using equation (13).

[0086] TIFF0007595810000023.tif15166

[0087] The polarization state determination unit 5 determines an arbitrary transmission polarization state (ψ t ,χ t ), the power P of each polarimetric SAR image is optimized by applying the Lagrange multiplier method to equation (16), as shown in equation (39) below.

[0088] TIFF0007595810000024.tif15166

[0089] Since <[C']> is a 2x2 matrix, two eigenvalues ​​and two eigenvectors are obtained. In order to maximize the polarization sensitivity shown in equation (12), the polarization state determination unit 5 selects the eigenvector v corresponding to the eigenvalue with the largest absolute value. → is found as the optimal receiving polarization state.

[0090] Specifically, the polarization state determination unit 5 determines an arbitrary transmission polarization state (ψ t ,χ t ), the receiving polarization state (ψ r ,χ r ) is calculated.

[0091] TIFF0007595810000025.tif15166

[0092] Any transmission polarization state (ψ t ,χ t ), which is the maximized power P corresponding to t ,χ t ) is expressed by the received polarization state (ψ r ,χ r) can be used to express it.

[0093] TIFF0007595810000026.tif12166

[0094] The polarization state determining unit 5 calculates the power P(ψ) as shown in the following equation (42) for the orientation angle ψ within the range shown in equation (9) and the ellipticity angle χ within the range shown in equation (10). t ,χ t ) is calculated. Then, the polarization state determination unit 5 calculates the power P(ψ t ,χ t The absolute value of the transmission polarization state (ψ t opt ,χ t opt ) to determine From the above, the optimal polarization state (ψ t opt ,χ t opt , ψ r opt ,χ r opt ) is determined. The polarization state determination unit 5 determines the optimal polarization state (ψ t opt ,χ t opt , ψ r opt ,χ r opt ) to the change detection unit 6.

[0095] TIFF0007595810000027.tif37166

[0096] The change detection unit 6 receives the optimal polarization state (ψ t opt ,χ t opt , ψ r opt ,χr opt ) to obtain information indicating the The change detection unit 6 compares the polarization states of the time-series polarimetric SAR images with each other. The change detection unit 6 detects a change in the observation target based on the comparison result of the polarization state. Specifically, if the difference between the polarization state of a plurality of multi-polarized SAR images, for example, between the polarization state at time t1 and the polarization state at time t2, is equal to or greater than a threshold value Thp, the change detection unit 6 determines that a change has occurred in the observed object between time t1 and time t2. That is, the change detection unit 6 detects ψ t opt and ψ at time t2 t opt The difference between χ and χ at time t1 t opt and χ at time t2 t opt The difference between ψ and t r opt and ψ at time t2 r opt or the difference between χ at time t1 r opt and χ at time t2 r opt If any of the differences between these is equal to or greater than the threshold Thp, it is determined that a change has occurred in the observation target between time t1 and time t2. If the difference between the polarization state at time t1 and the polarization state at time t2 is less than the threshold value Thp, the change detection unit 6 determines that no change has occurred in the observation target between time t1 and time t2. That is, the change detection unit 6 detects ψ t opt and ψ at time t2 t opt The difference between χ and χ at time t1 t opt and χ at time t2 t opt The difference between ψ and t r opt and ψ at time t2 r opt The difference between and χ at time t1 r opt and χ at time t2r opt If all of the differences from are less than the threshold value Thp, it is determined that no change has occurred in the observation target between time t1 and time t2. The threshold value Thp may be stored in an internal memory of the change detection unit 6, or may be provided from outside the change detection device shown in FIG. The change detection unit 6 outputs the detection result of the change in the observation target to, for example, a monitoring device (not shown).

[0097] In the above-described second embodiment, the polarization state determining unit 5 is an image acquiring unit 1 The change detection device is configured such that the change detection unit 6 compares the polarization states of the multiple polarized SAR images determined by the polarization state determination unit 5 with each other, and detects a change in the observation target based on the comparison result of the polarization states. Therefore, the change detection device can detect a change in the observation target based on a combination of polarization states that clearly indicates a change in the observation target.

[0098] In addition, the present disclosure allows free combination of the respective embodiments, modification of any of the components of each embodiment, or omission of any of the components of each embodiment. [Industrial Applicability]

[0099] The present disclosure is applicable to a change detection apparatus and a change detection method. [Explanation of symbols]

[0100] 1 image acquisition unit, 2 polarization state determination unit, 3 polarization component extraction unit, 4 change detection unit, 5 polarization state determination unit, 6 change detection unit, 11 image acquisition circuit, 12 polarization state determination circuit, 13 polarization component extraction circuit, 14 change detection circuit, 15 polarization state determination circuit, 16 change detection circuit, 21 memory, 22 processor.

Claims

1. an image acquisition unit that acquires time-series polarimetric synthetic aperture radar (SAR) images obtained by observing an observation target at a plurality of mutually different times; a polarization state determination unit that determines a combination of a transmission polarization state and a polarization state of a received radio wave, which is a radio wave reflected by the observation target, as a polarization state used to detect a change in the observation target, while switching the polarization state of a transmission radio wave radiated toward the observation target, based on a difference ΔPlin in power values ​​of the two polarized SAR images acquired by the image acquisition unit, The polarization state determination unit includes: when an arbitrary transmission polarization state is selected, a reception polarization state corresponding to a maximum value of the difference ΔPlin in power values ​​between the polarized SAR images at two times is calculated, and while switching the transmission polarization state, the calculation process of the difference ΔPlin in power values ​​and the calculation process of the reception polarization state are repeatedly performed, and the differences ΔPlin for all combinations are compared with each other to determine an optimal combination of the transmission polarization state and the reception polarization state that maximizes the difference ΔPlin in power values; The polarization state determination unit includes a polarization component extraction unit that extracts polarization components corresponding to the combination determined by the polarization state determination unit from each of the polarized SAR images acquired by the image acquisition unit. Change detection device.

2. an image acquisition unit that acquires time-series polarimetric synthetic aperture radar (SAR) images obtained by observing an observation target at a plurality of mutually different times; a polarization state determination unit that determines a combination of a transmission polarization state and a polarization state of a received radio wave, which is a radio wave reflected by the observation target, as a polarization state used to detect a change in the observation target, while switching the polarization state of a transmission radio wave radiated toward the observation target, based on a difference ΔPlin in power values ​​of the two polarized SAR images acquired by the image acquisition unit, The polarization state determination unit includes: when an arbitrary transmission polarization state is selected, a reception polarization state corresponding to a maximum value of the difference ΔPlin in power values ​​between the polarized SAR images at two times is calculated, and while switching the transmission polarization state, the calculation process of the difference ΔPlin in power values ​​and the calculation process of the reception polarization state are repeatedly performed, and the differences ΔPlin for all combinations are compared with each other to determine an optimal combination of the transmission polarization state and the reception polarization state that maximizes the difference ΔPlin in power values; a polarization component extracting unit that extracts, from each of the polarimetric SAR images acquired by the image acquiring unit, a polarization component corresponding to the combination determined by the polarization state determining unit; a change detection unit that compares the powers of the multiple polarization components extracted by the polarization component extraction unit with each other and detects a change in the observation target based on a result of the comparison of the powers. Change detection device.

3. The polarization state determination unit, in the range shown in the following formula, −90 deg≦ψ≦90 deg (9) −45 deg≦χ≦45 deg (10) The power difference ΔP is repeatedly calculated while switching the orientation angle ψ and the ellipsity angle χ.

3. A change detection device according to claim 1 or 2.

4. The polarization state determination unit, in the range shown in the following formula, −90 deg≦ψ≦90 deg (9) −45 deg≦χ≦45 deg (10) Solving the optimization problem for physically realizable antenna states, 3. A change detection device according to claim 1 or 2.

5. A change detection method for a change detection device including an image acquisition unit and a polarization state determination unit including a polarization component extraction unit, the image acquisition unit acquires time-series polarimetric SAR images obtained by observing an observation target with a polarimetric SAR (Synthetic Aperture Radar) at a plurality of mutually different times; the polarization state determination unit determines a combination of a transmission polarization state and a polarization state of a received radio wave, which is a radio wave reflected by the observation target, as a polarization state used to detect a change in the observation target, based on a difference ΔPlin in power values ​​of the two polarized SAR images acquired by the image acquisition unit, while switching the polarization state of a transmission radio wave radiated toward the observation target; the polarization component extraction unit extracts, from each of the polarized SAR images acquired by the image acquisition unit, a polarization component corresponding to the combination determined by the polarization state determination unit; The polarization state determination unit includes: When an arbitrary transmission polarization state is selected, a reception polarization state corresponding to the maximum value of the power value difference ΔPlin between the polarized SAR images at two times is calculated, and while switching the transmission polarization state, the calculation process of the power value difference ΔPlin and the calculation process of the reception polarization state are repeated, and the differences ΔPlin for all combinations are compared with each other to determine an optimal combination of the transmission polarization state and the reception polarization state that maximizes the power value difference ΔPlin. Change detection methods.

Citation Information

Patent Citations

  • Rock abundance determination method and device, equipment and storage medium

    CN115840202A

  • Fluctuation detection device, fluctuation detection method, and fluctuation detection program

    JP2015215210A

  • Measurement point information provision device, fluctuation detection device, method, and program

    JP2015215211A

  • Displacement extraction device, displacement extraction system, displacement extraction method, and computer program

    JP2023065066A