A 3D rolling curtain comparison and analysis method applicable to high-resolution remote sensing images

Abstract

The present invention provides a three-dimensional rolling comparison analysis method applicable to high-resolution remote sensing images. The method uses remote sensing images to obtain event types, track the mouse screen position, convert the intersection coordinate space, and set shader variables according to an event processor. The method can achieve rolling comparison analysis of remote sensing images in any direction and at any angle, can meet the mining acquisition of remote sensing image information, and achieve the purpose of obtaining higher-value image information.

Description

Technical Field

[0001] The present invention belongs to the technical field of remote sensing image applications, and particularly relates to a three-dimensional rolling comparison analysis method applicable to high-resolution remote sensing images. Background Art

[0002] High-resolution remote sensing satellite images have the advantages of wide detection range, fast data acquisition, large information content, and strong comprehensiveness. They are widely used in agriculture, forestry, geology, ocean, meteorology, military and other fields, and have significant economic and military value. At the same time, remote sensing information has multi-temporal characteristics. Multi-temporal usually refers to the characteristics of a set of remote sensing images in a time series. Remote sensing satellites support periodic and repetitive observations of the same area. By analyzing remote sensing images of the same area at different times, changes in target information can be discovered and dynamically tracked, and this characteristic has wide applications in monitoring natural disasters, environmental resources, and battlefield situation analysis.

[0003] The image rolling comparison analysis technology is a common means for comparing and analyzing remote sensing images of different times. When performing rolling comparison, one side of the rolling shows the upper-layer image, and the other side shows the lower-layer image. This direct comparison between images can more intuitively display the spatio-temporal data differences in the images. In the traditional two-dimensional rolling technology, limited by the directions of the rolling and the images, the comparison methods of the images are only horizontal comparison from left to right and vertical comparison from top to bottom, and more in-depth comparison analysis from more angles cannot be carried out, which limits the information acquisition ability during the comparison analysis of remote sensing images. For example, this may cause some details to be overlooked or some relatively hidden information to be missed. Therefore, there is an urgent need for a more flexible rolling comparison analysis technology from more angles. Summary of the Invention

[0004] The purpose of the present invention is to solve the problems in the prior art, and a three-dimensional rolling comparison analysis method applicable to high-resolution remote sensing images is proposed.

[0005] The present invention is realized through the following technical solutions. The present invention proposes a three-dimensional rolling comparison analysis method applicable to high-resolution remote sensing images, and the specific comparison analysis method is as follows:

[0006] (1) Load the high-resolution remote sensing images to be compared on the three-dimensional earth according to requirements;

[0007] (2) Select a high-resolution remote sensing image and turn on the three-dimensional rolling switch;

[0008] (3) Design and generate an event processor;

[0009] (4) Rotate the three-dimensional earth to obtain different display directions of the image, and select the required image direction;

[0010] (5) Hold down the left mouse button and drag the mouse. Use the event handler to track the screen position of the mouse, denoted as P. mou ;

[0011] (6) Set the rolling direction set fromTos = {l2r, r2l, u2d, d2u}, where l2r represents the rolling direction from left to right, r2l represents the rolling direction from right to left, u2d represents the rolling direction from top to bottom, and d2u represents the rolling direction from bottom to top.

[0012] (7) Assign a direction d to the rolling shutter.

[0013] (8) Calculate the intersection of P mou with the three-dimensional earth to obtain the world coordinates of the intersection point, denoted as P world ;

[0014] (9) Transform P world to the viewing space coordinate system, denoted as P view = P world * ViewMatrix;

[0015] (10) Denote the x-direction component of P view as view x , and the y-direction component as view y ;

[0016] (11) Customize the vertex shader vertSoure in the LOCATION_VERTEX_VIEW space.

[0017] (12) Customize the fragment shader fragSourse in the FRAGMENT space.

[0018] (13) Release the mouse.

[0019] (14) Set the value of the shader uniform_x or uniform_y according to the rolling direction.

[0020] (15) Rotate the three-dimensional earth again according to the requirement to obtain different image directions, and repeat steps (4) to (14) to perform rolling shutter comparison from different directions.

[0021] (16) Turn off the three-dimensional rolling shutter switch.

[0022] Further, if P mou is located in the left 1 / 4 of the screen, then let d = l2r; if P mou is located in the right 1 / 4 of the screen, then let d = r2l; if P mou is located in the upper 1 / 2 of the screen except for the left and right quarters, then let d = u2d; if P mouIf it is located in the lower half of the screen except for the quarter on the left and right sides, then let d = d2u.

[0023] Further, in vertSoure, set the values of uniform_x, uniform_y, and uniform_d according to view x 、view y and d respectively.

[0024] Further, set the identifier sign in vertSoure, with the type of out int and the default value of 1; the out keyword makes sign passed to the FRAGMENT space, thereby passing the information in the vertex space to the fragment space.

[0025] Further, in vertSoure, change the value of sign according to uniform_d, uniform_x or uniform_d, uniform_y, that is, determine whether the sign value is 1 or 0 according to whether the vertex coordinates are less than the mouse position during the rolling screen comparison, and pass this information to the FRAGMENT space.

[0026] Further, set the identifier sign in fragSourse, with the type of in int, used to receive the sign value in the vertex space.

[0027] Further, in fragSourse, set the alpha value of the image layer color according to sign, control the position of the layer transparency, and implement the rolling screen.

[0028] Further, if the rolling screen direction is l2r, set the value of uniform_x to -6400000.0; if the rolling screen direction is r2l, set the value of uniform_x to 6400000.0; if the rolling screen direction is u2d, set the value of uniform_y to 6400000.0; if the rolling screen direction is d2u, set the value of uniform_y to -6400000.0 to release the rolling screen.

[0029] The present invention provides an electronic device, including a memory and a processor, where the memory stores a computer program, and when the processor executes the computer program, the steps of the three-dimensional rolling screen comparison analysis method applicable to high-resolution remote sensing images are implemented.

[0030] The present invention provides a computer-readable storage medium for storing computer instructions, and when the computer instructions are executed by a processor, the steps of the three-dimensional rolling screen comparison analysis method applicable to high-resolution remote sensing images are implemented.

[0031] The present invention has the following beneficial effects:

[0032] The 3D rolling comparison analysis method based on the osgEarth open source engine for high-resolution remote sensing satellite images described in the present invention can achieve the rolling comparison analysis of remote sensing images in any direction and at any angle, can meet the mining-type acquisition of remote sensing image information, and achieve the purpose of obtaining higher-value image information. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 It is a flowchart of the 3D rolling comparison analysis method for high-resolution remote sensing images described in the present invention.

[0034] Figure 2 It is a horizontal comparison result diagram of 3D rolling using the method described in the present invention without adjusting the image position;

[0035] Figure 3 It is a vertical comparison result diagram of 3D rolling using the method described in the present invention without adjusting the image position;

[0036] Figure 4 It is a horizontal comparison result diagram of 3D rolling using the method described in the present invention with the image rotated 60 degrees counterclockwise;

[0037] Figure 5 It is a vertical comparison result diagram of 3D rolling using the method described in the present invention with the image rotated 60 degrees counterclockwise;

[0038] Figure 6 It is a horizontal comparison result diagram of 3D rolling using the method described in the present invention with the viewport tilted 45 degrees upward;

[0039] Figure 7 It is a vertical comparison result diagram of 3D rolling using the method described in the present invention with the viewport tilted 45 degrees upward;

[0040] Figure 8 It is a horizontal comparison result diagram of 3D rolling using the method described in the present invention with the viewport reduced;

[0041] Figure 9 It is a vertical comparison result diagram of 3D rolling using the method described in the present invention with the viewport reduced;

[0042] Figure 10 It is a usage scenario of the present invention, which is a result diagram of image rolling comparison on a 3D earth. DETAILED DESCRIPTION OF THE INVENTION

[0043] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0044] In combination with Figures 1 - 10 , the present invention proposes a three-dimensional rolling comparison analysis method applicable to high-resolution remote sensing images. The specific comparison analysis method is as follows:

[0045] Step (1): According to the requirements of the comparison analysis, load the high-resolution remote sensing images to be compared on the three-dimensional earth; the remote sensing images support loading one or more images at a time. In this embodiment, two images are loaded.

[0046] Step (2): Select a high-resolution remote sensing image and turn on the three-dimensional rolling switch; each image supports turning on the three-dimensional rolling switch. After the switch is turned on, the image is regarded as the upper rolled-up image, and the display range of the image is controlled by dragging the mouse.

[0047] Step (3): Design and generate an event processor; the event processor is used to obtain the event type, track the mouse screen position, convert the intersection coordinate space, and set shader variables, etc.

[0048] Step (4): Rotate the three-dimensional earth to obtain different display directions of the image, and select the required image direction.

[0049] Step (5): Hold down the left mouse button and drag the mouse. Use the event processor to track the screen position of the mouse and record it as P mou ;

[0050] Step (6): Set the rolling direction set fromTos = {l2r, r2l, u2d, d2u}, where l2r represents the rolling direction from left to right, r2l represents the rolling direction from right to left, u2d represents the rolling direction from top to bottom, and d2u represents the rolling direction from bottom to top.

[0051] Step (7): Assign a direction d to the rolling; if P mou is located in the left 1 / 4 of the screen, then let d = l2r; if P mou is located in the right 1 / 4 of the screen, then let d = r2l; if P mou is located in the upper 1 / 2 except for the left and right quarters of the screen, then let d = u2d; if P mou is located in the lower 1 / 2 except for the left and right quarters of the screen, then let d = d2u.

[0052] Step (8): Calculate Pmou The intersection point with the three-dimensional Earth is obtained, and the world coordinates of the intersection point are denoted as P world ;

[0053] Step (9): Transform P world to the viewing space coordinate system, denoted as P view = P world *VidewMatrix;

[0054] Step (10): Denote the x-direction component of P view as view x , and the y-direction component as view y ;

[0055] Step (11): Customize the vertex shader vertSoure in the LOCATION_VERTEX_VIEW space;

[0056] i. In vertSoure, set the values of uniform_x, uniform_y, and uniform_d according to view x , view y and d respectively.

[0057] ii. In vertSoure, set the identifier sign, with the type of out int and the default value of 1; the out keyword makes sign passed to the FRAGMENT space, thereby passing the information in the vertex space to the fragment space.

[0058] iii. In vertSoure, change the value of sign according to uniform_d, uniform_x or uniform_d, uniform_y, that is, determine whether the sign value is 1 or 0 according to whether the vertex coordinates are less than the mouse position during the rolling curtain comparison, and pass this information to the FRAGMENT space. Specifically, if the value of uniform_d is l2r and the x component of the spatial point coordinates is less than uniform_x, then set sign = 0; if the value of uniform_d is r2l and the x component of the spatial point coordinates is greater than uniform_x, then set sign = 0; if the value of uniform_d is u2d and the y component of the spatial point coordinates is greater than uniform_y, then set sign = 0; if the value of uniform_d is d2u and the y component of the spatial point coordinates is less than uniform_y, then set sign = 0;

[0059] Step (12): Customize the fragment shader fragSourse in the FRAGMENT space;

[0060] i. Set an identifier sign in fragSourse with the type of in int to receive the sign value in the vertex space.

[0061] ii. Set the alpha value of the image layer color in fragSourse according to sign. If the sign value is 0, set alpha = 0.0; otherwise, do not modify the alpha value. Control the position of the layer transparency to achieve rolling shutter.

[0062] Step (13): Release the mouse.

[0063] Step (14): Release the rolling shutter; set the value of shader uniform_x or uniform_y according to the rolling shutter direction. If the rolling shutter direction is l2r, set the value of uniform_x to -6400000.0; if the rolling shutter direction is r2l, set the value of uniform_x to 6400000.0; if the rolling shutter direction is u2d, set the value of uniform_y to 6400000.0; if the rolling shutter direction is d2u, set the value of uniform_y to -6400000.0.

[0064] Step (15): Rotate the 3D globe again according to the requirement to obtain different image directions, and repeat steps (4) to (14) to perform rolling shutter comparison from different directions.

[0065] Step (16): Turn off the 3D rolling shutter switch to end the rolling shutter.

[0066] The present invention provides an electronic device, including a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, the steps of the three-dimensional rolling shutter comparison analysis method applicable to high-resolution remote sensing images are implemented.

[0067] The present invention provides a computer-readable storage medium for storing computer instructions. When the computer instructions are executed by a processor, the steps of the three-dimensional rolling shutter comparison analysis method applicable to high-resolution remote sensing images are implemented.

[0068] The memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read only memory (ROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct rambus RAM (DRRAM). It should be noted that the memory of the method described in the present invention is intended to include but not limited to these and any other suitable types of memory.

[0069] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, fiber optic, digital subscriber line (DSL)) or wirelessly (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that the computer can access or a data storage device such as a server, data center, etc. that contains one or more integrated available media. The available media can be magnetic media (such as floppy disks, hard disks, magnetic tapes), optical media (such as high-density digital video discs (DVDs)), or semiconductor media (such as solid state discs (SSDs)), etc.

[0070] In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware in the processor or the instructions in the form of software. The steps of the method disclosed in combination with the embodiments of the present application can be directly embodied as being executed by the hardware processor or executed by the combination of the hardware and software modules in the processor. The software module can be located in a mature storage medium in the art such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers, etc. This storage medium is located in the memory, and the processor reads the information in the memory and combines its hardware to complete the steps of the above method. To avoid repetition, it will not be described in detail here.

[0071] It should be noted that the processor in the embodiments of the present application may be an integrated circuit chip with signal processing capabilities. In the implementation process, the steps of the above method embodiments can be completed by the integrated logic circuit in the hardware of the processor or instructions in the form of software. The above-mentioned processor may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. It can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor may be a microprocessor, or the processor may also be any conventional processor, etc. The steps of the method disclosed in combination with the embodiments of the present application can be directly embodied as being executed and completed by the hardware decoding processor, or executed and completed by a combination of the hardware and software modules in the decoding processor. The software module may be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. This storage medium is located in the memory, and the processor reads the information in the memory and combines its hardware to complete the steps of the above method.

[0072] The above has introduced in detail a three-dimensional rolling comparison analysis method applicable to high-resolution remote sensing images proposed by the present invention. Specific examples are used in this article to elaborate on the principle and implementation manner of the present invention. The description of the above embodiments is only used to help understand the method and its core idea of the present invention; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present invention.

Claims

1. A three-dimensional rolling curtain comparison analysis method applicable to high-resolution remote sensing images, characterized in that, The specific contrast analysis method is as follows: (1) Load the high-resolution remote sensing images to be compared on the 3D Earth according to requirements; (2) Select a high-resolution remote sensing image and turn on the 3D rolling curtain switch; (3) Design and generate an event processor; (4) Rotate the 3D Earth to obtain different display directions of the image, and select the required image direction; (5) Hold down the left mouse button and drag the mouse. Use the event handler to track the screen position of the mouse, denoted as ; (6) Set the rolling curtain direction set among which indicates that the rolling curtain direction is from left to right, indicates that the rolling curtain direction is from right to left, indicates that the rolling curtain direction is from top to bottom, indicates that the rolling curtain direction is from bottom to top; (7) Assign a direction to the rolling shutter ; (8) Calculate the intersection points with the three-dimensional Earth to obtain the world coordinates of the intersection points, denoted as ; (9) Transform into the observation space coordinate system, denoted as ; (10) Denote the x - direction component of as ; (11) Customize the vertex shader vertSoure in the LOCATION_VERTEX_VIEW space; (12) Customize the fragment shader fragSourse in the FRAGMENT space; (13) Release the mouse; Set the shader according to the rolling direction or value; (15) Rotate the 3D Earth again according to requirements to obtain different image directions, and repeat steps (4) to (14) to perform rolling curtain comparison from different directions; (16) Turn off the 3D rolling curtain switch.

2. The method according to claim 1, wherein If is located on the left side of the screen , then let ; If is located on the right side of the screen , then make ; If is located above the screen except for the quarter on the left and right sides , then make ; If is located below the screen except for the quarter on the left and right sides , then make .

3. The method according to claim 2, wherein In vertSoure, set according to , and respectively the values of , and .

4. The method according to claim 3, characterized in that, Set the identifier in vertSoure , with the type of , and the default value is 1; The keyword makes passed to the FRAGMENT space, so as to transfer the information in the vertex space to the fragment space.

5. The method according to claim 4, characterized in that In vertSoure, according to , or , change the value, that is, determine whether the value is 1 or 0 according to whether the vertex coordinates are less than the mouse position during the curtain comparison, and pass this information to the FRAGMENT space. ​ 6. The method according to claim 5, wherein Set the identifier in fragSourse , of type , used to receive the value in vertex space.

7. The method according to claim 6, characterized in that Set the value of the color of the image layer in fragSourse according to the identifier to control the position of the layer transparency and achieve a rolling shutter effect. ​ 8. The method according to claim 7, wherein If the rolling curtain direction is , set value to -6400000.0; if the rolling curtain direction is , set value to 6400000.0; if the rolling curtain direction is , set value to 6400000.0; if the rolling curtain direction is , set value to -6400000.0 and release the rolling curtain.

9. An electronic device, comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method described in any one of claims 1-8.

10. A computer-readable storage medium for storing computer instructions, characterized in that, When the computer instructions are executed by the processor, it implements the steps of the method described in any one of claims 1-8.

Images