Remote sensing image display method and device, electronic equipment and storage medium

Abstract

The invention provides a remote sensing image display method and device, electronic equipment and a storage medium, and the specific implementation scheme comprises the steps: receiving a tile obtaining request of a user terminal, the tile obtaining request comprising a target identifier associated with a to-be-loaded tile, a tile parameter and target display time; obtaining target tile data, first attribute information of the target tile data and a candidate change pattern spot set for the target tile data according to the target identifier and the tile parameters; determining at least one effective change pattern spot matched with the target tile data according to the target display time, the first attribute information of the target tile data and the candidate change pattern spot set; obtaining associated images associated with the at least one effective change pattern spot, and fusing the target tile data and the at least one associated image based on the at least one effective change pattern spot to obtain target fused tile data; and returning the target fusion tile data to the user terminal.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of remote sensing image loading, and in particular to a remote sensing image display method and device, an electronic device, a storage medium and a computer program product. BACKGROUND

[0002] Remote sensing images, as important geographic information data, need to be frequently loaded and used in various geographic information systems. Loading remote sensing images is a basic function of a Web-based geographic information system, and the purpose is to provide real base map data for the system scene. At present, the Web-based geographic information system loads remote sensing images by slicing the remote sensing images to be loaded, relying on a data center product to publish the sliced data as a data service, and further calling and loading the data service on the Web to realize the loading and display of remote sensing images.

[0003] However, when the remote sensing images to be loaded are locally updated, the related art usually uses a "full update" method to obtain the updated remote sensing images, and further uses the updated remote sensing images to publish new data services to replace the original data services. The above process not only has a large amount of calculation and takes a long time, but also cannot realize rapid response to changes, and is difficult to meet the timeliness requirements of business. SUMMARY

[0004] The present application provides a remote sensing image display method and device, an electronic device, a storage medium and a computer program product.

[0005] According to one aspect of the present application, a remote sensing image display method is provided, comprising: receiving a tile acquisition request of a user terminal, the tile acquisition request comprising a target identifier associated with a tile to be loaded, tile parameters and a target display time; obtaining target tile data, first attribute information of the target tile data and a candidate change plot set for the target tile data according to the target identifier and the tile parameters, wherein the candidate change plot set comprises a plurality of candidate change plots and second attribute information of each of the plurality of candidate change plots; determining at least one effective change plot matched with the target tile data according to the target display time, the first attribute information of the target tile data and the candidate change plot set; acquiring associated images associated with each of the at least one effective change plot, and fusing the target tile data and the at least one associated image based on the at least one effective change plot to obtain target fused tile data; and returning the target fused tile data to the user terminal.

[0006] According to another aspect of the present application, there is provided a remote sensing image display device, comprising: a receiving module configured to receive a tile acquisition request of a user terminal, the tile acquisition request comprising a target identifier associated with a target tile to be loaded, tile parameters, and a target display time; an obtaining module configured to obtain target tile data, first attribute information of the target tile data, and a candidate change patch set for the target tile data according to the target identifier and the tile parameters, wherein the candidate change patch set comprises a plurality of candidate change patches and second attribute information of each of the plurality of candidate change patches; a determining module configured to determine at least one valid change patch matched with the target tile data according to the target display time, the first attribute information of the target tile data, and the candidate change patch set; a fusing module configured to obtain associated images associated with each of the at least one valid change patch, and fuse the target tile data and the at least one associated image based on the at least one valid change patch to obtain target fused tile data; and a returning module configured to return the target fused tile data to the user terminal.

[0007] According to another aspect of the present application, there is provided an electronic device, comprising: one or more processors; a memory storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the remote sensing image display method as described above.

[0008] According to another aspect of the present application, there is provided a computer-readable storage medium having stored thereon executable instructions that, when executed by a processor, cause the processor to perform the remote sensing image display method as described above.

[0009] According to another aspect of the present application, there is provided a computer program product comprising a computer program which, when executed by a processor, performs the remote sensing image display method as described above. BRIEF DESCRIPTION OF DRAWINGS

[0010] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly introduced as follows. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can also be obtained by those skilled in the art without any creative effort on the basis of these drawings.

[0011] Figure 1 is a system architecture schematic diagram according to an embodiment of the present application which can apply the remote sensing image display method;

[0012] Figure 2 is a flowchart of the remote sensing image display method according to an embodiment of the present application;

[0013] Figure 3AThe schematic diagram illustrates the structure of the target tile data;

[0014] Figure 3B This schematically illustrates the spatial relationship between the target area corresponding to the target image data block and the change areas corresponding to each of the multiple potential change patches;

[0015] Figure 4 This is a block diagram of a remote sensing image display device according to an embodiment of the present invention;

[0016] Figure 5 This is a block diagram of an electronic device suitable for implementing a remote sensing image display method according to an embodiment of the present invention. Detailed Implementation

[0017] The technical solutions of the present invention will be clearly and completely described below with reference to the embodiments and accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention are within the scope of protection of the present invention.

[0018] It should be noted that the sequence numbers of each operation in the following methods are merely for descriptive purposes and should not be construed as indicating the execution order of the operations. Unless explicitly stated otherwise, the method does not need to be executed in the exact order shown. Furthermore, in the description of this invention, terms such as "first," "second," etc. (if present) are used only for distinguishing descriptions and should not be construed as indicating or implying relative importance.

[0019] In the technical solution of this invention, the collection, storage, use, processing, transmission, provision, disclosure, and application of data (including but not limited to user personal information) comply with the relevant laws and regulations of the relevant countries and regions, and do not violate public order and good morals. Furthermore, in the technical solution of this invention, authorization or consent from the data owner is obtained before acquiring or collecting any relevant data.

[0020] Figure 1 This is a schematic diagram of a system architecture for displaying remote sensing images according to an embodiment of the present invention. It should be noted that... Figure 1 The examples shown are merely examples of system architectures that can be applied to embodiments of the present invention, in order to help those skilled in the art understand the technical content of the present invention, but do not mean that embodiments of the present invention cannot be used in other devices, systems, environments or scenarios.

[0021] like Figure 1 As shown, the system architecture 100 according to this embodiment may include a user terminal 101, a server 102, and a network 103.

[0022] User terminal 101 can be, for example, various electronic devices with interactive interfaces, including but not limited to smartphones, laptops, tablets, VR / AR devices, and in-vehicle terminals. User terminal 101 can, for example, have various client applications installed, including but not limited to geographic information system applications, map navigation applications, or web browser applications. Users can query the information or data they need through human-computer interaction with user terminal 101.

[0023] Server 102 can be, for example, a backend management server that supports the operation of client applications in user terminal 101. Server 102 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0024] Network 103 is a medium used to provide a communication link between user terminal 101 and server 102. Network 103 may include various connection types, such as wired or wireless communication links or fiber optic cables, etc.

[0025] User terminal 101 can, for example, obtain the tile parameters, target identifier, and target display time associated with the tile to be loaded through human-computer interaction, and send a tile acquisition request to server 102. The tile acquisition request includes the target identifier, tile parameters, and target display time associated with the tile to be loaded.

[0026] For example, server 102 can obtain target tile data, first attribute information of the target tile data, and a set of candidate change patches for the target tile data based on the target identifier and tile parameters carried in the tile acquisition request. The set of candidate change patches includes multiple candidate change patches and their respective second attribute information. Server 102 can determine at least one valid change patch matching the target tile data based on the target display time, the first attribute information of the target tile data, and the set of candidate change patches. It can also acquire associated images associated with each of the at least one valid change patch, and fuse the target tile data and the at least one associated image based on the at least one valid change patch to obtain target fused tile data. This target fused tile data is then fed back to user terminal 101 for display on user terminal 101.

[0027] It should be noted that the remote sensing image display method provided in this embodiment of the invention can be executed by server 102. Correspondingly, the remote sensing image display device provided in this embodiment of the invention can be located in server 102. The remote sensing image display method provided in this embodiment of the invention can also be executed by a server or server cluster that is different from server 102 and capable of communicating with user terminal 101 and / or server 102. Correspondingly, the remote sensing image display device provided in this embodiment of the invention can also be located in a server or server cluster that is different from server 102 and capable of communicating with user terminal 101 and / or server 102.

[0028] It should be understood that Figure 1 The number of user terminals 101, servers 102, and networks 103 shown is merely illustrative. Any number of user terminals 101, servers 102, and networks 103 can be used as needed.

[0029] Figure 2 This is a flowchart of a remote sensing image display method according to an embodiment of the present invention.

[0030] like Figure 2 As shown, the remote sensing image display method 200 includes operations S210 to S250.

[0031] In operation S210, a tile acquisition request is received from the user terminal. The tile acquisition request includes the target identifier associated with the tile to be loaded, the tile parameters, and the target display time.

[0032] Tile parameters are used to identify and locate the target tile data corresponding to the tile to be loaded. In embodiments of the present invention, tile parameters may include, for example, parameters such as the scaling level, row number, and column number corresponding to the tile to be loaded.

[0033] The target identifier is used to indicate the target baseline map service associated with the target tile data corresponding to the tile to be loaded, as well as the target change patch requirement attributes corresponding to the target baseline map service.

[0034] The target display time is used to indicate the time range to which the tile to be loaded belongs. In this embodiment of the invention, the target display time can be in units of days, months, quarters, or years, and can be set according to actual needs; this invention does not limit this.

[0035] In operation S220, based on the target identifier and tile parameters, target tile data, first attribute information of the target tile data, and a set of candidate change patches for the target tile data are obtained.

[0036] In one example, the target tile data, the first attribute information of the target tile data, and the candidate variation patch set for the target tile data can be obtained through the following steps.

[0037] First, based on the target identifier, the target baseline map service identifier and the target change patch requirement attributes are determined from the pre-stored change mapping data.

[0038] According to an embodiment of the present invention, the change mapping data includes multiple entries, each entry including a candidate identifier, a base map service identifier, and a change patch demand attribute. The candidate identifier is used to identify the base map service identifier and the change patch demand attribute. The base map service identifier is used to identify the service address of the base map service. Based on the base map service identifier, all tile data resources corresponding to the corresponding base map service can be obtained. The change patch demand attribute is used to characterize the demand for change patches for the corresponding base map service.

[0039] According to an embodiment of the present invention, the target entry containing the target identifier is queried from the change mapping data based on the target identifier, and the base map service identifier and change patch requirement attribute in the target entry are used as the target base map service identifier and the target change patch requirement attribute.

[0040] Next, based on the target baseline map service identifier and tile parameters, the target tile data and the first attribute information of the target tile data are obtained.

[0041] According to an embodiment of the present invention, the target reference map service identifier and tile parameters are used to index the target tile data and its first attribute information under the target reference map service. Based on the target reference map service identifier and tile parameters, the target tile data and its first attribute information can be obtained from the reference service library.

[0042] In this embodiment of the invention, the reference service library pre-stores tile datasets associated with multiple reference base map services and their corresponding attribute information, which are generated based on multi-source remote sensing data in a spatiotemporal database. Each tile dataset includes multiple tile data, and each tile data includes at least one image data block. The attribute information of each tile dataset is used to indicate the first attribute information of each tile data in the tile dataset, such as, but not limited to, the index information of the tile data, the reference time information corresponding to each image data block in the tile data, the first spatial location information, the coordinate system, and the spatial resolution. Among them, the reference time information is used to indicate the imaging time of the image data block.

[0043] According to an embodiment of the present invention, the target tile data includes at least one image data block. The first attribute information of the target tile data includes reference time information, first spatial location information, coordinate system, and spatial resolution corresponding to each image data block.

[0044] Next, based on the target change patch requirements attributes and tile parameters, a set of candidate change patches for the target tile data is obtained from the spatiotemporal database.

[0045] According to embodiments of the present invention, the spatiotemporal database stores multi-source remote sensing images and their attribute information, change patches associated with the multi-source remote sensing images and their attribute information, as well as spatiotemporal indexes for the multi-source remote sensing images and for the change patches. The attribute information of the multi-source remote sensing images includes, but is not limited to, the service category, coordinate system, spatial resolution, temporal information, and spatial location information corresponding to the multi-source remote sensing images. The attribute information of the change patches includes, but is not limited to, the change time information, second spatial location information, change type, and associated image identifier corresponding to the change patches.

[0046] According to an embodiment of the present invention, since the target change patch demand attribute can characterize the demand for change patch acquisition for the target reference base map service, an initial set of change patches associated with all tile data resources corresponding to the target reference base map service can be queried from the spatiotemporal database based on the target change patch demand attribute. Then, based on the tile parameters, the spatial location information corresponding to the target tile data is determined, and based on the spatial location information corresponding to the target tile data and the second spatial location information of each change patch in the initial change patch set, change patches whose change areas overlap with the areas corresponding to the target tile data are selected from the initial change patch set, thereby obtaining a candidate change patch set. The candidate change patch set includes multiple candidate change patches and their respective second attribute information. The second attribute information may include, but is not limited to, the change time information, second spatial location information, change type, and associated image identifier of the candidate change patch.

[0047] It should be noted that in some embodiments, if only target tile data is obtained based on the target identifier and tile parameters, that is, no change patches for the target tile data are found in the spatiotemporal database, in other words, no changes have occurred within the spatial geographic area covered by the target tile data, then the target tile data can be returned to the user terminal for display on the user terminal.

[0048] In operation S230, based on the target display time, the first attribute information of the target tile data, and the candidate change patch set, at least one valid change patch that matches the target tile data is determined.

[0049] Understandably, target tile data is typically used to reflect the geographic information of a given area at a reference time (determined by the reference time information of each image data block contained in the target tile data). However, the real world is often dynamic, and the geographic information of a given area at a reference time may differ from its geographic information at the target display time. This makes it impossible for target tile data to accurately reflect the actual ground features of the given area at the target display time.

[0050] To ensure that the geographic information of the corresponding area at the time of the user's target display matches the actual surface conditions, at least one valid change patch that matches the target tile data can be selected from the candidate change patch set based on the target display time, the first attribute information of the target tile data, and the candidate change patch set. This at least one valid change patch can then be used to update the target tile data.

[0051] In operation S240, associated images are acquired that are associated with at least one valid change patch, and the target tile data and at least one associated image are fused based on at least one valid change patch to obtain target fused tile data.

[0052] For example, for each valid change patch, the associated image is retrieved from the spatiotemporal database based on the associated image identifier corresponding to the valid change patch. Then, the target tile data and at least one associated image are fused based on at least one valid change patch to obtain target fused tile data. The target fused tile data can reflect the true geographic information of the corresponding area at the time when the user's target is displayed.

[0053] During operation of S250, the target fused tile data is returned to the user terminal.

[0054] According to an embodiment of the present invention, after obtaining the target fused tile data, the server can return the target fused tile data to the user terminal so that the target fused tile data can be displayed on the user terminal.

[0055] According to embodiments of the present invention, target tile data, first attribute information of the target tile data, and a candidate set of change patches for the target tile data are obtained based on target identifiers and tile parameters. At least one valid change patch matching the target tile data is determined based on the target display time, the first attribute information of the target tile data, and the candidate set of change patches. Furthermore, the target tile data and at least one associated image are fused based on at least one valid change patch to obtain target fused tile data that reflects the true geographic information of the user's area of ​​interest at the target display time, and is displayed through a user terminal. Compared to the "full update" approach used in related technologies to update and display changes, the technical solution of the present invention enables real-time fusion processing of image data only within the changed area, without processing image data within the non-changed area or republishing image data services. This significantly reduces computational load, improves processing efficiency, and enhances the display efficiency of remote sensing image data, achieving rapid response to changes and meeting the timeliness requirements of business operations. In some embodiments, the actual running time of the electronic device executing the above method can reach the minute level.

[0056] The process of identifying at least one valid variation patch that matches the target tile data is illustrated below.

[0057] First, based on the reference time information corresponding to each image data block in at least one image data block contained in the target display time and target tile data, the target image data block is determined, wherein the target image data block refers to the image data block whose reference time information does not match the target display time.

[0058] For each image data block, the target display time is compared with the reference time information of the image data block to determine whether the reference time information of the image data block matches the target display time, thereby determining whether the image data block is a target image data block. For example, if the reference time information of the image data block falls within the target display time range, it is considered that the reference time information of the image data block matches the target display time, and the image data block is not a target image data block; otherwise, it is considered that the reference time information of the image data block does not match the target display time, and the image data block is a target image data block.

[0059] In this embodiment of the invention, if it is determined that at least one image data block contained in the target tile data does not contain a target image data block, that is, the target tile data can reflect the true geographic information of the corresponding area at the target display time, the target tile data can be directly fed back to the user terminal. If it is determined that at least one target image data block exists in at least one image data block, subsequent operations are performed to determine whether there are valid change patches in the candidate change patch set that match each target image data block, so as to use the valid change patches to update the corresponding target image data blocks.

[0060] Figure 3A A schematic diagram illustrating the structure of the target tile data is shown. For example, as... Figure 3A As shown, the target tile data 300 includes multiple image data blocks, such as image data block 310, image data block 320, image data block 330, and image data block 340. The reference time information corresponding to image data blocks 310 to 340 are January 10, 2022, October 9, 2023, May 3, 2022, and May 31, 2023, respectively.

[0061] Assuming the target display period is from January 1, 2024 to December 31, 2024, by comparing the target display period with the reference time information of each image data block, the target image data blocks in the target tile data can be determined to include target image data block 310, target image data block 320, target image data block 330, and target image data block 340. Further steps can be taken to determine whether there are valid change patches corresponding to each of the target image data blocks 310, 320, 330, and 340 in the candidate change patch set, so that the corresponding target image data blocks can be updated using the valid change patches.

[0062] Next, in response to determining that at least one target image data block exists in at least one image data block, for each target image data block, based on the target display time, the reference time information and the first spatial location information of the target image data block, and the change time information and the second spatial location information corresponding to each of the multiple candidate change patches, at least one valid change patch associated with the target image data block is determined from the multiple candidate change patches.

[0063] According to an embodiment of the present invention, each valid change patch refers to a candidate change patch whose corresponding change area overlaps with the target area corresponding to the target image data block, and whose change time information for the change area is the most up-to-date before the target display time. The target area refers to the spatial geographic range corresponding to the target image data block, which is determined based on the first spatial location information corresponding to the target image data block. The change area corresponding to the candidate change patch refers to the spatial geographic range corresponding to the candidate change patch, which is determined based on the second spatial location information corresponding to the candidate change patch.

[0064] The process of determining at least one valid change patch associated with each target image data block is described below, using target image data block 310 in the example above.

[0065] First, based on the first spatial location information corresponding to the target image data block 310 and the second spatial location information corresponding to each of the multiple candidate change patches, at least one potential change patch associated with the target image data block 310 is determined from the multiple candidate change patches. The change area corresponding to each potential change patch overlaps with the target area corresponding to the target image data block 310. The change area corresponding to each potential change patch refers to the spatial geographic range corresponding to the potential change patch, which is determined based on the second spatial location information corresponding to that potential change patch.

[0066] Figure 3B The illustration schematically shows the spatial relationship between the target area corresponding to the target image data block 310 and the change areas corresponding to each of the multiple potential change patches. For example... Figure 3B As shown, multiple change regions exist within the target area 311, including, for example, a portion of change region 3111, change region 3112, change region 3113, change region 3114, change region 3115, and change region 3116. Change regions 3113 and 3114 partially overlap, and change region 3115 covers change region 3116. Change regions 3111, 3112, 3113, 3114, 3115, and 3116 correspond one-to-one with potential change patch 1, potential change patch 2, potential change patch 3, potential change patch 4, potential change patch 5, and potential change patch 6, respectively.

[0067] Next, based on the target display time, the change time information and change area corresponding to each of the at least one potential change patch, at least one valid change patch associated with the target image data block 310 is determined from the at least one potential change patch.

[0068] For example, assume the target display time is from January 1, 2024 to December 31, 2024. The change time information for potential change patches 1 to 6 are December 10, 2022, February 2, 2023, January 22, 2023, July 15, 2023, May 15, 2023, and March 10, 2023, respectively. Based on the target display time and the change time information and change area corresponding to each potential change patch, at least one valid change patch associated with the target image data block 310 can be determined from potential change patches 1 to 6. Each valid change patch refers to a potential change patch whose change time information for the corresponding change area is the most up-to-date before the target display time.

[0069] For example, for potential change patch 1, although the change region 3111 partially overlaps with the target region 311 (e.g. Figure 3B As shown), since the change corresponding to the potential change patch 1 (the change time information is December 10, 2022) is the latest change that occurred in the overlapping part between the change area 3111 and the target area 311 before the target display time, the potential change patch 1 can be identified as a valid change patch associated with the target image data block 310, and is denoted as valid change patch 1.

[0070] For example, for potential change patch 2, since the change corresponding to potential change patch 2 (the change time information is February 2, 2023) is the latest change that occurred in change area 3112 before the target display time, potential change patch 2 can be identified as a valid change patch associated with target image data block 310, and is denoted as valid change patch 2.

[0071] For example, for potential change patch 3, since the change corresponding to potential change patch 3 (change time information is January 22, 2023) is the latest change that occurred in the other change areas of change area 3113 excluding the overlapping part between change area 3113 and change area 3114 before the target display time, potential change patch 3 is determined as a valid change patch associated with target image data block 310, and is denoted as valid change patch 3. For potential change patch 4, since the change corresponding to it (change time information is July 15, 2023) is the latest change that occurred in change area 3114 before the target display time, potential change patch 4 is determined as a valid change patch associated with target image data block 310, and is denoted as valid change patch 4.

[0072] For example, for potential change patch 5, since its corresponding change (change time information is May 15, 2023) is the latest change that occurred in change area 3115 before the target display time, potential change patch 5 is determined as a valid change patch associated with target image data block 310, and is denoted as valid change patch 5. However, for potential change patch 6, since change area 3116 underwent two changes before the target display time, and the change corresponding to potential change patch 6 (change time information is March 10, 2023) is not the latest change, it can be determined that potential change patch 6 is not a valid change patch associated with target image data block 310.

[0073] Using the above method, the effective change patches associated with the target image data block 310 can be identified as effective change patch 1, effective change patch 2, effective change patch 3, effective change patch 4, and effective change patch 5.

[0074] Similarly, based on the above process, effective change patches associated with each of the target image data blocks 320 to 340 can be determined.

[0075] Next, at least one valid change patch associated with at least one target image data block is identified as at least one valid change patch that matches the target tile data.

[0076] For example, the effective variation patches associated with each of the target image data blocks 310 to 340 can be identified as effective variation patches that match the target tile data.

[0077] It should be noted that in some embodiments, if no valid change patch matching the target tile data is found based on the target display time, the first attribute information of the target tile data, and the candidate change patch set, the target tile data is returned to the user terminal for display.

[0078] The following describes the process of fusing target tile data and at least one associated image based on at least one valid change patch.

[0079] First, for any one of the at least one valid variation patches that matches the target tile data, based on the second spatial location information corresponding to each valid variation patch, it is determined whether there are any neighboring valid variation patches associated with that valid variation patch in the at least one valid variation patch that matches the target tile data.

[0080] According to an embodiment of the present invention, a neighboring valid change patch associated with a certain valid change patch refers to another valid change patch among the at least one valid change patch that overlaps with the valid change patch. In other words, the change area corresponding to the neighboring valid change patch overlaps with the change area corresponding to the valid change patch.

[0081] Next, in response to determining that there are no neighboring valid change patches associated with the aforementioned valid change patch in at least one valid change patch that matches the target tile data, the associated image and target tile data corresponding to the valid change patch are fused according to the valid change patch.

[0082] The following describes the process of fusing associated images and target tile data corresponding to effective change patches.

[0083] First, identify the target image data blocks associated with the effective change patches.

[0084] For each valid change patch, since the valid change patch accurately reflects the area where the associated target image data block has changed, the process of fusing the associated image and target tile data corresponding to the valid change patch in this embodiment of the invention can be simplified to fusing only the associated image and the associated target image data block corresponding to the valid change patch. This eliminates the need to process the unchanged image data blocks in the target tile data, thereby significantly reducing the computational overhead during the fusion process and improving fusion efficiency.

[0085] Based on this, embodiments of the present invention can obtain target image data blocks associated with effective change patches from target tile data, so that the associated target image data blocks can be used to replace the target tile data for subsequent fusion processing.

[0086] Next, based on the associated target image data block, the associated image corresponding to the effective change patch is resampled to obtain a first reference image that matches the associated target image data block.

[0087] It is understandable that the spatial resolution of the associated image corresponding to the effective change patch and the spatial resolution of the associated target image data block may be inconsistent, which will affect the subsequent fusion processing of the associated image and the associated target image data block. To solve this problem, in this embodiment of the invention, the associated image corresponding to the effective change patch can be resampled using the associated target image data block as a reference to obtain a first reference image. The first reference image and the associated target image data block have the same scale. The first reference image and the associated target image data block can then be used for subsequent fusion.

[0088] Next, a first reference image region corresponding to the first overlapping region is determined in the first reference image. The first overlapping region refers to the overlapping portion between the change region corresponding to the effective change patch and the target region corresponding to the associated target image data block.

[0089] For example, based on the first spatial location information corresponding to the associated target image data block and the second spatial location information corresponding to the effective change patch, the overlapping portion between the change area corresponding to the effective change patch and the target area corresponding to the associated target image data block, i.e., the first overlapping area, can be determined. Then, a first reference image area corresponding to the first overlapping area can be determined in the first reference image.

[0090] Next, based on the first overlapping area, the first reference image area is stitched into the associated target image data block to obtain the first fused image data block.

[0091] In embodiments of the present invention, for example, based on feathering fusion processing technology, a first reference image region can be stitched to the corresponding position in the associated target image data block, using a first overlapping region as a reference, thereby obtaining a first fused image data block. The first fused image data block is used to replace the associated target image data block and is fused with another valid change patch.

[0092] In this embodiment of the invention, by using feathering fusion processing technology to stitch the first reference image region into the associated target image data block, the colors of the first reference image region and the associated target image data block can be made similar, thereby reducing the "seam" and improving the image display effect.

[0093] In some embodiments, after acquiring the first fused image data block, the second attribute information corresponding to the effective changed patches and the associated image can be associated with the first fused image data block. This facilitates the subsequent association and display of the target fused tile data, the associated image, and the second attribute information corresponding to the effective changed patches.

[0094] Next, the associated target image data block is replaced with the first fused image data block.

[0095] In this embodiment of the invention, a first fused image data block can be used to replace the associated target image data block so that the first fused image data block can be used subsequently to fuse another valid change patch.

[0096] In some embodiments of the present invention, if it is determined that at least one valid variation patch matching the target tile data contains a neighboring valid variation patch associated with the aforementioned valid variation patch, then the associated images corresponding to the neighboring valid variation patch and the valid variation patch, as well as the target tile data, are fused based on the neighboring valid variation patch and the valid variation patch. This process will be described below.

[0097] First, identify the target image data blocks associated with the effective change patches.

[0098] In this embodiment of the invention, a target image data block associated with an effective change patch can be obtained from the target tile data so that the associated target image data block can be used to replace the target tile data for subsequent fusion processing.

[0099] Next, based on the associated target image data blocks, the associated images corresponding to the effective change patches and the adjacent effective change patches are resampled respectively to obtain a first reference image and a second reference image that match the associated target image data blocks. The first reference image and the second reference image correspond one-to-one with the effective change patches and the adjacent effective change patches, respectively.

[0100] Similarly, using the associated target image data block as a reference, the associated images corresponding to the effective change patch and the adjacent effective change patch can be resampled to obtain a first reference image and a second reference image. Both the first and second reference images have the same scale as the associated target image data block. Subsequently, the first and second reference images can be fused with the associated target image data block.

[0101] Next, a first reference image region corresponding to the first overlapping region is determined in the first reference image, a second reference image region corresponding to the second overlapping region is determined in the second reference image, and a first overlapping image region and a second overlapping image region corresponding to the overlapping portion between the first overlapping region and the second overlapping region are determined in the first reference image and the second reference image, respectively.

[0102] According to an embodiment of the present invention, the first overlapping region refers to the overlapping portion between the changing region corresponding to the effective changing patch and the target region corresponding to the associated target image data block. The second overlapping region refers to the overlapping portion between the changing region corresponding to a neighboring effective changing patch and the target region corresponding to the associated target image data block. The first overlapping region is determined based on the first spatial location information corresponding to the associated target image data block and the second spatial location information corresponding to the effective changing patch. The second overlapping region is determined based on the first spatial location information corresponding to the associated target image data block and the second spatial location information corresponding to a neighboring effective changing patch.

[0103] Next, based on the change time information corresponding to the adjacent effective change patches and the effective change patches, the target overlapping image region is determined from the first overlapping image region and the second overlapping image region.

[0104] According to an embodiment of the present invention, the target overlapping image region refers to the overlapping image region corresponding to the effective change patch with the change time information later.

[0105] It is understandable that since the overlapping part between the first and second overlapping areas undergoes two changes (i.e., one change each for the adjacent effective change patch and the effective change patch), in order to ensure the timeliness of the image data of the overlapping part, the overlapping image area corresponding to the effective change patch with the later change time information can be used as the real image data of the overlapping part for subsequent fusion processing.

[0106] Next, based on the first overlapping region, the second overlapping region and the overlapping portion between the first overlapping region and the second overlapping region, the image regions in the first reference image region excluding the target overlapping image region, the image regions in the second reference image region excluding the target overlapping image region, and the target overlapping image region are stitched together into the associated target image data block to obtain the second fused image data block.

[0107] Similarly, based on feathering fusion processing technology, using the first overlapping region, the second overlapping region, and the overlapping portion between the first and second overlapping regions as references, the image regions in the first reference image region excluding the target overlapping image region, the image regions in the second reference image region excluding the target overlapping image region, and the target overlapping image region are stitched to their corresponding positions in the associated target image data block, thereby obtaining a second fused image data block. This second fused image data block is used to replace the associated target image data block and is fused with another valid change patch.

[0108] In some embodiments, after acquiring the second fused image data block, the second attribute information corresponding to the effective change patch and the associated image can be associated with the second fused image data block. This facilitates the subsequent association and display of the target fused tile data with the associated image, the effective change patch, and the second attribute information corresponding to the adjacent effective change patches.

[0109] Next, the associated target image data block is replaced with the second fused image data block.

[0110] In this embodiment of the invention, a second fused image data block can be used to replace the associated target image data block so that the second fused image data block can be used subsequently to fuse another valid change patch.

[0111] Through the above process, it is possible to fuse the associated image and target tile data corresponding to any valid change patch.

[0112] Next, repeat the above operation until the processing of at least one valid changed patch is completed, and the target fused tile data is obtained.

[0113] For any valid change patch, the above process can be used to fuse the associated imagery and target tile data corresponding to the valid change patch, resulting in either a first fused image data block or a second fused image data block. Then, the first or second fused image data block is used to fuse the associated imagery and target tile data corresponding to another valid change patch. This iterative process is repeated until the fusion of all valid change patches is completed, yielding the target fused tile data.

[0114] Figure 4 This is a block diagram of a remote sensing image display device according to an embodiment of the present invention.

[0115] like Figure 4 As shown, the remote sensing image display 400 includes: a receiving module 410, an acquisition module 420, a determination module 430, a fusion module 440, and a return module 450.

[0116] The receiving module 410 is used to receive a tile acquisition request from a user terminal. The tile acquisition request includes a target identifier associated with the tile to be loaded, tile parameters, and target display time.

[0117] The acquisition module 420 is used to obtain target tile data, first attribute information of the target tile data, and a set of candidate change patches for the target tile data based on the target identifier and tile parameters. The set of candidate change patches includes multiple candidate change patches and second attribute information of each of the multiple candidate change patches.

[0118] The determination module 430 is used to determine at least one valid change patch that matches the target tile data based on the target display time, the first attribute information of the target tile data, and the candidate change patch set.

[0119] The fusion module 440 is used to acquire associated images associated with at least one valid change patch, and to fuse the target tile data and at least one associated image based on at least one valid change patch to obtain target fused tile data.

[0120] The return module 450 is used to return the target fused tile data to the user terminal.

[0121] It should be noted that the implementation methods, technical problems solved, functions achieved, and technical effects of each module in the device embodiment are the same as or similar to the implementation methods, technical problems solved, functions achieved, and technical effects of each corresponding step in the method embodiment, and will not be repeated here.

[0122] Figure 5 A block diagram schematically illustrates an electronic device suitable for implementing a remote sensing image display method according to an embodiment of the present invention.

[0123] like Figure 5 As shown, an electronic device 500 according to an embodiment of the present invention includes a processor 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage portion 508 into a random access memory (RAM) 503. The processor 501 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or an associated chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 501 may also include onboard memory for caching purposes. The processor 501 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present invention.

[0124] RAM 503 stores various programs and data required for the operation of electronic device 500. Processor 501, ROM 502, and RAM 503 are interconnected via bus 504. Processor 501 executes various operations of the method flow according to embodiments of the present invention by executing programs in ROM 502 and / or RAM 503. It should be noted that the programs may also be stored in one or more memories other than ROM 502 and RAM 503. Processor 501 may also execute various operations of the method flow according to embodiments of the present invention by executing programs stored in said one or more memories.

[0125] According to an embodiment of the present invention, the electronic device 500 may further include an input / output (I / O) interface 505, which is also connected to a bus 504. The electronic device 500 may also include one or more of the following components connected to the I / O interface 505: an input section 506 including a keyboard, mouse, etc.; an output section 507 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 508 including a hard disk, etc.; and a communication section 509 including a network interface card such as a LAN card, modem, etc. The communication section 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the I / O interface 505 as needed. A removable medium 511, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on the drive 510 as needed so that computer programs read from it can be installed into the storage section 508 as needed.

[0126] The present invention also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or it may exist independently and not assembled into the device / apparatus / system. The computer-readable storage medium carries one or more programs, which, when executed, implement the remote sensing image display method according to embodiments of the present invention.

[0127] According to embodiments of the present invention, the computer-readable storage medium may be a non-volatile computer-readable storage medium, such as including, but not limited to: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In the present invention, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. For example, according to embodiments of the present invention, the computer-readable storage medium may include ROM 502 and / or RAM 503 and / or one or more memories other than ROM 502 and RAM 503 described above.

[0128] Embodiments of the present invention also include a computer program product comprising a computer program containing program code for performing the methods shown in the flowchart. When the computer program product is run on a computer system, the program code is used to enable the computer system to implement the remote sensing image display method provided in the embodiments of the present invention.

[0129] When the computer program is executed by the processor 501, it performs the functions defined in the system / apparatus of this invention. According to embodiments of the invention, the systems, apparatuses, modules, units, etc., described above can be implemented by computer program modules.

[0130] In one embodiment, the computer program may rely on a tangible storage medium such as an optical storage device or a magnetic storage device. In another embodiment, the computer program may also be transmitted and distributed in the form of signals over a network medium, and may be downloaded and installed via the communication section 509, and / or installed from a removable medium 511. The program code contained in the computer program can be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination thereof.

[0131] In such an embodiment, the computer program can be downloaded and installed from a network via communication section 509, and / or installed from removable medium 511. When the computer program is executed by processor 501, it performs the functions defined in the system of this embodiment of the invention. According to embodiments of the invention, the systems, devices, apparatuses, modules, units, etc., described above can be implemented by computer program modules.

[0132] According to embodiments of the present invention, program code for executing the computer programs provided in the embodiments of the present invention can be written in any combination of one or more programming languages. Specifically, these computational programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, languages ​​such as Java, C++, Python, "C", or similar programming languages. The program code can be executed entirely on the user's computing device, partially on the user's device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0133] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0134] Those skilled in the art will understand that the features described in the various embodiments of the present invention can be combined and / or combined in various ways, even if such combinations or combinations are not explicitly described in the present invention. In particular, the features described in the various embodiments of the present invention can be combined and / or combined in various ways without departing from the spirit and teachings of the present invention. All such combinations and / or combinations fall within the scope of the present invention.

[0135] The embodiments of the present invention have been described above. However, these embodiments are merely illustrative and not intended to limit the scope of the invention. Although various embodiments have been described above, this does not mean that the measures in the various embodiments cannot be used advantageously in combination. Various substitutions and modifications can be made by those skilled in the art without departing from the scope of the invention, and all such substitutions and modifications should fall within the scope of the invention.

Claims

1. A method for displaying remote sensing images, comprising: receiving a tile acquisition request of a user terminal, the tile acquisition request comprising a target identifier associated with a tile to be loaded, tile parameters, and a target display time; obtaining target tile data, first attribute information of the target tile data, and a candidate change patch set for the target tile data according to the target identifier and the tile parameters, wherein the candidate change patch set comprises a plurality of candidate change patches and second attribute information of each of the plurality of candidate change patches; determining at least one valid change patch matching the target tile data according to the target display time, the first attribute information of the target tile data, and the candidate change patch set; acquiring associated images associated with each of the at least one valid change patch, and fusing the target tile data and the at least one associated image based on the at least one valid change patch to obtain target fused tile data; returning the target fused tile data to the user terminal.

2. The method of claim 1, wherein, The obtaining of the target tile data, the first attribute information of the target tile data, and the candidate change patch set for the target tile data according to the target identifier and the tile parameters comprises: determining a target reference base map service identifier and target change patch requirement attribute from pre-stored change mapping data according to the target identifier; acquiring the target tile data and the first attribute information of the target tile data according to the target reference base map service identifier and the tile parameters; acquiring the candidate change patch set for the target tile data from a space-time database according to the target change patch requirement attribute and the tile parameters.

3. The method of claim 2, wherein, The target tile data comprises at least one image data block, the first attribute information of the target tile data comprises reference time information and first spatial position information corresponding to each of the image data blocks, and the second attribute information comprises change time information and second spatial position information corresponding to the candidate change patch; The determining of the at least one valid change patch matching the target tile data according to the target display time, the first attribute information of the target tile data, and the candidate change patch set comprises: determining a target image data block in the at least one image data block according to the target display time and the reference time information of each of the image data blocks, the target image data block being an image data block for which the reference time information does not match the target display time. In response to determining that at least one of the image data blocks is the target image data block, for each target image data block, determining at least one valid change patch associated with the target image data block from the plurality of candidate change patches according to the target display time, the reference time information and the first spatial position information of the target image data block, and the change time information and the second spatial position information of each of the plurality of candidate change patches, wherein each valid change patch refers to a candidate change patch whose corresponding change region has an overlapping part with a target region corresponding to the target image data block, and the change time information of the change region is the latest before the target display time. At least one valid change patch associated with each of the at least one target image data block is determined as at least one valid change patch matched with the target tile data.

4. The method of claim 3, wherein, The fusion of the target tile data and at least one associated image based on at least one valid change patch includes: For any one of the valid change patches, according to the second spatial position information corresponding to each of the valid change patches, it is determined whether there is a neighboring valid change patch associated with the valid change patch in at least one valid change patch matched with the target tile data, and the neighboring valid change patch has an overlapping part with the valid change patch. In response to determining that there is no neighboring valid change patch in at least one valid change patch matched with the target tile data, the associated image corresponding to the valid change patch and the target tile data are fused according to the valid change patch. In response to determining that there is a neighboring valid change patch in at least one valid change patch matched with the target tile data, the associated images corresponding to the neighboring valid change patch and the valid change patch, and the target tile data are fused according to the neighboring valid change patch and the valid change patch. The above operations are repeatedly performed until the processing of at least one valid change patch is completed, and target fusion tile data is obtained.

5. The method of claim 4, wherein, The fusion of the target tile data and at least one associated image based on at least one valid change patch includes: determining a target image data block associated with the valid change patch; based on the associated target image data block, resampling the associated image corresponding to the valid change patch to obtain a first reference image matched with the associated target image data block; determining a first reference image region corresponding to a first overlapping region in the first reference image, wherein the first overlapping region refers to an overlapping part between a change region corresponding to the valid change patch and a target region corresponding to the associated target image data block; splicing the first reference image region into the associated target image data block according to the first overlapping region to obtain a first fusion image data block; replace the associated target image data block with the first fused image data block.

6. The method of claim 4, wherein, The fusing of the associated images corresponding to the adjacent effective change patch and the effective change patch and the target tile data according to the adjacent effective change patch and the effective change patch comprises: determining a target image data block associated with the effective change patch; based on the associated target image data block, respectively resampling the associated images corresponding to the effective change patch and the adjacent effective change patch to obtain a first reference image and a second reference image matching the associated target image data block, the first reference image and the second reference image corresponding to the effective change patch and the adjacent effective change patch one by one; determining a first reference image region corresponding to a first overlap region in the first reference image, a second reference image region corresponding to a second overlap region in the second reference image, and a first overlap image region and a second overlap image region corresponding to the overlapping part between the first overlap region and the second overlap region in the first reference image and the second reference image respectively; wherein the first overlap region refers to the overlapping part between the change region corresponding to the effective change patch and the target region corresponding to the associated target image data block, and the second overlap region refers to the overlapping part between the change region corresponding to the adjacent effective change patch and the target region corresponding to the associated target image data block; determining a target overlap image region from the first overlap image region and the second overlap image region according to the change time information corresponding to the adjacent effective change patch and the effective change patch, the target overlap image region being the overlap image region corresponding to the effective change patch with later change time information; splicing the image region in the first reference image region except the target overlap image region, the image region in the second reference image region except the target overlap image region, and the target overlap image region into the associated target image data block according to the first overlap region, the second overlap region, and the overlapping part between the first overlap region and the second overlap region, to obtain a second fused image data block; replacing the associated target image data block with the second fused image data block.

7. The method of any one of claims 1 to 6, further comprising: if target tile data is obtained according to the target identifier and the tile parameter, returning the target tile data to the user terminal; or, if no effective change patch matching the target tile data is matched according to the target display time, the first attribute information of the target tile data, and the candidate change patch set, returning the target tile data to the user terminal.

8. The method of claim 3, wherein, The second attribute information further comprises an associated image identifier corresponding to the candidate change patch; and the obtaining of the associated images respectively associated with at least one of the effective change patches comprises: For each of the effective change patches, according to the associated image identifier corresponding to the effective change patch, an associated image associated with the effective change patch is obtained from the spatio-temporal database.

9. The method of claim 5, wherein, The fusing according to the effective change patch, the associated image corresponding to the effective change patch and the target tile data further comprises: associating the second attribute information corresponding to the effective change patch with the first fused image data block.

10. A remote sensing image display device, comprising: a receiving module configured to receive a tile acquisition request of a user terminal, the tile acquisition request comprising a target identifier associated with a to-be-loaded tile, tile parameters and a target display time; an obtaining module configured to obtain target tile data, first attribute information of the target tile data and a candidate change patch set for the target tile data according to the target identifier and the tile parameters, wherein the candidate change patch set comprises a plurality of candidate change patches and second attribute information of each of the plurality of candidate change patches; a determining module configured to determine at least one effective change patch matched with the target tile data according to the target display time, the first attribute information of the target tile data and the candidate change patch set; a fusing module configured to obtain associated images associated with each of the at least one effective change patch, and fuse the target tile data and the at least one associated image based on the at least one effective change patch to obtain target fused tile data; a returning module configured to return the target fused tile data to the user terminal.

11. An electronic device, comprising: one or more processors; a memory storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the remote sensing image display method according to any one of claims 1 to 9.

12. A computer-readable storage medium having stored thereon executable instructions that, when executed by a processor, cause the processor to perform the remote sensing image display method according to any one of claims 1 to 9.

13. A computer program product comprising a computer program that, when executed by a processor, implements the remote sensing image display method according to any one of claims 1 to 9.

Images