A Web online generation method and device of video remote sensing image data of geospatial information, an electronic device and a storage medium

Abstract

The application discloses a kind of Web online generation methods of geographic spatial information video remote sensing image data, comprising: receiving the target range geographic coordinates of target area marked on electronic map;Find multiple target geographic metadata at least partially overlapping with target area in the geographic metadata of MP4 file;Load target geographic metadata corresponding MP4 file as target MP4 file, and obtain the image of each frame as target frame image;Obtain the intersection area of the area indicated by geographic metadata and target area;According to intersection area, target frame image is cropped, and target play frame image is obtained;According to the geographic metadata of each target MP4 file and target play frame image, target play frame image is displayed.The application can meet the needs of user flexible adjustment display range, greatly improve the flexibility of data interaction, significantly improve viewing experience and interpretation accuracy.The application also discloses a device, electronic equipment and computer readable storage medium for implementing the above method.

Description

Technical Field

[0001] This invention relates to the field of geographic information technology, and in particular to a Web-based online generation method, apparatus, electronic device, and storage medium for video remote sensing image data of geospatial information. Background Technology

[0002] With the rapid development of remote sensing technology, video remote sensing imagery, as a new form of data capable of continuously and dynamically recording the process of surface changes, is increasingly widely used in fields such as power line inspection, natural disaster monitoring, urban management, and ecological environment assessment. Compared with traditional static remote sensing imagery, video remote sensing imagery not only provides higher temporal resolution for surface observation but also captures the dynamic evolution of target areas, greatly improving the timeliness and information dimension of remote sensing data.

[0003] However, the deep integration of existing video remote sensing imagery technology with Geographic Information Systems (GIS) still faces significant technical bottlenecks, hindering its effectiveness in practical applications. Specifically, on the one hand, the visualization and interaction methods of current video remote sensing imagery within GIS platforms are relatively rigid. The image display range is typically pre-set to a fixed geographical area, making it difficult to flexibly adjust the display range according to real-time user needs. For example, when a user focuses on a specific area of ​​interest (such as a section of river or a construction site), the system cannot efficiently and dynamically crop or focus the video image on that area, forcing the user to rely on additional spatial queries and image cropping operations, increasing workload and reducing decision-making efficiency. On the other hand, during video playback, due to limitations in image registration accuracy, sensor attitude changes, and projection conversion errors, significant geometric jitter or positional drift often occurs in image edge areas. This jitter not only disrupts the spatial consistency of the image but also severely impacts the user's experience in interpreting surface details. Especially in scenarios requiring precise comparison of image content at different times, the jitter problem further reduces the reliability and usability of video remote sensing data. Summary of the Invention

[0004] To address the aforementioned problems in the prior art, this invention provides a web-based online generation method, apparatus, electronic device, and storage medium for geospatial video remote sensing image data. The technical problem to be solved by this invention is achieved through the following technical solution: The first aspect of this invention provides a Web-based online generation method for geospatial video remote sensing image data, comprising the following steps: Receive the geographic coordinates of the target area marked on the electronic map; Based on the geographic coordinates of the target area, search for multiple target geographic metadata that at least partially overlap with the target area in the geographic metadata of the associated geographic information MP4 file; wherein, the associated geographic information MP4 file is a pre-generated MP4 format file in which each frame of image is associated with its own geographic information data, and the associated geographic information MP4 file is located in the layer above the electronic map. Load the MP4 file containing the associated geographic information corresponding to the target geographic metadata as the target MP4 file, and obtain the image of each frame of the target MP4 file as the target frame image; Obtain the intersection area between the geographic metadata indicated by the target frame image and the target region; The target frame image is obtained by cropping the target frame image based on the intersecting region; The target playback frame image is displayed based on the geographic metadata of each target MP4 file and the target playback frame image.

[0005] In one embodiment of the present invention, displaying the target playback frame image based on the geographic metadata of each target MP4 file and the target playback frame image includes: The target MP4 file and the target playback frame image are combined into a corresponding playback window based on their geographic metadata, and the target playback frame image is played in the corresponding playback window in a web-based online playback format.

[0006] In one embodiment of the present invention, the method for generating the MP4 file associated with the geographic information includes: Frame extraction is performed on the original MP4 video remote sensing image data to obtain the frame images to be processed. The frame image to be processed is geo-registered based on the positioning and attitude determination system data, ground control points, or a base map of a geographic reference to obtain a registered frame image. Calculate the geographic affine transformation parameters and OGC standard global coordinate system information for each frame of the registered image. The global coordinate system information is written as an atom into the moov atom of the original video remote sensing image data MP4 file; By associating the geographic affine transformation parameters with each frame of video sample using the sample table of the original video remote sensing image data MP4 file, an MP4 file with associated geographic information is obtained.

[0007] In one embodiment of the present invention, the step of associating the geographic affine transformation parameters with each frame of video sample through the sample table of the original video remote sensing image data MP4 file to obtain an MP4 file with associated geographic information includes: Add saiz and saio atoms to the sample table atoms of the original video remote sensing image data MP4 file; wherein, the geographic affine transformation parameters are used as auxiliary data of the MP4 file, the saiz atom is used to store the size of the MP4 file auxiliary data, and the saio atom is used to store the offset information of the MP4 file auxiliary data; Based on the order of the video frames of the saiz and saio atoms and the original video remote sensing image data MP4 file, the auxiliary data of the MP4 file is sequentially written into the mdat data area to obtain the MP4 file with associated geographic information.

[0008] A second aspect of this invention provides a web-based online generation device for video remote sensing image data of geospatial information, comprising: The receiving module is used to receive the geographic coordinates of the target area marked on the electronic map; The search module is used to search for multiple target geographic metadata that at least partially overlap with the target area in the geographic metadata of the MP4 file of associated geographic information based on the geographic coordinates of the target area; wherein, the MP4 file of associated geographic information is a pre-generated MP4 format file in which each frame of image is associated with its own geographic information data, and the MP4 file of associated geographic information is located in the layer above the electronic map. The loading module is used to load the MP4 file containing the associated geographic information corresponding to the target geographic metadata as the target MP4 file, and to obtain the image of each frame of the target MP4 file as the target frame image; The processing module is used to obtain the intersection area between the geographic metadata indicated by the target frame image and the target area; The cropping module is used to crop the target frame image according to the intersecting region to obtain the target playback frame image; The playback module is used to display the target playback frame image based on the geographic metadata of each target MP4 file and the target playback frame image.

[0009] In one embodiment of the present invention, displaying the target playback frame image based on the geographic metadata of each target MP4 file and the target playback frame image includes: The target MP4 file and the target playback frame image are combined into a corresponding playback window based on their geographic metadata, and the target playback frame image is played in the corresponding playback window in a web-based online playback format.

[0010] In one embodiment of the present invention, the method for generating the MP4 file associated with the geographic information includes: Frame extraction is performed on the original MP4 video remote sensing image data to obtain the frame images to be processed. The frame image to be processed is geo-registered based on the positioning and attitude determination system data, ground control points, or a base map of a geographic reference to obtain a registered frame image. Calculate the geographic affine transformation parameters and OGC standard global coordinate system information for each frame of the registered image. The global coordinate system information is written as an atom into the moov atom of the original video remote sensing image data MP4 file; By associating the geographic affine transformation parameters with each frame of video sample using the sample table of the original video remote sensing image data MP4 file, an MP4 file with associated geographic information is obtained.

[0011] In one embodiment of the present invention, the step of associating the geographic affine transformation parameters with each frame of video sample through the sample table of the original video remote sensing image data MP4 file to obtain an MP4 file with associated geographic information includes: Add saiz and saio atoms to the sample table atoms of the original video remote sensing image data MP4 file; wherein, the geographic affine transformation parameters are used as auxiliary data of the MP4 file, the saiz atom is used to store the size of the MP4 file auxiliary data, and the saio atom is used to store the offset information of the MP4 file auxiliary data; Based on the order of the video frames of the saiz and saio atoms and the original video remote sensing image data MP4 file, the auxiliary data of the MP4 file is sequentially written into the mdat data area to obtain the MP4 file with associated geographic information.

[0012] A third aspect of the present invention provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements a Web-based online generation method for video remote sensing image data of geospatial information provided in the first aspect of the present invention.

[0013] A fourth aspect of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements a Web-based online generation method for video remote sensing image data of geospatial information provided in the first aspect of the present invention.

[0014] The beneficial effects of this invention are: This invention utilizes video remote sensing images carrying geographic information data in each frame to crop each frame based on geographic coordinates according to the user's real-time needs (such as selecting a specific area of ​​interest), and then plays the cropped image. This allows for flexible adjustment of the display range to meet user needs, significantly improving the flexibility of data interaction. Furthermore, when the user plays the cropped video frame according to their needs, the geographic boundary of the cropped area is calculated based on stable geographic coordinates, rather than relying on the physical pixels at the edges of the original video frame. Because geographic coordinates are continuous and stable, unaffected by edge pixel drift caused by minor changes in the original video sensor's pose or projection distortion, the cropped video area maintains spatial stability during playback, avoiding the visual jitter caused by edge pixel misalignment in traditional solutions, and significantly improving the viewing experience and interpretation accuracy.

[0015] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings.

[0016] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0017] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings: Figure 1 A schematic flowchart illustrating a method for online generation of video remote sensing image data for geospatial information provided in an embodiment of the present invention; Figure 2 This is a schematic diagram of a web-based online generation device for video remote sensing image data of geospatial information, provided in an embodiment of the present invention. Detailed Implementation

[0018] The present invention will be further described in detail below with reference to specific embodiments, but the implementation of the present invention is not limited thereto.

[0019] like Figure 1 As shown, the first aspect of this invention provides a Web-based online generation method for video remote sensing image data of geospatial information, comprising the following steps: Step 11: Receive the geographic coordinates of the target area marked on the electronic map.

[0020] Step 12: Based on the geographic coordinates of the target area, search for multiple target geographic metadata that at least partially overlap with the target area in the geographic metadata of the MP4 file associated with the geographic information.

[0021] Among them, the MP4 file associated with geographic information is a pre-generated MP4 file in which each frame of the image is associated with its own geographic information data, and the MP4 file associated with geographic information is located on the layer above the electronic map.

[0022] Step 13: Load the MP4 file containing the associated geographic information corresponding to the target geographic metadata as the target MP4 file, and obtain the image of each frame of the target MP4 file as the target frame image.

[0023] Step 14: Obtain the intersection area between the geographic coordinates of the geographic metadata of the target frame image and the target area.

[0024] Step 15: Crop the target frame image based on the intersecting region to obtain the target playback frame image.

[0025] Step 16: Display the target playback frame image based on the geographic metadata of each target MP4 file and the target playback frame image.

[0026] This invention utilizes video remote sensing images carrying geographic information data in each frame to crop each frame based on geographic coordinates according to the user's real-time needs (such as selecting a specific area of ​​interest), and then plays the cropped image. This allows for flexible adjustment of the display range to meet user needs, significantly improving the flexibility of data interaction. Furthermore, when the user plays the cropped video frame according to their needs, the geographic boundary of the cropped area is calculated based on stable geographic coordinates, rather than relying on the physical pixels at the edges of the original video frame. Because geographic coordinates are continuous and stable, unaffected by edge pixel drift caused by minor changes in the original video sensor's pose or projection distortion, the cropped video area maintains spatial stability during playback, avoiding the visual jitter caused by edge pixel misalignment in traditional solutions, and significantly improving the viewing experience and interpretation accuracy.

[0027] Based on the first aspect of the present invention, the second aspect of the present invention provides a web-based online generation method for geospatial video remote sensing image data, comprising the following steps: Step 21: The keyframe processing module performs frame extraction processing on the original video remote sensing image data MP4 file to obtain the frame image to be processed.

[0028] In this step, the original MP4 video remote sensing image data is processed by extracting frames at fixed time intervals or keyframes to obtain representative frame images as the frames to be processed.

[0029] Step 22: The registration module performs georegistration on the frame image to be processed based on the positioning and attitude system data, ground control points, or georeferenced base map to obtain the registered frame image.

[0030] Step 23: The calculation module calculates the geographic affine transformation parameters and OGC standard global coordinate system information for each frame of the original video remote sensing image data MP4 file based on the registration frame image.

[0031] In this step, the WKT standard format example for global coordinate system information is as follows: <spatialreference> <projection> UTM Zone 50N< / projection> <datum> WGS84< / datum> <epsg> 32650< / epsg> < / spatialreference> The WKT code above means UTM projection, WGS84 datum plane, and EPSG code 32650.

[0032] The geographic affine transformation parameters include six parameters representing scale, rotation, and translation, denoted by [A, B, C, D, E, F] respectively. These parameters can convert between frame pixel coordinates (i,j) in the video and geographic coordinates (X,Y), using the following formula: X = A * i + B * j + C Y = D * i + E * j + F.

[0033] Step 24: The writing module writes the global coordinate system information as atoms into the moov atom of the original video remote sensing image data MP4 file.

[0034] Based on the MP4 file format standard (ISO / IEC 14496-12), the MP4 file format consists of structured units called "atoms" (or boxes). The key structures relevant to this invention are as follows: moov (global metadata) ├── trak (video track) │ ├── stbl (Video Track Sample Table) │ │ ├── stsd (sample description) │ │ ├── saiz (sample auxiliary information size) │ │ ├── saio (Sample Auxiliary Information Offset) │ │ └── stsz (sample size) ├── udta (User data, customizable name) mdat (stores data for each frame of the video) Specifically, in this step, the global coordinate system information (EPSG code) of the OGC standard is encapsulated into a custom metadata atom gisd, and this atom is written into the moov atom of the MP4 file.

[0035] Step 25: The association module associates the geographic affine transformation parameters with each frame of video sample using the sample table of the original video remote sensing image data MP4 file, and obtains an MP4 file with associated geographic information.

[0036] In this step, the geographic affine transformation parameters are associated with each video sample frame. Specifically, this is achieved by extending the MP4 sample table structure. In the stbl atom of the video track, the saiz (sample auxiliary information size) and saio (sample auxiliary information offset) atoms are used to attach an auxiliary data area storing 6 floating-point numbers (float32) to each frame of the video. This auxiliary data area stores the affine transformation parameters [A, B, C, D, E, F] of each frame.

[0037] Step 25 includes steps 251-252: Step 251: Add saiz and saio atoms to the sample table atoms of the original video remote sensing image data MP4 file.

[0038] The geographic affine transformation parameters serve as auxiliary data for the MP4 file, the saiz atom is used to store the size of the MP4 file auxiliary data, and the saio atom is used to store the offset information of the MP4 file auxiliary data.

[0039] Step 252: Based on the order of the video frames of the saiz atoms, saio atoms, and the original video remote sensing image data MP4 file, the auxiliary data of the MP4 file is written into the mdat data area in sequence to obtain the MP4 file with associated geographic information.

[0040] Specifically, if the original MP4 file of the video remote sensing image data does not contain saiz and saio atoms, then saiz and saio atoms are added; if the original MP4 file of the video remote sensing image data already contains saiz and saio atoms, then new saiz and saio atoms are added to the stbl track of the MP4 file, where: The new SAZ Atomic Records contains information about the size of the geographic affine transformation parameters (MP4 file auxiliary data). Key information includes the version (fixed to 1 byte, value such as 1), the identifier (fixed to 3 bytes, value such as 777), the number of samples (i.e. the number of video frames), and an array representing the size of the geographic affine transformation parameters (MP4 file auxiliary data) for each frame (array length is sample_count, and the value of each element is 24, indicating that the geographic affine transformation parameter auxiliary data for each frame is 24 bytes).

[0041] The new saio atom records the offset information of the geographic affine transformation parameters (MP4 file auxiliary data). Key contents include version, identifier (these two items are consistent with the corresponding items in saiz atom), entry number entry_count (the same as the number of video frames), and an array representing the offset of the MP4 file auxiliary data for each frame (the array length is entry_count, and the i-th element records the starting byte position of the i-th frame auxiliary data relative to the entire file storage).

[0042] Based on the updated size and offset information of the saiz and saio atoms, the geographic affine transformation parameters are written into the mdat data area. During the writing process, starting from the first frame of the video, the geographic affine transformation parameters (MP4 file auxiliary data) of each frame are written sequentially until the last frame, resulting in an MP4 file with associated geographic information.

[0043] Steps 21-25 ultimately generate an enhanced MP4 file (GeoMP4) with built-in geographic information. This process ensures that standard video players can still decode the video stream correctly even when the custom geographic information atoms are ignored.

[0044] Step 26: Use the MP4 file containing the associated geographic information as a dynamic layer on the online electronic map.

[0045] In this embodiment, a publishing engine can be used to combine MP4 files containing associated geographic information with online electronic maps. After reading the geographic metadata of the MP4 file containing the associated geographic information, the publishing engine automatically registers the video as a new dynamic layer on the web online electronic map (such as the Web Mercator projection) based on its spatial extent information. The video's coverage area can be accurately overlaid on the base map, and spatial location-based video retrieval is supported. Here, the publishing engine integrates functional modules such as video parsing (FFmpeg, etc.), spatial reference parsing (OGC WKT), and dynamic layer publishing (Cesium / Leaflet / GeoServer plugin development).

[0046] The subsequent steps are performed on the web-based online electronic map that has registered the new video dynamic layer.

[0047] Step 27: The user uses the mouse to select a target area on the online electronic map where a video needs to be displayed.

[0048] Step 28: The Web online electronic map module obtains the geographic coordinates of the corresponding area, i.e., the geographic coordinates of the target area, based on the target area, and sends the coordinates to the video player. Step 29: The receiving module of the video player receives the geographic coordinates of the target area.

[0049] Step 30: The video player's search module searches for multiple target geographic metadata that at least partially overlap with the target area in the geographic metadata of the MP4 file associated with the geographic information, based on the geographic coordinates of the target area.

[0050] Among them, the MP4 file associated with geographic information is a pre-generated MP4 file in which each frame of the image is associated with its own geographic information data, and the MP4 file associated with geographic information is located on the layer above the electronic map.

[0051] In this step, the video player searches for geographic metadata that intersects with the coordinates of the target area as the target geographic metadata. There can be multiple target geographic metadata entries; an MP4 file containing associated geographic information can be associated with multiple target geographic metadata entries.

[0052] The target area can be a sub-region within the geographic metadata range indicated by an MP4 file containing associated geographic information (the target area is smaller than the geographic metadata range), or it can cover the geographic metadata range indicated by multiple MP4 files containing associated geographic information (the target area is larger and can cover the range indicated by multiple MP4 files).

[0053] Step 31: The video player's loading module loads the MP4 file containing the associated geographic information corresponding to the target geographic metadata as the target MP4 file, and obtains the image of each frame of the target MP4 file as the target frame image.

[0054] In this step, an MP4 file containing the associated geographic information of the target geographic metadata is loaded. Depending on the client's target area, this may be one or multiple MP4 files. Regardless of whether it is one or multiple MP4 files, each frame of the image in each MP4 file is acquired.

[0055] Step 32: The video player's processing module obtains the intersection area between the geographic metadata of the target frame image and the target area.

[0056] In this step, the geographic metadata of each frame of image is intersected with the target area to obtain the geographic metadata of the extent of the intersecting area.

[0057] Step 33: The video player's cropping module crops the target frame image based on the intersecting region to obtain the target playback frame image.

[0058] In this step, the geographic metadata of the intersecting area is converted into pixel coordinates of the corresponding frame image, and the target frame image is cropped according to the range of pixel coordinates.

[0059] Here, for each frame of the image, it is determined whether it intersects with the target region. If it intersects, it is cropped. If it does not intersect or the frame of the image is completely covered by the target region, it is not cropped.

[0060] Step 34: The video player's playback module displays the target playback frame image based on the geographic metadata of each target MP4 file and the target playback frame image.

[0061] Specifically, the target playback frame image is played in the corresponding playback window by stitching together the geographic metadata of each target MP4 file and the target playback frame image, and then playing the target playback frame image in the corresponding playback window in the form of web-based online playback.

[0062] Here, a target MP4 file contains multiple target playback frame images. One target MP4 file corresponds to one video player and one playback window. When there are multiple target MP4 files, the playback module of the video player can call the corresponding number of video players, assign one target MP4 file to each video player, and each video player plays multiple target playback frame images of the target MP4 file.

[0063] The video player's playback window is positioned at the pixel coordinates corresponding to the geographic metadata of the target playback frame image on the electronic map. In other words, the playback window's position is where the image being played is located on the electronic map. During playback, when multiple video players are invoked, their playback windows are seamlessly stitched together, playing in a sequential order based on time and location. The target area is a continuous region; stitching multiple playback windows does not affect the location range of a single playback window on the electronic map. Each playback window remains within the area of ​​the image to be played; the position of the playback window is moved during stitching, but it does not exceed its respective area range. Seamless stitching is performed according to the pixel coordinates corresponding to the geographic coordinates of the frame image to be played, thus eliminating video playback jitter. If the target area is smaller than the geographic metadata area, only one window will play the target playback frame image from the final MP4 file, without stitching.

[0064] In this embodiment, HTML5 video playback technology is combined ( <video>With tags and JavaScript map libraries (such as Leaflet or OpenLayers), the video player plays on top of the online electronic map on the web. Since each frame has affine transformation parameters, the system can calculate the precise geographic coordinates of any pixel in the current frame during video playback, achieving true pixel-level geographic reference.

[0065] The receiving module, searching module, loading module, processing module, trimming module, and playback module of the video player constitute the backend data processing system of the video player. The playback module can call multiple video players for playback.

[0066] In this embodiment, geographic information is embedded for convenient management. Geographic information is directly written into each frame as shown below, realizing the integration of geographic data and video metadata. This avoids the trouble of managing external files and the risk of data inconsistency, and improves the standardization and reliability of data management.

[0067] Users can directly browse, locate, and play georeferenced videos on electronic maps, enabling intuitive visualization of dynamic spatial information and greatly facilitating location-based dynamic monitoring, analysis, and decision-making.

[0068] By adopting a common file format standard and Web service interface, this method can be well integrated with a variety of mainstream GIS platforms and Web application frameworks, promoting the widespread application of video remote sensing data.

[0069] like Figure 2 As shown, a second aspect of the present invention provides a web-based online generation device for video remote sensing image data of geospatial information, comprising: Receiver module 41 is used to receive the geographic coordinates of the target area marked on the electronic map; The search module 42 is used to search for multiple target geographic metadata that at least partially overlap with the target area in the geographic metadata of the MP4 file of associated geographic information based on the geographic coordinates of the target area; wherein, the MP4 file of associated geographic information is a pre-generated MP4 format file that associates the geographic information data of each frame of the image with itself, and the MP4 file of associated geographic information is located in the layer above the electronic map. Loading module 43 is used to load the MP4 file containing the associated geographic information corresponding to the target geographic metadata as the target MP4 file, and to obtain the image of each frame of the target MP4 file as the target frame image; Processing module 44 is used to obtain the intersection area between the geographic metadata indicated by the target frame image and the target area; The cropping module 45 is used to crop the target frame image based on the intersecting region to obtain the target playback frame image; Playback module 46 is used to display the target playback frame image based on the geographic metadata of each target MP4 file and the target playback frame image.

[0070] A web-based online generation device for geospatial information video remote sensing image data is also a video player.

[0071] In one embodiment of the present invention, displaying a target playback frame image based on the geographic metadata of each target MP4 file and the target playback frame image includes: Based on the geographic metadata of each target MP4 file and target playback frame image, the target playback frame images are played sequentially and continuously in the corresponding playback window in a web-based online playback format. In one embodiment of the present invention, the method for generating an MP4 file associated with geographic information includes: Frame extraction is performed on the original MP4 video remote sensing image data to obtain the frame images to be processed. Based on the positioning and attitude determination system data, ground control points, or georeferenced base map, georegistration is performed on the frame image to be processed to obtain the registered frame image; Calculate the geographic affine transformation parameters and OGC standard global coordinate system information for each frame of the registered image. The global coordinate system information is written as atoms into the moov atom of the original video remote sensing image data MP4 file. By associating the geographic affine transformation parameters with each frame of video sample using a sample table from the original MP4 video remote sensing image data, an MP4 file containing associated geographic information is obtained.

[0072] In one embodiment of the present invention, geographic affine transformation parameters are associated with each frame of video sample using a sample table of the original video remote sensing image data MP4 file to obtain an MP4 file with associated geographic information, including: Add saiz and saio atoms to the sample table atoms of the original video remote sensing image data MP4 file; wherein, the geographic affine transformation parameters are used as auxiliary data of the MP4 file, the saiz atom is used to store the size of the MP4 file auxiliary data, and the saio atom is used to store the offset information of the MP4 file auxiliary data; Based on the order of the video frames of the saiz and saio atoms and the original video remote sensing image data MP4 file, the auxiliary data of the MP4 file is sequentially written into the mdat data area to obtain the MP4 file with associated geographic information.

[0073] A third aspect of the present invention provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements the Web-based online generation method for video remote sensing image data of geospatial information provided in the above-described embodiments of the present invention.

[0074] A fourth aspect of the present invention also provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the Web-based online generation method for video remote sensing image data of geospatial information provided in the above-described embodiments of the present invention.

[0075] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage device. Optionally, the memory may also be at least one storage device located remotely from the aforementioned processor.

[0076] The processors mentioned above can be general-purpose processors, including central processing units (CPUs), network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware devices.

[0077] The method provided in this invention can be applied to electronic devices. Specifically, the electronic device can be a desktop computer, a portable computer, a smart mobile terminal, a server, etc. No limitation is made herein; any electronic device that can implement this invention falls within the protection scope of this invention.

[0078] For the device / electronic device embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and relevant parts can be referred to in the description of the method embodiments.

[0079] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0080] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0081] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0082] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.< / video>

Claims

1. A Web-based online generation method for geospatial video remote sensing image data, characterized in that, Includes the following steps: Receive the geographic coordinates of the target area marked on the electronic map; Based on the geographic coordinates of the target area, search for multiple target geographic metadata that at least partially overlap with the target area in the geographic metadata of the associated geographic information MP4 file; wherein, the associated geographic information MP4 file is a pre-generated MP4 format file in which each frame of image is associated with its own geographic information data, and the associated geographic information MP4 file is located in the layer above the electronic map. Load the MP4 file containing the associated geographic information corresponding to the target geographic metadata as the target MP4 file, and obtain the image of each frame of the target MP4 file as the target frame image; Obtain the intersection area between the geographic metadata indicated by the target frame image and the target region; The target frame image is obtained by cropping the target frame image based on the intersecting region; The target playback frame image is displayed based on the geographic metadata of each target MP4 file and the target playback frame image.

2. The method as described in claim 1, characterized in that, The step of displaying the target playback frame image based on the geographic metadata of each target MP4 file and the target playback frame image includes: The target MP4 file and the target playback frame image are combined into a corresponding playback window based on their geographic metadata, and the target playback frame image is played in the corresponding playback window in a web-based online playback format.

3. The method as described in claim 1, characterized in that, The method for generating the MP4 file of the associated geographic information includes: Frame extraction is performed on the original MP4 video remote sensing image data to obtain the frame images to be processed. The frame image to be processed is geo-registered based on the positioning and attitude determination system data, ground control points, or a base map of a geographic reference to obtain a registered frame image. Calculate the geographic affine transformation parameters and OGC standard global coordinate system information for each frame of the registered image. The global coordinate system information is written as an atom into the moov atom of the original video remote sensing image data MP4 file; By associating the geographic affine transformation parameters with each frame of video sample using the sample table of the original video remote sensing image data MP4 file, an MP4 file with associated geographic information is obtained.

4. The method as described in claim 3, characterized in that, The step of associating the geographic affine transformation parameters with each frame of video sample using a sample table from the original video remote sensing image data MP4 file to obtain an MP4 file with associated geographic information includes: Add saiz and saio atoms to the sample table atoms of the original video remote sensing image data MP4 file; wherein, the geographic affine transformation parameters are used as auxiliary data of the MP4 file, the saiz atom is used to store the size of the MP4 file auxiliary data, and the saio atom is used to store the offset information of the MP4 file auxiliary data; Based on the order of the video frames of the saiz and saio atoms and the original video remote sensing image data MP4 file, the auxiliary data of the MP4 file is sequentially written into the mdat data area to obtain the MP4 file with associated geographic information.

5. A Web-based online generation device for video remote sensing image data of geospatial information, characterized in that, include: The receiving module is used to receive the geographic coordinates of the target area marked on the electronic map; The search module is used to search for multiple target geographic metadata that at least partially overlap with the target area in the geographic metadata of the MP4 file of associated geographic information based on the geographic coordinates of the target area; wherein, the MP4 file of associated geographic information is a pre-generated MP4 format file in which each frame of image is associated with its own geographic information data, and the MP4 file of associated geographic information is located in the layer above the electronic map. The loading module is used to load the MP4 file containing the associated geographic information corresponding to the target geographic metadata as the target MP4 file, and to obtain the image of each frame of the target MP4 file as the target frame image; The processing module is used to obtain the intersection area between the geographic metadata indicated by the target frame image and the target area; The cropping module is used to crop the target frame image according to the intersecting region to obtain the target playback frame image; The playback module is used to display the target playback frame image based on the geographic metadata of each target MP4 file and the target playback frame image.

6. The apparatus as claimed in claim 5, characterized in that, The step of displaying the target playback frame image based on the geographic metadata of each target MP4 file and the target playback frame image includes: The target MP4 file and the target playback frame image are combined into a corresponding playback window based on their geographic metadata, and the target playback frame image is played in the corresponding playback window in a web-based online playback format.

7. The apparatus as claimed in claim 5, characterized in that, The method for generating the MP4 file of the associated geographic information includes: Frame extraction is performed on the original MP4 video remote sensing image data to obtain the frame images to be processed. The frame image to be processed is geo-registered based on the positioning and attitude determination system data, ground control points, or a base map of a geographic reference to obtain a registered frame image. Calculate the geographic affine transformation parameters and OGC standard global coordinate system information for each frame of the registered image. The global coordinate system information is written as an atom into the moov atom of the original video remote sensing image data MP4 file; By associating the geographic affine transformation parameters with each frame of video sample using the sample table of the original video remote sensing image data MP4 file, an MP4 file with associated geographic information is obtained.

8. The apparatus as claimed in claim 7, characterized in that, The step of associating the geographic affine transformation parameters with each frame of video sample using a sample table from the original video remote sensing image data MP4 file to obtain an MP4 file with associated geographic information includes: Add saiz and saio atoms to the sample table atoms of the original video remote sensing image data MP4 file; wherein, the geographic affine transformation parameters are used as auxiliary data of the MP4 file, the saiz atom is used to store the size of the MP4 file auxiliary data, and the saio atom is used to store the offset information of the MP4 file auxiliary data; Based on the order of the video frames of the saiz and saio atoms and the original video remote sensing image data MP4 file, the auxiliary data of the MP4 file is sequentially written into the mdat data area to obtain the MP4 file with associated geographic information.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the Web-based online generation method for video remote sensing image data of geospatial information as described in any one of claims 1 to 4.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements a Web-based online generation method for video remote sensing image data of geospatial information as described in any one of claims 1 to 4.

Images