Spacetime grid file system
By introducing a grid configuration table into the file system and utilizing the hierarchical and encoded indexing techniques of the grid, the problems existing in the prior art are solved, enabling direct access to the data index, improving data query efficiency and reducing system load.
Patent Information
- Application Number
- CN202211652289.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-21
- Publication Date
- 2025-11-18
- Estimated Expiration
- 2042-12-21
AI Technical Summary
Existing file systems suffer from heavy system load and low query efficiency when querying and retrieving grid data in three-dimensional or four-dimensional space.
A grid configuration table is used instead of a file configuration table. The disk sectors are indexed by the grid hierarchy and grid encoding, allowing direct access to the data storage location and reducing database retrieval steps.
It improves data query efficiency, reduces system load, and enhances the flexibility and scalability of the file system.
Abstract
Description
Technical Field
[0001] This invention belongs to the field of spatial grid application technology, and in particular relates to a spatiotemporal grid file system. Background Technology
[0002] Currently, file systems manage indexes using multi-level directories and filenames. Specifically, the File Allocation Table (FAT) of the current file system (FAT32, NTFS, etc.) indexes the actual disk sectors where each file's data is stored through multi-level directories. This allows access to data by locating its storage location on the disk through directories and files. However, querying and retrieving grid data in three-dimensional or four-dimensional space requires spatiotemporal data retrieval and program calls within a large database, resulting in a heavy system load and low query efficiency. Summary of the Invention
[0003] In view of the problems existing in the prior art, the present invention provides a spatiotemporal grid file system, which at least partially solves the problems of heavy system load and low query efficiency in spatiotemporal data retrieval and program calling in the prior art.
[0004] This disclosure provides a spatiotemporal grid file system, including:
[0005] The grid configuration table corresponds to the file configuration table. The grid configuration table includes the grid hierarchy and grid code. The grid hierarchy and grid code index the disk sector location associated with each grid. The disk sector where the data is located can be accessed by querying the grid configuration table through the grid code.
[0006] Optionally, the system also includes a grid directory. When a user creates a new file or copies a file to the grid directory, they can select a specific level of grid within the grid directory. The grid is used to associate file data.
[0007] Optionally, when the new file or copied file is a spatial data file, the grid in which the data range is located is automatically extracted, and the data content is divided according to the extracted grid when storing.
[0008] Optionally, you can switch between file list mode and grid map mode in the grid directory. Zooming in and out on the grid map will show the number of files or update time within each grid. Clicking on a grid will show the data list within the grid, and clicking on a grid will open a file or a segmented data block.
[0009] Optionally, the system's directory or folder properties have the function of defining a grid data directory. Data entering the grid data directory carries a grid index, thus allowing data to be managed and used according to the grid.
[0010] Optionally, the system has the function of organizing data according to the spatial location of file data, based on the level and grid encoding of the subdivided grid.
[0011] Optionally, the function of organizing data according to the spatial location of file data based on the level and grid code of the subdivided grid includes: clicking on any grid on the grid base map to query the spatially associated data of that grid, with the data arranged by time and type.
[0012] Optionally, the system supports cloud storage, which is dynamically allocated to parallel grid storage devices according to grid coding, supporting parallel access and computation processing.
[0013] Optionally, parallel access and computation processing includes retrieving spatiotemporal data corresponding to the grid from a parallel grid cloud storage device, based on the grid encoding and time requirements.
[0014] Optionally, the system provides a grid data access program interface and data management functions. When multiple grid data read requests are received, the spatiotemporal data of the corresponding grid is obtained from the spatiotemporal grid file system according to the grid encoding and time requirements.
[0015] The spatiotemporal grid file system provided by this invention directly indexes disk data by setting a grid configuration table corresponding to the file configuration table, without needing to go through database retrieval before accessing the file system, thereby reducing the system load and improving query efficiency. Detailed Implementation
[0016] It should be understood that the following specific examples illustrate the implementation of this disclosure, and those skilled in the art can easily understand other advantages and effects of this disclosure from the content disclosed in this specification. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. This disclosure can also be implemented or applied through other different specific implementation methods, and the details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this disclosure. It should be noted that, in the absence of conflict, the following embodiments and features in the embodiments can be combined with each other. Based on the embodiments in this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.
[0017] It should be noted that various aspects of embodiments within the scope of the appended claims are described below. It will be apparent that the aspects described herein can be embodied in a wide variety of forms, and any particular structure and / or function described herein is merely illustrative. Based on this disclosure, those skilled in the art will understand that one aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways. For example, any number of aspects set forth herein can be used to implement the device and / or practice the method. Additionally, this device and / or method can be implemented using structures and / or functionalities other than one or more of the aspects set forth herein.
[0018] Furthermore, specific details are provided in the following description to facilitate a thorough understanding of the examples. However, those skilled in the art will understand that the described aspects can be practiced without these specific details.
[0019] Grid base map: This is a base map in the grid file system composed of grids divided according to the Earth's partitioning standard. Each grid is initially empty and is used to index file data based on location.
[0020] This embodiment is based on the GeoSOT global mesh data index architecture to construct a spatiotemporal mesh file system that supports spatiotemporal mesh data. This system is used to organize and manage spatiotemporal mesh data identified using GeoSOT mesh encoding technology, whereby the spatiotemporal mesh data carries a mesh index (meta-level + mesh encoding), enabling data organization, storage, management, and application based on mesh spatial location (i.e., according to mesh meta-level and mesh encoding).
[0021] This embodiment discloses a spatiotemporal grid file system, including:
[0022] The grid configuration table corresponds to the file configuration table. The grid configuration table includes the grid hierarchy and grid code. The grid hierarchy and grid code index the disk sector location associated with each grid. The disk sector where the data is located can be accessed by querying the grid configuration table through the grid code.
[0023] The spatiotemporal grid file system needs to establish a grid allocation table (GAT) corresponding to the file allocation table (FAT). It uses a hierarchical grid to replace the multi-level directory and grid encoding to replace the file name. The data associated with each grid is indexed at the disk sector location. The data can be accessed by querying the disk sector where the data is located in the GAT through the grid encoding.
[0024] Optionally, the system also includes a grid directory. When a user creates a new file or copies a file to the grid directory, they can select a specific level of grid within the grid directory. The grid is used to associate file data.
[0025] Optionally, when the new file or copied file is a spatial data file, the grid in which the data range is located is automatically extracted, and the data content is divided according to the extracted grid when storing.
[0026] When a user creates a new file in the grid directory or copies a file from a regular directory to the grid directory, they need to select a specific grid level within the grid directory to associate the file's data. If the file itself is a spatial data file, such as a GeoTIFF image or a Shape format GIS file, the system can automatically extract one or more grids containing the data range and divide the data content according to the grids during storage.
[0027] Optionally, you can switch between file list mode and grid map mode in the grid directory. Zooming in and out on the grid map will show the number of files or update time within each grid. Clicking on a grid will show the data list within the grid, and clicking on a grid will open a file or a segmented data block.
[0028] Within the grid directory, users can switch between file list mode and grid base map mode. The grid map can be zoomed (high and low levels) to display the number of files or update time within each grid. Clicking on a grid will display the data list within that grid, and further, users can open files or segmented data blocks (images or maps).
[0029] Optionally, the system's directory or folder properties have the function of defining a grid data directory. Data entering the grid data directory carries a grid index, thus allowing data to be managed and used according to the grid.
[0030] Considering that not all files can be associated with spatial locations, and current user habits need to be preserved, the function of defining grid data directories has been added to the directory or folder attributes in the current file system. Data entering the grid data directory has a grid index and can be managed and used according to the grid.
[0031] Optionally, the system has the function of organizing data according to the spatial location of file data, based on the level and grid encoding of the subdivided grid.
[0032] Optionally, the function of organizing data according to the spatial location of file data based on the level and grid code of the subdivided grid includes: clicking on any grid on the grid base map to query the spatially associated data of that grid, with the data arranged by time and type.
[0033] It has the ability to organize data according to the spatial location of file data, based on the level and grid code of the subdivided grid. That is, you can click on any grid on the grid base map to query the spatially associated data of that grid, and the data can be arranged by time and type.
[0034] Optionally, the system supports cloud storage, which is dynamically allocated to parallel grid storage devices according to grid coding, supporting parallel access and computation processing.
[0035] Optionally, parallel access and computation processing includes retrieving spatiotemporal data corresponding to the grid from a parallel grid cloud storage device, based on the grid encoding and time requirements.
[0036] It supports cloud storage, which dynamically allocates data to parallel grid storage devices according to grid codes, enabling parallel access and computation. This means that spatiotemporal data corresponding to a given grid can be retrieved from the parallel grid cloud storage device based on the grid code and time requirements.
[0037] Optionally, the system provides a grid data access program interface and data management functions. When multiple grid data read requests are received, the spatiotemporal data of the corresponding grid is obtained from the spatiotemporal grid file system according to the grid encoding and time requirements.
[0038] It provides a grid data access interface and data management functions, supporting functions such as creating, undoing, opening, closing, protecting, reading, writing, copying, duplicating, encrypting, compressing, statistically analyzing, and logging spatiotemporal grid data. It also supports parallel access and processing of multiple grid data. That is, when multiple grid data read requests are received, the spatiotemporal data of the corresponding grid can be obtained from the spatiotemporal grid file system according to the grid encoding and time requirements.
[0039] In specific development, it is possible to extend and modify open-source file systems, such as minio (supporting Windows and Linux) or fastDFS distributed file system, and it is also possible to interface with the file system of HarmonyOS operating system for corresponding extended development.
[0040] The spatiotemporal grid file system of this embodiment has the following advantages:
[0041] 1) Compared with the current method of indexing through a database, indexing directly on disk data does not require a database retrieval layer before accessing the file system, which can improve access efficiency.
[0042] 2) By configuring files according to hierarchical levels and spatial locations (grid coding), data querying, storage, and application become more flexible and efficient, and file system expansion is facilitated.
[0043] 3) No need to install database and grid management application systems; the OS's built-in file system can be used directly, making deployment and maintenance more convenient and user-friendly.
[0044] The basic principles of this disclosure have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this disclosure are merely examples and not limitations, and should not be considered as essential features of each embodiment of this disclosure. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the scope of this disclosure to the necessity of employing the aforementioned specific details for implementation.
[0045] In this disclosure, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Words such as "including," "comprising," "having," etc., are open-ended terms meaning "including but not limited to," and are used interchangeably with them. The terms "or" and "and" as used herein refer to the terms "and / or," and are used interchangeably with them unless the context explicitly indicates otherwise. The term "such as" as used herein refers to the phrase "such as but not limited to," and is used interchangeably with it.
[0046] Additionally, as used herein, the “or” used in a list of items beginning with “at least one” indicates a separate list, such that a list of, for example, “at least one of A, B, or C” means A or B or C, or AB or AC or BC, or ABC (i.e., A and B and C). Furthermore, the word “exemplary” does not imply that the described example is preferred or better than other examples.
[0047] It should also be noted that in the systems and methods of this disclosure, the components or steps can be decomposed and / or recombined. These decompositions and / or recombinations should be considered as equivalent solutions to this disclosure.
[0048] Various changes, substitutions, and modifications can be made to the technology described herein without departing from the teachings defined by the appended claims. Furthermore, the scope of the claims of this disclosure is not limited to the specific aspects of the processes, machines, manufactures, events, means, methods, and actions described above. Currently existing or later-developed processes, machines, manufactures, events, means, methods, or actions that perform substantially the same function or achieve substantially the same result as the corresponding aspects described herein can be utilized. Therefore, the appended claims include such processes, machines, manufactures, events, means, methods, or actions within their scope.
[0049] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features disclosed herein.
[0050] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this disclosure to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations thereof.
Claims
1. A spatiotemporal grid file system, characterized in that, The spatiotemporal grid file system is used to organize and manage spatiotemporal grid data identified using GeoSOT mesh encoding technology. The spatiotemporal grid data carries a grid index, which includes a mesh hierarchy and a grid encoding. The spatiotemporal grid file system includes: The grid configuration table corresponds to the file configuration table. The grid configuration table includes the grid hierarchy and grid code. The grid hierarchy and grid code index the disk sector location of the data associated with each grid. The disk sector where the data is located can be accessed by querying the grid configuration table through the grid code. The correspondence between the grid configuration table and the file configuration table includes: The hierarchy of the subdivided grid of the first spatiotemporal grid data in the grid configuration table is used to replace the multi-level directory file paths of the first spatiotemporal grid data in the file configuration table; and The grid code of the first spatiotemporal grid data in the grid configuration table is used to replace the filename of the first spatiotemporal grid data in the file configuration table; The system's directory or folder properties have the function of defining a grid data directory. Data entering the grid data directory carries a grid index, thus allowing data to be managed and used according to the grid.
2. The spatiotemporal grid file system according to claim 1, characterized in that, This includes a grid directory. When a user creates a new file or copies a file to the grid directory, they can select a specific level of grid within the grid directory. The grid is used to associate file data.
3. The spatiotemporal grid file system according to claim 2, characterized in that, When a new or copied file is a spatial data file, the grid containing the data range is automatically extracted, and the data content is divided according to the extracted grid when storing.
4. The spatiotemporal grid file system according to claim 2, characterized in that, Within the grid directory, you can switch between file list mode and grid map mode. Zooming in on the grid map will display the number of files or update time within each grid. Clicking on a grid will show the data list within that grid, and clicking on a grid will open a file or a segmented data block.
5. The spatiotemporal grid file system according to claim 1, characterized in that, The system has the function of organizing data according to the spatial location of file data, based on the level and grid encoding of the subdivided grid.
6. The spatiotemporal grid file system according to claim 1, characterized in that, The function of organizing data according to the spatial location of file data, based on the level and grid code of the subdivided grid, includes: clicking on any grid on the grid base map to query the spatially associated data of that grid, with the data arranged by time and type.
7. The spatiotemporal grid file system according to claim 1, characterized in that, The system supports cloud storage, which is dynamically allocated to parallel grid storage devices according to grid coding, supporting parallel access and computation processing.
8. The spatiotemporal grid file system according to claim 7, characterized in that, Parallel access and computation processing includes retrieving spatiotemporal data corresponding to the grid from the parallel grid cloud storage device, based on the grid encoding and time requirements.
9. The spatiotemporal grid file system according to claim 1, characterized in that, The system provides a grid data access program interface and data management functions. When multiple grid data read requests are received, the spatiotemporal data of the corresponding grid is obtained from the spatiotemporal grid file system according to the grid encoding and time requirements.
Citation Information
Patent Citations
Ship positioning data-oriented space-time grid and tree fusion storage method
CN114398459A