Multi-source data integrated storage system based on territorial space planning information

Abstract

The invention belongs to the technical field of information storage management, and particularly relates to a multi-source data integration storage system based on territorial space planning information, which comprises a data integration module, a data processing module, a data storage module, a data query module and a storage management module, the data integration module receives and integrates data from different data sources, the data processing module performs cleaning, conversion and standardization processing on the integrated data, and the data storage module stores the processed data by adopting a distributed storage technology. And the storage management module monitors the storage security of the data storage module to identify the risk storage device, so that a manager can be reminded to take corresponding regulation and control measures for the corresponding risk storage device in time, the storage security of all the storage devices is ensured, and the intelligent degree is high.

Description

Technical Field

[0001] The present invention relates to the technical field of information storage management, and in particular to a multi-source data integration storage system based on national land space planning information. Background Art

[0002] With the rapid development of information and digital technologies, national land spatial planning data is becoming increasingly complex and diverse, including multi-source data such as remote sensing images, geospatial data, and socio-economic data;

[0003] However, existing data storage systems often have low data integration and poor data security. They are unable to reasonably analyze the storage risks of all storage devices and accurately determine the management and control levels of storage devices. They are also low in intelligence and cannot meet the high requirements for data processing and storage in the field of land and space planning.

[0004] In view of the above technical defects, a solution is now proposed. Summary of the invention

[0005] The purpose of the present invention is to provide a multi-source data integration storage system based on national land space planning information, which solves the problems of low data integration and poor data security in the prior art, inability to reasonably analyze the storage risks of all storage devices and accurately judge the management and control level of storage devices, and low intelligence.

[0006] To achieve the above object, the present invention provides the following technical solutions:

[0007] A multi-source data integration storage system based on national land space planning information includes a data integration module, a data processing module, a data storage module, a data query module and a storage management module; the data integration module receives and integrates data from different data sources, including remote sensing images and geospatial data, and achieves seamless docking and efficient integration of multi-source data by formulating a unified data format and interface standard, and sends the integrated data to the data processing module;

[0008] The data processing module cleans, converts and standardizes the integrated data to eliminate data redundancy and errors, and uses distributed computing technology to quickly process and analyze large-scale data, and sends the processed data to the data storage module;

[0009] The data storage module uses distributed storage technology to store processed data. The data query module provides a data query interface, supports query methods based on spatial location and attribute information, and realizes rapid retrieval and query of massive data by optimizing query algorithms and indexing technologies. The storage management module monitors the storage security of the data storage module, identifies risky storage devices through analysis, and sends the risky storage devices to the smart terminals of the corresponding managers.

[0010] Furthermore, the specific operation process of the storage management module includes:

[0011] All storage devices covered by the data storage module are obtained, and the corresponding storage device is marked as h, where h is a natural number greater than 1. The operation detection value and the environmental hazard detection value of the storage device h are obtained, and the operation detection value and the environmental hazard detection value are numerically compared with the preset operation detection threshold and the preset environmental hazard detection threshold respectively; if the operation detection value or the environmental hazard detection value exceeds the corresponding preset threshold, the storage device h is marked as a risky storage device.

[0012] Furthermore, the storage management module is communicatively connected to the operation assessment module and the environmental risk detection module. The operation assessment module detects and analyzes the operation risk of the storage device h, obtains the operation detection value of the storage device h through analysis, and sends the operation detection value of the storage device h to the storage management module; the environmental risk detection module obtains the environment to which the storage device h belongs and marks it as a regulatory environment, detects and analyzes the environmental risk of the regulatory environment, obtains the environmental risk detection value of the storage device h through analysis, and sends the environmental risk detection value of the storage device h to the storage management module.

[0013] Furthermore, the specific analysis process of running the evaluation module is as follows:

[0014] The real-time temperatures at several positions on the storage device h are collected, the real-time temperatures at the corresponding positions are calculated by ratio with the corresponding preset temperature thresholds to obtain the position temperature values, the position temperature values ​​at all positions are averaged to obtain the storage temperature value, and the vibration data of the storage device is collected and marked as the storage vibration value; the storage temperature value and the storage vibration value are numerically compared with the preset storage temperature threshold and the preset storage vibration threshold, respectively; if the storage temperature value or the storage vibration value exceeds the corresponding preset threshold, it is determined that the storage device h is in the running danger table state;

[0015] The total time that the storage device h is in the operation risk table state per unit time is obtained and marked as the operation risk table time, and the storage temperature risk value is obtained by averaging all the storage temperature condition values ​​per unit time, and the storage vibration risk value is obtained by averaging all the storage vibration condition values ​​per unit time. The operation detection value of the storage device h is obtained by numerically calculating the operation risk table time, the storage temperature value and the storage vibration value.

[0016] Furthermore, the specific analysis process of the environmental risk detection module is as follows:

[0017] The ambient temperature and ambient humidity of the regulatory environment to which the storage device h belongs within a unit time are collected, and the deviation value of the ambient temperature compared to the preset appropriate temperature standard value is marked as the regulatory temperature analysis value, and the regulatory humidity analysis value is obtained similarly; and the dust detection value and electromagnetic radiation value of the regulatory environment to which the storage device h belongs within a unit time are collected, and the environmental risk detection value of the storage device h is obtained by numerically calculating the regulatory temperature analysis value, the regulatory humidity analysis value, the dust detection value and the electromagnetic radiation value.

[0018] Furthermore, the storage management module is communicated with the storage classification module, which classifies all storage devices into levels, marks the storage device h as a high-management device or a low-management device through analysis, and sends the level classification information of the storage device h to the intelligent terminal of the corresponding manager.

[0019] Furthermore, the specific analysis process of the storage partition module is as follows:

[0020] The amount of data stored in the storage device h is collected and marked as the data storage value, the number of times the data in the storage device h is queried during the detection period is collected and marked as the data query value, and the number of times the storage device h is marked as a risk storage device during the detection period is obtained and marked as the risk frequency detection value;

[0021] The storage level value is obtained by numerically calculating the data storage value, data query value and risk frequency detection value, and the storage level value is numerically compared with the preset storage level threshold. If the storage level value exceeds the preset storage level threshold, the storage device h is marked as a high-management device; if the storage level value does not exceed the preset storage level threshold, the storage device h is marked as a low-management device.

[0022] Compared with the prior art, the present invention has the following beneficial effects:

[0023] 1. In the present invention, the data integration module receives and integrates data from different data sources to achieve seamless docking and efficient integration of multi-source data. The data processing module cleans, converts and standardizes the integrated data, and uses distributed computing technology to quickly process and analyze large-scale data. The data storage module uses distributed storage technology to store the processed data. The data query module optimizes the query algorithm and index technology to achieve rapid retrieval and query of massive data, effectively solving the problems of low data integration, low query efficiency and poor data security.

[0024] 2. In the present invention, the storage security of the data storage module is monitored through the storage management module, and the risky storage equipment is identified to remind the management personnel to take corresponding regulatory measures for the corresponding risky storage equipment in time, and all storage devices are graded through the storage classification module to determine high-management equipment and low-management equipment, and the storage supervision of high-management equipment is strengthened in the future, which is conducive to formulating suitable management plans for different storage devices, has a high degree of intelligence, and ensures the data storage security of all storage devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to facilitate understanding by those skilled in the art, the present invention is further described below in conjunction with the accompanying drawings;

[0026] Figure 1 This is a first system block diagram of Embodiment 1 of the present invention;

[0027] Figure 2 is a second system block diagram of Embodiment 1 of the present invention;

[0028] Figure 3 This is a system block diagram of Embodiment 2 of the present invention. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0030] Embodiment 1: Figure 1-2 As shown, the multi-source data integration storage system based on national land space planning information proposed in the present invention includes a data integration module, a data processing module, a data storage module, a data query module and a storage management module; the data integration module receives and integrates data from different data sources, including multi-source data such as remote sensing images and geographic space data, and realizes seamless connection and efficient integration of multi-source data by formulating a unified data format and interface standard, and sends the integrated data to the data processing module;

[0031] The data processing module cleans, converts and standardizes the integrated data to eliminate data redundancy and errors, improve data quality and availability, and uses distributed computing technology to achieve rapid processing and analysis of large-scale data, and sends the processed data to the data storage module;

[0032] The data storage module uses distributed storage technology to store processed data. The data query module provides a data query interface, supports multiple query methods based on spatial location and attribute information, and achieves rapid retrieval and query of massive data by optimizing query algorithms and indexing technologies, meeting users' real-time query needs for data.

[0033] The storage management module monitors the storage security of the data storage module, identifies risky storage devices through analysis, and sends the risky storage devices to the intelligent terminal of the corresponding management personnel. The management personnel conduct timely investigation and analysis of the causes, and make corresponding control measures for the corresponding risky storage devices as needed, thereby reducing the safety hazards of the corresponding risky storage devices, ensuring the storage security of all storage devices, and avoiding data loss. The specific operation process of the storage management module is as follows:

[0034] All storage devices covered by the data storage module are obtained, and the corresponding storage device is marked as h, where h is a natural number greater than 1. The operation detection value and the environmental hazard detection value of the storage device h are obtained, and the operation detection value and the environmental hazard detection value are numerically compared with the preset operation detection threshold and the preset environmental hazard detection threshold respectively. If the operation detection value or the environmental hazard detection value exceeds the corresponding preset threshold, indicating that the storage device h currently has a high safety hazard, the storage device h is marked as a risky storage device.

[0035] Furthermore, the storage management module is connected to the operation evaluation module and the environmental risk detection module in communication. The operation evaluation module detects and analyzes the operation risk of the storage device h, obtains the operation detection value of the storage device h through analysis, and sends the operation detection value of the storage device h to the storage management module, which can not only reasonably feedback the operation risk of the storage device h, but also provide data support for the analysis process of the storage management module to ensure the accuracy of its analysis results; the specific analysis process of the operation evaluation module is as follows:

[0036] The real-time temperatures at several positions on the storage device h are collected, and the ratio of the real-time temperature at the corresponding position to the corresponding preset temperature threshold is calculated to obtain the position temperature value, and the position temperature values ​​at all positions are averaged to obtain the storage temperature value, and the vibration data of the storage device is collected and marked as the storage vibration value; the storage temperature value and the storage vibration value are numerically compared with the preset storage temperature threshold and the preset storage vibration threshold, respectively. If the storage temperature value or the storage vibration value exceeds the corresponding preset threshold, it indicates that the current operating condition of the storage device h is poor, and the storage device h is judged to be in an operating risk state;

[0037] The total time that the storage device h is in the operation risk table state within a unit time is obtained and marked as the operation risk table time, and the storage temperature risk value is obtained by averaging all the storage temperature condition values ​​within the unit time, and the storage vibration risk value is obtained by averaging all the storage vibration condition values ​​within the unit time. The operation risk table time YSh, the storage temperature condition value YLh and the storage vibration condition value YKh are numerically calculated by the formula YXh=a1*YSh+(a2*YLh+a3*YKh) / 2 to obtain the operation detection value YXh of the storage device h; wherein a1, a2, and a3 are preset proportional coefficients, and the values ​​of a1, a2, and a3 are all positive numbers; and the larger the numerical value of the operation detection value YXh, the higher the operation risk of the storage device h.

[0038] The environmental risk detection module obtains the environment to which the storage device h belongs and marks it as a regulatory environment, detects and analyzes the environmental risk of the regulatory environment, obtains the environmental risk detection value of the storage device h through analysis, and sends the environmental risk detection value of the storage device h to the storage management module, which can not only reasonably feedback the degree of hazard of the environment in which the storage device h is located, but also provide data support for the analysis process of the storage management module to ensure the accuracy of its analysis results; the specific analysis process of the environmental risk detection module is as follows:

[0039] The ambient temperature and ambient humidity of the regulatory environment to which the storage device h belongs per unit time are collected, and the deviation value of the ambient temperature compared to the preset suitable temperature standard value is marked as the regulatory temperature analysis value, and the regulatory humidity analysis value is obtained similarly; and the dust detection value and electromagnetic radiation value of the regulatory environment to which the storage device h belongs per unit time are collected, wherein the dust detection value is a data quantity value indicating the dust concentration of the regulatory environment, and the electromagnetic radiation value is a data quantity value indicating the electromagnetic radiation intensity in the regulatory environment;

[0040] By formula The regulated temperature analysis value WYh, the regulated moisture analysis value WFh, the dust detection value WPh and the electromagnetic radiation value WKh are numerically calculated to obtain the environmental risk detection value WXh of the storage device h; wherein, ry1, ry2, ry3, ry4 are preset proportional coefficients, and the values ​​of ry1, ry2, ry3, ry4 are all positive numbers; and, the larger the value of the environmental risk detection value WXh, the worse the environmental performance of the regulated environment of the storage device h, and the greater the adverse impact on the safe operation of the storage device h.

[0041] Embodiment 2: Figure 3As shown, the difference between this embodiment and embodiment 1 is that the storage management module is connected to the storage division module in communication, and the storage division module divides all storage devices into grades, and marks the storage device h as a high-management device or a low-management device through analysis, and sends the grade division information of the storage device h to the intelligent terminal of the corresponding manager through the storage management module. The manager will subsequently strengthen the storage supervision of the high-management device, which is conducive to formulating appropriate management plans for different storage devices. It has a high degree of intelligence, reduces the management difficulty of the manager, and ensures the data storage security of all storage devices. The specific analysis process of the storage division module is as follows:

[0042] The amount of data stored in the storage device h is collected and marked as the data storage value, and the number of times the data in the storage device h is queried during the detection period is collected and marked as the data query value. It should be noted that the larger the values ​​of the data storage value and the data query value, the higher the importance of the corresponding storage device h; and the number of times the storage device h is marked as a risk storage device during the detection period is obtained and marked as the risk frequency detection value, wherein the larger the value of the risk frequency detection value, the greater the storage risk of the storage device h during the detection period;

[0043] By formula The data storage value GPh, the data query value GFh and the risk frequency detection value GWh are numerically calculated to obtain the storage level value GNh, wherein fq1, fq2, and fq3 are preset proportional coefficients, and the values ​​of fq1, fq2, and fq3 are all positive numbers; and the larger the value of the storage level value GNh, the more it is necessary to strengthen the subsequent supervision of the storage device h; the storage level value GNh is numerically compared with the preset storage level threshold value, if the storage level value GNh exceeds the preset storage level threshold value, it indicates that the subsequent supervision of the storage device h needs to be strengthened, and the storage device h is marked as a high-management device; if the storage level value GNh does not exceed the preset storage level threshold value, it indicates that there is no need to strengthen the subsequent supervision of the storage device h, and the storage device h is marked as a low-management device.

[0044] The working principle of the present invention is as follows: when in use, the data from different data sources are received and integrated through the data integration module to achieve seamless docking and efficient integration of multi-source data; the data processing module cleans, converts and standardizes the integrated data, and uses distributed computing technology to quickly process and analyze large-scale data; the data storage module uses distributed storage technology to store the processed data; the data query module optimizes the query algorithm and indexing technology to achieve rapid retrieval and query of massive data; the storage security of the data storage module is monitored through the storage management module; risk storage equipment is identified through analysis to remind management personnel to make corresponding regulatory measures for the corresponding risk storage equipment in a timely manner, thereby reducing the safety hazards of the corresponding risk storage equipment, ensuring the storage security of all storage equipment, and avoiding data loss; the system has a high degree of intelligence.

[0045] The above formulas are all dimensionless and numerical calculations. The formula is a formula obtained by collecting a large amount of data and performing software simulation to obtain the most recent real situation. The preset parameters in the formula are set by technicians in this field according to actual conditions. The preferred embodiments of the present invention disclosed above are only used to help explain the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the invention to only specific implementation methods. Obviously, many modifications and changes can be made according to the contents of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that technicians in the relevant technical field can understand and use the present invention well. The present invention is only limited by the claims and their full scope and equivalents.

Claims

1. A multi-source data integration storage system based on national land space planning information, characterized by: It includes data integration module, data processing module, data storage module, data query module and storage management module; the data integration module receives and integrates data from different data sources, realizes seamless connection and efficient integration of multi-source data by formulating unified data format and interface standards, and sends the integrated data to the data processing module; The data processing module cleans, converts and standardizes the integrated data to eliminate data redundancy and errors, and uses distributed computing technology to quickly process and analyze large-scale data, and sends the processed data to the data storage module; The data storage module uses distributed storage technology to store processed data. The data query module provides a data query interface, supports query methods based on spatial location and attribute information, and realizes rapid retrieval and query of massive data by optimizing query algorithms and indexing technologies. The storage management module monitors the storage security of the data storage module, identifies risky storage devices through analysis, and sends the risky storage devices to the smart terminals of the corresponding managers.

2. The multi-source data integration storage system based on national land space planning information according to claim 1 is characterized in that: The specific operation process of the storage management module includes: All storage devices covered by the data storage module are obtained, and the corresponding storage device is marked as h, where h is a natural number greater than 1. The operation detection value and environmental hazard detection value of the storage device h are obtained. If the operation detection value or the environmental hazard detection value exceeds the corresponding preset threshold, the storage device h is marked as a risky storage device.

3. The multi-source data integration storage system based on national land space planning information according to claim 2 is characterized in that: The storage management module is communicatively connected to the operation evaluation module and the environmental risk detection module. The operation evaluation module detects and analyzes the operation risk of the storage device h, obtains the operation detection value of the storage device h through analysis, and sends the operation detection value of the storage device h to the storage management module; The environmental risk detection module obtains the environment to which the storage device h belongs and marks it as a regulatory environment, detects and analyzes the environmental risks of the regulatory environment, obtains the environmental risk detection value of the storage device h through analysis, and sends the environmental risk detection value of the storage device h to the storage management module.

4. The multi-source data integration storage system based on national land space planning information according to claim 3 is characterized in that: The specific analysis process of running the evaluation module is as follows: The real-time temperatures at several positions on the storage device h are collected, the real-time temperatures at the corresponding positions are calculated by ratio with the corresponding preset temperature threshold to obtain the position temperature value, the position temperature values ​​at all positions are averaged to obtain the storage temperature value, and the vibration data of the storage device is collected and marked as the storage vibration value; if the storage temperature value or the storage vibration value exceeds the corresponding preset threshold, it is determined that the storage device h is in the running danger table state; The total time that the storage device h is in the operation risk table state per unit time is obtained and marked as the operation risk table time, and the storage temperature risk value is obtained by averaging all the storage temperature condition values ​​per unit time, and the storage vibration risk value is obtained by averaging all the storage vibration condition values ​​per unit time. The operation detection value of the storage device h is obtained by numerically calculating the operation risk table time, the storage temperature value and the storage vibration value.

5. The multi-source data integration storage system based on national land space planning information according to claim 3 is characterized in that: The specific analysis process of the environmental risk detection module is as follows: The ambient temperature and humidity of the supervision environment of the storage device h are collected per unit time, and the deviation of the ambient temperature from the preset suitable temperature standard value is marked as the supervision temperature deviation value, and the supervision humidity deviation value is obtained similarly; The dust detection value and electromagnetic radiation value of the supervision environment of the storage device h are collected per unit time, and the environmental risk detection value of the storage device h is obtained by numerically calculating the supervision temperature analysis value, the supervision humidity analysis value, the dust detection value and the electromagnetic radiation value.

6. The multi-source data integration storage system based on national land space planning information according to claim 3 is characterized in that: The storage management module is communicated with the storage classification module, which classifies all storage devices into levels, marks the storage device h as a high-management device or a low-management device through analysis, and sends the level classification information of the storage device h to the intelligent terminal of the corresponding manager.

7. The multi-source data integration storage system based on national land space planning information according to claim 6 is characterized in that: The specific analysis process of the storage partition module is as follows: The amount of data stored in the storage device h is collected and marked as the data storage value, the number of times the data in the storage device h is queried during the detection period is collected and marked as the data query value, and the number of times the storage device h is marked as a risk storage device during the detection period is obtained and marked as the risk frequency detection value; The storage level value is obtained by numerically calculating the data storage value, the data query value and the risk detection value. If the storage level value exceeds the preset storage level threshold, the storage device h is marked as a high-level device; If the storage level value does not exceed the preset storage level threshold, the storage device h is marked as a low-management device.

Images