Geological survey data management method and system

Abstract

The invention provides a geological survey data management method and system, and belongs to the field of data management, and the method comprises the steps: carrying out the storage analysis of a database, determining the standard storage type of a distributed storage node according to the maximum storage data type, carrying out the analysis according to the use frequency of other data types, and determining a transfer position; and generating transfer storage information, selecting a corresponding distributed storage node according to the data type of the database, and generating data storage information. According to the geological survey data management method and system provided by the invention, the problem of low storage resource utilization rate caused by lack of scientific planning of data storage in a distributed storage environment is solved, the standard storage type of each node is determined by analyzing the distributed storage nodes, and the storage resource utilization rate is improved. And other types of data are transferred according to the data delay demand and the use frequency, so that reasonable distribution of the data is realized, the load balance and the resource utilization rate of the storage nodes are improved, and the storage cost is reduced.

Description

Technical Field

[0001] The present application belongs to the field of data management technology, and more specifically, to a geological survey data management method and system. Background Art

[0002] With the rapid development of geological exploration technology and the increasing level of informatization, geological exploration data has become multi-source, multi-dimensional, and massive. In actual work, data comes from a wide range of sources, including topographic mapping, laboratory analysis, field survey records, and other channels. Data types include spatial data, attribute data, document data, and multimedia data.

[0003] According to the patent publication number CN116304977A, a multi-source geological survey data fusion method, device, equipment and storage medium are disclosed. The method includes: acquiring two-dimensional and three-dimensional multi-source geological survey data; classifying and storing the two-dimensional and three-dimensional multi-source geological survey data to obtain multiple geological spatial databases corresponding to different data types; determining the surface data and underground data to be fused based on each geological spatial database; obtaining the configured fusion type; when the fusion type is the fusion of surface data and underground data, constraining the underground data to be fused by the surface data to be fused, and performing interpolation processing to achieve the fusion of the two-dimensional and three-dimensional multi-source geological survey data; Through the above-mentioned methods, the storage and management of modeling data sources can be realized, the application threshold of data organization, update and management can be lowered, the interactive processing flow can be greatly optimized, and the personnel input can be reduced. In addition, the fusion and utilization method of two-dimensional and three-dimensional geological data can further assist in the rapid construction of high-precision and high-reliability geological models.

[0004] However, in a distributed storage environment, data storage lacks scientific planning, resulting in excessive load on some storage nodes, while other node resources are idle and storage resource utilization is low. Existing technologies lack security control in the data sharing process and cannot effectively identify abnormal user operations. Data lacks a complete encryption protection mechanism in the shared download link, which can easily lead to data leakage or malicious tampering. Summary of the Invention

[0005] The purpose of this application is to provide a geological survey data management method and system to solve the problem of low storage resource utilization caused by lack of scientific planning of data storage in a distributed storage environment.

[0006] A first aspect of an embodiment of the present application provides a method for managing geological survey data, comprising the following steps: Step S101: Collect geological survey data within a preset time period, and perform data cleaning and preprocessing to obtain preprocessed data; Step S102: The pre-processed data is divided into classified data based on data types, and a corresponding database is established after standardization processing; Step S103: Perform storage analysis on the database, determine the standard storage type of the distributed storage node based on the largest number of stored data types, analyze and determine the transfer location based on the usage frequency of other data types, generate transfer storage information, select the corresponding distributed storage node based on the database data type, and generate data storage information; Step S104: Perform data sharing analysis on the obtained data storage information, analyze the download frequency corresponding to the user operation, generate a download normal or abnormal signal, determine the download information based on the abnormal download signal, generate operation warning information, and perform shared encryption processing; Step S105: Perform shared encryption processing on the downloaded information, convert it into binary first, divide it equally and then reverse it, extract the even-digit binary numbers and reassemble them with the reversed segment to generate encrypted information.

[0007] The specific method of establishing the corresponding database after the standardization process in step S102 is: Obtain preprocessed data and the corresponding data type, and divide it according to its data type to obtain classified data. Standardize the obtained classified data, and then process the preprocessed data accordingly according to the relationship of "project-work area-data type" to generate a database; Use cross-validation to eliminate erroneous data in the database and set different viewing permissions.

[0008] The specific method of performing storage analysis on the database in step S103 is: Get all distributed storage nodes n1 to n m And the corresponding storage data type, where m represents the number of distributed storage nodes, and sorts different storage data types from largest to smallest according to the number; At the same time, the data type with the largest number is selected as the standard storage type. Similarly, the same process is performed on all distributed storage nodes to determine the standard storage type corresponding to the distributed storage nodes.

[0009] The specific method of generating the transfer storage information in step S103 is: Based on the data delay requirements of other data types, screen the distributed storage nodes that meet the conditions, calculate the data type usage frequency and the data reading frequency of the pre-selected nodes respectively, compare the frequency difference between the two, select the pre-selected node with the smallest difference to store the data, and generate the transfer storage information.

[0010] The specific method of performing data sharing analysis on the obtained data storage information in step S104 is: Obtain user operation information during the data sharing process, calculate the user's download frequency, and compare the download frequency with the threshold. If the download frequency is greater than the threshold, it means that the user operation is abnormal and a download abnormality signal is generated. Conversely, if the download frequency is less than the threshold, it means that the user operation is normal and a download normal signal is generated. The two are analyzed separately.

[0011] The specific methods of analyzing the two are as follows: For the generated download abnormality signal, further obtain the corresponding download information, generate the corresponding operation warning information, and perform shared encryption processing on it; For the generated normal download signal, the user operation information is continuously monitored.

[0012] The specific method of generating the encrypted information in step S105 is: Obtain real-time download information, convert the real-time download information into binary data, divide it equally to obtain binary equally divided segments, reverse the equally divided segments, extract the even-digit binary arrays of two groups of reversed segments to synthesize a new sequence, and then recombine it with the original reversed segments to generate encrypted information.

[0013] In a second aspect of the embodiment of the present application, a geological survey data management system includes: a data acquisition unit, a data classification processing unit, a data storage analysis unit, a data sharing analysis unit, and a management information output unit; A data acquisition unit is used to collect geological survey data within a preset time period and transmit it to a data classification processing unit; The data classification processing unit is used to clean and preprocess the acquired geological survey data to obtain preprocessed data, and to divide the data based on the data type to obtain classified data, and to establish a corresponding database after standardization, and then transmit it to the data storage and analysis unit; The data storage analysis unit is used to perform storage analysis on the acquired database, analyze the storage data types corresponding to different distributed storage nodes, and use the storage data type with the largest number as the standard storage type. At the same time, the remaining other data types are transferred, and the transfer location is determined by analyzing the usage frequency of other data types, and transfer storage information is generated. The corresponding distributed storage node is selected according to the data type of the database, and data storage information is generated and transmitted to the data sharing analysis unit. A data sharing analysis unit is used to perform data sharing analysis on the obtained data storage information, analyze the download frequency corresponding to the user operation, generate a download normal or abnormal signal, determine the download information based on the download abnormal signal, generate operation warning information, and perform shared encryption processing; Perform shared encryption processing on the downloaded information, convert it into binary, and divide it equally according to the binary numbers to obtain binary equally divided segments. At the same time, reverse the entire information to obtain reverse equally divided segments. Extract the binary numbers corresponding to the even-numbered bits, reassemble them with the original reverse equally divided segments to obtain a recombined sequence, generate encrypted information, and transmit it to the management information output unit; The management information output unit is used to display the operation warning information to the corresponding management personnel, and at the same time encrypt the downloaded information according to the obtained encryption information.

[0014] According to a third aspect of an embodiment of the present application, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the above-mentioned geological survey data management method when executing the computer program.

[0015] In a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned geological survey data management method are implemented.

[0016] The geological survey data management method and system provided by the embodiments of the present application have the following beneficial effects: First, through unified data cleaning and preprocessing of geological survey data, categorization by type, and standardized processing, a relational database based on the "project-work area-data type" relationship was established to achieve orderly data storage and efficient management. Furthermore, hierarchical permission management was implemented to ensure that different personnel had access to data on demand, improving data retrieval and usage efficiency.

[0017] Secondly, the distributed storage nodes are analyzed to determine the standard storage type of each node, and other types of data are transferred based on data latency requirements and usage frequency to achieve reasonable data distribution, improve the load balance and resource utilization of storage nodes, and reduce storage costs.

[0018] In addition, in the data sharing process, by monitoring user operations in real time, setting download frequency thresholds to identify abnormal behaviors, and encrypting abnormal operation data; using encryption strategies such as binary conversion, equal division, reversal, and reorganization, the downloaded information is highly encrypted to effectively prevent data leakage and tampering, and ensure the security of data sharing. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0020] Figure 1 A flowchart of a geological survey data management method provided in one embodiment of the present application; Figure 2 A block diagram of a geological survey data management system is provided for one embodiment of the present application; Figure 3 A schematic block diagram of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0021] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0022] In order to make the purpose, technical solutions and advantages of this application clearer, specific embodiments will be described below with reference to the accompanying drawings.

[0023] Please refer to Figure 1 , Figure 1 This is a flow chart of a geological survey data management method provided in one embodiment of the present application, which specifically includes the following steps: S101: Acquire geological survey data, and the geological survey data here is data of a preset time period, and the specific value of the preset time period is set by the operator, and perform data cleaning and data preprocessing to obtain corresponding preprocessed data, and the data cleaning and data preprocessing include deduplication, processing of missing values ​​and processing of outliers. The specific cleaning and preprocessing process is existing technology and will not be described in detail here.

[0024] S102: The obtained pre-processed data is divided into data to obtain classified data. Here, the pre-processed data is divided according to the data type to obtain spatial data (including data with geographic spatial coordinate information such as topographic maps, geological profiles, borehole spatial positions, and ore body distribution. Common formats include CAD drawings, GIS vector data (.shp), etc. For example, in a geological survey project for highway construction in a mountainous area, the three-dimensional coordinates of each borehole collected by a total station and the high-precision terrain contour map generated by drone aerial survey are all spatial data), attribute data (used to describe the physical and chemical properties of geological objects, mainly information such as lithology, mineral composition, water content, and mechanical parameters, mostly stored in the form of Excel tables and database fields. For example, after laboratory analysis of the collected rock samples, the test data such as rock compressive strength and porosity constitute attribute data), document data (covering various text materials such as survey reports, original records, experimental reports, and project files. Common formats are PDF and Word documents, such as the "XX" compiled by the project team. The "Regional Geological Survey Comprehensive Report", as well as scanned copies of handwritten notebooks for field geological surveys, all fall into the category of document data) and multimedia data (including on-site photos, videos, remote sensing images, 3D models and other data, in formats such as JPG, MP4, BIM files, etc. For example, videos of geological outcrops at the construction site taken with a high-definition camera, and visualization models of underground ore bodies constructed using 3D modeling software, all fall into the category of multimedia data). At the same time, the obtained classified data are standardized and a corresponding database is established. The database here is specifically a relational database, which is processed according to the relationship between "project-work area-data type". The specific geological survey project is used as the top-level directory, and each project corresponds to an independent database instance or database architecture. For example, the "XX City Metro Line Geological Survey Project" is a project level. A dedicated project database is created in the database. Different work areas are divided according to the actual survey area of ​​the project, and each work area is used as a subdirectory under the project. For example, the subway project mentioned above can be divided into multiple work areas such as A, B, and C according to different line sections. Under each work area, the four subcategories of spatial data, attribute data, document data, and multimedia data are further subdivided, and corresponding data tables or file storage paths are established for each. For example, under the attribute data category of work area A, specific data tables such as rock mechanics parameter tables and soil moisture content tables are created. Then, the data quality of the database is controlled and analyzed. Specifically, cross-validation (for the same geological parameters, different test methods are used to obtain data and compare them. For example, when determining the density of rocks in a certain area, laboratory measurement methods and geophysical logging methods are used simultaneously. If the data deviation obtained by the two methods exceeds the set threshold (such as 5%), it is necessary to re-test, analyze the reasons, and eliminate erroneous data) and statistical analysis (detect outliers in the data through statistical methods).Taking borehole depth data as an example, we use boxplots to analyze data distribution. If a borehole depth value significantly deviates from the overall data range, exceeding 1.5 times the interquartile range, it is identified as an outlier. Further verification of its accuracy is conducted, and if confirmed to be incorrect, it is removed. We use methods such as (presumably a tool) to remove erroneous data. Furthermore, we set different permissions based on different data, and assign corresponding viewing permissions based on personnel level.

[0025] For example, the core permissions of the super administrator are: system global configuration, role creation, full data access and deletion, and the corresponding data scope is: all project data. The core permissions of the project administrator are: project member management, data upload / download approval, subset data sharing configuration, and the corresponding data scope is: all data of this project. The core permissions of ordinary users are: query and download data according to the authorized scope, and submit data use applications, and the corresponding data scope is: data related to personal responsibilities. The core permissions of external users are: read-only access, limited data download (approval required), and the corresponding data scope is: shared data sets after desensitization. The core permissions of public users are: browsing public report summaries and basic geological maps (such as regional geological overviews), and the corresponding data scope is: publicly available non-confidential data.

[0026] S103: Perform storage analysis on the different databases obtained, obtain all distributed storage nodes, and label them as n1 to n m , where m represents the number of distributed storage nodes. Taking a large-scale mineral exploration project as an example, its distributed storage system contains 4 nodes (m=4), numbered n1 to n4. Get the data type and corresponding quantity stored in each node. Assume that the data type and quantity of node n1 are: spatial data quantity is 200, attribute data quantity is 350, document data quantity is 100, and multimedia data quantity is 50; At the same time, the storage data types corresponding to the distributed storage nodes are obtained, and the corresponding quantities of different storage data types are obtained. They are sorted from largest to smallest in terms of quantity, and then the data type with the largest quantity is selected as the standard storage type. Similarly, the same process is performed on all distributed storage nodes to determine the standard storage type corresponding to the distributed storage nodes. Specifically, if there are multiple distributed storage nodes with the same maximum type, the distributed storage node with the largest quantity is used as the standard. For the remaining distributed storage nodes, the data type with the largest quantity among the remaining data types is used to determine the standard storage type. For example, if nodes n2 and n1 both have the largest quantity of attribute data, but n2 has a larger total amount of data, then n2's attribute data is used as a reference. For the remaining nodes, the data type with the largest quantity among the remaining data types is selected as the standard. Ultimately, the standard storage types of the four nodes are determined as follows: n1 is space, n2 is attribute data, n3 is document data, and n4 is multimedia data.

[0027] At the same time, other types of data corresponding to the distributed storage nodes are transferred and processed, and the standard of transfer processing is determined according to the data requirements and usage frequency of the data type. The specific determination method is as follows: Obtain other data types and obtain corresponding data requirements, where the data requirements are specifically expressed as corresponding data delay requirements, and use this as a standard to screen distributed storage nodes to obtain pre-selected storage nodes, then calculate the usage frequency of other data types, where the usage frequency represents the ratio of the number of uses to the duration within time t, and at the same time calculate the data reading frequency of the pre-selected storage nodes, and match the usage frequency with it, calculate the numerical difference between the two, and use the pre-selected storage node with the smallest numerical difference as the standard to store other data types and generate transfer storage information; Then, the data type corresponding to the database is obtained, and the data type here is determined according to the data type in "Project-Work Area-Data Type", and the database is matched with the corresponding distributed storage node to generate data storage information.

[0028] For example, if a non-standard data type requires a data delay of no more than 100ms, and only nodes n1, n3, and n4 meet the requirements, they will be used as pre-selected storage nodes. If a non-standard data type is used 12 times within 1 hour, the usage frequency is 12 times / hour; the read frequencies of nodes n1, n3, and n4 are 10 times / hour, 15 times / hour, and 8 times / hour, respectively. The numerical difference between the usage frequency and the read frequency is calculated. The difference for n1 is 2, the difference for n3 is 3, and the difference for n4 is 4. The n1 node with the smallest difference is selected as the target storage node, and the data type is transferred there to generate transfer storage information.

[0029] S104: Based on the obtained data storage information, analyze the data sharing between users, obtain user operation information during the data sharing process, and the user operation information specifically includes the number of queries and download information within the time T, and calculate the user's download frequency. At the same time, compare the download frequency with a threshold. If the download frequency is greater than the threshold, it indicates that the user operation is abnormal, and a download abnormality signal is generated. Conversely, if the download frequency is less than the threshold, it indicates that the user operation is normal, and a download normal signal is generated. For example, between 8:00 AM and 6:00 PM on a certain weekday, user A queries geological survey reports five times and downloads three drill hole data files (total size 50 MB). Download frequency = number of file downloads within time T / T. For example, if user A downloads three times in time T = 10 hours, the download frequency is 3 times / 10 hours = 0.3 times / hour. If a preset download frequency threshold (such as 0.5 times / hour) is used, a download frequency of 0.3 times / hour is reduced to less than 0.5 times / hour, generating a normal download signal.

[0030] For the generated download abnormality signal, further obtain the corresponding download information, generate the corresponding operation warning information, and perform shared encryption processing on it; For the generated normal download signal, the user operation information is continuously monitored.

[0031] S105: Shared encryption processing is performed on the download information to obtain real-time download information, and its data content is converted into binary. At the same time, it is evenly divided according to the generated binary number to obtain binary evenly divided segments. Here, evenly divided according to the number of binary numbers. For odd numbers, binary supplement is performed, and the supplemented binary number is 1. Specifically, at the last position, the entire binary evenly divided segment is evenly divided. Then, the obtained binary evenly divided segment is reversed to generate reversed evenly divided segments. The reversed evenly divided segments are encrypted as a whole. The specific encryption method is as follows: Obtain two groups of reverse-order evenly divided segments, then obtain the binary numbers corresponding to their even-numbered digits, and combine them in order to obtain a combined binary sequence. At the same time, the combined binary sequence and the corresponding reverse-order evenly divided segments are recombined to generate a recombined sequence to generate the corresponding encrypted information.

[0032] Capture user downloading behavior in real time and record information such as file name, size, type, and data content. For example, a user downloads the "Geological Profile of the XX Mining Area", the file size is 1024KB, and the data content includes text information such as graphic coordinates and lithology annotations. Convert the downloaded data content into binary format. Assuming that the original text data is "Drilling depth 120 meters", the binary sequence obtained after conversion through ASCII encoding is: 01101111011101110110001101101010010000000110001001100100011000000101110, and divide it equally according to the total number of binary numbers. If the total number is even, divide it into two equal parts; if it is odd, add 1 1 at the end of the sequence to make it an even number and then divide it into segments; For example, "rock formation dip angle 30°" is converted to 0111011101100001011100100110010001100100000001100110011000000101110. Calculate the total number of bits N. If N is an even number, directly divide it into two segments S1 and S2 (both with length N / 2). If N is an odd number, append binary 1 to the end of the data to make the total number of bits N+1, and then divide it equally. Original data (15 bits): 01101010011101010 After complement (16 bits): 011010100111010101 Average results: S1:011010100; S2:111010101; If the length of a data segment is less than 8 bits, it needs to be padded with zeros on the left to 8 bits to ensure the consistency of subsequent encryption operations; Reverse the order of S1 and S2 respectively, for example: Original S1: 011010100 → after reverse order: 001010110; Extract the even-numbered digits of S1 and S2 in reverse order (2nd, 4th, 6th, ... digits from left to right) respectively; Splice in sequence to form a combined binary sequence C; S1 reverse order: 001010110 → even bit extraction: 011010; S2 reverse order: 101010111 → even bit extraction: 000111; Combination sequence C: 011010000111; Insert C in sequence between the original reversed segments S1 and S2; If there are remaining fragments, insert them cyclically until all combinations are completed; Original reorganization: 00101011001101000011110101010111; Format adjustment: 00101011001101000001111010101011.

[0033] Corresponding to the geological survey data management method of the above embodiment, Figure 2 This is a structural diagram of a geological survey data management system provided by an embodiment of the present application. For ease of explanation, only the parts related to the embodiment of the present application are shown. Figure 2 The geological survey data management system includes: a data acquisition unit, a data classification processing unit, a data storage and analysis unit, a data sharing and analysis unit, and a management information output unit, and the above functional units are unidirectionally electrically connected.

[0034] A data acquisition unit is used to collect geological survey data within a preset time period and transmit it to a data classification processing unit; The data classification processing unit is used to clean and preprocess the acquired geological survey data to obtain preprocessed data, and to classify the data based on the data type to obtain classified data, and to establish a corresponding database after standardization, and then transmit it to the data storage and analysis unit. The specific processing method is the same as the processing process of the above step S102; The data storage analysis unit is used to perform storage analysis on the acquired database, analyze the storage data types corresponding to different distributed storage nodes, and use the storage data type with the largest number as the standard storage type. At the same time, it transfers the remaining other data types, determines the transfer location by analyzing the usage frequency of other data types, generates transfer storage information, selects the corresponding distributed storage node according to the data type of the database, generates data storage information, and transmits it to the data sharing analysis unit and the management information output unit. The specific processing method is the same as the processing process of step S103 above. The data sharing analysis unit is used to perform data sharing analysis on the obtained data storage information, analyze the download frequency corresponding to the user operation, generate a download normal or abnormal signal, determine the download information based on the download abnormal signal, generate an operation warning message, and perform shared encryption processing. The specific processing method is the same as the processing process of step S104 above; The downloaded information is shared and encrypted, converted into binary, and evenly divided according to the binary numbers to obtain binary evenly divided segments. The entire information is then reversed to obtain reversed evenly divided segments. The binary numbers corresponding to even-numbered bits are extracted and recombined with the original reversed evenly divided segments to obtain a recombined sequence. The encrypted information is generated and transmitted to the management information output unit. The specific processing method is the same as the processing process of step S105 above. The management information output unit is used to display the operation warning information to the corresponding management personnel, and at the same time encrypt the downloaded information according to the obtained encryption information.

[0035] See also Figure 3 , Figure 3 This is a schematic block diagram of an electronic device provided in one embodiment of the present application. Figure 3 The electronic device 300 in this embodiment may include one or more processors 301, one or more input devices 302, one or more output devices 303, and one or more memories 304. The processors 301, input devices 302, output devices 303, and memories 304 communicate with each other via a communication bus 305. The memories 304 are used to store computer programs, which include program instructions. The processor 301 is used to execute the program instructions stored in the memory 304. The processor 301 is configured to invoke the program instructions to execute the functions of the various modules / units in the aforementioned system embodiments.

[0036] It should be understood that in the embodiment of the present application, the processor 301 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0037] The input device 302 may include a touchpad, a fingerprint collection sensor (for collecting user fingerprint information and fingerprint direction information), a microphone, etc. The output device 303 may include a display (LCD, etc.), a speaker, etc.

[0038] The memory 304 may include a read-only memory and a random access memory, and provides instructions and data to the processor 301. A portion of the memory 304 may also include a non-volatile random access memory. For example, the memory 304 may also store device type information.

[0039] In a specific implementation, the processor 301, input device 302, and output device 303 described in the embodiments of the present application can execute the implementation methods described in the first and second embodiments of the geological survey data management method provided in the embodiments of the present application, and can also execute the implementation methods of the electronic device described in the embodiments of the present application, which will not be repeated here.

[0040] In another embodiment of the present application, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program. The computer program includes program instructions. When the program instructions are executed by a processor, all or part of the process of the method in the above embodiment is implemented. The computer program can also be used to instruct related hardware to complete the process. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of each of the above method embodiments are implemented. The computer program includes computer program code, which can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can include: any entity or device capable of carrying computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium.

[0041] The computer-readable storage medium can be an internal storage unit of the electronic device in any of the aforementioned embodiments, such as a hard disk or memory of the electronic device. The computer-readable storage medium can also be an external storage device of the electronic device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, etc. Furthermore, the computer-readable storage medium can include both an internal storage unit of the electronic device and an external storage device. The computer-readable storage medium is used to store computer programs and other programs and data required by the electronic device. The computer-readable storage medium can also be used to temporarily store data that has been output or is about to be output.

[0042] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0043] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the electronic devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0044] In the several embodiments provided in this application, it should be understood that the disclosed electronic devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces or units, or can be an electrical, mechanical or other form of connection.

[0045] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0046] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0047] The above are only specific embodiments of the present application, but the scope of protection of the present application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and such modifications or substitutions should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A geological survey data management method, characterized in that: The following steps are involved: Step S101: Collect geological survey data within a preset time period, and perform data cleaning and preprocessing to obtain preprocessed data; Step S102: The pre-processed data is divided into classified data based on data types, and a corresponding database is established after standardization processing; Step S103: Perform storage analysis on the database, determine the standard storage type of the distributed storage node based on the largest number of stored data types, analyze and determine the transfer location based on the usage frequency of other data types, generate transfer storage information, select the corresponding distributed storage node based on the database data type, and generate data storage information; Step S104: Perform data sharing analysis on the obtained data storage information, analyze the download frequency corresponding to the user operation, generate a download normal or abnormal signal, determine the download information based on the abnormal download signal, generate operation warning information, and perform shared encryption processing; Step S105: Perform shared encryption processing on the downloaded information, convert it into binary first, divide it equally and then reverse it, extract the even-digit binary numbers and reassemble them with the reversed segment to generate encrypted information.

2. The geological survey data management method according to claim 1, wherein: The specific method of establishing the corresponding database after the standardization process in step S102 is: Obtain preprocessed data and its corresponding data type, divide it into categorized data according to its data type, standardize the categorized data, and then process the preprocessed data accordingly based on the "project-work area-data type" relationship to generate a database. Use cross-validation to eliminate erroneous data in the database and set different viewing permissions.

3. The geological survey data management method according to claim 1, wherein: The specific method of performing storage analysis on the database in step S103 is: Get all distributed storage nodes n1 to n m And the corresponding storage data type, where m represents the number of distributed storage nodes, and sorts different storage data types from largest to smallest according to the number; At the same time, the data type with the largest number is selected as the standard storage type. Similarly, the same process is performed on all distributed storage nodes to determine the standard storage type corresponding to the distributed storage nodes.

4. The geological survey data management method according to claim 3, wherein: The specific method of generating the transfer storage information in step S103 is: Based on the data delay requirements of other data types, screen the distributed storage nodes that meet the conditions, calculate the data type usage frequency and the data reading frequency of the pre-selected nodes respectively, compare the frequency difference between the two, select the pre-selected node with the smallest difference to store the data, and generate the transfer storage information.

5. The geological survey data management method according to claim 1, wherein: The specific method of performing data sharing analysis on the obtained data storage information in step S104 is: Obtain user operation information during the data sharing process, calculate the download frequency of user operations, and compare it with the threshold. If the download frequency is greater than the threshold, generate a download abnormality signal. Conversely, if the download frequency is less than the threshold, generate a download normal signal, and analyze the two separately.

6. The geological survey data management method according to claim 5, wherein: The specific methods of analyzing the two are as follows: For the generated download abnormality signal, further obtain the corresponding download information, generate the corresponding operation warning information, and perform shared encryption processing on it; For the generated normal download signal, the user operation information is continuously monitored.

7. The geological survey data management method according to claim 1, wherein: The specific method of generating the encrypted information in step S105 is: Obtain real-time download information and convert the data content into binary. If the number of binary digits is odd, add 1 at the end and divide it into two equal segments. Reverse the two segments of binary data to obtain reversed and evenly divided segments. Extract the even-numbered binary digits of the two reversed and evenly divided segments, combine them into a new sequence, and then reassemble them with the original reversed and evenly divided segments to generate encrypted information.

8. A geological survey data management system for executing the geological survey data management method according to any one of claims 1 to 7, characterized in that: include: Data collection unit, data classification processing unit, data storage and analysis unit, data sharing and analysis unit, and management information output unit; A data acquisition unit is used to collect geological survey data within a preset time period and transmit it to a data classification processing unit; The data classification processing unit is used to clean and preprocess the acquired geological survey data to obtain preprocessed data, and to divide the data based on the data type to obtain classified data, and to establish a corresponding database after standardization, and then transmit it to the data storage and analysis unit; The data storage analysis unit is used to perform storage analysis on the acquired database, analyze the storage data types corresponding to different distributed storage nodes, and use the storage data type with the largest number as the standard storage type. At the same time, the remaining other data types are transferred, and the transfer location is determined by analyzing the usage frequency of other data types, and transfer storage information is generated. The corresponding distributed storage node is selected according to the data type of the database, and data storage information is generated and transmitted to the data sharing analysis unit. A data sharing analysis unit is used to perform data sharing analysis on the obtained data storage information, analyze the download frequency corresponding to the user operation, generate a download normal or abnormal signal, determine the download information based on the download abnormal signal, generate operation warning information, and perform shared encryption processing; Perform shared encryption processing on the downloaded information, convert it into binary, and divide it equally according to the binary numbers to obtain binary equally divided segments. At the same time, reverse the entire information to obtain reverse equally divided segments. Extract the binary numbers corresponding to the even-numbered bits, reassemble them with the original reverse equally divided segments to obtain a recombined sequence, generate encrypted information, and transmit it to the management information output unit; The management information output unit is used to display the operation warning information to the corresponding management personnel, and at the same time encrypt the downloaded information according to the obtained encryption information.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images