Geological survey data management method and system

Abstract

The application provides a geological survey data management method and system, belonging to the field of data management, which comprises storage analysis on a database, determination of the standard storage type of a distributed storage node according to the maximum number of storage data types, analysis and determination of a transfer position according to the use frequency of other data types, generation of a transfer storage signal, selection of a corresponding distributed storage node according to the data type of the database, and generation of data storage information. The geological survey data management method and system provided by the application solve the problem of low storage resource utilization rate caused by the lack of scientific planning of data storage in a distributed storage environment, determine the standard storage type of each node by analyzing the distributed storage node, transfer other types of data according to the data delay requirement and use frequency, realize the reasonable distribution of data, improve the load balancing and resource utilization rate of the storage node, and reduce the storage cost.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of data management, and more particularly relates to a geological survey data management method and system. BACKGROUND

[0002] With the rapid development of geological survey technology and the continuous improvement of informatization, geological survey data presents the characteristics of multi-source, multi-dimension and massiveness. In actual work, data sources are extensive, covering topographic mapping, laboratory analysis, field investigation records and other channels, and data types include spatial data, attribute data, document data and multimedia data.

[0003] According to the patent with the publication number CN116304977A, a multi-source geological survey data fusion method, device, equipment and storage medium are disclosed. The method comprises: acquiring two / three-dimensional multi-source geological survey data; classifying and storing the two / three-dimensional multi-source geological survey data to obtain a plurality of geological space databases corresponding to different data types; determining to-be-fused surface data and to-be-fused underground data according to the geological space databases; acquiring a configured fusion type; when the fusion type is surface data and underground data fusion, the to-be-fused underground data is constrained by the to-be-fused surface data, and interpolation processing is performed to realize fusion of two / three-dimensional multi-source geological survey data.

[0004] In the above manner, storage management of modeling data sources is realized, the application threshold of data organization, updating and management is reduced, the interactive processing process is greatly optimized, personnel investment is reduced, and the two / three-dimensional geological data fusion method further assists rapid construction of a high-precision and high-reliability geological model.

[0005] However, in a distributed storage environment, data storage lacks scientific planning, resulting in excessively high load of some storage nodes, while resources of other nodes are idle, the utilization rate of storage resources is low, the existing technology is insufficient in safety control in the data sharing process, cannot effectively identify abnormal operations of users, and lacks a perfect encryption protection mechanism for data in the sharing and downloading link, which is prone to cause data leakage or malicious tampering. SUMMARY

[0006] The application aims to provide a geological survey data management method and system, and solve the problem of low utilization rate of storage resources caused by lack of scientific planning in data storage in a distributed storage environment.

[0007] In a first aspect, the application provides a geological survey data management method, comprising the following steps:

[0008] In step S101, geological survey data in a preset time period is collected, and data cleaning and preprocessing are performed to obtain preprocessed data.

[0009] Step S102, the pre-processed data is divided based on the data type to obtain classified data, and a corresponding database is established after standardization processing;

[0010] Step S103, the database is analyzed, the maximum number of storage data types determines the standard storage type of the distributed storage node, and the transfer position is determined according to the use frequency of other data types, the transfer storage information is generated, the corresponding distributed storage node is selected according to the data type of the database, and the data storage information is generated;

[0011] Step S104, the obtained data storage information is analyzed, the corresponding download frequency of the user operation is analyzed, the download normal or abnormal signal is generated, the download information generation operation warning information is determined according to the download abnormal signal, and the sharing encryption processing is performed;

[0012] Step S105, the download information is shared and encrypted, which is first converted into binary, divided and reversed, the even binary number is extracted and recombined with the reversed segment to generate encrypted information.

[0013] The specific method of the step S102 for establishing the corresponding database after standardization processing is:

[0014] The pre-processed data and the corresponding data type are obtained, and the classified data is obtained by dividing according to the data type. The classified data is standardized, and then the pre-processed data is processed according to the relationship of "project-work area-data type" to generate the database;

[0015] The cross-validation is used to remove the error data in the database, and different viewing permissions are set.

[0016] The specific method of the step S103 for analyzing the database is:

[0017] All distributed storage nodes n1 to n m and the corresponding storage data type are obtained, wherein m represents the number of distributed storage nodes, and different storage data types are sorted in descending order according to the number;

[0018] The largest number of data types is selected as the standard storage type, and the same processing is performed on all distributed storage nodes to determine the corresponding standard storage type of the distributed storage node.

[0019] The specific method of the step S103 for generating the transfer storage information is:

[0020] According to the data delay requirement of other data types, the distributed storage nodes meeting the condition are screened, the data type usage frequency and the data read frequency of the preselected nodes are calculated respectively, the frequency difference between the two is compared, the preselected node with the minimum difference value is selected to store data, and transfer storage information is generated.

[0021] The specific way of data sharing analysis of the obtained data storage information in the step S104 is:

[0022] User operation information in the data sharing process is obtained, and the download frequency of the user is calculated, and the download frequency is compared with the threshold value, if the download frequency is greater than the threshold value, it indicates that the user operation is abnormal, and a download abnormal signal is generated, otherwise if the download frequency is less than the threshold value, it indicates that the user operation is normal, and a download normal signal is generated, and the two are analyzed respectively.

[0023] The specific way of analyzing the two respectively is:

[0024] For the generated download abnormal signal, further download information corresponding to the download abnormal signal is obtained, and corresponding operation warning information is generated, and the operation warning information is shared and encrypted;

[0025] For the generated download normal signal, the user operation information is continuously monitored.

[0026] The specific way of generating the encryption information in the step S105 is:

[0027] Real-time download information is obtained, the real-time download information is converted into binary data, the binary data is divided equally to obtain binary equal segments, the equal segments are processed in reverse order, two groups of reverse segment even binary combinations are extracted to form a new sequence, and the new sequence is recombined with the original reverse segment to generate encryption information.

[0028] In a second aspect of the embodiment, the geological survey data management system includes a data acquisition unit, a data classification processing unit, a data storage analysis unit, a data sharing analysis unit, and a management information output unit.

[0029] The data acquisition unit is configured to acquire geological survey data in a preset time period and transmit the data to the data classification processing unit.

[0030] The data classification processing unit is configured to perform data cleaning and preprocessing on the acquired geological survey data to obtain preprocessed data, divide the preprocessed data based on data types to obtain classified data, and perform standardization processing to establish a corresponding database, and then transmit the database to the data storage analysis unit.

[0031] The data storage analysis unit is configured to perform storage analysis on the obtained database, analyze storage data types corresponding to different distributed storage nodes, take the storage data type with the largest quantity as a standard storage type, transfer the remaining other data types, determine a transfer position by analyzing the usage frequency of the other data types, generate transfer storage information, select a corresponding distributed storage node according to the data type of the database, generate data storage information, and transmit the data storage information to the data sharing analysis unit.

[0032] The data sharing analysis unit is configured to perform data sharing analysis on the obtained data storage information, analyze a download frequency corresponding to a user operation, generate a download normal or abnormal signal, determine operation warning information according to the download abnormal signal, and perform sharing encryption processing.

[0033] The download information is subjected to sharing encryption processing, binary conversion, and equal division according to binary numbers to obtain binary equal division segments, and the binary equal division segments are subjected to overall reverse ordering to obtain reverse order equal division segments, binary numbers corresponding to even bits are extracted, and the binary numbers are recombined with the original reverse order equal division segments to obtain a recombined sequence, encryption information is generated, and the encryption information is transmitted to the management information output unit.

[0034] The management information output unit is configured to display the operation warning information to a corresponding management personnel, and encrypt the download information according to the obtained encryption information.

[0035] In a third aspect, an electronic device is provided, which includes a memory, a processor, and a computer program stored in the memory and running on the processor, and the processor implements the steps of the geological survey data management method when executing the computer program.

[0036] In a fourth aspect, a computer readable storage medium is provided, which stores a computer program, and the computer program implements the steps of the geological survey data management method when executed by a processor.

[0037] The geological survey data management method and system provided by the embodiments of the present application have the following beneficial effects:

[0038] First, the geological survey data is subjected to unified data cleaning and preprocessing, type division and standardized processing, a relational database based on a "project - work area - data type" relationship is established, and ordered storage and efficient management of the data are achieved. Meanwhile, hierarchical permission management is set to ensure that different personnel access the data as needed, and the data retrieval and use efficiency is improved.

[0039] Secondly, the distributed storage nodes are analyzed, the standard storage types of the nodes are determined, and other types of data are transferred according to the data delay requirement and the use frequency, so that the data is reasonably distributed, the load balancing and resource utilization of the storage nodes are improved, and the storage cost is reduced.

[0040] In addition, in the data sharing link, the user operation is monitored in real time, the download frequency threshold is set to identify abnormal behavior, and the abnormal operation data is encrypted; binary conversion, equal division, reverse order, reorganization and other encryption strategies are adopted to encrypt the download information with high intensity, so as to effectively prevent data leakage and tampering and ensure the safety of data sharing. BRIEF DESCRIPTION OF DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0042] Figure 1 The flowchart of the geological survey data management method provided by an embodiment of the present application is shown in the figure.

[0043] Figure 2 The block diagram of the geological survey data management system provided by an embodiment of the present application is shown in the figure.

[0044] Figure 3 The schematic block diagram of the electronic device provided by an embodiment of the present application is shown in the figure. DETAILED DESCRIPTION

[0045] In the following description, specific details such as specific system structures, techniques, etc. are presented in order to thoroughly understand the embodiments of the present application. However, it should be clear to those skilled in the art that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits and methods are omitted to avoid unnecessary details that hinder the description of the present application.

[0046] In order to make the purpose, technical solutions and advantages of the present application clearer, the following will be described by specific embodiments in conjunction with the drawings.

[0047] Please refer to Figure 1 , Figure 1 The flowchart of the geological survey data management method provided by an embodiment of the present application is shown in the figure. The method specifically includes the following steps:

[0048] S101: Obtain geological survey data, and the geological survey data here is data of a preset time period, and the specific value of the preset time period is set by an operator, and data cleaning and data preprocessing are performed thereon to obtain corresponding preprocessed data, and the data cleaning and data preprocessing include deduplication, missing value processing and abnormal value processing. The specific cleaning and preprocessing process is prior art, and will not be described in detail here.

[0049] S102: Divide the obtained preprocessed data into classification data, and here the preprocessed data is divided according to the data type to obtain spatial data (containing topographic and geomorphic maps, geological profile maps, spatial positions of drill holes, ore body distribution, and other data with geographic spatial coordinate information, common formats such as CAD drawings, GIS vector data (.shp), etc., for example, in a mountainous road construction geological survey project, the three-dimensional coordinates of each drill hole collected by the total station, and the high-precision topographic contour map generated by unmanned aerial vehicle survey all belong to spatial data), attribute data (used to describe the physical and chemical properties of geological objects, mainly including lithology, mineral composition, water content, mechanical parameters, etc., and is mainly stored in the form of Excel tables and database fields, for example, after laboratory analysis of collected rock samples, the obtained rock compressive strength, porosity, and other test data constitute attribute data), document data (covering survey reports, original records, experimental reports, project files, and other types of text materials, common formats are PDF and Word documents, such as the “XX Regional Geological Survey Comprehensive Report” prepared by the project team, and the scanned copy of the handwritten field investigation notebook, all belong to the category of document data), and multimedia data (including field photos, videos, remote sensing images, three-dimensional models, and other data, formats such as JPG, MP4, BIM files, etc. For example, the construction site geological outcrop video taken by a high-definition camera, and the underground ore body visualization model constructed by three-dimensional modeling software, all belong to multimedia data), and the obtained classification data is standardized and a corresponding database is established, and the database here is a relational database, which is specifically processed according to the relationship of “project-work area-data type”, and the specific geological survey project is taken as the top-level directory, each project corresponds to an independent database instance or database architecture. For example, “XX City Subway Line Geological Survey Project” as a project level, creates a dedicated project database in the database, divides different work areas according to the actual survey area of the project, and each work area is taken as a subdirectory under the project. For example, the subway project can be divided into A, B, C, and other work areas according to different line sections, and under each work area, the spatial data, attribute data, document data, and multimedia data are further subdivided into four subcategories, and corresponding data tables or file storage paths are established. For example, under the attribute data category of A work area, rock mechanical parameter table and soil water content table are created, and then the data quality of the database is controlled and analyzed, specifically by cross-validation (for the same geological parameter, different test methods are used to obtain data and compared. For example, when measuring the density of rocks in a certain area, laboratory measurement and geophysical logging method are used at the same time, if the data deviation obtained by the two methods exceeds the set threshold (such as 5%), the data is re-detected, the reason is analyzed, and the wrong data is removed), statistical analysis (abnormal values in the data are detected by statistical methods.Taking borehole depth data as an example, box plots are used to analyze the data distribution. If a borehole depth value significantly deviates from the overall data range, exceeding 1.5 times the interquartile range, it is identified as an outlier and its accuracy is further verified. If an error is confirmed, it is removed. Other methods are used to remove erroneous data. Different permissions are set for different types of data, and corresponding viewing permissions are assigned based on the personnel's level.

[0050] For example, the core permissions of a super administrator are: system-wide configuration, role creation, and full access to and deletion of data, corresponding to all project data. The core permissions of a project administrator are: project member management, data upload / download approval, and subset data sharing configuration, corresponding to all data in the project. The core permissions of a regular user are: querying and downloading data within the authorized scope, and submitting data usage applications, corresponding to data related to personal responsibilities. The core permissions of an external user are: read-only access and limited data download (requiring approval), corresponding to the anonymized shared dataset. The core permissions of a public user are: browsing public report summaries and basic geological maps (such as regional geological overviews), corresponding to publicly available non-confidential data.

[0051] S103: Perform storage analysis on the obtained different databases, obtain all distributed storage nodes, and label them as n1 to n... m Where m represents the number of distributed storage nodes. Taking a large-scale mineral exploration project as an example, its distributed storage system contains 4 nodes (m=4), numbered from n1 to n4. Obtain the data type and corresponding quantity stored in each node. Assume that the data type and quantity of node n1 are: 200 spatial data, 350 attribute data, 100 document data, and 50 multimedia data.

[0052] Simultaneously, the storage data types corresponding to the distributed storage nodes are obtained, and the quantity of each storage data type is acquired and sorted from largest to smallest. The data type with the largest quantity is then selected as the standard storage type. This same process is repeated for all distributed storage nodes to determine their standard storage types. Specifically, if multiple distributed storage nodes have the same maximum type, the one with the largest quantity is used as the standard. For the remaining distributed storage nodes, the standard storage type is determined based on the data type with the largest quantity among the remaining data types. For example, if nodes n2 and n1 both have the largest quantity of attribute data, but n2 has a larger total data volume, then n2's attribute data is used as a reference. For the remaining nodes, the standard is preferentially selected based on the data type with the largest quantity among the remaining data types. Ultimately, the standard storage types for the four nodes are determined as follows: n1 for space, n2 for attribute data, n3 for document data, and n4 for multimedia data.

[0053] Meanwhile, other types of data corresponding to the distributed storage nodes are transferred, and the transfer standard is determined according to the data requirements and the use frequency of the data type, and the specific determination method is as follows:

[0054] Other data types are obtained, and the corresponding data requirements are obtained. The data requirements here specifically represent the corresponding data delay requirements, and are used as a standard to screen the distributed storage nodes to obtain pre-selected storage nodes. Then, the use frequency of other data types is calculated, and the use frequency here represents the ratio of the number of uses to the time length within time t. At the same time, the data read frequency of the pre-selected storage nodes is calculated, and the use frequency is matched with it. The numerical difference between the two is calculated, and the pre-selected storage node with the smallest numerical difference is used as a standard to store other data types, and transfer storage information is generated;

[0055] Then, the data type corresponding to the database is obtained, and the data type here is determined according to the data type in "project-work area-data type", and the database is matched with the corresponding distributed storage node for storage to generate data storage information.

[0056] For example, if a non-standard data type requires a data delay of no more than 100 ms, and nodes n1, n3, and n4 meet the condition, then they are used as pre-selected storage nodes. A non-standard data type is used 12 times within 1 hour, so the use frequency is 12 times / hour. The read frequency of nodes n1, n3, and n4 is 10 times / hour, 15 times / hour, and 8 times / hour, respectively. The numerical difference between the use frequency and the read frequency is calculated. The difference of n1 is 2, the difference of n3 is 3, and the difference of n4 is 4. The n1 node with the smallest difference is selected as the target storage node, and the data type is transferred to it to generate transfer storage information.

[0057] S104: Based on the obtained data storage information, the data sharing between users is analyzed, the user operation information in the data sharing process is obtained, and the user operation information specifically includes the number of queries and download information within time T, and the download frequency of the user is calculated. At the same time, the download frequency is compared with the threshold value. If the download frequency is greater than the threshold value, it indicates that the user operation is abnormal, and a download abnormal signal is generated. Conversely, if the download frequency is less than the threshold value, it indicates that the user operation is normal, and a download normal signal is generated.

[0058] For example, user A queries the geological survey report 5 times during 8:00-18:00 on a working day, and downloads 3 drill hole data files (total size 50MB), and the download frequency = number of downloaded files in time T / T. Taking user A as an example, if T=10 hours, and he downloads 3 times, then the download frequency is 3 times / 10 hours=0.3 times / hour, and the preset download frequency threshold (such as 0.5 times / hour) is less than 0.5 times / hour, so a normal download signal is generated.

[0059] For the generated download abnormal signal, further obtain the corresponding download information, and generate corresponding operation warning information, and simultaneously perform sharing encryption processing;

[0060] For the generated download normal signal, the user operation information is continuously monitored.

[0061] S105: The download information is shared and encrypted, the real-time download information is obtained, and the data content is converted into binary, and the binary numbers generated are divided equally to obtain binary equal segments, and here the number of binary numbers is divided equally, and for the case of odd number, binary supplement is performed, and the supplemented binary number is 1, and the specific supplement is in the last position, and the whole is divided equally, then the obtained binary equal segments are processed in reverse order to generate reverse equal segments, and the reverse equal segments are encrypted as a whole, and the specific encryption processing method is as follows:

[0062] Two groups of reverse equal segments are obtained, then the binary numbers corresponding to the even positions are obtained, and they are combined in order to obtain a combined binary sequence, and the combined binary sequence and the corresponding reverse equal segments are recombined to generate a recombined sequence, and the corresponding encrypted information is generated.

[0063] Real-time capture user download behavior, record file name, size, type and data content information. For example, the user downloads “XX mine area geological profile”, the file size is 1024KB, and the data content includes graphic coordinates, lithology annotation and other text information, and the download data content is converted into binary format. Assuming that the original text data is “drill hole depth 120 meters”, the binary sequence obtained after ASCII encoding conversion is: 011011110111011101100011011010110010000000110001001100100011000000101110, and the total number of binary numbers is divided equally. If the total number is even, it is divided into two segments; if it is odd, 1 is supplemented at the end of the sequence to make it even before segmentation;

[0064] For example, the "rock stratum inclination 30°" is converted to 0111011101100001011100100110001100100000001100110011000000101110. Calculate the total number of bits N. If N is even, directly divide it into two segments S1 and S2 (each with a length of N / 2). If N is odd, append a binary 1 at the end of the data to make the total number of bits N+1, and then divide it.

[0065] Original data (15 bits): 01101010011101010

[0066] After supplementing (16 bits): 011010100111010101

[0067] Division result:

[0068] S1: 011010100;

[0069] S2: 111010101;

[0070] If the length of a segment of data is less than 8 bits, it needs to be supplemented with zeros on the left side to 8 bits to ensure the consistency of subsequent encryption operations.

[0071] Reverse the bits of S1 and S2, for example:

[0072] Original S1: 011010100 → reversed: 001010110;

[0073] Extract the even bits (2nd, 4th, 6th... from left to right) of the reversed S1 and S2 respectively.

[0074] Concatenate them in order to form a combined sequence C.

[0075] S1 reversed: 001010110 → even bit extraction: 011010;

[0076] S2 reversed: 101010111 → even bit extraction: 000111;

[0077] Combined sequence C: 011010000111;

[0078] Insert C between the reversed segments S1 and S2 in order.

[0079] If there is a remaining segment, insert it in a loop until all combinations are completed.

[0080] Original recombination: 001010110011010000111101010111;

[0081] Format adjustment: 00101011001101000001111010101011.

[0082] The geological exploration data management method corresponding to the above embodiment, Figure 2 The structural block diagram of the geological exploration data management system provided for an embodiment of the present application is shown. For ease of illustration, only parts related to the embodiments of the present application are shown. For reference Figure 2 The geological exploration data management system includes a data acquisition unit, a data classification processing unit, a data storage analysis unit, a data sharing analysis unit, and a management information output unit, and the functional units are unidirectionally electrically connected.

[0083] The data acquisition unit is used to acquire geological exploration data within a preset time period and transmit it to the data classification processing unit;

[0084] The data classification processing unit is used to perform data cleaning and preprocessing on the acquired geological exploration data to obtain preprocessed data, divide the data based on data types to obtain classified data, and perform standardization processing to establish a corresponding database, and then transmit it to the data storage analysis unit. The specific processing method is the same as the processing process of step S102 above;

[0085] The data storage analysis unit is used to store and analyze the acquired database, analyze the storage data types corresponding to different distributed storage nodes, and take the maximum number of storage data types as the standard storage type, while transferring the remaining other data types. The transfer position is determined by analyzing the usage frequency of other data types, generating transfer storage information, and selecting the corresponding distributed storage node according to the data type of the database, generating data storage information, and transmitting it to the data sharing analysis unit and the management information output unit. The specific processing method is the same as the processing process of step S103 above;

[0086] The data sharing analysis unit is used to analyze the download frequency corresponding to user operations based on the obtained data storage information, generate a download normal or abnormal signal, determine the download information generation operation warning information for the download abnormal signal, and perform sharing encryption processing. The specific processing method is the same as the processing process of step S104 above;

[0087] The download information is shared and encrypted, converted to binary, and divided into binary segments according to the binary number, and the overall reverse sequence is obtained by reversing the entire sequence. The binary number corresponding to the even bit is extracted, and the original reverse segment is reorganized to obtain a reorganized sequence, generate encrypted information, and transmit it to the management information output unit. The specific processing method is the same as the processing process of step S105 above;

[0088] The management information output unit is used to display operation warning information to the corresponding management personnel, and at the same time, encrypt the downloaded information based on the obtained encryption information.

[0089] See Figure 3 , Figure 3 This is a schematic block diagram of an electronic device provided according to an embodiment of this application. Figure 3 The electronic device 300 in this embodiment may include one or more processors 301, one or more input devices 302, one or more output devices 303, and one or more memories 304. The processors 301, input devices 302, output devices 303, and memories 304 communicate with each other via a communication bus 305. The memories 304 store computer programs, including program instructions. The processors 301 execute the program instructions stored in the memories 304. The processors 301 are configured to invoke the program instructions to perform the functions of each module / unit in the above system embodiments.

[0090] It should be understood that, in the embodiments of this application, the processor 301 may be a central processing unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0091] Input device 302 may include a touchpad, a fingerprint sensor (for collecting the user's fingerprint information and fingerprint orientation information), a microphone, etc., and output device 303 may include a display (LCD, etc.), a speaker, etc.

[0092] The memory 304 may include read-only memory and random access memory, and provides instructions and data to the processor 301. A portion of the memory 304 may also include non-volatile random access memory. For example, the memory 304 may also store device type information.

[0093] In specific implementation, the processor 301, the input device 302 and the output device 303 described in the embodiments of the present application can execute the implementation manners described in the first embodiment and the second embodiment of the geological survey data management method provided by the embodiments of the present application, and can also execute the implementation manners of the electronic device described in the embodiments of the present application, which will not be described here.

[0094] In another embodiment of the present application, a computer readable storage medium is provided, which stores a computer program. The computer program includes program instructions, which are executed by a processor to implement all or part of the processes of the above-mentioned embodiments. The computer program can also be used to instruct related hardware to complete the processes. The computer program can be stored in a computer readable storage medium. When the computer program is executed by the processor, the steps of the above-mentioned method embodiments can be implemented. The computer program includes computer program code, which can be in the form of source code, object code, executable file or some intermediate form. The computer readable medium can include any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc.

[0095] The computer readable storage medium can be an internal storage unit of the electronic device, such as a hard disk or a memory of the electronic device. The computer readable storage medium can also be an external storage device of the electronic device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. Further, the computer readable storage medium can include both the internal storage unit and the external storage device of the electronic device. The computer readable storage medium is used to store the computer program and other programs and data required by the electronic device. The computer readable storage medium can also be used to temporarily store data that has been output or will be output.

[0096] Those skilled in the art can clearly understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware, computer software or a combination of both. In order to clearly illustrate the interchangeability of hardware and software, the components and steps of each example have been described in general terms in the above description. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0097] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the electronic device and the unit described above can refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

[0098] In several embodiments provided in the present application, it should be understood that the disclosed electronic device and method can be implemented in other ways. For example, the device embodiments described above are only schematic, and the division of units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces or units, and can also be electrical, mechanical or other forms of connection.

[0099] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0100] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or software functional unit.

[0101] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method of managing geological survey data, characterized by, The method comprises the following steps: Step S101, collecting geological survey data in a preset time period, and performing data cleaning and preprocessing to obtain preprocessed data; Step S102, dividing the preprocessed data based on data types to obtain classified data, and performing standardization processing to establish a corresponding database; Step S103, performing storage analysis on the database, determining the standard storage type of the distributed storage node with the maximum number of storage data types, and determining the transfer position according to the use frequency of other data types, generating transfer storage information, selecting the corresponding distributed storage node according to the data type of the database, and generating data storage information, and the specific processing mode is: According to the data delay requirement of other data types, the distributed storage node meeting the condition is screened, the data type use frequency and the data reading frequency of the pre-screening node are calculated respectively, the frequency difference of the two is compared, the pre-screening node with the smallest difference value is selected to store data, and transfer storage information is generated; Step S104, performing data sharing analysis on the obtained data storage information, analyzing the download frequency corresponding to the user operation, generating a download normal signal or an abnormal signal, determining the corresponding download information for the download abnormal signal, generating operation warning information, and performing sharing encryption processing; Step S105, performing sharing encryption processing on the download information, first converting it into binary, dividing it equally and reversing it, extracting the even binary numbers and recombining them with the reversed segments to generate encrypted information, and the specific processing mode is: Obtain real-time download information, convert the data content into binary, if the number of binary numbers is odd, add 1 at the end, divide it into two segments, reverse the two segments of binary data respectively, obtain the reversed and divided segments, extract the even binary numbers of the two groups of reversed and divided segments, combine them into a new sequence, and recombine the new sequence with the original reversed and divided segments to generate encrypted information.

2. The geological survey data management method of claim 1, wherein, The specific way of step S102 for establishing a corresponding database after standardization processing is: Obtain preprocessed data and corresponding data types, divide the classified data according to the data types, perform standardization processing on the classified data, and then perform corresponding processing on the preprocessed data according to the relationship of "project-work area-data type" to generate a database; Cross-validation is used to remove error data in the database, and different viewing permissions are set.

3. The geophysical survey data management method of claim 1, wherein, The specific way of step S103 for performing storage analysis on the database is: Get all the distributed storage nodes n1 to n m And the corresponding storage data types, where m represents the number of distributed storage nodes, and different storage data types are sorted in descending order of quantity. Select the data type with the largest number as the standard storage type, and similarly process all distributed storage nodes to determine the corresponding standard storage type of the distributed storage node.

4. The geophysical survey data management method of claim 1, wherein, The specific way of step S104 for performing data sharing analysis on the obtained data storage information is: Obtain user operation information in the data sharing process, calculate the download frequency of user operation, and compare it with the threshold value, if the download frequency is greater than the threshold value, generate a download abnormal signal, otherwise if the download frequency is less than the threshold value, generate a download normal signal, and analyze them respectively.

5. The geophysical survey data management method of claim 4, wherein, The specific way of analyzing them respectively is: Further, the corresponding download information is acquired according to the generated download abnormal signal, and the corresponding operation warning information is generated and shared and encrypted; For the generated download normal signal, the user operation information is continuously monitored.

6. A geological survey data management system for carrying out the geological survey data management method according to any one of claims 1 to 5, characterized by, Comprise: Data acquisition unit, data classification processing unit, data storage analysis unit, data sharing analysis unit and management information output unit; The data acquisition unit is used for collecting geological survey data in a preset time period and transmitting it to the data classification processing unit; The data classification processing unit is used for data cleaning and preprocessing of the obtained geological survey data to obtain pretreatment data, and classifies the data based on data type to obtain classified data, and establishes a corresponding database after standardization processing, and then transmits it to the data storage analysis unit; The data storage analysis unit is used for storing and analyzing the obtained database, analyzing the storage data types corresponding to different distributed storage nodes, taking the maximum number of storage data types as the standard storage type, and transferring the remaining other data types, determining the transfer position by analyzing the use frequency of other data types, generating transfer storage information, and selecting the corresponding distributed storage node according to the data type of the database, generating data storage information, and transmitting it to the data sharing analysis unit; The data sharing analysis unit is used for data sharing analysis of the obtained data storage information, analyzing the download frequency corresponding to the user operation, generating a download normal signal or an abnormal signal, determining the corresponding download information according to the download abnormal signal, generating operation warning information, and sharing and encrypting; The download information is shared and encrypted, which is binary converted and evenly divided according to the binary number to obtain binary evenly divided segments, and the whole is reversed to obtain reversed evenly divided segments, the binary number of the corresponding even bit is extracted, and the original reversed evenly divided segments are reorganized to obtain a reorganized sequence, and the encryption information is generated and transmitted to the management information output unit; The management information output unit is used for displaying the operation warning information to the corresponding management personnel.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, The processor executes the computer program to realize the steps of the method of any one of claims 1 to 5.

8. A computer-readable storage medium storing a computer program, the computer program comprising instructions that, when executed by a computer, cause the computer to perform the method of any one of claims 1 to 7. The computer program is executed by the processor to realize the steps of the method of any one of claims 1 to 5.

Images