Government affair data operation and maintenance intelligent management method

Abstract

The invention relates to the technical field of data management, in particular to a government affair data operation and maintenance intelligent management method, which comprises the following steps of: 1, determining a space boundary value based on the data processing speed of each storage node value, and setting a space state for a data storage space; 2, setting a data label for the collected government affair data, storing the data according to the data label, detecting the space state of the data storage space at the moment, and generating a space management signal; 3, based on the space management signal, acquiring and analyzing a data use record of the historical storage data, and determining an inertia use period and a data use value; and 4, calculating a data evaluation value of the historical storage data according to the inertial use cycle and the data use value, determining expired data according to the data evaluation value, and performing operation and maintenance management on the expired data, thereby optimizing the utilization resources of the government affair data storage space, further reducing the load of the storage equipment, and saving the energy cost.

Description

Technical Field

[0001] The present invention relates to the field of data management technology, and in particular to an intelligent management method for government data operation and maintenance. Background Art

[0002] Government data is a general term for information, situations, materials, data, charts, text materials, and audio-visual materials that reflect government work and related matters in government activities. It is managed by government data management departments such as the Bureau of Government Information and Statistics.

[0003] Prior art CN118796647A discloses a government affairs system operation and maintenance method and system based on multi-source data fusion, which obtains the current performance data, current application data, and current security data of each government affairs server in the government affairs system, and performs comprehensive analysis to obtain the current system performance evaluation index, current application performance evaluation index, and current security evaluation index of each government affairs server; then, the data are compared and analyzed with the preset corresponding evaluation thresholds, and operation and maintenance measures are taken according to the comparison and analysis results;

[0004] However, when government data is collected, many information sources are involved. When the government data is operated and managed, the collected information will contain a large amount of data, which in turn increases the data storage space. When the data storage space is occupied in large quantities, the performance of the storage system will decline. At this time, the response time of government data may be extended from a few seconds to several minutes, seriously affecting the efficiency of government services. Summary of the invention

[0005] The purpose of the present invention is to solve the problems in the background technology and to propose an intelligent management method for government data operation and maintenance.

[0006] The present invention adopts the following technical solution: a method for intelligent management of government data operation and maintenance, which specifically includes the following steps:

[0007] Step 1: According to the basic information of the data storage space, retrieve the relevant equipment and obtain the usage information of the relevant equipment. First, set the storage node value, and according to the storage node value, obtain the data processing speed of the relevant equipment at each storage node value in the usage information, and calculate the speed characteristic value of each storage node value. Then, based on the storage node value and the speed characteristic value, obtain the speed change curve and the change function, calculate the change function, and obtain the processing rate value. According to the processing rate value, determine the space boundary value, and set the space state for the data storage space according to the space boundary value. The space state includes free space and control space.

[0008] Step 2: Set data tags for the collected government data and store them according to the data tags. When storing the government data, detect the spatial state of the data storage space at this time and generate a spatial management signal accordingly.

[0009] Step 3: When a space management signal is detected, historical storage data is obtained, target analysis data is set according to the data tag, the collection time and data usage record of the target analysis data are obtained, the last use time is obtained in the data usage record, and the inertial use cycle is determined based on the last use time and the collection time, and then within the inertial use cycle, the data usage value of the target analysis data is determined according to the total number of times the target analysis data is used;

[0010] Step 4: The actual usage times and time intervals of the historical storage data are then collected, and the data evaluation value of the historical storage data is calculated based on the data usage value and inertial usage cycle under the corresponding data tag. The expired data and valid data are then determined based on the data evaluation value, and operation and maintenance management is performed on the expired data. The operation and maintenance management methods include data deletion, data archiving, and data compression.

[0011] As a further solution of the present invention, a method for obtaining a speed change curve and a change function includes:

[0012] S1: Based on the device model of the data storage space, relevant devices are retrieved on the big data network, and usage information of the relevant devices is obtained. The usage information includes the data processing speed of the data storage space under different data storage capacities;

[0013] S2: Set an equidistant value d for the data storage capacity, and start from the initial capacity, and use the formula n=CS+d×a to obtain the storage node value n in sequence according to the equidistant value, where CS is the initial capacity and a=1, 2, ...;

[0014] S3: According to the storage node value, obtain the data processing speed V of the relevant device i-n , where i represents the device number of the relevant device, V i-n Indicates the data processing speed of the relevant device i corresponding to the storage node value n;

[0015] Calculate the velocity characteristic value VTn at each storage node value n, I is the total number of related devices obtained after retrieval. Further, i∈[1,I];

[0016] S4: taking the storage node value n as the abscissa and the speed characteristic value VTn as the ordinate, setting a plane coordinate system, and plotting the speed characteristic value corresponding to each storage node value in the plane coordinate system to obtain several point coordinates;

[0017] Then the storage node value is set as the independent variable factor, the speed characteristic value is set as the dependent variable factor, and the point coordinates are fitted into a linear curve according to the point coordinates in the plane coordinate system and marked as the speed change curve, and the change function VTn=f(n) of the speed change curve is obtained at the same time.

[0018] As a further solution of the present invention, a method for setting a space state of a data storage space includes:

[0019] S5: Perform a derivative operation on the change function to obtain a processing rate value k, k=f'(n). When the absolute value of the processing rate value k is larger, it means that the slope of the speed change curve at this position is larger, that is, the change speed is larger;

[0020] According to the rate threshold, take the storage node value at the corresponding position when the absolute value of the processing speed threshold k is equal to the rate threshold, and mark this storage node value as the space boundary value;

[0021] S6: According to the space demarcation value, the data storage space with a data storage amount less than the space demarcation value is marked as free space, and the data storage space with a data storage amount greater than or equal to the space demarcation value is marked as controlled space.

[0022] As a further solution of the present invention, a method for generating a spatial management signal includes:

[0023] The collected government data is preprocessed and stored in the data storage space. When storing the government data, the spatial state of the data storage space is determined. If the spatial state is free space, the government data is directly stored in the data storage space. If the spatial state is a controlled space, a space management signal is generated.

[0024] As a further solution of the present invention, the data preprocessing method includes data cleaning and data integration. Data cleaning refers to identifying abnormal data of government data collected in real time and processing it accordingly. The abnormal data includes missing data, abnormal data and repeated data. Data integration refers to identifying corresponding data tags of government data collected from different information sources and merging and storing them according to the data tags.

[0025] Data labeling refers to marking government data according to its data source, and data source refers to the source from which government data is obtained.

[0026] As a further solution of the present invention, a method for obtaining the inertial usage cycle and the data usage value includes:

[0027] SS1: Mark the government data stored in the data storage space as historical storage data, select a data label at random, obtain the historical storage data corresponding to the data label, and mark it as target analysis data, arrange the target analysis data in chronological order, and obtain a position sequence;

[0028] Obtain the data update time and data usage record of the target analysis data, where the data update time refers to the collection time of the target analysis data, and the data usage record refers to the record of the target analysis data being used;

[0029] In the data usage record, the last usage time of the target analysis data is identified, and the collection time of the target analysis data is obtained at the same time. The collection time is subtracted from the last usage time to obtain the usage interval time, and then the usage interval time of multiple target analysis data is obtained. The usage interval time of the multiple target analysis data is averaged, and the obtained result is marked as the inertial usage cycle of the target analysis data;

[0030] SS2: Determine the data usage value of the target analysis data according to the inertial usage time, that is, obtain the total number of times each target analysis data is used during the inertial usage time, and then take the average of the total number of times all target analysis data are used, and mark it as the data usage value of the target analysis data.

[0031] As a further solution of the present invention, when identifying the last use time of the target analysis data, it is necessary to first determine the use interval time of the target analysis data according to the data use record. When there is a target analysis data m1 that is used at time t1 and is not used within the next consecutive b1 use intervals, then time t1 is used as the last use time of the target analysis data m1, where b1 is a threshold value;

[0032] When obtaining the total number of times target analysis data is used, only the target analysis data containing the last use time is counted.

[0033] As a further solution of the present invention, a method for determining expired data and valid data includes:

[0034] ST1: Evaluate the historical storage data and determine the data evaluation value PL. The specific evaluation methods include:

[0035] Select any data from the historical storage data and mark it as the analysis object data, identify the data label of the analysis object data, and determine the data usage value SY and the inertial usage period Tz based on the data label;

[0036] Using the formula The data evaluation value PL is obtained, where Ds represents the actual number of times the analysis object data is used, Dt represents the time interval between the collection time of the analysis object data and the current time, that is, Dt is equal to the current time minus the collection time of the analysis object data, u is a fixed coefficient, and 0<u<1, r1, r2 and r3 are all proportional coefficients;

[0037] ST2: Obtain the data evaluation value PL of all historical storage data, and compare the data evaluation value PL with the evaluation threshold Py. If PL < Py, the corresponding historical storage data is marked as expired data. Otherwise, if PL ≥ Py, the corresponding historical storage data is marked as valid data.

[0038] ST3: Obtain expired data and perform operation and maintenance management on expired data. Specific operation and maintenance management methods include data deletion, data archiving, and data compression.

[0039] During operation, the present invention detects the data processing speed of the data storage space of the government data to determine the free space and the control space. When in the free space, the collected government data is directly stored. When in the control space, the data usage record of the historical storage data is obtained to determine the data usage value and the inertial usage cycle of the government data, and the data evaluation value of the historical storage data is calculated. Then, expired data is determined according to the data evaluation value, and operation and maintenance management is performed on the expired data, thereby optimizing the utilization resources of the government data storage space, further reducing the load of the storage device, and saving energy costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 It is a schematic diagram of the method flow structure of the present invention. DETAILED DESCRIPTION

[0041] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments.

[0042] Reference Figure 1 , a method for intelligent management of government data operation and maintenance, the method specifically comprising the following steps:

[0043] Step 1: Collect basic information of the data storage space and set the space status for the data storage space, where the space status includes free space and control space. The data storage space in this embodiment refers to the device for storing government data. The basic information includes the device model and overall storage space of the storage device. The specific method for dividing the data storage space includes:

[0044] S1: Based on the device model of the data storage space, relevant devices are retrieved on the big data network, and usage information of the relevant devices is obtained, wherein the usage information includes the data processing speed of the data storage space under different data storage capacities, for example, when the data storage capacity in the data storage space is 5%, the data processing speed in the data storage space is 200MB / s, and when the data storage capacity in the data storage space is 85%, the data processing speed in the data storage space is 95MB / s;

[0045] S2: Set an equal distance value d for the data storage capacity, and start from the initial capacity, and use the formula n=CS+d×a to obtain the storage node value n in sequence according to the equal distance value, where CS is the initial capacity, a=1, 2, ..., in this embodiment, the initial capacity is set to 0, and the equal distance value d is set to 5;

[0046] S3: According to the storage node value, obtain the data processing speed V of the relevant device i-n , where i represents the device number of the relevant device, V i-n Indicates the data processing speed of the relevant device i corresponding to the storage node value n;

[0047] Then calculate the velocity characteristic value VTn at each storage node value n. Specifically, I is the total number of related devices obtained after retrieval. Further, i∈[1,I];

[0048] S4: taking the storage node value n as the abscissa and the speed characteristic value VTn as the ordinate, setting a plane coordinate system, and plotting the speed characteristic value corresponding to each storage node value in the plane coordinate system to obtain several point coordinates;

[0049] Then, the storage node value is set as the independent variable factor, the speed characteristic value is set as the dependent variable factor, and the point coordinates are fitted into a linear curve according to the point coordinates in the plane coordinate system, and marked as the speed change curve, and the change function of the speed change curve VTn=f(n) is obtained at the same time;

[0050] Among them, the coordinates of several points are fitted into a linear function using the curve fitting toolbox in MATLAB for processing. The specific processing method is the existing technology and will not be described here;

[0051] S5: performing a derivative operation on the change function to obtain a processing rate value k, specifically, k=f'(n). When the absolute value of the processing rate value k is larger, it means that the slope of the speed change curve at this position is larger, that is, the change speed is larger;

[0052] Then, according to the rate threshold, the storage node value at the corresponding position when the absolute value of the processing speed threshold k is equal to the rate threshold is taken, and this storage node value is marked as the space boundary value;

[0053] The specific value of the rate threshold is obtained by technicians in this field after big data calculation;

[0054] S6: Then, according to the space demarcation value, the data storage space whose data storage capacity is less than the space demarcation value is marked as free space, and the data storage space whose data storage capacity is greater than or equal to the space demarcation value is marked as controlled space;

[0055] For example, when the space boundary value is 80%, when the data storage capacity in the data storage space is [0%, 80%), the space status at this time is free space, and when the data storage capacity in the data storage space is [80%, 100%), the space status at this time is controlled space;

[0056] Step 2: After that, the collected government data is preprocessed and stored in the data storage space. At the same time, when storing the government data, the spatial state of the data storage space is determined. If the spatial state is free space, the government data is directly stored in the data storage space. If the spatial state is controlled space, a spatial management signal is generated at this time;

[0057] Among them, the data preprocessing method includes data cleaning and data integration. Data cleaning refers to identifying abnormal data of government data collected in real time and processing them accordingly. Abnormal data includes missing data, abnormal data and repeated data. The specific processing method is the existing technology and will not be described here. Data integration refers to identifying the corresponding data tags of government data collected from different information sources and merging and storing them according to the data tags.

[0058] Data labeling refers to labeling government data according to their data sources. Data sources refer to where government data is obtained, including service windows, online service platforms, on-site consultations, and social media platforms.

[0059] Step 3: When a space management signal is detected, the government data stored in the data storage space is inertially processed, the government data stored in the data storage space is marked as historical storage data, and then the historical storage data is inertially analyzed to determine the data usage value and inertial usage cycle of the historical storage data with different data tags;

[0060] The specific method for determining the data usage value and the inertial usage cycle includes:

[0061] SS1: Select a data tag at random, obtain the historical storage data corresponding to this data tag, mark it as the target analysis data, and arrange the target analysis data in chronological order to obtain a position sequence;

[0062] Obtain the data update time and data usage record of the target analysis data, where the data update time refers to the collection time of the target analysis data, and the data usage record refers to the record of the target analysis data being used;

[0063] In the data usage record, the last usage time of the target analysis data is identified, and the collection time of the target analysis data is obtained at the same time. The collection time is subtracted from the last usage time to obtain the usage interval time, and then the usage interval time of multiple target analysis data is obtained. The usage interval time of the multiple target analysis data is averaged, and the obtained result is marked as the inertial usage cycle of the target analysis data;

[0064] When identifying the last use time of the target analysis data, it is necessary to first determine the use interval of the target analysis data according to the data use record. When there is a target analysis data m1 that is used at time t1 and is not used within the next consecutive b1 use intervals, then time t1 is used as the last use time of the target analysis data m1, wherein b1 is a threshold value, and the specific value of b1 is obtained by technicians in this field after big data calculation;

[0065] SS2: Determine the data usage value of the target analysis data according to the inertial usage time, that is, obtain the total number of times each target analysis data is used during the inertial usage time, then take the average of the total number of times all target analysis data are used, and mark it as the data usage value of the target analysis data;

[0066] It should be further explained that when obtaining the total number of times the target analysis data is used, only the target analysis data containing the last time of use is counted;

[0067] The historical storage data under all different tags are used as target analysis data in turn, and are processed according to the methods in steps SS1 and SS2 above to obtain the data usage value and inertial usage cycle of the historical storage data of each tag;

[0068] Step 4: Perform operation and maintenance management on historical storage data based on the data usage values ​​and inertial usage cycles of different tags. Specific operation and maintenance management methods include:

[0069] ST1: Evaluate the historical storage data and determine the data evaluation value PL. The specific evaluation methods include:

[0070] Select any data from the historical storage data and mark it as the analysis object data, identify the data label of the analysis object data, and determine the data usage value SY and the inertial usage period Tz based on the data label;

[0071] Then use the formula The data evaluation value PL is obtained, wherein Ds represents the actual number of times the analysis object data is used, Dt represents the time interval between the collection time of the analysis object data and the current time, that is, Dt is equal to the current time minus the collection time of the analysis object data, u is a fixed coefficient, and 0<u<1, r1, r2 and r3 are all proportional coefficients, and the specific values ​​of u, r1, r2 and r3 are obtained by technicians in this field after big data calculation;

[0072] It should be further explained that, for the data evaluation value PL, the data evaluation value PL represents the data evaluation level. The lower the data evaluation value PL, the lower the importance level of the corresponding historical storage data at the current time. Conversely, the higher the data evaluation value PL, the higher the importance level of the corresponding historical storage data at the current time.

[0073] ST2: Obtain the data evaluation value PL of all historical storage data, and compare the data evaluation value PL with the evaluation threshold Py. If PL < Py, the corresponding historical storage data is marked as expired data. Otherwise, if PL ≥ Py, the corresponding historical storage data is marked as valid data.

[0074] The specific value of the evaluation threshold value Py is obtained by those skilled in the art after big data calculation;

[0075] ST3: After that, the expired data is obtained and operation and maintenance management is performed on the expired data. Specific operation and maintenance management methods include data deletion, data archiving, and data compression, thereby optimizing the utilization of government data storage space resources, further reducing the load on storage devices, and saving energy costs.

[0076] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A method for intelligent management of government data operation and maintenance, characterized in that: The method specifically comprises the following steps: Step 1: According to the basic information of the data storage space, retrieve the relevant equipment and obtain the usage information of the relevant equipment. First, set the storage node value, and according to the storage node value, obtain the data processing speed of the relevant equipment at each storage node value in the usage information, and calculate the speed characteristic value of each storage node value. Then, based on the storage node value and the speed characteristic value, obtain the speed change curve and the change function, calculate the change function, and obtain the processing rate value. According to the processing rate value, determine the space boundary value, and set the space state for the data storage space according to the space boundary value. The space state includes free space and control space. Step 2: Set data tags for the collected government data and store them according to the data tags. When storing the government data, detect the spatial state of the data storage space at this time and generate a spatial management signal accordingly. Step 3: When a space management signal is detected, historical storage data is obtained, target analysis data is set according to the data tag, the collection time and data usage record of the target analysis data are obtained, the last use time is obtained in the data usage record, and the inertial use cycle is determined based on the last use time and the collection time, and then within the inertial use cycle, the data usage value of the target analysis data is determined according to the total number of times the target analysis data is used; Step 4: The actual usage times and time intervals of the historical storage data are then collected, and the data evaluation value of the historical storage data is calculated based on the data usage value and inertial usage cycle under the corresponding data tag. The expired data and valid data are then determined based on the data evaluation value, and operation and maintenance management is performed on the expired data. The operation and maintenance management methods include data deletion, data archiving, and data compression.

2. According to claim 1, a method for intelligent management of government data operation and maintenance is characterized in that: The methods for obtaining the speed change curve and the change function include: S1: Based on the device model of the data storage space, relevant devices are retrieved on the big data network, and usage information of the relevant devices is obtained. The usage information includes the data processing speed of the data storage space under different data storage capacities; S2: Set an equidistant value d for the data storage capacity, and start from the initial capacity, and use the formula n=CS+d×a to obtain the storage node value n in sequence according to the equidistant value, where CS is the initial capacity and a=1, 2, ...; S3: According to the storage node value, obtain the data processing speed V of the relevant device i-n , where i represents the device number of the relevant device, V i-n Indicates the data processing speed of the relevant device i corresponding to the storage node value n; Calculate the velocity characteristic value VTn at each storage node value n, I is the total number of related devices obtained after retrieval. Further, i∈[1,I]; S4: taking the storage node value n as the abscissa and the speed characteristic value VTn as the ordinate, setting a plane coordinate system, and plotting the speed characteristic value corresponding to each storage node value in the plane coordinate system to obtain several point coordinates; Then the storage node value is set as the independent variable factor, the speed characteristic value is set as the dependent variable factor, and the point coordinates are fitted into a linear curve according to the point coordinates in the plane coordinate system and marked as the speed change curve, and the change function VTn=f(n) of the speed change curve is obtained at the same time.

3. According to claim 2, a method for intelligent management of government data operation and maintenance is characterized in that: Methods for setting the space status of a data storage space include: S5: Perform a derivative operation on the change function to obtain a processing rate value k, k=f'(n). When the absolute value of the processing rate value k is larger, it means that the slope of the speed change curve at this position is larger, that is, the change speed is larger; According to the rate threshold, take the storage node value at the corresponding position when the absolute value of the processing speed threshold k is equal to the rate threshold, and mark this storage node value as the space boundary value; S6: According to the space demarcation value, the data storage space with a data storage amount less than the space demarcation value is marked as free space, and the data storage space with a data storage amount greater than or equal to the space demarcation value is marked as controlled space.

4. According to claim 1, a method for intelligent management of government data operation and maintenance is characterized in that: The method for generating the space management signal includes: The collected government data is preprocessed and stored in the data storage space. When storing the government data, the spatial state of the data storage space is determined. If the spatial state is free space, the government data is directly stored in the data storage space. If the spatial state is a controlled space, a space management signal is generated.

5. According to claim 4, a method for intelligent management of government data operation and maintenance is characterized in that: Data preprocessing methods include data cleaning and data integration. Data cleaning refers to identifying abnormal data in real-time government data and processing it accordingly. Abnormal data includes missing data, abnormal data, and duplicate data. Data integration refers to identifying corresponding data labels for government data collected from different information sources and merging and storing them according to data labels. Data labeling refers to marking government data according to its data source, and data source refers to the source from which government data is obtained.

6. According to claim 1, a method for intelligent management of government data operation and maintenance is characterized in that: Methods for obtaining the inertial usage cycle and data usage value include: SS1: Mark the government data stored in the data storage space as historical storage data, select a data label at random, obtain the historical storage data corresponding to the data label, and mark it as target analysis data, arrange the target analysis data in chronological order, and obtain a position sequence; Obtain the data update time and data usage record of the target analysis data, where the data update time refers to the collection time of the target analysis data, and the data usage record refers to the record of the target analysis data being used; In the data usage record, the last usage time of the target analysis data is identified, and the collection time of the target analysis data is obtained at the same time. The collection time is subtracted from the last usage time to obtain the usage interval time, and then the usage interval time of multiple target analysis data is obtained. The usage interval time of the multiple target analysis data is averaged, and the obtained result is marked as the inertial usage cycle of the target analysis data; SS2: Determine the data usage value of the target analysis data according to the inertial usage time, that is, obtain the total number of times each target analysis data is used during the inertial usage time, and then take the average of the total number of times all target analysis data are used, and mark it as the data usage value of the target analysis data.

7. A method for intelligent management of government data operation and maintenance according to claim 6, characterized in that: When identifying the last usage time of the target analysis data, it is necessary to first determine the usage interval of the target analysis data based on the data usage record. When a target analysis data m1 is used at time t1 and is not used within the next b1 consecutive usage intervals, time t1 is used as the last usage time of the target analysis data m1, where b1 is the threshold value. When obtaining the total number of times target analysis data is used, only the target analysis data containing the last use time is counted.

8. The method for intelligent management of government data operation and maintenance according to claim 7, characterized in that: Methods for determining expired data and valid data include: ST1: Evaluate the historical storage data and determine the data evaluation value PL. The specific evaluation methods include: Select any data from the historical storage data and mark it as the analysis object data, identify the data label of the analysis object data, and determine the data usage value SY and the inertial usage period Tz based on the data label; Using the formula The data evaluation value PL is obtained, where Ds represents the actual number of times the analysis object data is used, Dt represents the time interval between the collection time of the analysis object data and the current time, that is, Dt is equal to the current time minus the collection time of the analysis object data, u is a fixed coefficient, and 0<u<1, r1, r2 and r3 are all proportional coefficients; ST2: Obtain the data evaluation value PL of all historical storage data, and compare the data evaluation value PL with the evaluation threshold Py. If PL < Py, the corresponding historical storage data is marked as expired data. Otherwise, if PL ≥ Py, the corresponding historical storage data is marked as valid data. ST3: Obtain expired data and perform operation and maintenance management on expired data. Specific operation and maintenance management methods include data deletion, data archiving, and data compression.

Images