Government and enterprise data governance system based on business data

Abstract

The invention relates to the technical field of data governance, and discloses a governance and enterprise data governance system based on business data, which is characterized in that work logs of all governance and enterprise data in a system database are inquired according to a data inquiry acquisition module, and the use condition of the data in the system is analyzed according to an inquiry result; according to an analysis result, part of data in the system is migrated to a network disk for backup, it is guaranteed that a system database has enough storage space for containing new data, when a new data source needs to be uploaded to the system database, the new data source is analyzed, uploading is conducted only when the safety of the data source is guaranteed, and the safety of the system database is guaranteed.

Description

Technical Field

[0001] The present invention relates to the field of data governance technology, and in particular to a government and enterprise data governance system based on business data. Background Art

[0002] Government and enterprise data refers to various types of data generated in the process of business dealings and cooperation between government agencies and enterprises. These data cover multiple fields such as government administration, business operations, market monitoring, and public services, including but not limited to administrative record data, enterprise production and operation data, and public service data. With the rapid development of information technology, government and enterprise agencies have accumulated a large amount of business data in their daily operations. However, these data are often scattered in different business systems, databases, and files, lacking unified management and governance.

[0003] The existing government and enterprise data governance system has the following problems: with the development of business, government and enterprise data are increased and updated in real time, but the storage of the system database is limited. If the data in the system database is not migrated regularly, the new data will not be stored in the system. Therefore, this application proposes a government and enterprise data governance system based on business data. Summary of the invention

[0004] The purpose of the present invention is to provide a government and enterprise data governance system based on business data to solve the above-mentioned technical problems.

[0005] The purpose of the present invention can be achieved by the following technical solutions: A government and enterprise data governance system based on business data, including a data query and acquisition module, a data analysis module, an internal governance module, an external governance module and an early warning module; The data query acquisition module is used to query the work log corresponding to the government and enterprise data; The data analysis module is used to analyze the work log of government and enterprise data according to the query results of the data query acquisition module; The internal governance module is used to migrate the internal data source of the system database according to the analysis results of the data analysis module; The external governance module is used to perform security management on the external data source according to the analysis results of the data analysis module.

[0006] As a further description of the solution of the present invention, the working process of the data analysis module includes:

[0007] The government and enterprise data sources in the system database are classified into n categories according to their contents. The classification numbers are: 1, 2, ..., i, ..., n, where i belongs to n;

[0008] Construct a data usage coefficient calculation model, the expression is: ,in, is the utilization coefficient of the i-th type of data, is the redundancy index of the i-th type of data, Contribution index for the i-th category of data, and are the corresponding weight coefficients respectively;

[0009] The calculation expression of the i-th type data redundancy index is: ,in, The time when the i-th type of data is uploaded to the system. The frequency used by the system.

[0010] As a further description of the solution of the present invention, the method for assigning the i-th type of data contribution index is:

[0011] The usage frequency of n types of data is counted. When the usage frequency of the i-th type of data ranks in the top one third of all data, then , when the usage frequency of the i-th type of data ranks in the middle third of all data, then , when the usage frequency of the i-th type of data ranks in the last third of all data, then .

[0012] As a further description of the solution of the present invention, the working process of the data analysis module also includes:

[0013] Get the total number of times the jth type of data is used , the number of times the j-th type of data is used in the current cycle and the number of changes in the use of the j-th type of data in the current cycle relative to the previous cycle ;

[0014] According to the obtained parameters, a data migration coefficient calculation model is constructed, and the expression is:

[0015] ;

[0016] In the formula, is the migration coefficient of the j-th type of data.

[0017] As a further description of the solution of the present invention, the working process of the internal governance module includes:

[0018] The data usage coefficients of n types of data are calculated in sequence through the data usage coefficient calculation model, and the data usage coefficients of the n types of data are sorted from small to large;

[0019] The top q ranked data are intercepted as the objects to be migrated, where q belongs to n and j belongs to q;

[0020] The migration coefficient of the j-th type of data With the migration coefficient threshold set By comparison, if the migration coefficient of the jth type of data is Less than the set migration coefficient threshold , then the j-th type of data needs to be migrated to the network disk. If the migration coefficient of the j-th type of data is Greater than or equal to the set migration coefficient threshold , then there is no need to migrate the jth type of data to the network disk for the time being.

[0021] As a further description of the solution of the present invention, the working process of the data analysis module also includes:

[0022] When an external data source Q needs to be uploaded to the system database, the source address A of the external data source to be updated to the system database is obtained;

[0023] According to the acquired source address A of the external data source Q to be updated to the system database, query the historical records of the source address A uploading the data source to the system database;

[0024] Get the total number of times source address A uploads data sources to the system database. For a period, obtain the number of times source address A uploads data sources to the system database in each period in the historical time period, and construct a time-varying curve of the number of times source address A uploads data sources to the system database in each period in the historical time period. ;

[0025] Construct the mathematical model of the safety factor of the external data source Q, the expression is:

[0026] ;

[0027] In the formula, , is the weight coefficient, is the initial period of the historical time period, The end cycle of the historical time period, For curve The first derivative of For curve The maximum value of the first-order derivative of For curve The minimum value of the first-order derivative of is the safety factor of the external data source Q.

[0028] As a further description of the solution of the present invention, the working process of the external governance module includes:

[0029] The safety factor of the external data source Q With the set safety factor threshold By comparison, if the safety factor of the external data source Q Less than the set safety factor threshold , it means that the security of the external data source Q is poor, and the external data source Q needs to be verified before it can be uploaded to the system database. If the security factor of the external data source Q is Greater than or equal to the set safety factor threshold , it means that the external data source Q has good security.

[0030] As a further description of the solution of the present invention, the working method of the governance system includes:

[0031] Step S1: Migrate the data source inside the system database periodically to ensure that when a new external data source is uploaded to the system database, the system database has enough space to receive it;

[0032] Step S2: When a new external data source is uploaded to the system database, a security assessment is performed on the uploaded external data source.

[0033] The beneficial effects of the present invention are as follows: 1. The present invention queries the work logs of all government and enterprise data in the system database according to the data query acquisition module, analyzes the usage of the data in the system according to the query results, and migrates part of the data inside the system to the network disk backup according to the analysis results, ensuring that the system database has enough storage space to accommodate new data. When a new data source needs to be uploaded to the system database, the new data source is analyzed to ensure the security of the data source before uploading it, thereby ensuring the security of the system database.

[0034] 2. The present invention first classifies the government and enterprise data sources within the system database into n categories of data according to content classification, and then queries the usage of each category of data through work logs, and then calculates the data redundancy index according to the time when the data is uploaded to the system and the frequency of use, and then assigns the data impact index according to the frequency of use of the data, and then calculates the data usage coefficient according to the data redundancy index and the impact index, and calculates the data usage coefficient of the n categories of data in turn, and sorts the data usage coefficients of the n categories of data from small to large, intercepts the top q data as the pre-migration objects, and then analyzes the top q data, calculates the data migration coefficient by a formula, and finally, compares the migration coefficient of the j-th category of data with the set migration coefficient threshold. If the migration coefficient of the j-th category of data is less than the set migration coefficient threshold, it is necessary to migrate the j-th category of data to the network disk. If the migration coefficient of the j-th category of data is greater than or equal to the set migration coefficient threshold, it is temporarily not necessary to migrate the j-th category of data to the network disk.

[0035] 3. The present invention provides a solution for verifying the security of an external data source. First, the source address A of the external data source Q is obtained. For a period, obtain the number of times source address A uploads the data source to the system database in each period of the historical time period, and construct a time-varying curve of the number of times source address A uploads the data source to the system database in each period of the historical time period. Calculate the safety factor of the external data source Q through the formula based on the obtained parameters, and convert the safety factor of the external data source Q into Compared with the set safety factor threshold, if the safety factor of the external data source Q is less than the set safety factor threshold, it means that the security of the external data source Q is poor, and the external data source Q needs to be verified before it can be uploaded to the system database. If the safety factor of the external data source Q is greater than or equal to the set safety factor threshold, it means that the security of the external data source Q is good. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The present invention will be further described below in conjunction with the accompanying drawings.

[0037] Figure 1 It is a structural diagram of the government and enterprise data governance system based on business data provided by the present invention. DETAILED DESCRIPTION

[0038] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0039] See also Figure 1 , the present invention is a government and enterprise data governance system based on business data, including a data query acquisition module, a data analysis module, an internal governance module, an external governance module and an early warning module; The data query acquisition module is used to query the work log corresponding to the government and enterprise data; The data analysis module is used to analyze the work log of government and enterprise data according to the query results of the data query acquisition module; The internal governance module is used to migrate the internal data source of the system database according to the analysis results of the data analysis module; The external governance module is used to perform security management on the external data source according to the analysis results of the data analysis module.

[0040] Through the above technical scheme, the present invention queries the work log of all government and enterprise data in the system database according to the data query acquisition module, analyzes the usage of the data in the system according to the query results, and migrates part of the data inside the system to the network disk backup according to the analysis results, ensuring that the system database has sufficient storage space to accommodate new data. When a new data source needs to be uploaded to the system database, the new data source is analyzed to ensure the security of the data source before uploading it, thereby ensuring the security of the system database.

[0041] As a further description of the solution of the present invention, the working process of the data analysis module includes:

[0042] The government and enterprise data sources in the system database are classified into n categories according to their contents. The classification numbers are: 1, 2, ..., i, ..., n, where i belongs to n;

[0043] Construct a data usage coefficient calculation model, the expression is: ,in, is the utilization coefficient of the i-th type of data, is the redundancy index of the i-th type of data, Contribution index for the i-th category of data, and are the corresponding weight coefficients respectively;

[0044] The calculation expression of the i-th type data redundancy index is: ,in, The time when the i-th type of data is uploaded to the system. The frequency used by the system.

[0045] As a further description of the solution of the present invention, the method for assigning the i-th type of data contribution index is:

[0046] The usage frequency of n types of data is counted. When the usage frequency of the i-th type of data ranks in the top one third of all data, then =1, when the usage frequency of the i-th category of data ranks in the middle third of all data, then =0.5, when the usage frequency of the i-th category of data ranks in the last third of all data, then =0.2.

[0047] As a further description of the solution of the present invention, the working process of the data analysis module also includes:

[0048] Get the total number of times the jth type of data is used , the number of times the j-th type of data is used in the current cycle and the number of changes in the use of the j-th type of data in the current cycle relative to the previous cycle ;

[0049] According to the obtained parameters, a data migration coefficient calculation model is constructed, and the expression is:

[0050] ;

[0051] In the formula, is the migration coefficient of the j-th type of data.

[0052] As a further description of the solution of the present invention, the working process of the internal governance module includes:

[0053] The data usage coefficients of n types of data are calculated in sequence through the data usage coefficient calculation model, and the data usage coefficients of the n types of data are sorted from small to large;

[0054] The top q ranked data are intercepted as the objects to be migrated, where q belongs to n and j belongs to q;

[0055] The migration coefficient of the j-th type of data With the migration coefficient threshold set By comparison, if the migration coefficient of the jth type of data is Less than the set migration coefficient threshold , then the j-th type of data needs to be migrated to the network disk. If the migration coefficient of the j-th type of data is Greater than or equal to the set migration coefficient threshold , then there is no need to migrate the jth type of data to the network disk for the time being.

[0056] Through the above technical solution, this embodiment first divides the government and enterprise data sources in the system database into n types of data according to content classification, and then queries the usage of each type of data through the work log, and then calculates the redundancy index of the data according to the time when the data is uploaded to the system and the frequency of use, and then assigns the impact index of the data according to the frequency of use of the data, and then calculates the data usage coefficient according to the redundancy index and the impact index of the data, and calculates the data usage coefficient of n types of data in turn, sorts the data usage coefficients of n types of data from small to large, intercepts the top q data as the pre-migration object, and then analyzes the top q data, and uses the formula Calculate the migration coefficient of the data, and finally, the migration coefficient of the j-th type of data With the migration coefficient threshold set By comparison, if the migration coefficient of the jth type of data is Less than the set migration coefficient threshold , then the j-th type of data needs to be migrated to the network disk. If the migration coefficient of the j-th type of data is Greater than or equal to the set migration coefficient threshold , then there is no need to migrate the jth type of data to the network disk for the time being.

[0057] As a further description of the solution of the present invention, the working process of the data analysis module also includes:

[0058] When an external data source Q needs to be uploaded to the system database, the source address A of the external data source to be updated to the system database is obtained;

[0059] According to the acquired source address A of the external data source Q to be updated to the system database, query the historical records of the source address A uploading the data source to the system database;

[0060] Get the total number of times source address A uploads data sources to the system database. For a period, obtain the number of times source address A uploads data sources to the system database in each period in the historical time period, and construct a time-varying curve of the number of times source address A uploads data sources to the system database in each period in the historical time period. ;

[0061] Construct the mathematical model of the safety factor of the external data source Q, the expression is:

[0062] ;

[0063] In the formula, , is the weight coefficient, is the initial period of the historical time period, The end cycle of the historical time period, For curve The first derivative of For curve The maximum value of the first-order derivative of For curve The minimum value of the first-order derivative of is the safety factor of the external data source Q.

[0064] As a further description of the solution of the present invention, the working process of the external governance module includes:

[0065] The safety factor of the external data source Q With the set safety factor threshold By comparison, if the safety factor of the external data source Q Less than the set safety factor threshold , it means that the security of the external data source Q is poor, and the external data source Q needs to be verified before it can be uploaded to the system database. If the security factor of the external data source Q is Greater than or equal to the set safety factor threshold , it means that the external data source Q has good security.

[0066] Through the above technical solution, this embodiment provides a solution for verifying the security of an external data source. First, the source address A of the external data source Q is obtained. For a period, obtain the number of times source address A uploads data sources to the system database in each period of the historical time period, and construct a time-varying curve of the number of times source address A uploads data sources to the system database in each period of the historical time period. According to the obtained parameters, use the formula Calculate the safety factor of the external data source Q and convert the safety factor of the external data source Q With the set safety factor threshold By comparison, if the safety factor of the external data source Q Less than the set safety factor threshold , it means that the security of the external data source Q is poor, and the external data source Q needs to be verified before it can be uploaded to the system database. If the security factor of the external data source Q is Greater than or equal to the set safety factor threshold , it means that the external data source Q has good security.

[0067] As a further description of the solution of the present invention, the working method of the governance system includes:

[0068] Step S1: Migrate the data source inside the system database periodically to ensure that when a new external data source is uploaded to the system database, the system database has enough space to receive it;

[0069] Step S2: When a new external data source is uploaded to the system database, a security assessment is performed on the uploaded external data source.

[0070] It should be noted that all weight coefficients, thresholds and threshold intervals in the present invention are obtained based on empirical data and do not require detailed description.

[0071] The above is a detailed description of an embodiment of the present invention, but the content is only a preferred embodiment of the present invention and cannot be considered to limit the scope of implementation of the present invention. All equivalent changes and improvements made within the scope of the present invention should still fall within the scope of the patent coverage of the present invention.

Claims

1. A government and enterprise data governance system based on business data, characterized in that: It includes data query and acquisition module, data analysis module, internal governance module, external governance module and early warning module; The data query acquisition module is used to query the work log corresponding to the government and enterprise data; The data analysis module is used to analyze the work log of government and enterprise data according to the query results of the data query acquisition module; The internal governance module is used to migrate the internal data source of the system database according to the analysis results of the data analysis module; The external governance module is used to perform security management on the external data source according to the analysis results of the data analysis module.

2. According to claim 1, a government and enterprise data governance system based on business data is characterized in that: The working process of the data analysis module includes: The government and enterprise data sources in the system database are classified into n categories according to their contents. The classification numbers are: 1, 2, ..., i, ..., n, where i belongs to n; Construct a data usage coefficient calculation model, the expression is: ,in, is the utilization coefficient of the i-th type of data, is the redundancy index of the i-th type of data, Contribution index for the i-th category of data, and are the corresponding weight coefficients respectively; The calculation expression of the i-th type data redundancy index is: ,in, The time when the i-th type of data is uploaded to the system. The frequency used by the system.

3. According to claim 2, a government and enterprise data governance system based on business data is characterized in that: The method for assigning the i-th type of data contribution index is: The usage frequency of n types of data is counted. When the usage frequency of the i-th type of data ranks in the top one third of all data, then , when the usage frequency of the i-th type of data ranks in the middle third of all data, then , when the usage frequency of the i-th type of data ranks in the last third of all data, then .

4. According to claim 2, a government and enterprise data governance system based on business data is characterized in that: The working process of the data analysis module also includes: Get the total number of times the jth type of data is used , the number of times the j-th type of data is used in the current cycle and the number of changes in the use of the j-th type of data in the current cycle relative to the previous cycle ; According to the obtained parameters, a data migration coefficient calculation model is constructed, and the expression is: ； In the formula, is the migration coefficient of the j-th type of data.

5. According to claim 4, a government and enterprise data governance system based on business data is characterized in that: The working process of the internal governance module includes: The data usage coefficients of n types of data are calculated in sequence through the data usage coefficient calculation model, and the data usage coefficients of the n types of data are sorted from small to large; The top q ranked data are intercepted as the objects to be migrated, where q belongs to n and j belongs to q; The migration coefficient of the j-th type of data With the migration coefficient threshold set By comparison, if the migration coefficient of the j-th type of data is Less than the set migration coefficient threshold , then the j-th type of data needs to be migrated to the network disk. If the migration coefficient of the j-th type of data is Greater than or equal to the set migration coefficient threshold , then there is no need to migrate the jth type of data to the network disk for the time being.

6. According to claim 2, a government and enterprise data governance system based on business data is characterized in that: The working process of the data analysis module also includes: When an external data source Q needs to be uploaded to the system database, the source address A of the external data source to be updated to the system database is obtained; According to the acquired source address A of the external data source Q to be updated to the system database, query the historical records of the source address A uploading the data source to the system database; Get the total number of times source address A uploads data sources to the system database. For a period, obtain the number of times source address A uploads data sources to the system database in each period in the historical time period, and construct a time-varying curve of the number of times source address A uploads data sources to the system database in each period in the historical time period. ; Construct the mathematical model of the safety factor of the external data source Q, the expression is: ； In the formula, , is the weight coefficient, is the initial period of the historical time period, The historical time period ends the cycle, For curve The first derivative of For curve The maximum value of the first-order derivative of For curve The minimum value of the first-order derivative of is the safety factor of the external data source Q.

7. According to claim 6, a government and enterprise data governance system based on business data is characterized in that: The working process of the external governance module includes: The safety factor of the external data source Q With the set safety factor threshold By comparison, if the safety factor of the external data source Q Less than the set safety factor threshold , it means that the security of the external data source Q is poor, and the external data source Q needs to be verified before it can be uploaded to the system database. If the security factor of the external data source Q is Greater than or equal to the set safety factor threshold , it means that the external data source Q has good security.

8. The government and enterprise data governance system based on business data according to any one of claims 1 to 7, characterized in that: The working methods of the governance system include: Step S1: Migrate the data source inside the system database periodically to ensure that when a new external data source is uploaded to the system database, the system database has enough space to receive it; Step S2: When a new external data source is uploaded to the system database, a security assessment is performed on the uploaded external data source.

Images