Intelligent database metadata management system

Abstract

The invention provides an intelligent database metadata management system, and relates to the technical field of data management, and the system comprises the following steps: obtaining metadata of a database, carrying out data analysis, and determining data correlation among the metadata; the method comprises the steps of determining a data transmission source of metadata, performing metadata classification, constructing a metadata management platform, determining a distributed architecture of the metadata, and performing metadata management according to data correlation among the metadata and the load capacity of the metadata management platform; performing storage management on the metadata according to the metadata management result; and intelligent database metadata management is realized.

Description

Technical Field

[0001] The present invention relates to the technical field of data management, and in particular to an intelligent database metadata management system. Background Art

[0002] With the development of society, the amount of data stored in databases has become more and more numerous, and data management faces many challenges. First, when users access data, it is inefficient to call related data from the database, and it is difficult to link related data. In addition, the large amount of stored data causes serious database load, which also leads to the risk of data leakage in the data storage in the database.

[0003] Therefore, the present invention provides an intelligent database metadata management system. Summary of the invention

[0004] The present invention provides an intelligent database metadata management system, which obtains the metadata of the database and performs data analysis to determine the data correlation between the metadata; determines the data transmission source of the metadata and performs metadata classification, builds a metadata management platform, determines the distributed architecture of the metadata, performs metadata management according to the data correlation between the metadata and the load of the metadata management platform; performs storage management on the metadata according to the metadata management result, and realizes intelligent database metadata management.

[0005] The present invention provides an intelligent database metadata management system, comprising: The metadata association module is used to obtain the metadata of the database and perform data analysis to determine the data correlation between the metadata; The metadata management module is used to determine the data transmission source of metadata and classify metadata, build a metadata management platform, determine the distributed architecture of metadata, and manage metadata based on the data correlation between metadata and the load of the metadata management platform; The metadata storage module is used to store and manage the metadata according to the metadata management results.

[0006] According to an intelligent database metadata management system provided by the present invention, the metadata association module includes: A metadata acquisition unit, used to automatically acquire the stored data of the database and acquire the metadata of the stored data according to a preset data extraction strategy; The metadata classification unit is used to perform a metadata classification process on the metadata of the stored data according to the data type of the stored data, and classify the metadata into text metadata, image metadata and other metadata; The metadata of the stored data is subjected to secondary metadata classification processing according to the metadata type, and is divided into inherent metadata, management metadata, and description metadata.

[0007] According to the present invention, an intelligent database metadata management system, a metadata association module, includes: A metadata association unit, used for determining whether there is a metadata association between the stored data when there is a data link between the stored data; An association refinement unit, used to obtain metadata corresponding to the storage data with metadata association, recorded as association metadata; Performing association refinement analysis on the associated metadata according to the primary metadata classification processing result and the secondary metadata classification processing result, and when there is a data link in the associated metadata in a metadata classification processing result, determining that the metadata type corresponding to the metadata classification processing result is the association refinement type of the associated metadata; When there is no data link for the management metadata in a metadata classification processing result, determining that the metadata type corresponding to the metadata classification processing result is an association-independent type of the association metadata; The data correlation unit is used to extract all stored data corresponding to the associated refinement type of the associated metadata to perform data correlation analysis and determine the data correlation between the metadata.

[0008] According to the present invention, an intelligent database metadata management system, a metadata management module, includes: A transmission source metadata classification unit is used to obtain the data transmission relationship between metadata and determine the data transmission source of the metadata; Perform tertiary metadata classification processing according to the data transmission source of metadata; The classification management unit is used to add classification management tags to the metadata for classification management of the primary metadata classification processing results, the secondary metadata classification processing results and the tertiary metadata classification processing results, wherein the classification management tags include: primary metadata classification management tags, secondary metadata classification management tags and tertiary metadata classification management tags.

[0009] According to the present invention, an intelligent database metadata management system, a metadata management module, includes: The platform construction unit is used to obtain metadata management requirements, build a metadata management platform, and determine the distributed architecture of metadata; The distributed storage management unit is used to obtain the data storage space of metadata according to the distributed architecture of metadata, divide the data storage space area according to the number of categories of the metadata classification processing results, and allocate the data storage space according to the number of metadata classification management tags and the data volume of metadata, so as to perform distributed storage management of metadata.

[0010] According to the present invention, an intelligent database metadata management system, a metadata management module, includes: The load management unit is used to distribute the load of the metadata management platform according to the distributed storage management result and obtain the load distribution amount of the metadata; A metadata of the stored data is randomly calibrated as the standard metadata, and the load utilization rate of the metadata management platform is calculated according to the data correlation between other metadata and the standard metadata and the load distribution of the standard metadata; ;in, Indicates the load utilization of the metadata management platform; Indicates the load distribution amount of standard metadata; Indicates The number of occurrences of other metadata in the corresponding stored data; Indicates The number of other metadata corresponding to the stored data; Indicates The number of other metadata that appear in the metadata management platform; Indicates the data relevance of the other metadata to the standard metadata; Indicates The amount of other metadata in the metadata management platform; Indicates the amount of standard metadata in the metadata management platform; Indicates the load of the metadata management platform; Indicates the number of other metadata; When the load utilization rate of the metadata management platform is not lower than the preset utilization rate, it is determined that the metadata load management is completed; A load migration management unit, used to determine a separate load utilization rate of the metadata according to a load distribution amount of the metadata and a load usage amount of the metadata when a load utilization rate of the metadata management platform is lower than a preset utilization rate; Sort the metadata according to their individual load utilization rates, and mark the metadata whose individual load utilization rate is not higher than the load utilization rate of the metadata management platform as metadata with insufficient load utilization; Determine the migratable load distribution amount of the underutilized metadata according to the individual load utilization of the metadata, the load utilization of the metadata management platform, and the load distribution amount of the metadata; According to the data correlation between metadata, the migratable load distribution metadata of the under-utilized metadata is obtained, and the load of the metadata management platform is reallocated based on the migratable load distribution amount of the under-utilized metadata.

[0011] According to an intelligent database metadata management system provided by the present invention, the metadata storage module includes: A metadata hierarchical storage unit, used to determine the storage level of metadata according to the load distribution amount of metadata, and perform hierarchical storage management on metadata, wherein the metadata storage level includes: hot spot metadata storage level, general metadata storage level and cold spot metadata storage level; The metadata clearing unit is used to set the metadata storage management cycle, regularly update the metadata storage level and perform metadata clearing management on the metadata of the cold spot metadata storage level according to the storage time.

[0012] An intelligent database metadata management system provided by the present invention also includes: The metadata visualization module is used to visualize the metadata management results.

[0013] Compared with the prior art, the present invention has the following beneficial effects: By acquiring the metadata of the database and performing data analysis, the data correlation between metadata is determined; the data transmission source of the metadata is determined and metadata is classified, a metadata management platform is built, the distributed architecture of metadata is determined, and metadata management is performed based on the data correlation between metadata and the load of the metadata management platform; metadata is stored and managed based on the metadata management results; and intelligent database metadata management is achieved.

[0014] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.

[0015] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings: Figure 1 It is a structural diagram of an intelligent database metadata management system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0017] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0018] Embodiment 1: The embodiment of the present invention provides an intelligent database metadata management system. Figure 1 As shown, including: The metadata association module is used to obtain the metadata of the database and perform data analysis to determine the data correlation between the metadata; The metadata management module is used to determine the data transmission source of metadata and classify metadata, build a metadata management platform, determine the distributed architecture of metadata, and manage metadata based on the data correlation between metadata and the load of the metadata management platform; The metadata storage module is used to store and manage the metadata according to the metadata management results.

[0019] In this embodiment, the metadata of the database refers to data used to describe the storage data of the database, that is, the smallest data unit, used to represent the storage data. For example, the data type and data storage location of the storage data a1 can be regarded as the metadata of the storage data a1.

[0020] In this embodiment, the data correlation between metadata refers to the connection relationship between metadata determined based on data analysis of the metadata. For example, if metadata b1 and metadata b2 belong to the same storage area, it is determined that metadata b1 and metadata b2 have data correlation.

[0021] In this embodiment, the data transmission source of metadata refers to the data transmission call source when accessing metadata, which is the data source determined according to the data transmission relationship between metadata. For example, the data transmission source a1 of metadata b1 means obtaining metadata b1 from the data transmission source a1.

[0022] In this embodiment, the data transmission source of the metadata is determined and the metadata is classified. The metadata classification result is determined according to the data transmission source, for example, metadata is classified according to the data transmission source a1 for subsequent metadata management.

[0023] In this embodiment, the metadata management platform refers to a platform for intelligently managing metadata.

[0024] In this embodiment, the distributed architecture of metadata refers to an architecture determined according to the distributed storage of metadata. Since there are many databases and the types of metadata obtained are different, a distributed architecture is adopted.

[0025] In this embodiment, the load of the metadata management platform refers to the total amount of load distributed by the metadata management platform to implement metadata management.

[0026] In this embodiment, the metadata management result refers to the result of management based on the data correlation between metadata and the load of the metadata management platform.

[0027] In this embodiment, metadata is stored and managed according to the metadata management results. For example, metadata is stored and managed in a hierarchical manner to reasonably utilize the load of the metadata management platform; metadata is cleared and managed to avoid the presence of a large amount of historical data in the metadata management platform, thereby affecting metadata management efficiency.

[0028] The working principle and beneficial effects of the above technical solution are: obtaining the metadata of the database and performing data analysis to determine the data correlation between the metadata; determining the data transmission source of the metadata and classifying the metadata, building a metadata management platform, determining the distributed architecture of the metadata, and managing the metadata according to the data correlation between the metadata and the load of the metadata management platform; storing and managing the metadata according to the metadata management results; and realizing intelligent database metadata management.

[0029] Embodiment 2: The embodiment of the present invention provides an intelligent database metadata management system, a metadata association module, including: A metadata acquisition unit, used to automatically acquire the stored data of the database and acquire the metadata of the stored data according to a preset data extraction strategy; The metadata classification unit is used to perform a metadata classification process on the metadata of the stored data according to the data type of the stored data, and classify the metadata into text metadata, image metadata and other metadata; The metadata of the stored data is subjected to secondary metadata classification processing according to the metadata type, and is divided into inherent metadata, management metadata, and description metadata.

[0030] In this embodiment, the preset data extraction strategy refers to a strategy for extracting stored data to obtain metadata, such as a strategy for extracting keywords of stored data.

[0031] In this embodiment, a metadata classification process refers to a classification process performed according to the data type of the stored data, wherein the data type of the stored data includes a text data type, an image data type, and other data types.

[0032] In this embodiment, the secondary metadata classification process refers to the classification process performed according to metadata types, wherein the metadata types include: inherent metadata types, management metadata types, and description metadata types.

[0033] In this embodiment, inherent metadata refers to the description of the structure of data, which is used to identify storage, such as the storage address of the data and the name of the database corresponding to the data; management metadata refers to the description of the management attributes of the data, such as the storage data belongs to database a1; description metadata refers to the description of the content of the data, which is used to represent the stored data, such as the keywords of the stored data.

[0034] The working principle and beneficial effect of the above technical solution are: by acquiring the metadata of the database, performing primary metadata classification processing and secondary metadata classification processing, a data classification foundation is laid for subsequent metadata management.

[0035] Embodiment 3: The embodiment of the present invention provides an intelligent database metadata management system, a metadata association module, including: A metadata association unit, used for determining whether there is a metadata association between the stored data when there is a data link between the stored data; An association refinement unit, used to obtain metadata corresponding to the storage data with metadata association, recorded as association metadata; Performing association refinement analysis on the associated metadata according to the primary metadata classification processing result and the secondary metadata classification processing result, and when there is a data link in the associated metadata in a metadata classification processing result, determining that the metadata type corresponding to the metadata classification processing result is the association refinement type of the associated metadata; When there is no data link for the management metadata in a metadata classification processing result, determining that the metadata type corresponding to the metadata classification processing result is an association-independent type of the association metadata; The data correlation unit is used to extract all stored data corresponding to the associated refinement type of the associated metadata to perform data correlation analysis and determine the data correlation between the metadata.

[0036] In this embodiment, when there is a data link between the stored data, the data link refers to a reference relationship between the stored data, for example, if the stored data a1 references the stored data a2, it is determined that there is a data link between the stored data a1 and the stored data a2.

[0037] In this embodiment, metadata association means that there is an association between metadata of storage data with data links, for example, metadata b1 of storage data a1 and metadata b2 of storage data a2 are associated with each other.

[0038] In this embodiment, the associated metadata refers to metadata corresponding to the storage data with which there is metadata association, for example, associated metadata (b1, b2).

[0039] In this embodiment, the association refinement analysis refers to determining the specific association type of metadata and then performing specific association analysis. For example, according to the primary metadata classification processing result and the secondary metadata classification processing result, the association refinement analysis is performed on the associated metadata. If the associated metadata (b1, b2) both belong to inherent class metadata, then the associated metadata is further subjected to association analysis based on the inherent class metadata.

[0040] In this embodiment, a metadata classification processing result refers to one of the primary metadata classification processing result and the secondary metadata classification processing result.

[0041] In this embodiment, the association refinement type refers to the metadata type with data links determined by performing association refinement analysis on the associated metadata according to the primary metadata classification processing result and the secondary metadata classification processing result. For example, the association refinement type of the associated metadata (b1, b2) is the inherent metadata type.

[0042] In this embodiment, the association-independent type refers to a metadata type without a data link determined by performing association refinement analysis on the associated metadata based on the primary metadata classification processing result and the secondary metadata classification processing result. For example, the association refinement type of the associated metadata (b1, b2) is a management metadata type.

[0043] The working principle and beneficial effects of the above technical solution are: by determining the metadata association between stored data, performing association refinement, performing data correlation analysis according to the association refinement type, determining the data correlation between metadata, and ensuring the management quality of subsequent metadata management.

[0044] Embodiment 4: The embodiment of the present invention provides an intelligent database metadata management system, a metadata management module, including: A transmission source metadata classification unit, used to obtain the data transmission relationship between metadata and determine the data transmission source of metadata; Perform tertiary metadata classification processing according to the data transmission source of metadata; The classification management unit is used to add classification management tags to the metadata for classification management of the primary metadata classification processing results, the secondary metadata classification processing results and the tertiary metadata classification processing results, wherein the classification management tags include: primary metadata classification management tags, secondary metadata classification management tags and tertiary metadata classification management tags.

[0045] In this embodiment, the data transmission relationship between metadata is, for example, metadata a1 is obtained from metadata a2, and metadata a2 belongs to database b1, then there is a data transmission relationship between metadata a1 and metadata a2.

[0046] In this embodiment, the data transmission relationship between metadata is acquired, and the data transmission source of the metadata is determined. For example, the data transmission source of metadata a1 is database b1.

[0047] In this embodiment, the tertiary metadata classification processing refers to the classification processing performed according to the data transmission source of the metadata, which is used to determine the data transmission source and further provide a data classification basis for subsequent data management.

[0048] In this embodiment, the classification management label refers to a label determined according to the metadata classification processing result, and is used to represent the metadata.

[0049] The working principle and beneficial effect of the above technical solution are: by obtaining the data transmission relationship between metadata, determining the data transmission source of metadata and performing three-dimensional metadata classification processing, the management quality of subsequent metadata management is further ensured.

[0050] Embodiment 5: The embodiment of the present invention provides an intelligent database metadata management system, a metadata management module, including: The platform construction unit is used to obtain metadata management requirements, build a metadata management platform, and determine the distributed architecture of metadata; The distributed storage management unit is used to obtain the data storage space of metadata according to the distributed architecture of metadata, divide the data storage space area according to the number of categories of the metadata classification processing results, and allocate the data storage space according to the number of metadata classification management tags and the data volume of metadata, so as to perform distributed storage management of metadata.

[0051] In this embodiment, metadata management requirements, such as data security requirements and data processing efficiency requirements.

[0052] In this embodiment, data storage space for metadata is obtained according to the distributed architecture of metadata. The more complex the distributed architecture of metadata is, the larger the data storage space for metadata is. The complexity of the distributed architecture of metadata is determined according to the number of sub-modules included in the distributed architecture of metadata. For example, the distributed architecture of metadata includes a1 number of sub-modules, corresponding to the complexity of the distributed architecture of metadata b1, and an average of 1 sub-module is allocated with c1 data storage space for metadata. Then, the data storage space for metadata obtained according to the distributed architecture of metadata is a1*c1.

[0053] In this embodiment, the data storage space areas are divided according to the number of categories of the metadata classification processing results. For example, if the number of categories of the metadata classification processing results is d1, the data storage space is divided into d1 number of data storage space areas for subsequent management of various types of metadata classification processing results.

[0054] In this embodiment, the amount of data storage space is allocated based on the number of classification management tags of the metadata and the amount of metadata data. For example, when a data storage space amount is calibrated, the more classification management tag data of the metadata, the more data storage space is allocated; the more metadata data, the more data storage space is allocated.

[0055] In this embodiment, distributed storage management of metadata refers to the management of dividing data storage space areas according to the number of categories of metadata classification processing results and allocating data storage space according to the number of metadata classification management tags and the data volume of metadata.

[0056] The working principle and beneficial effects of the above technical solution are: by building a metadata management platform, determining the distributed architecture of metadata, and performing distributed storage management on metadata, the storage quality of metadata is ensured.

[0057] Embodiment 6: The embodiment of the present invention provides an intelligent database metadata management system, a metadata management module, including: The load management unit is used to distribute the load of the metadata management platform according to the distributed storage management result and obtain the load distribution amount of the metadata; A metadata of the stored data is randomly calibrated as the standard metadata, and the load utilization rate of the metadata management platform is calculated according to the data correlation between other metadata and the standard metadata and the load distribution of the standard metadata; ;in, Indicates the load utilization of the metadata management platform; Indicates the load distribution amount of standard metadata; Indicates The number of occurrences of other metadata in the corresponding stored data; Indicates The number of other metadata corresponding to the stored data; Indicates The number of other metadata that appear in the metadata management platform; Indicates the data relevance of the other metadata to the standard metadata; Indicates The amount of other metadata in the metadata management platform; Indicates the amount of standard metadata in the metadata management platform; Indicates the load of the metadata management platform; Indicates the number of other metadata; When the load utilization rate of the metadata management platform is not lower than the preset utilization rate, it is determined that the metadata load management is completed; A load migration management unit, used to determine a separate load utilization rate of the metadata according to a load distribution amount of the metadata and a load usage amount of the metadata when a load utilization rate of the metadata management platform is lower than a preset utilization rate; Sort the metadata according to their individual load utilization rates, and mark the metadata whose individual load utilization rate is not higher than the load utilization rate of the metadata management platform as metadata with insufficient load utilization; Determine the migratable load distribution amount of the underutilized metadata according to the individual load utilization of the metadata, the load utilization of the metadata management platform, and the load distribution amount of the metadata; According to the data correlation between metadata, the migratable load distribution metadata of the under-utilized metadata is obtained, and the load of the metadata management platform is reallocated based on the migratable load distribution amount of the under-utilized metadata.

[0058] In this embodiment, the distributed storage management result refers to the result of distributed storage management of metadata by dividing the data storage space area according to the number of categories of the metadata classification processing results and allocating the data storage space amount according to the number of metadata classification management tags and the data volume of the metadata.

[0059] In this embodiment, the load of the metadata management platform refers to the total amount of resources used by the metadata management platform to manage metadata.

[0060] In this embodiment, the load distribution amount of metadata refers to a single resource distribution amount used by the metadata management platform to manage a single metadata.

[0061] In this embodiment, the load of the metadata management platform is allocated according to the distributed storage management result. For example, the distributed storage management result c1 of metadata a1 allocates the load b1 of the metadata management platform, where b1 is the load allocation amount of metadata a1.

[0062] In this embodiment, the more data storage space the metadata allocates, the more load the metadata management platform allocates, that is, the more load the metadata allocates.

[0063] In this embodiment, different metadata have different load distribution amounts.

[0064] In this embodiment, standard metadata refers to metadata used to determine the load utilization of the metadata management platform, which is determined based on metadata of randomly calibrated storage data.

[0065] In this embodiment, the load utilization rate of the metadata management platform refers to the utilization rate of the metadata to the load amount allocated to the metadata management platform. The higher the load utilization rate of the metadata management platform, the better the metadata management is judged to be.

[0066] In this embodiment, the preset utilization rate refers to a set value set by the metadata management platform for measuring the load utilization rate of the metadata management platform.

[0067] In this embodiment, the payload usage of metadata refers to the actual load allocation used for metadata management.

[0068] In this embodiment, the individual load utilization rate of metadata refers to the load utilization rate of a single piece of metadata. For example, the load utilization rate p1 of metadata a1.

[0069] In this embodiment, metadata with insufficient load utilization refers to metadata whose individual load utilization rate is not higher than the load utilization rate of the metadata management platform. For example, if the load utilization rate of the metadata management platform is p2 and p1 < p2, then metadata a1 is metadata with insufficient load utilization.

[0070] In this embodiment, the migratable load allocation amount refers to the load allocation amount in metadata with insufficient load utilization that can be used for other metadata for load management.

[0071] In this embodiment, the migratable load allocation amount of metadata with insufficient load utilization is determined based on the individual load utilization rate of the metadata, the load utilization rate of the metadata management platform, and the load allocation amount of the metadata. For example, the migratable load allocation amount of metadata a1 is (p2 - p1) * the load allocation amount b1 of metadata a1.

[0072] In this embodiment, the migratable load allocation metadata of metadata with insufficient load utilization refers to the metadata that has data correlation with the metadata with insufficient load utilization.

[0073] In this embodiment, the migratable load allocation metadata of metadata with insufficient load utilization is obtained based on the data correlation between the metadata, and the load amount of the metadata management platform is re - allocated in combination with the migratable load allocation amount of the metadata with insufficient load utilization. For example, if metadata a2 has data correlation with metadata a1, then metadata a1 can migrate its migratable load allocation amount to metadata a2 to improve the load utilization rate of metadata a1.

[0074] The working principle and beneficial effects of the above - mentioned technical solution are as follows: By managing metadata according to the data correlation between metadata and the load amount of the metadata management platform, intelligent database metadata management is realized.

[0075] Embodiment 7: The embodiment of the present invention provides an intelligent database metadata management system, and a metadata storage module, including: A metadata hierarchical storage unit, which is used to determine the storage level of metadata according to the load allocation amount of the metadata, and perform hierarchical storage management on the metadata. Among them, the storage levels of the metadata include: a hot - spot metadata storage level, a general - metadata storage level, and a cold - spot metadata storage level; The metadata clearing unit is used to set the metadata storage management cycle, regularly update the metadata storage level and perform metadata clearing management on the metadata of the cold spot metadata storage level according to the storage time.

[0076] In this embodiment, the storage level of the metadata is determined according to the load distribution amount of the metadata, and the metadata is stored and managed in a hierarchical manner. For example, the load distribution amounts a1 and a2 are set, and a1>a2. When the load distribution amount of the metadata is not lower than a1, the storage level of the metadata is determined to be a hot spot metadata storage level; when the load distribution amount of the metadata is at (a2, a1), the storage level of the metadata is determined to be a general metadata storage level; when the load distribution amount of the metadata is lower than a2, the storage level of the metadata is determined to be a cold spot metadata storage level.

[0077] In this embodiment, setting the metadata storage management period refers to setting the management period of metadata storage management, for example, setting the metadata storage management period t1, that is, managing the metadata once every t1 period.

[0078] In this embodiment, metadata of the cold spot metadata storage level is cleared and managed according to the storage time, that is, metadata of the cold spot metadata storage level with a long storage time is cleared first.

[0079] The working principle and beneficial effect of the above technical solution are: by performing hierarchical storage management and clearing management on metadata, the management efficiency of metadata is ensured.

[0080] Embodiment 8: The embodiment of the present invention provides an intelligent database metadata management system, further comprising: The metadata visualization module is used to visualize the metadata management results.

[0081] In this embodiment, the metadata management results are visualized, for example, the metadata load management results, the load utilization of the metadata management platform, and the storage level of the metadata are visualized.

[0082] The working principle and beneficial effect of the above technical solution are: by visually displaying the metadata management results, the user experience is ensured.

[0083] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An intelligent database metadata management system, characterized in that: include: The metadata association module is used to obtain the metadata of the database and perform data analysis to determine the data correlation between the metadata; The metadata management module is used to determine the data transmission source of metadata and classify metadata, build a metadata management platform, determine the distributed architecture of metadata, and manage metadata based on the data correlation between metadata and the load of the metadata management platform; The metadata storage module is used to store and manage the metadata according to the metadata management results.

2. An intelligent database metadata management system according to claim 1, characterized in that: Metadata association modules, including: A metadata acquisition unit, used to automatically acquire the stored data of the database and acquire the metadata of the stored data according to a preset data extraction strategy; The metadata classification unit is used to perform a metadata classification process on the metadata of the stored data according to the data type of the stored data, and classify the metadata into text metadata, image metadata and other metadata; The metadata of the stored data is subjected to secondary metadata classification processing according to the metadata type, and is divided into inherent metadata, management metadata and description metadata.

3. An intelligent database metadata management system according to claim 2, characterized in that: Metadata association modules, including: A metadata association unit, used for determining whether there is a metadata association between the stored data when there is a data link between the stored data; An association refinement unit, used to obtain metadata corresponding to the storage data with metadata association, recorded as association metadata; Performing association refinement analysis on the associated metadata according to the primary metadata classification processing result and the secondary metadata classification processing result, and when there is a data link in the associated metadata in a metadata classification processing result, determining that the metadata type corresponding to the metadata classification processing result is the association refinement type of the associated metadata; When there is no data link for the management metadata in a metadata classification processing result, determining that the metadata type corresponding to the metadata classification processing result is an association-irrelevant type of the association metadata; The data correlation unit is used to extract all stored data corresponding to the associated refinement type of the associated metadata to perform data correlation analysis and determine the data correlation between the metadata.

4. The intelligent database metadata management system according to claim 1, characterized in that: Metadata management module, including: A transmission source metadata classification unit is used to obtain the data transmission relationship between metadata and determine the data transmission source of the metadata; Perform tertiary metadata classification processing according to the data transmission source of metadata; The classification management unit is used to add classification management tags to the metadata for classification management of the primary metadata classification processing results, the secondary metadata classification processing results and the tertiary metadata classification processing results, wherein the classification management tags include: primary metadata classification management tags, secondary metadata classification management tags and tertiary metadata classification management tags.

5. An intelligent database metadata management system according to claim 4, characterized in that: Metadata management module, including: The platform construction unit is used to obtain metadata management requirements, build a metadata management platform, and determine the distributed architecture of metadata; The distributed storage management unit is used to obtain the data storage space of metadata according to the distributed architecture of metadata, divide the data storage space area according to the number of categories of the metadata classification processing results, and allocate the data storage space according to the number of metadata classification management tags and the data volume of metadata, so as to perform distributed storage management of metadata.

6. An intelligent database metadata management system according to claim 5, characterized in that: Metadata management module, including: The load management unit is used to distribute the load of the metadata management platform according to the distributed storage management result and obtain the load distribution amount of the metadata; A metadata of the stored data is randomly calibrated as the standard metadata, and the load utilization rate of the metadata management platform is calculated according to the data correlation between other metadata and the standard metadata and the load distribution of the standard metadata; ;in, Indicates the load utilization of the metadata management platform; Indicates the load distribution amount of standard metadata; Indicates The number of occurrences of other metadata in the corresponding stored data; Indicates The number of other metadata corresponding to the stored data; Indicates The number of other metadata that appear in the metadata management platform; Indicates the data relevance of the other metadata to the standard metadata; Indicates The amount of other metadata in the metadata management platform; Indicates the amount of standard metadata in the metadata management platform; Indicates the load of the metadata management platform; Indicates the number of other metadata; When the load utilization rate of the metadata management platform is not lower than the preset utilization rate, it is determined that the metadata load management is completed; A load migration management unit, used to determine a separate load utilization rate of the metadata according to a load distribution amount of the metadata and a load usage amount of the metadata when a load utilization rate of the metadata management platform is lower than a preset utilization rate; Sort the metadata according to their individual load utilization rates, and mark the metadata whose individual load utilization rate is not higher than the load utilization rate of the metadata management platform as metadata with insufficient load utilization; Determine the migratable load distribution amount of the underutilized metadata according to the individual load utilization of the metadata, the load utilization of the metadata management platform, and the load distribution amount of the metadata; According to the data correlation between metadata, the migratable load distribution metadata of the under-utilized metadata is obtained, and the load of the metadata management platform is reallocated based on the migratable load distribution amount of the under-utilized metadata.

7. The intelligent database metadata management system according to claim 1, characterized in that: Metadata storage module, including: A metadata hierarchical storage unit, used to determine the storage level of metadata according to the load distribution amount of metadata, and perform hierarchical storage management on metadata, wherein the metadata storage level includes: hot spot metadata storage level, general metadata storage level and cold spot metadata storage level; The metadata clearing unit is used to set the metadata storage management cycle, regularly update the metadata storage level and perform metadata clearing management on the metadata of the cold spot metadata storage level according to the storage time.

8. The intelligent database metadata management system according to claim 1, characterized in that: Also includes: The metadata visualization module is used to visualize the metadata management results.

Images