Business architecture-driven data warehouse model construction management system and method

Through the business architecture-driven digital warehouse model, the management system is built, and business and data metadata is automatically collected and managed, and the fitting model is established, which solves the problem of the separation of digital warehouse model from the business state, and achieves more efficient management and fitting promote.

CN118941170AInactive Publication Date: 2024-11-12SUZHOU SINAN STARGAZING DATA TECHNOLOGY CO LTD

Patent Information

Application Number
CN202410952037.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-16
Publication Date
2024-11-12
Estimated Expiration
Not applicable · inactive patent

Smart Images

  • Figure CN118941170A_ABST
    Figure CN118941170A_ABST
Patent Text Reader

Abstract

The invention discloses a business architecture-driven data warehouse model construction management system and method, relates to the technical field of data information processing, and solves the problems of incomplete relation chains of business and data and incomplete fitting degree of the business and the data. The system comprises a metadata automatic acquisition module, a business architecture management module, a data architecture management module, a data warehouse model management module and a data warehouse model intelligent construction and maintenance module. The metadata automatic acquisition module is used for acquiring information of a whole link; the business architecture management module and the data architecture management module are used for performing management according to the business architecture in the enterprise informatization architecture; and the data warehouse model intelligent construction and management module is used for recording fitting degree data with business in a data warehouse model construction process, constructing an evaluation model of data warehouse coverage and fitting degree by utilizing the fitting degree data, generating a continuous maintenance and management instruction, constructing a data warehouse model in combination with input of a business framework, and outputting the data warehouse model to a data scene for use.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data information processing technology, and in particular to a business architecture-driven data warehouse model construction management system and method. Background Art

[0002] At present, the technical solution for data warehouse modeling and business relationship is mainly realized through bus matrix. Bus matrix, also known as matrix diagram or business process-dimension matrix, is a common tool. Bus matrix is ​​mainly used to describe business processes, dimensions and the relationship between them, so as to help data warehouse designers build data models that meet business needs.

[0003] However, the existing bus matrix still has some problems in practical applications. For example, when establishing the relationship between business and data warehouse models, the bus matrix does not start from the enterprise architecture, but directly builds when it encounters needs, which is easy to be incomplete. In addition, the information of data and business is not uniformly maintained and updated. After long-term use, the data warehouse model does not correspond to the actual status of the business. There is also a lack of evaluation methods and indicators to evaluate whether the data warehouse model meets the business. In addition, the business cannot be informed of changes in the data warehouse model in a timely manner. In the long run, the business and the data warehouse model are out of actual relationship, resulting in the management of the data warehouse model out of control.

[0004] However, the main problem is that the information related to business and data is only collected and mapped in a limited number of links, most commonly in the business process and consistency dimension design links; the information related to data and business is still in the process category, business activities and other links, and this information has not been collected, resulting in the subsequent data warehouse model being unable to reflect the information on the use of data such as indicators, labels, APIs, and reports, which in turn leads to an incomplete relationship chain between business and data and incomplete fit between business and data. Summary of the invention

[0005] In order to improve the deficiencies in the prior art, the present application provides a business architecture driven data warehouse model construction management system and method.

[0006] This application provides a business architecture driven data warehouse model construction management system and method, which adopts the following technical solutions:

[0007] A business architecture-driven data warehouse model construction management system, including a metadata automatic collection module, a business architecture management module, a data architecture management module, a data warehouse model management module, and a data warehouse model intelligent construction and maintenance module;

[0008] The metadata automatic collection module includes collecting business information, data information, behavior information, and event information of the entire link, and the entire link includes a business architecture (BA) and a data architecture (IA);

[0009] The business architecture management module is used to manage according to the business architecture (BA) in the enterprise information architecture, including basic information management and business rule information management;

[0010] The data architecture management module is used to manage according to the business architecture (BA) in the enterprise information architecture, including information management, data model information management, and business association relationship management transmitted in the business architecture (BA);

[0011] The data warehouse model management module is used to manage key elements in the data warehouse model;

[0012] The data warehouse model intelligent construction and management module is responsible for the daily process of building the data warehouse model through the business architecture (BA) and the data architecture, and continuously analyzing and maintaining it; by recording the fit data with the business during the data warehouse model construction process, using the fit data to build a data warehouse coverage and fit evaluation model, generating continuous maintenance and management instructions, combining the input of the business architecture (BA) to build the data warehouse model, and outputting it for use in data scenarios.

[0013] Preferably, the process of constructing the data warehouse model includes the following steps:

[0014] Step 1: Based on the information input of the business architecture (BA), extract key business activities; including collecting the definition of business activities, information on the business segments to which they belong, and recording the fit model between business activities and the business architecture (BA);

[0015] Step 2: Based on business activities, extract the data entities involved in business activities and the relationships between data entities, collect the relationships between data entities and business activities and attach the upstream and downstream information of related business activities, and establish a fit model between data entities and business;

[0016] Step 3: Based on the relationship between data entities, present the ER relationship diagram from the data perspective and the process diagram from the business perspective, collect the relationship between data entities, attributes, business activities and upstream and downstream information, and establish a fit model between data attributes and business activities;

[0017] Step 4: Based on the relationship between business activities and data entities, design the composition of the bus matrix, including business processes and consistency dimensions, collect business activities and data entities associated with business processes and consistency dimensions, record upstream and downstream information, and establish a fit model between the data warehouse and business activities;

[0018] Step 5: Based on the bus matrix design, design a physical implementation plan in combination with the data warehouse technology stack, including fact tables, dimension tables, summary tables, and indicators. It also includes automatic collection of the relationship between fact tables, dimension tables, summary tables, and indicators, automatic collection of upstream and downstream related information such as business activities and data entities, and establishment of a fit model between the data warehouse and business activities.

[0019] Step 6: In the process of data warehouse modeling driven by business architecture (BA), the system automatically completes the data across the links and forms the final fit data, spanning the metadata collected in steps 1 to 5 and the constructed fit model.

[0020] Preferably, in the metadata automatic collection module, the information collected by the business architecture (BA) includes business modules, business processes, business activities, business entities, and business descriptions, and the information collected by the data architecture (IA) includes data entities, logical entities, and attributes.

[0021] Preferably, in the business architecture management module, the basic information management includes L1 (process classification), L2 (process group), L3 (business process), L4 (industry activities), and L5 (tasks); the business rule information management includes L3 (business process), L4 (industry activities), and L5 (tasks).

[0022] Preferably, in the data architecture management module, the information management includes L1 (data domain), L2 (subject group), L3 (data entity), L4 (logical entity), and L5 (attribute).

[0023] A business architecture driven data warehouse model construction management method, including any one of the business architecture driven data warehouse model construction management systems described in any one of the items, combining business architecture (BA) with data architecture (IA), and guiding the construction of data warehouse models, management systems, and processes.

[0024] In summary, the present application includes at least one of the following beneficial effects:

[0025] 1. Extract business metadata and data metadata of business architecture (BA) and data architecture (IA) from enterprise information architecture (4A), establish two-way auxiliary description of business and data, and complete the identification, mapping and completion of the relationship between data warehouse and business through intelligent collection of metadata information of business and data, so as to improve the relevance and fit between data warehouse model and business;

[0026] 2. Automatically collect business and data metadata to replace the original manual management of business and data, improve management efficiency, timeliness, and accuracy, and keep data and business in linkage management, improve the fit between business and data, and identify timeliness, greatly reducing the difficulty of subsequent data improvement, understanding, and use;

[0027] 3. The relationship between business and data runs through the entire system, adding a large amount of related information between business and data, which helps to understand business and data in a timely and effective manner, solves the problem of incomplete fit between business and data, and improves the availability of the data warehouse model. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 It is a schematic diagram of the overall management system of this embodiment of the present application;

[0029] Figure 2 It is a schematic diagram of the business architecture driven data warehouse model construction process of this embodiment of the present application. DETAILED DESCRIPTION

[0030] The following is combined with Figure 1-2 This application is described in further detail.

[0031] The embodiment of the present application discloses a business architecture-driven data warehouse model construction management system, which is designed based on the enterprise information architecture (4A) methodology and includes a metadata automatic collection module, a business architecture management module, a data architecture management module, a data warehouse model management module, and a data warehouse model intelligent construction and maintenance module.

[0032] Specifically, the metadata automatic collection module is responsible for collecting metadata such as business, data, behavior, and events in the entire chain:

[0033] Collect basic information such as business segments, business processes, business activities, business entities, and business description information from the business architecture (BA); collect data entities, logical entities, attributes, and other information from the data architecture (IA); collect user behavior information, system log information, key event records and status, and other information during system use.

[0034] The business architecture management module is managed strictly in accordance with the business architecture (BA) in the enterprise information architecture (4A):

[0035] Includes basic information management such as L1 (process classification), L2 (process group), L3 (business process), L4 (industry activities), L5 (tasks), etc.; includes information management such as more fine-grained business rules such as L3 (business process), L4 (industry activities), L5 (tasks), etc.

[0036] The data architecture management module is managed strictly in accordance with the business architecture (BA) in the enterprise information architecture (4A):

[0037] Includes basic information management of L1 (data domain), L2 (subject group), L3 (data entity), L4 (logical entity), and L5 (attribute); includes data model information management such as ER diagrams; includes business association relationship management transmitted in business architecture (BA).

[0038] The embodiments of the present application start from the business architecture (BA) of the enterprise in the business architecture management module and the data architecture management module, and take into account the required information management as much as possible, so as to carry out unified maintenance and management to ensure that the data in the subsequent data warehouse model corresponds to the business.

[0039] The data warehouse model management module is responsible for managing the key elements of the data warehouse model:

[0040] It includes the management of the bus matrix and the business processes and consistency dimensions therein; it includes physical table management, managing fact tables, dimension tables, summary tables, etc. according to the data warehouse layering specifications (ODS, DWD, DIM, DWS, ADS); it includes indicator definitions and the management of the relationship between indicators and business and data.

[0041] The data warehouse model intelligent construction and management module is responsible for the daily process of building data warehouse models through business architecture and data architecture, and continuously analyzing and maintaining them:

[0042] Functional business architecture drives the standard process of data warehouse modeling; records the data on the fit with the business during the data warehouse model construction process, builds a data warehouse coverage and fit evaluation model, and ensures that the data warehouse model can reflect the key entities, events, activities, evaluation indicators, etc. of the business; generates continuous maintenance and management instructions based on automatically collected information and the data warehouse fit and coverage evaluation model.

[0043] Furthermore, the core process of business architecture-driven data warehouse model construction is the data warehouse model construction process. The data warehouse model constructed by combining the input of business architecture (BA) can ensure that the system data is highly consistent with the business and can be used for data scenarios. The specific steps are as follows:

[0044] Step 1: Extract key business activities based on the information input of the business architecture BA (L1, L2, L3, L4, L5); collect the definition of business activities, the business segment to which they belong, and record the fit model between business activities and the architecture.

[0045] Step 2: Based on business activities, extract the data entities involved in business activities and the relationships between these data entities; collect the relationships between data entities and business activities and the upstream and downstream information of associated business activities, and establish a fit model between data entities and business.

[0046] Step 3: Based on the data entity relationship, present the ER relationship diagram from the data perspective and the process diagram from the business perspective; collect the relationship and upstream and downstream information of data entities, attributes, and business activities, and establish a fit model between data attributes and business activities.

[0047] Step 4: Based on the relationship between business activities and data entities, design the composition of the bus matrix, including business processes and consistency dimensions; collect business activities and data entities associated with business processes and consistency dimensions and record upstream and downstream information, and establish a fit model between the data warehouse and business activities.

[0048] Step 5: Based on the bus matrix design, design a physical implementation plan in combination with the data warehouse technology stack, including the design of fact tables, dimension tables, summary tables, indicators, etc.; automatically collect the relationships between fact tables, dimension tables, summary tables, indicators, etc.; automatically collect upstream and downstream related information such as business activities and data entities, and establish a fit model between the data warehouse and business activities.

[0049] Step 6: In the process of data warehouse modeling driven by the entire business architecture (BA), the system will automatically complete the data across the links and form the final fit data, spanning the metadata collected in steps 1 to 5 and the constructed fit model.

[0050] In an embodiment of the present application, the related information of business and data is collected from multiple links, incidental related activities, upstream and downstream relationships, etc., and a fit model of the data warehouse and business activities is established, which can accurately reflect the information of indicators, labels, APIs, reports, etc. using data, thereby improving the fit between business and data.

[0051] A business architecture driven data warehouse model construction management method includes a business architecture driven data warehouse model construction management system, which combines business architecture (BA) with data architecture (IA) and guides the construction of data warehouse models, management systems, and processes, thereby ensuring the actual relationship between the data warehouse model and the business, thereby improving the fit between data and business.

[0052] The above are all preferred embodiments of the present application, and the protection scope of the present application is not limited thereto. Therefore, any equivalent changes made according to the structure, shape, and principle of the present application should be included in the protection scope of the present application.

Claims

1. A data warehouse model construction management system driven by business architecture, characterized by: It includes automatic metadata collection module, business architecture management module, data architecture management module, data warehouse model management module, and data warehouse model intelligent construction and maintenance module; The metadata automatic collection module includes collecting business information, data information, behavior information, and event information of the entire link, and the entire link includes a business architecture (BA) and a data architecture (IA); The business architecture management module is used to manage according to the business architecture (BA) in the enterprise information architecture, including basic information management and business rule information management; The data architecture management module is used to manage according to the business architecture (BA) in the enterprise information architecture, including information management, data model information management, and business association relationship management transmitted in the business architecture (BA); The data warehouse model management module is used to manage key elements in the data warehouse model; The data warehouse model intelligent construction and management module is responsible for the daily process of building the data warehouse model through the business architecture (BA) and the data architecture, and continuously analyzing and maintaining it; by recording the fit data with the business during the data warehouse model construction process, using the fit data to build a data warehouse coverage and fit evaluation model, generating continuous maintenance and management instructions, combining the input of the business architecture (BA) to build the data warehouse model, and outputting it for use in data scenarios.

2. According to claim 1, a business architecture driven data warehouse model construction management system, characterized in that: The process of constructing the data warehouse model includes the following steps: Step 1: Based on the information input of the business architecture (BA), extract key business activities; including collecting the definition of business activities, information on the business segments to which they belong, and recording the fit model between business activities and the business architecture (BA); Step 2: Based on business activities, extract the data entities involved in business activities and the relationships between data entities, collect the relationships between data entities and business activities and attach the upstream and downstream information of related business activities, and establish a fit model between data entities and business; Step 3: Based on the relationship between data entities, present the ER relationship diagram from the data perspective and the process diagram from the business perspective, collect the relationship between data entities, attributes, business activities and upstream and downstream information, and establish a fit model between data attributes and business activities; Step 4: Based on the relationship between business activities and data entities, design the composition of the bus matrix, including business processes and consistency dimensions, collect business activities and data entities associated with business processes and consistency dimensions, record upstream and downstream information, and establish a fit model between the data warehouse and business activities; Step 5: Based on the bus matrix design, design a physical implementation plan in combination with the data warehouse technology stack, including fact tables, dimension tables, summary tables, and indicators. It also includes automatic collection of the relationship between fact tables, dimension tables, summary tables, and indicators, automatic collection of upstream and downstream related information such as business activities and data entities, and establishment of a fit model between the data warehouse and business activities. Step 6: In the process of data warehouse modeling driven by business architecture (BA), the system automatically completes the data across the links and forms the final fit data, spanning the metadata collected in steps 1 to 5 and the constructed fit model.

3. According to claim 1, a business architecture driven data warehouse model construction management system, characterized in that: In the metadata automatic collection module, the information collected by the business architecture (BA) includes business modules, business processes, business activities, business entities, and business descriptions, and the information collected by the data architecture (IA) includes data entities, logical entities, and attributes.

4. The business architecture driven data warehouse model building management system according to claim 1, characterized in that: In the business architecture management module, the basic information management includes L1 (process classification), L2 (process group), L3 (business process), L4 (industry activities), and L5 (tasks); the business rule information management includes L3 (business process), L4 (industry activities), and L5 (tasks).

5. According to claim 1, a business architecture driven data warehouse model construction management system, characterized in that: In the data architecture management module, the information management includes L1 (data domain), L2 (subject group), L3 (data entity), L4 (logical entity), and L5 (attribute).

6. A business architecture driven data warehouse model building management method, characterized by: It includes a business architecture driven data warehouse model construction management system as described in any one of claims 1 to 5, which combines the business architecture (BA) with the data architecture (IA) and guides the construction of data warehouse models, management systems, and processes.

Citation Information

Patent Citations

  • Data warehouse system based on data management and blood relationship design

    CN110232098A

  • Multi-warehouse management method and device for comprehensive and rapid check and analysis

    CN116303469A

  • Snowflake model number warehouse construction method based on Gaussian database

    CN117555973A

  • Data Warehouse System and Construction Method Thereof

    KR1020140135277A

Cited By

  • System and method for constructing business and data fusion knowledge based on enterprise architecture

    CN119622627A