A data association visualization method and system for automatically generating a business topology map

Abstract

The present invention relates to the field of data processing, and in particular to a data association visualization method and system for automatically generating a business topology map. The method includes the steps of S1. System access data, and all accessed data are cleaned and stored in the data processing module, and the data are labeled; S2. The processed data is arranged by the business rule arrangement module; S3. The arranged data is input into the business relationship generation module, and the business relationship generation service is called to generate the association relationship between data and business; S4. The association relationship is displayed in a topological manner through the visualization module. The present invention improves the reliability of data, reduces the cost of manual data analysis, and can automatically update the output in response to the latest business situation as the data is updated by continuously adjusting parameters to adjust the relationship between data and business.

Description

Technical Field

[0001] The present invention relates to the field of data processing, and in particular to a data association visualization method and system for automatically generating a business topology map. Background Art

[0002] With the advancement of informatization, data has changed from a small amount, single, slow update and low value to a large amount, diverse, high speed and high value. With the rapid development of information technology, data has begun to grow explosively. As time goes by, the storage unit has changed from GB to TB, and even to PB and EB levels. Such a large amount of diverse data urgently needs intelligent algorithms, powerful data processing platforms, new data processing technologies and new visualization solutions to represent the relationship between such large-scale data. In addition, data drives the business. Only by fully understanding the business can the data play its best role. Data processing personnel understand the data but lack the depth, breadth and details of the business exploration, while business personnel do not understand the data enough, and cannot form the best quality data output. Through the data association relationship, data personnel only need to dig deep into the data, and business personnel rely on visualization to dig into the business, and finally output high-quality and rich results. The development of this method realizes the cooperative relationship between data and business. As the data is gradually standardized and systematized, the relationship between data and business can also be gradually generated automatically.

[0003] The current visualization display scheme of related data has no fixed form and changes quickly due to the relationship between data and business. In addition, the data standards are inconsistent, the structured and unstructured data are diverse, a large amount of data is accessed without preprocessing and cleaning, the data is highly redundant and has no identifiable annotations. Basically, it is based on manual combing, and the business personnel put forward requirements to the data team. The data team spends a lot of time responding to the requirements and has no more energy to mine data. Finally, the manually combed business relationships are displayed in the form of topological diagrams to show the business association relationships.

[0004] Currently, there is no complete management process between data and business, which makes data a tool to serve business rather than a collaboration between data and business. The data association visualization of current business topology maps is done through the cooperation of business personnel and data personnel, which leads to low efficiency, heavy workload, high cost, long time and poor effect. Summary of the invention

[0005] The present invention provides a data association visualization method and system for automatically generating a business topology map, aiming to solve the problems of large workload, high cost and poor effect in existing business data processing.

[0006] The present invention provides a data association visualization method for automatically generating a business topology map, comprising the following steps:

[0007] S1. The system accesses data, cleans all the accessed data and stores them in the database through the data processing module, and labels the data;

[0008] S2. Arrange business rules for the processed data through the business rule arrangement module;

[0009] S3. Input the arranged data into the business relationship generation module, call the business relationship generation service, and generate the association relationship between the data and the business;

[0010] S4. Display the association relationship in a topological manner through the visualization module.

[0011] As a further improvement of the present invention, the data cleaning process in step S1 includes:

[0012] S11a. The system calls the data cleaning subsystem integrated with the customized algorithm;

[0013] S11b. Access the data to be processed through the service interface or directly connect to the database;

[0014] S11c. The data access module automatically checks the data according to the established rule function;

[0015] S11d. The data access module processes problematic data and performs operations to modify and supplement attributes of the data.

[0016] As a further improvement of the present invention, the data labeling process in step S1 includes:

[0017] S12a. The system calls the data annotation subsystem integrated with the custom algorithm;

[0018] S12b. Access the cleaned data according to the access rules established by the system;

[0019] S12c. The data access module automatically identifies the data attributes and forms annotation content;

[0020] S12d. Bind the annotation content with the data to form a unique identification basis for the data.

[0021] As a further improvement of the present invention, the process of business rule arrangement in step S2 includes:

[0022] S21. Open the business rule arrangement interface of the system and create a business rule;

[0023] S22. Select an editing mode, including a graphical mode and a script editing mode;

[0024] S23. Add processing nodes. In the graphical mode, drag and drop components, and then edit the node logic of the components; in the script mode, directly write the node logic;

[0025] S24. Repeat step S23 to add multiple processing nodes;

[0026] S25. Connect the nodes to form a business processing flow and complete the arrangement of a business rule.

[0027] As a further improvement of the present invention, the process of arranging business rules in step S2 further includes:

[0028] S26. Add multiple business rules and form a rule base. The system manages and maintains the rules of the rule base.

[0029] As a further improvement of the present invention, the service process of the business relationship generation service in step S3 includes:

[0030] S31a. Open the business rule management list, select a business rule, and start the selected business rule;

[0031] S31b. The system generates a corresponding background service, and the startup status of the selected business rule changes;

[0032] S31c. Determine the startup status based on the color change: the first color indicates successful startup, the second color indicates startup in progress, the third color indicates unsuccessful startup, and the fourth color indicates stop.

[0033] As a further improvement of the present invention, the process of generating the association relationship between data and business in step S3 includes:

[0034] S32a start the system's business relationship generation service;

[0035] S32b. The system automatically performs correlation analysis and calculations based on business rules and the relationship between business processes and data;

[0036] S32c. Output the calculation results and store the generated business association relationship in the database.

[0037] As a further improvement of the present invention, step S4 specifically includes:

[0038] S41. In the business rule management list, click to preview each successfully started business rule;

[0039] S42. The system provides the result data stored in the database to the visualization module, and the visualization module displays and describes the data association relationship in a topological diagram based on the data.

[0040] As a further improvement of the present invention, the data association visualization method further includes:

[0041] S5. Data personnel update data by maintaining and mining data, synchronously update and automatically generate business association relationships based on set business rules.

[0042] The present invention also provides a data association visualization system for automatically generating a business topology map, including a front-end management system, a data resource management system, a business rule management system, a business relationship generation system, and a data visualization system;

[0043] The front-end management system includes user information management module and authority management module;

[0044] Data resource management: responsible for logging into data resources, storing access data related information, managing database resources, cleaning accessed data and storing the cleaned data in the database;

[0045] Business rule management system: responsible for editing different business rules;

[0046] Business relationship generation system: responsible for receiving different types of rule data, connecting to the database and retrieving and extracting data information, associating structured and unstructured data, generating data relationship networks, and finally outputting data in a way that is easy to visualize;

[0047] Data visualization system: Switch the visualization display type according to the received data type and rules.

[0048] The beneficial effects of the present invention are: by continuously adjusting parameters to adjust the relationship between data and business, the reliability of data is improved, the cost of manual data analysis is reduced, and the output can be automatically updated in rapid response to the latest business situation as the data is updated. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 It is a flowchart of a data association visualization method of the present invention;

[0050] Figure 2 It is a front-end and back-end module diagram of a data association visualization system of the present invention. DETAILED DESCRIPTION

[0051] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments.

[0052] Embodiment 1:

[0053] This method uses cognitive computing, knowledge representation and reasoning, information retrieval and extraction, natural language processing, data mining and machine learning technologies to conduct in-depth mining of standardized and systematized data, combine business rules, generate business association relationships, and display the association relationships in visual forms such as topological maps.

[0054] To solve the cooperation between data and business and to realize the automatic generation of business topology maps, we must first solve the problem of data processing. The data association visualization method for automatically generating business topology maps includes the following steps:

[0055] S1. The system accesses data, cleans all the accessed data and stores them in the database through the data processing module, and labels the data;

[0056] S2. Arrange business rules for the processed data through the business rule arrangement module;

[0057] S3. Input the arranged data into the business relationship generation module, call the business relationship generation service, and generate the association relationship between the data and the business;

[0058] S4. Display the association relationship in a topological manner through a visualization module;

[0059] S5. Data personnel update data by maintaining and mining data, synchronously update and automatically generate business association relationships based on set business rules.

[0060] In the access data cleaning, the data cleaning process of step S1 includes:

[0061] S11a. The system calls the data cleaning subsystem integrated with the customized algorithm;

[0062] S11b. Access the data to be processed through the service interface or directly connect to the database;

[0063] S11c. The data access module automatically checks the data according to the established rule function;

[0064] S11d. The data access module processes problematic data and performs operations such as modifying and supplementing attributes of the data.

[0065] The data cleaning process is to perform preliminary processing on the data, check, modify, and supplement the attributes of different data according to the specified rule functions, and standardize the accessed data to facilitate more accurate subsequent labeling process.

[0066] The data annotation process in step S1 includes:

[0067] S12a. The system calls the data annotation subsystem integrated with the custom algorithm;

[0068] S12b. Access the cleaned data according to the access rules established by the system;

[0069] S12c. The data access module automatically identifies the data attributes to form annotation content. The data attributes include data type, data characteristics, etc.;

[0070] S12d. Bind the annotation content with the data to form a unique identification basis for the data.

[0071] The cleaned and labeled data increases data service capabilities, solves problems faced by data, such as lack of digital environment, difficulty in circulation of data elements, and difficulty in mining data value, making data more standardized and systematic, and promoting data openness, sharing, and circulation.

[0072] In the process of data generation, the process of business rule arrangement in step S2 includes:

[0073] S21. Open the business rule arrangement interface of the system and create a business rule. When creating a new business rule, click New on the interface.

[0074] S22. Select an editing mode, including a graphical mode and a script editing mode;

[0075] S23. Add processing nodes. In the graphical mode, drag and drop components, and then edit the node logic of the components; in the script mode, directly write the node logic;

[0076] S24. Repeat step S23 to add multiple processing nodes;

[0077] S25. Connect the nodes to form a business process, complete the arrangement of a business rule, and then perform visual operations;

[0078] S26. Add multiple business rules and form a rule base. The system manages and maintains the rules of the rule base.

[0079] Add or maintain services, each rule is a business relationship. The system can manage and maintain the rules in the rule base, such as adding rules, editing, starting services, and stopping services.

[0080] After the arrangement is completed, the business relationship generation service is called. The service process of the business relationship generation service in step S3 includes:

[0081] S31a. Open the business rule management list, select a business rule, and start the selected business rule; in the operation options of the selected rule, select the Start Rule button and click Start;

[0082] S31b. The system generates a corresponding background service, and the startup status of the selected business rule changes;

[0083] S31c. Determine the startup status based on the color change: the first color indicates successful startup, the second color indicates startup in progress, the third color indicates unsuccessful startup, and the fourth color indicates stop; you can choose to use green to indicate successful startup, yellow to indicate startup in progress, red to indicate unsuccessful startup, and gray to indicate stop.

[0084] After the data processing and business relationship are completed, the process of generating the association relationship between data and business in step S3 includes:

[0085] S32a start the system's business relationship generation service;

[0086] S32b. The system automatically performs correlation analysis and calculations based on business rules and the relationship between business processes and data;

[0087] S32c. Output the calculation results and store the generated business association relationship in the database.

[0088] After the association relationship between data and business is generated, the visualization module is called to display the relationship, wherein step S4 specifically includes:

[0089] S41. In the business rule management list, click to preview each successfully launched business rule; a preview button will be displayed for each successfully launched business rule. Click the preview button to preview the business rule.

[0090] S42. The system provides the result data stored in the database to the visualization module, and the visualization module displays and describes the data association relationship in a topological diagram based on the data.

[0091] The present invention sets business rules and continuously adjusts and optimizes with the help of the computing power of the computer system. The present invention solves the automatic generation of data association relationships of different business topology maps and visualizes them in a simple, low-cost and efficient manner.

[0092] The present invention transforms the service relationship between data and business into a cooperative relationship. The deeper the data mining, the more accurate the data available to the business, and the greater the value of the data. At the same time, through the management of different rules, multiple business associations can be efficiently output at the same time, and can be used for a long time. As long as simple updates and maintenance are done, it can continue to develop deeper into the business.

[0093] Embodiment 2:

[0094] like Figure 2As shown, a data association visualization system for automatically generating a business topology map of the present invention includes a front-end management system, a data resource management system, a business rule management system, a business relationship generation system, and a data visualization system;

[0095] The front-end management system 1 includes a user information management module and a permission management module; it is responsible for user login registration, user permission control, and system information communication, providing security capabilities for the system;

[0096] Data Resource Management 2: Responsible for logging into data resources, storing access data related information, managing database resources, cleaning accessed data and storing the cleaned data in the database;

[0097] Business rule management system 3: responsible for editing different business rules; business rules can be created, edited, deleted, reused, associated, and queried;

[0098] Business relationship generation system 4: responsible for receiving different types of rule data, connecting to the database and retrieving and extracting data information, with AI semantic recognition, associating structured and unstructured data, generating data relationship networks, and finally outputting data in a way that is easy to visualize; with functions such as exporting and downloading data results;

[0099] Data visualization system 5: Switch the visualization display type according to the received data type and rules; responsible for supporting multiple visualization methods, and can switch the display type according to the received data type and rules, including data statistics dashboards, data charts, etc., and complex visual expressions, with the ability to synchronize data in real time and be able to respond to the latest changes in visual data in a timely manner.

[0100] When using the system, once the users are accustomed to the system operation, they only need to provide the system and have sufficient understanding of the business before they can use it to analyze the business at low cost and quickly.

[0101] The present invention can obtain business associations through business rules, and can adjust the associations by changing parameters. By configuring multiple different business rules, the associations of multiple businesses can be obtained; based on the rule generation method, the effect of continuous use of one operation can be achieved, which reduces a lot of repetitive work for later analysis of data; it can be visualized in real time, respond to data changes immediately, and grasp first-hand data relationships at the first time; the separation of business and data allows both data and business to have greater development depth.

[0102] The above contents are further detailed descriptions of the present invention in combination with specific preferred embodiments, and it cannot be determined that the specific implementation of the present invention is limited to these descriptions. For ordinary technicians in the technical field to which the present invention belongs, several simple deductions or substitutions can be made without departing from the concept of the present invention, which should be regarded as falling within the protection scope of the present invention.

Claims

1. A data association visualization method for automatically generating a business topology map, characterized in that: The following steps are involved: S1. The system accesses data, cleans all the accessed data and stores them in the database through the data processing module, and labels the data; S2. Arrange business rules for the processed data through the business rule arrangement module; S3. Input the arranged data into the business relationship generation module, call the business relationship generation service, and generate the association relationship between the data and the business; S4. Display the association relationship in a topological manner through a visualization module; The process of business rule arrangement in step S2 includes: S21. Open the business rule arrangement interface of the system and create a business rule; S22. Select an editing mode, including a graphical mode and a script editing mode; S23. Add processing nodes. In the graphical mode, drag and drop components, and then edit the node logic of the components; in the script mode, directly write the node logic; S24. Repeat step S23 to add multiple processing nodes; S25. Connect the nodes to form a business process and complete the arrangement of a business rule; S26. Add multiple business rules and form a rule base. The system manages and maintains the rules of the rule base; The service process of the business relationship generation service in step S3 includes: S31a. Open the business rule management list, select a business rule, and start the selected business rule; S31b. The system generates a corresponding background service, and the startup status of the selected business rule changes; S31c determine the startup status according to the color change: the first color indicates a successful startup, the second color indicates startup, the third color indicates an unsuccessful startup, and the fourth color indicates stop; The process of generating the association relationship between data and business in step S3 includes: S32a start the system's business relationship generation service; S32b. The system automatically performs correlation analysis and calculations based on business rules and the relationship between business processes and data; S32c. Output the calculation results and store the generated business association relationship in the database.

2. The data association visualization method for automatically generating a business topology map according to claim 1, characterized in that: The data cleaning process in step S1 includes: S11a. The system calls the data cleaning subsystem integrated with the customized algorithm; S11b. Access the data to be processed through the service interface or directly connect to the database; S11c. The data access module automatically checks the data according to the established rule function; S11d. The data access module processes problematic data and performs operations to modify and supplement attributes of the data.

3. The data association visualization method for automatically generating a business topology map according to claim 2 is characterized in that: The data labeling process in step S1 includes: S12a. The system calls the data annotation subsystem integrated with the custom algorithm; S12b. Access the cleaned data according to the access rules established by the system; S12c. The data access module automatically identifies the data attributes and forms annotation content; S12d. Bind the annotation content with the data to form a unique identification basis for the data.

4. The data association visualization method for automatically generating a business topology map according to claim 1, characterized in that: The step S4 specifically includes: S41. In the business rule management list, click to preview each successfully started business rule; S42. The system provides the result data stored in the database to the visualization module, and the visualization module displays and describes the data association relationship in a topological diagram based on the result data.

5. The data association visualization method for automatically generating a business topology map according to claim 1, characterized in that: The data association visualization method further includes: S5. Data personnel update data by maintaining and mining data, synchronously update and automatically generate business association relationships based on set business rules.

6. A data association visualization system for automatically generating a business topology map, characterized in that: Including front-end management system, data resource management, business rule management system, business relationship generation system, and data visualization system; The front-end management system includes user information management module and authority management module; Data resource management: responsible for logging into data resources, storing access data related information, managing database resources, cleaning accessed data and storing the cleaned data in the database; Business rule management system: responsible for editing different business rules; Business relationship generation system: responsible for receiving different types of rule data, connecting to the database and retrieving and extracting data information, associating structured and unstructured data, generating data relationship networks, and finally outputting data in a way that is easy to visualize; Data visualization system: switches the visualization display type according to the received data type and rules; In the business rule management system, the editing process of business rules includes: S21. Open the business rule arrangement interface of the system and create a business rule. When creating a new business rule, click New on the interface. S22. Select an editing mode, including a graphical mode and a script editing mode; S23. Add processing nodes. In the graphical mode, drag and drop components, and then edit the node logic of the components; in the script mode, directly write the node logic; S24. Repeat step S23 to add multiple processing nodes; S25. Connect the nodes to form a business process, complete the arrangement of a business rule, and then perform visual operations; S26. Add multiple business rules and form a rule base. The system manages and maintains the rules of the rule base.

Images