Data tracing method and device, electronic equipment and storage medium

By obtaining data identification and change information of financial data, and generating traceability path information, the problem of traceability of data fields and row records in financial data is solved, the accurate display of data flow and blood relationship is achieved, and the efficiency and controllability of data management is improved. .

CN119088872APending Publication Date: 2024-12-06CHINA CONSTRUCTION BANK +1
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411149626.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-21
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

The prior art is difficult to accurately trace data fields and row records in financial data, especially in the collection and transmission of anti-money laundering data, and there is a lack of effective data traceability methods.

Method used

A data traceability method is proposed. By obtaining the data to be traced and its type of data identification, and obtaining changes information related to the identification, describing the allocation and change of data fields and row records in the process of generating the data to be traced and generating and traceability The traceability path information corresponding to the type to achieve accurate traceability of data fields and row records.

Benefits of technology

It realizes accurate traceability of data fields and row records in the data table, improves the ability to display data flow and blood relationships, meets the regulatory requirements of financial data processing, and improves business personnel's control and understanding of data paths.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119088872A_ABST
    Figure CN119088872A_ABST
Patent Text Reader

Abstract

The invention provides a data traceability method and device, electronic equipment and a storage medium, and relates to the technical field of computers, the data traceability method comprises the steps that to-be-traced data and the traceability type of the to-be-traced data are acquired, and the to-be-traced data has a corresponding data identifier; change information related to the data identification is obtained, the change information is used for describing the distribution condition and change condition of a first identification and / or a second identification in the process of generating the to-be-traced data, the first identification is used for describing a data field of the source table, and the second identification is used for describing a row record of the source table; and generating traceability path information corresponding to the traceability type according to the change information, thereby solving the technical problem that traceability cannot be accurately performed on data fields and line records in the data table in the prior art.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a data tracing method, device, electronic device and storage medium. Background Art

[0002] In order to collect and transmit some financial data (such as anti-money laundering data), a complete set of data processing, integration, analysis and management solutions needs to be established, and data tracing is the key and difficulty. In the related technology, it is not possible to accurately trace the data fields and row records in the data table. Summary of the invention

[0003] The present disclosure aims to solve one of the technical problems in the related art at least to some extent.

[0004] To this end, the first objective of the present disclosure is to propose a data tracing method to accurately trace the data fields and row records in a data table.

[0005] The second objective of the present disclosure is to provide a data tracing device.

[0006] A third objective of the present disclosure is to provide an electronic device.

[0007] A fourth objective of the present disclosure is to provide a computer-readable storage medium.

[0008] A fifth object of the present disclosure is to provide a computer program product.

[0009] To achieve the above-mentioned purpose, the first aspect of the present disclosure proposes a data traceability method, including: obtaining the data to be traced and the traceability type of the data to be traced, wherein the data to be traced has a corresponding data identifier; obtaining change information related to the data identifier, wherein the change information is used to describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced, the first identifier is used to describe the data field of the source table, and the second identifier is used to describe the row record of the source table; and generating traceability path information corresponding to the traceability type according to the change information.

[0010] To achieve the above-mentioned purpose, the second aspect embodiment of the present disclosure proposes a data tracing device, including: a first acquisition module, used to obtain the data to be traced and the traceability type of the data to be traced, wherein the data to be traced has a corresponding data identifier; a second acquisition module, used to obtain change information related to the data identifier, wherein the change information is used to describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced, the first identifier is used to describe the data field of the source table, and the second identifier is used to describe the row record of the source table; and a generation module, used to generate traceability path information corresponding to the traceability type according to the change information.

[0011] To achieve the above-mentioned purpose, the third aspect embodiment of the present disclosure proposes an electronic device, including: a processor, and a memory communicatively connected to the processor; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory to implement a data tracing method proposed in the first aspect embodiment of the present disclosure.

[0012] To achieve the above-mentioned purpose, the fourth aspect embodiment of the present disclosure proposes a computer-readable storage medium, in which computer execution instructions are stored. When the computer execution instructions are executed by the processor, they are used to implement a data tracing method proposed in the first aspect embodiment of the present disclosure.

[0013] To achieve the above-mentioned purpose, the fifth aspect of the present disclosure proposes a computer program product, including a computer program, which, when executed by a processor, implements a data tracing method proposed in the first aspect of the present disclosure.

[0014] The data tracing method, device, electronic device, non-transient computer-readable storage medium storing computer instructions, and computer program product provided by the present disclosure obtain the data to be traced and the tracing type of the data to be traced, wherein the data to be traced has a corresponding data identifier, and obtain the change information related to the data identifier, wherein the change information is used to describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced, the first identifier is used to describe the data field of the source table, and the second identifier is used to describe the row record of the source table, and according to the change information, the tracing path information corresponding to the tracing type is generated. In this way, the data fields and row records in the data table can be accurately traced.

[0015] Additional aspects and advantages of the present disclosure will be given in part in the following description and in part will be obvious from the following description or learned through practice of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The above and / or additional aspects and advantages of the present disclosure will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0017] Figure 1 A flowchart of a data tracing method provided by an embodiment of the present disclosure;

[0018] Figure 2 A flowchart of another data tracing method provided by an embodiment of the present disclosure;

[0019] Figure 3 This is a schematic diagram of data tracing in an embodiment of the present disclosure;

[0020] Figure 4is a schematic diagram of the ETL process in the embodiment of the present disclosure;

[0021] Figure 5 It is a schematic diagram of table-level data flow in an embodiment of the present disclosure;

[0022] Figure 6 is a schematic diagram of field-level data flow in one embodiment of the present disclosure;

[0023] Figure 7 is a schematic diagram of field-level data flow in another embodiment of the present disclosure;

[0024] Figure 8 is a schematic diagram of record-level data flow in another embodiment of the present disclosure;

[0025] Fig. 9 A schematic diagram of the structure of a data tracing device provided in an embodiment of the present disclosure;

[0026] Fig.10 It is a schematic structural diagram of an electronic device shown in an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0027] Embodiments of the present disclosure are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present disclosure, and should not be construed as limiting the present disclosure.

[0028] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. The acquisition, transmission, storage, use and processing of data in the technical solution of this disclosure are in compliance with the relevant provisions of national laws and regulations.

[0029] It should be noted that in the embodiments of the present disclosure, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present disclosure, but it does not mean that the applicant has or will necessarily use the solution.

[0030] Figure 1 A flowchart of a data tracing method provided in an embodiment of the present disclosure.

[0031] This embodiment takes the data tracing method being configured in a data tracing device as an example. In this embodiment, the data tracing method can be configured in the data tracing device. The data tracing device can be set in a server or in an electronic device, and there is no limitation to this.

[0032] This embodiment takes the data tracing method configured in an electronic device as an example, wherein the electronic device is a hardware device such as a smart phone, a tablet computer, a personal digital assistant, an e-book, etc. having various operating systems.

[0033] It should be noted that the execution subject of the embodiment of the present disclosure may be, for example, a central processing unit (CPU) in a server or electronic device in terms of hardware, or may be, for example, a related background service in a server or electronic device in terms of software, without limitation.

[0034] like Figure 1 As shown, the data tracing method includes:

[0035] S101: Acquire the data to be traced and the traceability type of the data to be traced, wherein the data to be traced has a corresponding data identifier.

[0036] The data to be traced may refer to data for which the blood relationship, source system, or source table needs to be checked. The data to be traced may be data in a result table, which refers to a result table obtained by processing, aggregating, and handling data in one or more source tables.

[0037] In some embodiments, the traceability requirements may be analyzed and the data to be traced may be determined based on the result table; or the data to be traced may be received from a third-party device; or the financial data to be collected and transmitted may be determined based on business requirements, and in the process of collecting and transmitting financial data, the data to be traced may be determined based on business requirements, and there is no limitation on this.

[0038] In some embodiments, the data to be traced includes at least one of the following: a data table to be traced; a field of the data table to be traced; and a row record of the data table to be traced. Thus, effective traceability of data tables, fields, and row records can be supported.

[0039] Among them, the data table to be traced can be, for example, a result table. Tracing the source of the data table to be traced can also be called table-level tracing. Table-level tracing refers to tracing the source of a data table, including the source system and the source table. Tracing the fields of the data table to be traced can also be called field-level tracing. Field-level tracing refers to tracing the source of the fields of a data table (such as the data table to be traced and the result table), including the source system, source table, and source field of the relevant fields. Tracing the row records of the data table to be traced can also be called record-level tracing. Record-level tracing refers to tracing the source of a specific row record of a data table (such as the data table to be traced and the result table), including the source system, source table, and source row record of the row record.

[0040] The traceability type is used to distinguish the above-mentioned traceability types, such as table-level traceability, field-level traceability, and record-level traceability, which are not limited.

[0041] The data to be traced has a corresponding data identifier. The data identifier is used to uniquely identify the data to be traced. The data identifier is, for example, the name of the table to be traced, the identifier of the field of the data table to be traced, and the identifier of the row record of the data table to be traced. The data identifier can be dynamically allocated during the processing, aggregation, and processing of the data fields and / or row records in the source table, or it can be obtained by changing the identifier of the data field and / or the identifier of the row record in the source table, without limitation.

[0042] After obtaining the data to be traced and the traceability type of the data to be traced, the data identifier corresponding to the data to be traced can be determined, and then the data to be traced can be traced based on the data identifier.

[0043] S102: Obtain change information related to the data identifier, wherein the change information is used to describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced, the first identifier is used to describe the data field of the source table, and the second identifier is used to describe the row record of the source table.

[0044] The identifier used to describe the data field of the source table may be referred to as the first identifier. The first identifier may be uniquely used to identify the data field of the source table. The identifier used to identify the row record of the source table may be referred to as the second identifier. The second identifier may be uniquely used to identify the row record of the source table.

[0045] The change information is used to describe the allocation and change of the first identifier in the process of generating the data to be traced. The change information can also be used to describe the allocation and change of the second identifier in the process of generating the data to be traced.

[0046] In some embodiments, in the process of processing, aggregating, and handling data fields and / or row records in a source table to generate data to be traced, identifiers can be dynamically assigned to data fields and / or row records in the source table. When identifiers have been assigned to data fields and / or row records in the source table, changes in the identifiers of data fields and / or row records in the source table can be dynamically recorded to obtain change information. After the data to be traced is generated, the change information can be associated with the data identifier of the data to be traced. A mapping relationship between the change information and the data identifier of the data to be traced can be generated, so that after determining the data identifier corresponding to the data to be traced, the change information can be determined based on the data identifier and the mapping relationship.

[0047] In some embodiments, the number of source tables may be one or more, that is, in the process of generating the data to be traced, it may involve processing, aggregating, and processing the data fields and / or row records in one or more source tables. For example, the data fields and / or row records in source table A and source table B may be processed, aggregated, and processed at the same time; or the data fields and / or row records in source table A may be processed, aggregated, and processed first to obtain an intermediate result table of source table A, and then the data fields and / or row records in the intermediate result table and the data fields and / or row records in source table B may be processed, aggregated, and processed to obtain the data to be traced.

[0048] In some embodiments, the change information may be used to describe, in the process of generating the data to be traced, the allocation of the first identifier of the data field in source table A, the allocation of the second identifier of the row record of source table A, the allocation of the first identifier of the data field in source table B, the allocation of the second identifier of the row record of source table B, the change of the first identifier of the data field in source table A during the process of source table A being processed, aggregated, and processed into an intermediate result table, the change of the second identifier of the row record of source table A during the process of source table A being processed, aggregated, and processed into an intermediate result table, the allocation of the first identifier of the data field in the intermediate result table, the allocation of the second identifier of the row record in the intermediate result table, and the change of the first identifier of the data field in the intermediate result table. The change of the first identifier of the data field during the process of the intermediate result table being processed, aggregated, and processed into the data to be traced; the change of the first identifier of the data field in the intermediate result table during the process of the intermediate result table being processed, aggregated, and processed into the data to be traced, the change of the first identifier of the data field in the intermediate result table during the process of the intermediate result table being processed, aggregated, and processed into the data to be traced, the change of the second identifier of the row record in the intermediate result table during the process of the intermediate result table being processed, aggregated, and processed into the data to be traced, and so on. It can be seen that the change information can accurately and comprehensively describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced.

[0049] In some embodiments, the mapping relationship between the data identifier of the data to be traced and the change information can be written into the change record table, so that when obtaining the change information related to the data identifier, the data identifier can be used as an index of the change information, and the change information can be queried from the change record table based on the index.

[0050] In some embodiments, change information related to the data identifier is obtained, and the change information can be used to trace the source of the data to be traced.

[0051] S103: Generate traceability path information corresponding to the traceability type according to the change information.

[0052] After obtaining the data to be traced and the traceability type of the data to be traced, wherein the data to be traced has a corresponding data identifier, and obtaining change information related to the data identifier, traceability path information corresponding to the traceability type can be generated according to the change information.

[0053] In some embodiments, the traceability path information refers to information related to the traceability path. The traceability path refers to the source path of the data to be traced. The traceability path information is associated with the traceability type. The traceability type is, for example, table-level traceability, field-level traceability, and record-level traceability. The traceability path information corresponding to the table-level traceability may be, for example, the table-level traceability path information. The traceability path information corresponding to the field-level traceability may be, for example, the field-level traceability path information. The traceability path information corresponding to the record-level traceability may be, for example, the record-level traceability path information. Among them, the table-level traceability path information can be used to describe the information of each source table involved in the path of generating the data table to be traced. The field-level traceability path information can be used to describe the information of each source table involved in the path of generating the field of the data table to be traced, and the information of the data fields in each source table. The record-level traceability path information can be used to describe the information of each source table involved in the path of generating the row record of the data table to be traced, and the information of the row record in each source table, without limitation.

[0054] In some embodiments, since the change information can describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced, the first identifier is used to describe the data field of the source table, and the second identifier is used to describe the row record of the source table. Therefore, in the process of generating the traceability path information corresponding to the traceability type according to the change information, the allocation and change of the first identifier can be referred to to analyze the change processing of the data field of the source table uniquely identified by the first identifier (for example, before the change, the first identifier is used to identify the data field A, and the data field A is changed to the data field B, then a first identifier is assigned to the data field B. In the traceability process, based on the change of the first identifier, it can be clarified that the data field A is changed to the data field B. By analogy, the path to generate the data to be traced can be determined. Various possible changes of data fields in the source table and various possible changes of row records in the source table to guide the tracing of traceable data), and referring to the allocation and change of the second identifier, to analyze the change processing of the row records of the source table uniquely identified by the second identifier, and then the traceability path information of the corresponding traceability type can be clarified based on the aforementioned change processing; or the change information can be identified based on artificial intelligence to analyze the traceability path information corresponding to the traceability type based on the allocation and change of the first identifier and / or the second identifier it carries; or it can be combined with any other possible method to generate the traceability path information corresponding to the traceability type according to the change information, such as the method of identifier statistics, the method of data table detailed analysis, etc., without limitation.

[0055] In this embodiment, by obtaining the data to be traced and the traceability type of the data to be traced, wherein the data to be traced has a corresponding data identifier, and obtaining the change information related to the data identifier, wherein the change information is used to describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced, the first identifier is used to describe the data field of the source table, the second identifier is used to describe the row record of the source table, and according to the change information, the traceability path information corresponding to the traceability type is generated. Accurately trace the data fields and row records in the data table.

[0056] In some embodiments of the present disclosure, the change information is generated based on the following methods: assigning a first identifier to a data field of a source table, and / or assigning a second identifier to a row record of a source table; generating data to be traced based on the data field and / or row record of the source table; determining the change of the first identifier and / or the change of the second identifier in the process of generating the data to be traced; and generating the change information based on the assignment and the change. Thus, the change of the first identifier and / or the change of the second identifier can be recorded in a timely manner, ensuring the accuracy of the change information, and effectively supporting the improvement of the accuracy of data traceability.

[0057] Figure 2 A flowchart of another data tracing method provided in an embodiment of the present disclosure.

[0058] like Figure 2 As shown, the data tracing method includes:

[0059] S201: Acquire the data to be traced and the traceability type of the data to be traced, wherein the data to be traced has a corresponding data identifier.

[0060] S202: Obtain change information related to the data identifier, wherein the change information is used to describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced, the first identifier is used to describe the data field of the source table, and the second identifier is used to describe the row record of the source table.

[0061] S203: Generate traceability path information corresponding to the traceability type according to the change information.

[0062] For the description of S201 - S203 , please refer to the above embodiment, which will not be repeated here.

[0063] S204: Generate a data flow diagram of the data to be traced based on the source table information, the table information of the data to be traced, and the data flow and blood relationship between the source table and the data to be traced.

[0064] Among them, data flow can be used to describe the data relationship change process between the source table and the data to be traced. Blood relationship can be used to describe the data source between the source table and the data to be traced. Data flow diagram can be used to intuitively display the data flow and blood relationship between the source table and the data to be traced.

[0065] The source table information is used to describe the source table. The source table information is such as the source table identifier and / or table name. The table information of the data to be traced can be used to describe the data table to be traced. The table information of the data to be traced is such as the source table identifier and / or table name.

[0066] Optionally, in some embodiments, the data flow direction includes at least one of the following: table-level data flow direction; field-level data flow direction; record-level data flow direction. The table-level data flow direction can be used to describe the data relationship change process between the source table and the data table to be traced. The field-level data flow direction can be used to describe the data relationship change process between the data fields in the source table and the fields in the data table to be traced. The record-level data flow direction can be used to describe the data relationship change process between the row records in the source table and the row records in the data table to be traced. In this way, it is possible to intuitively display the table-level data flow direction and / or field-level data flow direction and / or record-level data flow direction between the source table and the data to be traced.

[0067] S205: Displaying a data flow diagram of the data to be traced in an interface of the electronic device.

[0068] After the data flow diagram of the data to be traced is generated according to the source table information, the table information of the data to be traced, and the data flow and blood relationship between the source table and the data to be traced, the data flow diagram of the data to be traced can be displayed in the interface of the electronic device.

[0069] In this embodiment, by obtaining the data to be traced and the traceability type of the data to be traced, wherein the data to be traced has a corresponding data identifier, and obtaining change information related to the data identifier, wherein the change information is used to describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced, the first identifier is used to describe the data field of the source table, the second identifier is used to describe the row record of the source table, and according to the change information, the traceability path information corresponding to the traceability type is generated. In order to accurately trace the data fields and row records in the data table. By generating a data flow diagram of the data to be traced according to the source table information, the table information of the data to be traced, and the data flow and blood relationship between the source table and the data to be traced, and displaying the data flow diagram of the data to be traced in the interface of the electronic device, the data flow and blood relationship between the source table and the data to be traced can be intuitively displayed.

[0070] In some embodiments of the present disclosure, after displaying a data flow diagram of data to be traced in an interface of an electronic device, first instruction information may be detected, wherein the first instruction information is used to select table information of data to be traced in the data flow diagram, and display at least one data field of the table of data to be traced in the interface of the electronic device. Thus, on-demand display of one or more data fields in the table of data to be traced is supported.

[0071] In some embodiments of the present disclosure, after displaying a data flow diagram of the data to be traced in the interface of the electronic device and displaying at least one data field of the data table to be traced, second instruction information can be detected, wherein the second instruction information is used to select a target data field from at least one data field, and determine the field-level data flow corresponding to the target data field according to the traceability path information, and display first marking information in the displayed data flow diagram, wherein the first marking information is used to mark the field-level data flow from the data flow diagram. This enables an intuitive display of the field-level data flow of the data to be traced, and improves the practicality of data traceability.

[0072] In some embodiments of the present disclosure, after displaying the data flow diagram of the data to be traced in the interface of the electronic device, the third instruction information can be detected, wherein the third instruction information is used to determine the row record of the data table to be traced (for example, it can be a selected row record in the data table to be traced), and according to the traceability path information, determine the record-level data flow corresponding to the row record of the data table to be traced, display the row record of the data table to be traced in the interface of the electronic device, and display the second marking information in the displayed data flow diagram, wherein the second marking information is used to mark the record-level data flow from the data flow diagram. Thereby, the record-level data flow of the data to be traced can be intuitively displayed, and the practicality of data tracing can be improved.

[0073] The examples for the above embodiment are as follows:

[0074] The following examples are based on financial data, such as anti-money laundering data. The financial system is, for example, an anti-money laundering system, which is not limited to this.

[0075] The disclosed embodiment proposes a financial data traceability method that integrates table level, field level and data row level. By assigning a unique identifier to each row of records and each data field, all change information is dynamically recorded during the data processing process. By analyzing the change records, table level, field level and record level traceability paths are constructed to achieve a graphical display of data flow and blood relationship, which meets the regulatory requirements for financial data processing, greatly improves the business personnel's control and understanding of data paths, and ensures that business personnel and technical personnel can promptly discover and quickly resolve data-related issues.

[0076] The disclosed embodiment mainly includes four parts: data processing and integration, data marking and change records, traceability path analysis records, and data flow and lineage display. Figure 3 As shown, Figure 3 It is a schematic diagram of data tracing in an embodiment of the present disclosure.

[0077] Part 1: Data processing and integration. We can analyze financial data needs, design financial data processing and integration solutions, and form data extraction, transformation and loading (ETL) processes. Figure 4 As shown, Figure 4 The ETL process diagram in the embodiment of the present disclosure is shown in Figure 1. Table A1 of system A and table B1 of system B are processed and integrated to form financial data table T1.

[0078] Part 2: Data tagging and change records. All systems and tables on the ETL processing path must assign a unique identifier to each row record and each data field, and record the generation (assignment) and changes of the identifier during data generation or processing and integration. For example: when system A generates A1, system B generates table B1, and the financial system processes and integrates financial data table T1, they can assign unique identifiers and record changes.

[0079] (1) Assign a unique identifier: A unique identifier row_uid (starting with RUID) can be assigned to each row record, and a unique identifier xxxx_uid (starting with CUID) can be assigned to each data field.

[0080] (2) Record change marks: System A, System B, and the anti-money laundering system can record the generation and change of marks during the data generation or processing and integration process.

[0081] (3) Traceability path analysis and recording: At the end of the day, by analyzing the change records, the traceability path details are constructed (table level, field level, record level. The traceability path details are an optional example of traceability path information).

[0082] (4) Data flow and lineage display: Use graph databases, combined with traceability path details, to display data flow and lineage relationships (table level, field level, record level). Figure 5 As shown, Figure 5 1. Click on the target table T1 to list the fields corresponding to T1. Figure 6 As shown, Figure 6 ii. Select the field you want to view to display the corresponding field-level data flow. Figure 7 As shown, Figure 7 FIG. 2 is a schematic diagram of field-level data flow in another embodiment of the present disclosure. Figure 8 As shown, Figure 8 This is a schematic diagram of record-level data flow in another embodiment of the present disclosure. Click the target table T1, enter the unique identifier row_uid of the row record you want to view, and the corresponding record-level data flow will be displayed.

[0083] Therefore, the data traceability method provided in the embodiment of the present disclosure can achieve data traceability without relying on scheduling configuration tools, and has a wider range of application scenarios. Data traceability has nothing to do with whether the systems on the processing path belong to the same platform, and the application method is more flexible. Not only can table-level traceability be achieved, but also field-level and record-level processing path traceability can be achieved, so that business personnel can promptly locate the relevant systems and links where problems occur when problems such as missing data content in a certain row, data re-entry, and incorrect data content occur. The change information analyzed daily is the latest processing path, which is independent of whether the processing logic has changed, ensuring the timeliness and accuracy of traceability.

[0084] Fig. 9 A schematic diagram of the structure of a data tracing device provided in an embodiment of the present disclosure.

[0085] like Fig. 9 As shown, the data tracing device 90 includes:

[0086] The first acquisition module 901 is used to acquire the data to be traced and the traceability type of the data to be traced, wherein the data to be traced has a corresponding data identifier.

[0087] The second acquisition module 902 is used to obtain change information related to the data identifier, wherein the change information is used to describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced, the first identifier is used to describe the data field of the source table, and the second identifier is used to describe the row record of the source table.

[0088] The generating module 903 is used to generate the traceability path information corresponding to the traceability type according to the change information.

[0089] It should be noted that the above explanation of the data tracing method is also applicable to the data tracing device of this embodiment and will not be repeated here.

[0090] In this embodiment, by obtaining the data to be traced and the traceability type of the data to be traced, wherein the data to be traced has a corresponding data identifier, and obtaining the change information related to the data identifier, wherein the change information is used to describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced, the first identifier is used to describe the data field of the source table, the second identifier is used to describe the row record of the source table, and according to the change information, the traceability path information corresponding to the traceability type is generated. Accurately trace the data fields and row records in the data table.

[0091] As an example, Fig.10 is a schematic diagram of the structure of an electronic device shown in an exemplary embodiment of the present disclosure, such as Fig.10 As shown, the electronic device 700 may further include:

[0092] The memory 710 and the processor 720, a bus 730 connecting different components (including the memory 710 and the processor 720), the memory 710 stores a computer program, and when the processor 720 executes the program, the data tracing method of the embodiment of the present disclosure is implemented.

[0093] Bus 730 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus architectures. For example, these architectures include but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus and Peripheral Component Interconnect (PCI) bus.

[0094] The electronic device 700 typically includes a variety of electronic device readable media. These media can be any available media that can be accessed by the electronic device 700, including volatile and non-volatile media, removable and non-removable media.

[0095] The memory 710 may also include computer system readable media in the form of volatile memory, such as random access memory (RAM) 740 and / or cache memory 750. The electronic device 700 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 760 may be used to read and write non-removable, non-volatile magnetic media ( Fig.10 not shown, usually called a "hard drive"). Although Fig.10 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 730 via one or more data medium interfaces. The memory 710 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present disclosure.

[0096] A program / utility 780 having a set (at least one) of program modules 770 may be stored, for example, in the memory 710, such program modules 770 including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 770 generally perform the functions and / or methods of the embodiments described in the present disclosure.

[0097] The electronic device 700 may also communicate with one or more external devices 790 (e.g., keyboard, pointing device, display 791, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 700, and / or communicate with any device that enables the electronic device 700 to communicate with one or more other computing devices (e.g., network card, modem, etc.). Such communication may be performed through an input / output (I / O) interface 792. Furthermore, the electronic device 700 may also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN) and / or public network, such as the Internet) through a network adapter 793. As shown, the network adapter 793 communicates with other modules of the electronic device 700 through a bus 730. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0098] The processor 720 executes various functional applications and data processing by running the programs stored in the memory 710 .

[0099] It should be noted that the implementation process and technical principles of the electronic device of this embodiment refer to the aforementioned explanation of the data tracing method of the embodiment of the present disclosure, and will not be repeated here.

[0100] In order to implement the above embodiments, the present disclosure also proposes an electronic device, including: a processor, and a memory communicatively connected to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory to implement the method provided by the above embodiments.

[0101] In order to implement the above embodiments, the present disclosure further proposes a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the methods provided by the above embodiments.

[0102] In order to implement the above embodiments, the present disclosure also proposes a computer program product, including a computer program, which implements the methods provided by the above embodiments when executed by a processor.

[0103] The collection, storage, use, processing, transmission, provision and disclosure of user personal information involved in this disclosure shall comply with the relevant laws and regulations and shall not violate public order and good morals.

[0104] It should be noted that personal information from users should be collected for legitimate and reasonable purposes and should not be shared or sold outside of these legitimate uses. In addition, such collection / sharing should be carried out after receiving the user's informed consent, including but not limited to notifying the user to read the user agreement / user notice and sign the agreement / authorization including authorization of relevant user information before the user uses the function. In addition, any necessary steps should be taken to protect and safeguard access to such personal information data and ensure that others who have access to personal information data comply with its privacy policy and procedures.

[0105] The present disclosure anticipates providing implementation schemes for users to selectively block the use or access of personal information data. That is, the present disclosure anticipates providing hardware and / or software to prevent or block access to such personal information data. Once the personal information data is no longer needed, risks can be minimized by limiting data collection and deleting the data. In addition, when applicable, such personal information is de-identified to protect the privacy of the user.

[0106] In the description of the aforementioned embodiments, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are contradictory.

[0107] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0108] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present disclosure includes additional implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present disclosure belong.

[0109] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0110] It should be understood that the various parts of the present disclosure can be implemented in hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0111] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0112] In addition, each functional unit in each embodiment of the present disclosure may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0113] The storage medium mentioned above may be a read-only memory, a disk or an optical disk, etc. Although the embodiments of the present disclosure have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations of the present disclosure. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present disclosure.

Claims

1. A data tracing method, characterized in that: The method comprises: Acquire the data to be traced and the traceability type of the data to be traced, wherein the data to be traced has a corresponding data identifier; Acquire change information related to the data identifier, wherein the change information is used to describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced, the first identifier is used to describe the data field of the source table, and the second identifier is used to describe the row record of the source table; and According to the change information, traceability path information corresponding to the traceability type is generated.

2. The method according to claim 1, characterized in that The data to be traced includes at least one of the following: Table of data to be traced; Fields of the data table to be traced; The row records of the data table to be traced.

3. The method according to claim 1, characterized in that: The traceability path information includes at least one of the following: Table-level traceability path information; Field-level traceability path information; Record-level traceability path information.

4. The method according to claim 1, characterized in that: The change information is generated based on the following method: Assigning a first identifier to a data field of the source table, and / or assigning a second identifier to a row record of the source table; Generate the data to be traced based on the data fields and / or row records of the source table; In the process of generating the data to be traced, determining the change of the first identification and / or the change of the second identification; and The change information is generated based on the allocation situation and the change situation.

5. The method according to claim 1, characterized in that The method further comprises: Generate a data flow diagram of the data to be traced based on the source table information, the table information of the data to be traced, and the data flow and blood relationship between the source table and the data to be traced; A data flow diagram of the data to be traced is displayed in an interface of the electronic device.

6. The method according to claim 5, characterized in that The data flow direction includes at least one of the following: Table-level data flow; Field-level data flow; Record-level data flow.

7. The method according to claim 5, characterized in that The method further comprises: Detecting first instruction information, wherein the first instruction information is used to select table information of the data to be traced in the data flow diagram; At least one data field of the data table to be traced is displayed in the interface of the electronic device.

8. The method according to claim 7, characterized in that The method further comprises: detecting second instruction information, wherein the second instruction information is used to select a target data field from the at least one data field; Determine the field-level data flow direction corresponding to the target data field according to the traceability path information; The first marking information is displayed in the displayed data flow diagram, wherein the first marking information is used to mark the field-level data flow in the data flow diagram.

9. The method according to claim 5, characterized in that The method further comprises: Detecting third instruction information, wherein the third instruction information is used to determine a row record of a data table to be traced; Determine the record-level data flow direction corresponding to the row record of the to-be-traced data table according to the traceability path information; Displaying the row records of the to-be-traced data table in the interface of the electronic device; The second marking information is displayed in the displayed data flow diagram, wherein the second marking information is used to mark the record-level data flow in the data flow diagram.

10. A data tracing device, characterized in that: The device comprises: A first acquisition module is used to acquire the data to be traced and the traceability type of the data to be traced, wherein the data to be traced has a corresponding data identifier; a second acquisition module, configured to acquire change information related to the data identifier, wherein the change information is used to describe the allocation and change of the first identifier and / or the second identifier in the process of generating the data to be traced, the first identifier is used to describe the data field of the source table, and the second identifier is used to describe the row record of the source table; and A generation module is used to generate traceability path information corresponding to the traceability type according to the change information.

11. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 9 when executed by a processor.

13. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to any one of claims 1 to 9 when being executed by a processor.

Citation Information

Patent Citations

  • Data blood relationship construction and tracing method, device and equipment

    CN113138990A

  • Blood relationship construction method applied to data traceability, storage medium and equipment

    CN114064640A

  • Financial data consanguinity analysis method, device and system and storage medium

    CN117078371A

  • Snapshot-based data tracing method and system

    CN117743298A