Data management method and device and storage medium

Abstract

The invention discloses a data management method and device and a storage medium, and belongs to the field of data processing. The method comprises the steps that an object configuration interface is displayed, the object configuration interface is used for indicating a user to configure an object data format, and the object data format comprises a first source object data format and a target object data format; obtaining first source object data, wherein the format of the first source object data meets the first source object data format; a rule configuration interface is displayed, the rule configuration interface is used for indicating a user to configure a processing rule, and the processing rule is used for performing data management on data of which the format meets the first source object data format; a processing rule is obtained, first target object data is obtained according to the first source object data and the processing rule, the format of the first target object data meets the target object data format, and the first target object data is used for describing a data governance result obtained by carrying out data governance on the first source object data based on the processing rule. According to the invention, the data management efficiency can be improved.

Description

[0001] This application claims priority to Chinese patent application No. 202310989447.5 filed on August 8, 2023, with invention name “A method, system and device for object conversion”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of data processing, and in particular to a method, device and storage medium for data governance. Background Art

[0003] Data governance is a set of management behaviors involving data usage in an enterprise. Data governance has become the foundation of enterprise digital transformation and the engine of enterprise business upgrade. In theory, data that has undergone data governance can support the business improvement of an enterprise.

[0004] In the related art, a technician may write a program for implementing data governance in advance, and then run the program to perform data governance on the data source of the enterprise with high effectiveness. Since the program is written by the technician, it often takes a lot of time to write the program, which greatly reduces the efficiency of data governance. Summary of the invention

[0005] The present application provides a method, device and storage medium for data management to improve the efficiency of data management. The technical solution is as follows:

[0006] In a first aspect, the present application provides a method for data governance, in which an object configuration interface is displayed, and the object configuration interface is used to instruct a user to configure an object data format, and the object data format includes a first source object data format and a target object data format. First source object data is obtained, and the format of the first source object data satisfies the first source object data format. A rule configuration interface is displayed, and the rule configuration interface is used to instruct a user to configure a processing rule, and the processing rule is used to perform data governance on data whose format satisfies the first source object data format. The processing rule is obtained, and the first target object data is obtained according to the first source object data and the processing rule, and the format of the first target object data satisfies the target object data format, and the first target object data is used to describe the data governance result obtained by performing data governance on the first source object data based on the processing rule.

[0007] Since the rule configuration interface is displayed, the user uses the rule configuration interface to configure the processing rules for data governance, so that the first source object data can be data governed based on the processing rules and the first target object data can be obtained. The time required to configure the processing rules using the rule configuration interface is shorter, and compared with manually writing a data governance program to perform data governance, the efficiency of data governance can be greatly improved.

[0008] Since the object configuration interface is displayed, users can use the object configuration interface to configure the object data format. Based on the object data format, the data that users manage are all object data in the object data format. When managing object data, the object data does not need to be saved to the disk, and the object data can be saved in the memory. Since data does not need to be saved to the disk, the efficiency of data management is improved.

[0009] In a possible implementation, the first source object data format includes at least one attribute field and multiple sub-attribute fields of each attribute field, and the first source object data includes content corresponding to the at least one attribute field and content corresponding to the multiple sub-attribute fields of each attribute field. Thus, the first source object data whose format satisfies the first source object data format can be obtained through the first source object data format, and data governance can be performed on the first source object data, thereby improving the efficiency of data governance.

[0010] In another possible implementation, for each attribute field, the multiple sub-attribute fields of the attribute field include an identification field, a name field, and a type field, and the contents corresponding to the multiple sub-attribute fields of the attribute field include an attribute identifier corresponding to the identification field, an attribute name corresponding to the name field, and an attribute type corresponding to the type field.

[0011] In another possible implementation, the object configuration interface includes an identification configuration area, a name configuration area, and a type configuration area, wherein the identification configuration area is used to indicate that the user configures the identification field, the name configuration area is used to indicate that the user configures the name field, and the type configuration area is used to indicate that the user configures the type field. Thus, the first source object data format can be configured to include an attribute identification, an attribute name, and an attribute type.

[0012] In another possible implementation, the object data format also includes a second source object data format. The second source object data is obtained, and the format of the second source object data satisfies the second source object data format, wherein the processing rule is used to perform data governance on the data whose format satisfies the first source object data format and the data whose format satisfies the second source object data format. The first target object data is obtained according to the first source object data, the second source object data, and the processing rule. In this way, data governance can be performed on multiple source object data, and governance can be performed on one or more object data, thereby improving the flexibility of data governance.

[0013] In another possible implementation, the processing rules include at least one first attribute field in the first source object data format, at least one second attribute field in the second source object data format, at least one rule condition, and at least one data governance operation. Perform operations on at least one content corresponding to at least one first attribute field of the first source object data and at least one content corresponding to at least one second attribute field of the second source object data to obtain at least one operation result. When the operation result satisfies at least one rule condition, perform at least one data governance operation on the first source object data to obtain a data governance result. Obtain the first target object data for describing the data governance result. In this way, data governance can be performed through processing rules, and processing rules can be quickly configured through the rule configuration interface, thereby improving the efficiency of data governance.

[0014] In another possible implementation, a data correction configuration interface is displayed, and the data correction configuration interface is used to instruct the user to configure data correction rules, and the data correction rules include inspection rules and correction operations corresponding to each attribute field of the first source object data format. Receive third source object data, and the third source object data includes the content corresponding to each attribute field. Check whether the content corresponding to each attribute field of the third source object data satisfies the inspection rules corresponding to each attribute field. When it is found that the content corresponding to the attribute field does not satisfy the inspection rule corresponding to the attribute field, modify the content corresponding to the attribute field included in the third source object data based on the correction operation corresponding to the attribute field to obtain the first source object data. In this way, the third source object data can be corrected by the data correction rules to obtain the first source object data, thereby avoiding errors in data governance.

[0015] In another possible implementation, one or more of the following information is displayed: the amount of source object data obtained, the amount of source object data subject to data governance, or the amount of source object data modified. This makes it easier for users to get an overview of the results of data governance and improves user experience.

[0016] In a second aspect, the present application provides a data governance device for executing the method in the first aspect or any possible implementation of the first aspect. Specifically, the device includes a unit for executing the method in the first aspect or any possible implementation of the first aspect.

[0017] In a third aspect, the present application provides a data governance device for executing the method in the first aspect or any possible implementation of the first aspect. Specifically, the device includes a unit for executing the method in the first aspect or any possible implementation of the first aspect.

[0018] In a fourth aspect, the present application provides a computing device cluster, wherein the computing device cluster includes at least one computing device, each device in the at least one computing device includes at least one processor and at least one memory, and computer-readable instructions are stored in the at least one memory; the at least one processor executes the computer-readable instructions so that the computing device cluster executes the method in the first aspect or any possible implementation of the first aspect.

[0019] In a fifth aspect, the present application provides a computer program product, which includes a computer program stored in a computer-readable storage medium, and the computer program is loaded by a processor to implement the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0020] In a sixth aspect, the present application provides a computer-readable storage medium for storing a computer program, wherein the computer program is loaded by a processor to execute the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0021] In a seventh aspect, the present application provides a chip comprising a memory and a processor, wherein the memory is used to store computer instructions, and the processor is used to call and run the computer instructions from the memory to execute the method in the above-mentioned first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 is a schematic diagram of a network architecture provided in an embodiment of the present application;

[0023] Figure 2 is a schematic diagram of another network architecture provided in an embodiment of the present application;

[0024] Figure 3 It is a schematic diagram of a data management device provided in an embodiment of the present application;

[0025] Figure 4 is a schematic diagram of another data management device provided in an embodiment of the present application;

[0026] Figure 5 This is a flow chart of a method for data governance provided by an embodiment of the present application;

[0027] Figure 6 is a schematic diagram of an object data format provided in an embodiment of the present application;

[0028] Figure 7 is a schematic diagram of an object configuration interface provided in an embodiment of the present application;

[0029] Figure 8is a schematic diagram of another object data format provided in an embodiment of the present application;

[0030] Fig. 9 is a schematic diagram of a rule configuration interface provided in an embodiment of the present application;

[0031] Fig.10 is a schematic diagram of a data correction configuration interface provided in an embodiment of the present application;

[0032] Fig.11 This is a schematic diagram of an interface for displaying data governance results provided in an embodiment of the present application;

[0033] Fig.12 It is a schematic diagram of the structure of a data management device provided in an embodiment of the present application;

[0034] Fig.13 is a schematic diagram of the structure of a computing device provided in an embodiment of the present application;

[0035] Fig.14 is a schematic diagram of the structure of a computing device cluster provided in an embodiment of the present application;

[0036] Fig.15 It is a structural diagram of another computing device cluster provided in an embodiment of the present application. DETAILED DESCRIPTION

[0037] The implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0038] See also Figure 1 An embodiment of the present application provides a network architecture 100, which includes an application service platform 101, a terminal device 102 and a data source 103, and the terminal device 102 can communicate with the application service platform 101 and the data source 103.

[0039] The data source 103 is used to generate data;

[0040] When a user needs to perform data management on the data generated by the data source 103 , the terminal device 102 requests the application service platform 101 to assist it in generating a data management program for implementing data management, and then uses the data management program to perform data management on the data generated by the data source 103 .

[0041] In some embodiments, the data generated by the data source 103 is data with high effectiveness, and the data generated by the data source 103 can also be called real-time data, so data governance of the data generated by the data source 103 can also be called data governance of real-time data.

[0042] The terminal device 102 can send a data governance request to the application service platform 101 .

[0043] After receiving the data governance request, the application service platform 101 displays an object configuration interface on the terminal device 102. The object configuration interface is used to instruct the user to configure the object data format. The object data format includes a target object data format and at least one source object data format. The at least one source object data format includes a first source object data format. Optionally, the terminal device 102 and the application service platform 101 may belong to different entities. When the entity of the application service platform 101 sends the relevant content of the object configuration interface to the terminal device 102, it can be regarded as the entity of the application service platform 101 displaying the object configuration interface to the user of the terminal device 102.

[0044] After the user configures the object data format using the object configuration interface, the application service platform 101 displays a rule configuration interface on the terminal device 102, which is used to instruct the user to configure processing rules, which are used to perform data governance on data whose format meets the first source object data format.

[0045] The terminal device 102 can obtain the object data format from the object configuration interface and the processing rule from the rule configuration interface, and generate a data governance program based on the object data format and the processing rule. Optionally, the data governance program includes the object data format and the processing rule.

[0046] Then, run the data governance program, so that the data governance program can obtain the first source object data, the format of the first source object data meets the first source object data format, and the first source object data is obtained by converting the data generated by the data source 103 based on the first source object data format; perform data governance on the first source object data according to the processing program to obtain the data governance result corresponding to the first source object data; based on the data governance result, generate the first target object data for describing the data governance result, and the format of the first target object data meets the target object data format. Optionally, the subject who fills in the object configuration interface or the subject who fills in the rule configuration interface may be a different subject from the source subject of the first source object data, for example, the subject who fills in the object configuration interface or the subject who fills in the rule configuration interface is a user, and the source subject of the first source object data is the data source, etc.

[0047] In some embodiments, the object data format also includes a second source object data format. In this way, the data governance program can obtain the second source object data, the format of the second source object data satisfies the second source object data format; perform data governance on the first source object data and the second source object data according to the processing rule to obtain a data governance result corresponding to the first source object data; and generate first target object data for describing the data governance result based on the data governance result.

[0048] In some embodiments, the terminal device 102 is used to run the data governance program.

[0049] Optionally, the terminal device 102 may send the first source object data format to the data source 103, and the data source 103 may generate data. Whenever data is generated, the data is converted based on the first source object data format to obtain third source object data, and the third source object data is sent to the terminal device 102. The terminal device 102 receives the third source object data, obtains the first source object data based on the third source object data, performs data governance on the first source object data according to the processing rule, obtains a data governance result corresponding to the first source object data, and generates first target object data for describing the data governance result.

[0050] The format of the third source object data generated by the data source 103 may satisfy the format of the first source object data, or may not satisfy the format of the first source object data. When the format of the third source object data satisfies the format of the first source object data, the terminal device 102 uses the third source object data as the first source object data; when the format of the third source object data does not satisfy the format of the first source object data, the terminal device 102 converts the third source object data to obtain the first source object data.

[0051] Optionally, the terminal device 102 may not send the first source object data format to the data source 103. The data source 103 may generate data and send the data to the terminal device 102. The terminal device 102 receives the data, converts the data based on the first source object data format to obtain first source object data, performs data governance on the first source object data according to the processing rule, obtains a data governance result corresponding to the first source object data, and generates first target object data for describing the data governance result.

[0052] For the first source object data format, the first source object data format may be newly generated object data, for example, the first source object data is new object data obtained by converting data generated by the data source 103. Alternatively, the first source object data is obtained by converting existing third source object data, for example, the first source object data is obtained by modifying the third source object data and / or adding new fields.

[0053] In some embodiments, see Figure 2 The network architecture 100 also includes a data management device 104, which also communicates with the terminal device 102 and the data source 103. When the terminal device 102 generates the data management program, it sends the data management program to the data management device 104.

[0054] Optionally, the terminal device 102 may send the first source object data format to the data source 103. The data source 103 may generate data, and whenever data is generated, convert the data based on the first source object data format to obtain third source object data, and send the third source object data to the data management device 104. The data management device 104 receives the third source object data, obtains the first source object data based on the third source object data, performs data management on the first source object data according to the processing rule, obtains a data management result corresponding to the first source object data, and generates first target object data for describing the data management result.

[0055] Optionally, the terminal device 102 may not send the first source object data format to the data source 103. The data source 103 may generate data and send the data to the data management device 104. The data management device 104 receives the data, converts the data based on the first source object data format to obtain first source object data, performs data management on the first source object data according to the processing rule, obtains a data management result corresponding to the first source object data, and generates first target object data for describing the data management result.

[0056] In some embodiments, the network architecture 100 may include multiple terminal devices 102, which are terminal devices corresponding to multiple users, and each terminal device 102 may communicate with the application service platform 101. In this way, each user may use their corresponding terminal device 102 to request the application service platform 101 to assist in generating a data management program for each user, and each user uses their own data management program to perform data management.

[0057] See also Figure 3 , the data generated by the data source 103 is converted into first source object data, and the first source object data is stored in a data queue. The data management program dequeues the first source object data from the data queue, performs data management on the first source object data, obtains the first target object data, and saves the first target object data in the data queue. In this way, when an application needs to use the first target object data, the first target object data can be obtained from the data queue. The data queue is located in the memory of the device running the data management program, for example, the data queue is located in the memory of the terminal device 102, or the data queue is located in the memory of the data management device 104.

[0058] Since the first source object data is data-managed, the data-managed result is encapsulated into the first target object data, and both the first source object data and the first target object data are object-formatted data and can be stored in the memory of the terminal device 102 or the memory of the data management device 104, so there is no need to store the first source object data and the first target object data in the disk of the terminal device 102 or the disk of the data management device 104. Therefore, in the process of data management, only the first source object data stored in the memory is processed, and the processed first target object data is stored in the memory, which can greatly improve the efficiency of data management.

[0059] In some embodiments, see Figure 4 , the data generated by the data source 103 can be called real-time data, which includes device information, database operation logs, analysis results of images, videos or audios analyzed using AI, and / or real-time data analysis packages. These real-time data can be converted into first source object data, and the first source object data is stored in a data queue. The data governance program dequeues the first source object data from the data queue, performs data governance on the first source object data, obtains the first target object data, and saves the first target object data to the data queue. When an application needs to perform real-time production, real-time marketing, real-time risk control or real-time prediction, the first target object data can be obtained from the data queue.

[0060] See also Figure 5 The present application embodiment provides a data governance method 500, which is applied to Figure 1 or Figure 2 In the network architecture 100 shown, the method 500 includes the following process.

[0061] Step 501: displaying an object configuration interface, the object configuration interface is used to instruct a user to configure an object data format, the object data format including a first source object data format and a target object data format, and acquiring the object data format based on the object configuration interface.

[0062] When a user needs to perform data governance on the data generated by the data source, the user can trigger the terminal device to send a data governance request to the application service platform. After receiving the data governance request, the application service platform sends an object configuration interface to the terminal device. The terminal device receives the object configuration interface and displays it to the user, so that the user can configure the object data format in the object configuration interface.

[0063] In some embodiments, see Figure 6For an object data format configured by a user (such as a first source object data format or a target object data format), the object data format defines a format of object data, the object data format includes at least one attribute field and multiple sub-attribute fields of each attribute field. The object data includes at least one content corresponding to the at least one attribute field and multiple contents corresponding to the multiple sub-attribute fields of each attribute field.

[0064] For each attribute field, in the object data format, the multiple sub-attribute fields of the attribute field include an identification field, a name field, and a type field. The multiple contents corresponding to the multiple sub-attribute fields of the attribute field include an attribute identifier corresponding to the identification field, an attribute name corresponding to the name field, and an attribute type corresponding to the type field.

[0065] Alternatively, see Figure 6 , the multiple sub-attribute fields of the attribute field also include other sub-attribute fields. For example, the multiple sub-attribute fields of the attribute field also include one or more of the following sub-attribute fields: whether it can be empty field, value range field, unit field, length field or description field, etc. The multiple contents corresponding to the multiple sub-attribute fields of the attribute field also include the content corresponding to the whether it can be empty field (yes or no), the content value range corresponding to the value range field, the attribute unit corresponding to the unit field, the attribute length corresponding to the length field or the attribute description corresponding to the description field, etc.

[0066] For each attribute field, the attribute field corresponds to multiple sub-attribute fields, and the multiple sub-attribute fields correspond to multiple contents, and the multiple contents are attribute type, attribute name, attribute identifier, whether it can be empty (yes or no), content value range, attribute unit, attribute length or attribute description, etc. See the meaning of each content shown in Table 1 below.

[0067] Table 1

[0068]

[0069] In step 501, for each attribute field, the object configuration interface includes an object data format configuration area, an attribute configuration area corresponding to the attribute field, and multiple sub-attribute configuration areas corresponding to multiple sub-attribute fields of the attribute field. The object data format configuration area is used to indicate identification information (such as the name of the object data format) for the user to configure the object data format, the attribute configuration area is used to indicate the user to configure the attribute field, and the multiple sub-attribute configuration areas are used to indicate the user to configure the multiple sub-attribute fields. The terminal device obtains the object data format from the object configuration interface, and the object data format includes at least one attribute field and multiple sub-attribute fields for each attribute field.

[0070] For example, see Figure 7The object configuration interface shown, the object name in the object configuration interface is the object data format configuration area, which is used to instruct the user to configure the name of the object data format. The attribute name in the object configuration interface is the attribute configuration area corresponding to an attribute field, which is used to instruct the user to configure an attribute field. The object configuration interface also includes the identification configuration area, the name configuration area and the type configuration area of ​​the attribute field, the identification configuration area is used to instruct the user to configure the identification field, the name configuration area is used to instruct the user to configure the name field, and the type configuration area is used to instruct the user to configure the type field.

[0071] Optionally, the object configuration interface further includes one or more of the following: a length configuration area, a value range configuration area, a unit configuration area, a description configuration area, or a nullable configuration area, etc. The length configuration area is used to indicate that the user configures the length field, the value range configuration area is used to indicate that the user configures the value range field, the unit configuration area is used to indicate that the user configures the unit field, the description configuration area is used to indicate that the user configures the description field, and the nullable configuration area is used to indicate that the user configures the nullable field.

[0072] See also Figure 7 The object configuration interface includes an attribute adding button, and the user can use the attribute adding button to add an attribute configuration area and multiple sub-attribute configuration areas in the object configuration interface to configure other attribute fields and multiple sub-attribute fields corresponding to the other attribute fields in the object configuration interface.

[0073] See also Figure 7 The object configuration interface includes an object adding button, and the user can use the object adding button to add a property configuration area and multiple sub-property configuration areas corresponding to other object data formats in the object configuration interface to configure other object data formats in the object configuration interface.

[0074] In some embodiments, the object data format that can be configured by the user in the object configuration interface includes at least one source object data format and a target object data format, and the at least one source object data format includes a first source object data format. Optionally, the at least one source object data format also includes one or more source object data formats such as a second source object data format and / or a third source object data format.

[0075] For example, see Figure 8 , the user configures the first source object data format, the second source object data format and the target object data format in the object configuration interface. Figure 8 (a) The first source object data format is a card swiping information format, and the first source object data that meets the card swiping information format includes the user's card swiping information. Figure 8(b) The second source object data format is a consumption habit format, and the second source object data in a format that satisfies the consumption format includes the user's consumption habit information. Figure 8 (c) The target object data format is an abnormal card swiping format, and the target object data whose format satisfies the abnormal card swiping format includes abnormal card swiping information.

[0076] In some embodiments, the terminal device may send at least one source object data format to the data source, or send at least one source object data format to the data governance device. The at least one source object data format includes a first source object data format. Optionally, the at least one source object data format also includes a second source object data format and / or a third source object data format, etc.

[0077] Step 502: Display a rule configuration interface, which is used to instruct the user to configure a processing rule, and the processing rule is used to perform data governance on data whose format meets the first source object data format, and obtain the processing rule based on the rule configuration interface.

[0078] In step 502, after the user completes configuring the object data format in the object configuration interface, the terminal device sends a format configuration completion message to the application service platform. After receiving the format configuration completion message, the application service platform sends a rule configuration interface to the terminal device. The terminal device receives the rule configuration interface and displays the rule configuration interface to the user so that the user can configure the processing rule in the rule configuration interface. The terminal device obtains the processing rule from the rule configuration interface.

[0079] In some embodiments, see Fig. 9 In the rule configuration interface shown, the processing rules configured by the user in the rule configuration interface include at least one data governance operation, and the processing rules also include a first processing rule and / or a second processing rule, etc.

[0080] The first processing rule includes at least one first attribute field of the first source object data format, at least one second attribute field of the second source object data format, and at least one first rule condition. For source object data whose format satisfies the first source object data format, the source object data includes at least one content corresponding to the at least one first attribute field. For source object data whose format satisfies the second source object data format, the source object data includes at least one content corresponding to the at least one second attribute field. The first processing rule is used to instruct to operate on at least one content corresponding to the at least one first attribute field and at least one content corresponding to the at least one second attribute field, obtain at least one first operation result, and check whether the at least one first operation result satisfies the at least one first rule condition.

[0081] The second processing rule includes at least one third attribute field of the first source object data format, at least one target content and at least one second rule condition. For source object data whose format satisfies the first source object data format, the source object data includes at least one content corresponding to the at least one third attribute field. The second processing rule is used to instruct to perform operations on at least one content corresponding to the at least one third attribute field and the at least one target content to obtain at least one second operation result, and to determine whether the at least one second operation result satisfies the at least one second rule condition.

[0082] In some embodiments, the first processing rule may also include at least one attribute field of at least one other source object data rule. For example, the first processing rule may also include at least one fourth attribute field of a third source object data format. For source object data whose format satisfies the third source object data format, the source object data includes at least one content corresponding to the at least one fourth attribute field. The first processing rule is used to instruct to operate on at least one content corresponding to the at least one first attribute field, at least one content corresponding to the at least one fourth attribute field, and at least one content corresponding to the at least one second attribute field, to obtain at least one first operation result, and to check whether the at least one first operation result satisfies the at least one first rule condition.

[0083] See also Fig. 9 The first processing rule includes at least one first sub-processing rule, each of which includes a first attribute field in a first source object data format, a second attribute field in a second source object data format, and a first rule condition. The first sub-processing rule is used to indicate that a first operation result is obtained by operating the content corresponding to the first attribute field and the content corresponding to the second attribute field, and to check whether the first operation result satisfies the first rule condition.

[0084] For example, Fig. 9 As shown, the first processing rule includes a first sub-processing rule 1 and a first sub-processing rule 2.

[0085] A first attribute field of the first source object data format included in the first sub-processing rule 1 is "transaction location field in the card swiping information format", a second attribute field of the second source object data format included in the first sub-processing rule 1 is "transaction location field in the consumption habits format", and the first rule condition included in the first sub-processing rule 1 is "does not belong to".

[0086] For the card swiping information of the user whose format meets the card swiping information format and for the consumption habits of the user whose format meets the consumption habit format, the card swiping information of the user includes the transaction location corresponding to the transaction location field, and the transaction location is the transaction location where the user currently completes the card swiping. The consumption habits of the user include the transaction location corresponding to the transaction location field, and the transaction location is the transaction location where the user is accustomed to swiping the card. The first sub-processing rule 1 is used to indicate whether the transaction location where the user currently completes the card swiping is not a transaction location where the user is accustomed to swiping the card.

[0087] A first attribute field of the first source object data format included in the first sub-processing rule 2 is "transaction location field in the card swiping information format", a second attribute field of the second source object data format included in the first sub-processing rule 2 is "recent transaction location field in the consumption habit format", and the first rule condition included in the first sub-processing rule 2 is "different countries".

[0088] The user's consumption habits include the most recent transaction location corresponding to the most recent transaction location field, which is the transaction location where the user recently swiped his card. The first sub-processing rule 2 is used to indicate whether the transaction location where the user currently swipes his card and the transaction location where the user recently swiped his card are in different countries.

[0089] In some embodiments, the second processing rule may also include at least one attribute field of at least one other source object data rule. For example, the first processing rule may also include at least one fifth attribute field of the third source object data format. For source object data whose format satisfies the third source object data format, the source object data also includes at least one content corresponding to the at least one fifth attribute field. The second processing rule is used to indicate that at least one content corresponding to the at least one third attribute field, at least one content corresponding to the at least one fifth attribute field, and the at least one target content are operated to obtain at least one second operation result, and to check whether the at least one second operation result satisfies the at least one second rule condition.

[0090] See also Fig. 9 The second processing rule includes at least one second sub-processing rule, each of which includes a third attribute field in the first source object data format, a target content, and a second rule condition. The second sub-processing rule is used to instruct to operate the content corresponding to the third attribute field and the target content to obtain a second operation result, and check whether the second operation result satisfies the second rule condition.

[0091] For example, Fig. 9As shown, a first attribute field of the first source object data format included in the second sub-processing rule is "the amount field of the card swiping information format", the target content included in the second sub-processing rule is "1500", and the second rule condition included in the second sub-processing rule is "greater than or equal to". For the card swiping information of the user whose format meets the card swiping information format, the card swiping information of the user includes the transaction amount corresponding to the amount field, and the transaction amount is the transaction amount of the user's current card swiping. The second sub-processing rule is used to indicate whether the transaction amount of the user's current card swiping is greater than or equal to 1500.

[0092] The processing terminal can be Fig. 9 The processing rules obtained in the rule configuration interface shown include a data governance operation, a first processing rule and a second processing rule. The first processing rule includes a first sub-processing rule 1 and a second sub-processing rule 2, and the second processing rule includes a second sub-processing rule. That is, the processing rule includes a data governance operation, a first sub-processing rule 1, a second sub-processing rule 2 and a second sub-processing rule. For card swiping information whose format meets the card swiping information format, the data governance operation indicates that the card swiping information is abnormal card swiping information, and the data governance operation performed is to intercept the card swiping behavior and issue an early warning. And the target object data generated is the target object data in the abnormal card swiping format, and the target object data is used to describe the results of intercepting and warning the card swiping behavior based on the card swiping information.

[0093] In some embodiments, the rule configuration interface includes at least one source object data format and at least one rule condition. Thus, the user selects at least one first attribute field of the first source object data format, at least one attribute field of the second source object data format, and at least one first rule condition included in the first processing rule from among the at least one source object data format and at least one rule condition included in the rule configuration interface. And / or, from among the at least one source object data format and at least one rule condition included in the rule configuration interface, selects at least one third attribute field of the first source object data format and at least one second rule condition included in the second processing rule, and sets at least one target content in the second processing rule.

[0094] In some embodiments, the user may configure a data correction rule, which is used to correct the format of the source object data generated by the data source. Optionally, the method 500 may further include the following step 502a.

[0095] Step 502a: Display a data correction configuration interface, which is used to instruct the user to configure data correction rules. The data correction rules include inspection rules and correction operations corresponding to each attribute field of the first source object data format, and the data correction rules are obtained based on the data correction configuration interface.

[0096] In step 502a, after the user completes configuring the processing rules in the rule configuration interface, the terminal device sends a processing rule configuration completion message to the application service platform. After receiving the processing rule configuration completion message, the application service platform sends a data correction configuration interface to the terminal device. The terminal device receives the data correction configuration interface and displays the data correction configuration interface to the user, so that the user can configure the data correction rule in the data correction configuration interface. The terminal device obtains the data correction rule from the data correction configuration interface.

[0097] In some embodiments, see Fig.10 The data correction configuration interface shown includes at least one source object data format, at least one check rule and at least one correction operation. The user can select the check rule and correction operation corresponding to each attribute field of the first source object data format included in the data correction rule in the data correction configuration interface.

[0098] For each attribute field in the first source object data format, and for object data whose format satisfies the first source object data format, the object data includes content corresponding to the attribute field in the first source object data format. The check rule and the correction operation corresponding to the attribute field are used to indicate whether the content corresponding to the attribute field satisfies the check rule, and when the content corresponding to the attribute field does not satisfy the check rule, the object data is processed using the correction operation.

[0099] In some embodiments, the corrective operation corresponding to the attribute field includes modifying the content corresponding to the attribute field, or deleting the object data. Optionally, when the corrective operation corresponding to the attribute field includes deleting the object data, the corrective operation corresponding to the attribute field also includes recording identification information of the deleted object data.

[0100] For example, see Fig.10 , the first source object data format selected by the user in the data correction configuration interface is the card swiping information format. For the transaction identification field in the card swiping information format, the user selects the first check rule and the first correction operation corresponding to the transaction identification field as "is empty" and "delete and record" respectively, and selects the second check rule and the second correction operation corresponding to the transaction identification field as "length does not match" and "fill leading zeros" respectively. For object data whose format meets the first source object data format, the object data includes the content corresponding to the transaction identification field, which is the transaction identification. That is to say, when the transaction identification in the data object is empty, delete the data object and record the identification information of the data object; or, when the length of the transaction identification in the data object is insufficient, fill the header of the transaction identification with zeros. For the user in Fig.10The meanings of the inspection rules and correction operations corresponding to other attribute fields configured in the data correction configuration interface shown are not listed one by one here.

[0101] In some embodiments, the user can also configure the check rules and correction operations corresponding to each attribute field of other object data formats in the data correction configuration interface. For example, the user can select the second source object data format in the data correction configuration interface, and configure the check rules and correction operations corresponding to each attribute field of the second source object data format in the data correction configuration interface.

[0102] Data correction rules support regular expressions, which can perform complex data quality checks and data correction calculations.

[0103] Among them, data quality check rules and data correction operations support user customization according to business scenarios, as shown in the following Table 2, and multiple data correction operations shown in Table 2 can be customized.

[0104] Table 2

[0105]

[0106] There is no sequence between step 502 and step 502a, and step 502 may be performed first and then step 502a. Alternatively, step 502a may be performed first and then step 502, that is, after executing step 502a, the user configures the inspection rules and correction operations of each attribute field in the first source object data format in the data correction configuration interface, and then the terminal device sends a correction configuration completion message to the application service platform. After receiving the correction configuration completion message, the application service platform sends a rule configuration interface to the terminal device. The terminal device receives the rule configuration interface and displays the rule configuration interface to the user, so that the user can configure the data correction rules in the rule configuration interface, even if the terminal device performs the operation of step 502.

[0107] After the terminal device obtains the object data format and the processing rules, a data governance program can be generated based on the processing rules, and the data governance program includes the processing rules. Optionally, the data governance program may also include data correction rules and / or object data formats. For example, the data governance program may also include data correction rules corresponding to the first source object data format, the above-mentioned at least one source object data format and the target object data format. Since the data governance program is generated based on the processing rules, the user can quickly configure the processing rules through the rule configuration interface, thereby improving the efficiency of obtaining the data governance program.

[0108] When the terminal device is required to perform data management on the data generated by the data source, the terminal device can run the data management program. Alternatively, when the data management device is required to perform data management on the data generated by the data source, the terminal device can send the data management program to the data management device, and the data management device receives the data management program and runs the data management program.

[0109] Step 503: Acquire first source object data, where the format of the first source object data satisfies the first source object data format.

[0110] In step 503, other source object data may also be obtained, for example, second source object data may also be obtained, and the format of the second source object data satisfies the second source object data format.

[0111] In step 503, the first source object data may be acquired in the following multiple ways, which include the following way 1 and way 2.

[0112] Method 1: The data source includes a first source object data format, the data source generates data, and based on the first source object data format, the generated data is converted to obtain third source object data, and the third source object data is sent to a terminal device or a data management device. The terminal device or the data management device receives the third source object data, and obtains the first source object data based on the data correction rule and the third source object data.

[0113] The format of the third source object data obtained by the data source may be the same as the format of the first source object data, and the terminal device or the data management device uses the received third source object data as the first source object data. Alternatively, the format of the third source object data obtained by the data source may be different from the format of the first source object data, and the terminal device or the data management device corrects the received third source object data based on the data correction rule to obtain the first source object data.

[0114] In some embodiments, the data correction rules include checking rules and correction operations corresponding to each attribute field of the first source object data format. After receiving the third source object data, the third source object data includes the content corresponding to each attribute field in the first source object data format, and it is checked whether the content corresponding to each attribute field of the third source object data satisfies the checking rules corresponding to each attribute field respectively; when it is found that the content corresponding to an attribute field does not satisfy the checking rule corresponding to the attribute field, the content corresponding to the attribute field included in the third source object data is modified based on the correction operation corresponding to the attribute field to obtain the first source object data.

[0115] In some embodiments, the corrective operation corresponding to the attribute field may be to modify the content corresponding to the attribute field, so that based on the corrective operation corresponding to the attribute field, the content corresponding to the attribute field is modified. Alternatively, the corrective operation corresponding to the attribute field may be to delete the source object data, so that based on the corrective operation corresponding to the attribute field, the received third source object data is deleted. Optionally, after deleting the third source object data, identification information of the deleted third source object data may also be recorded.

[0116] In a second method, the terminal device or data management device includes a first source object data format, the data source generates data, and sends the data to the terminal device or data management device. The terminal device or data management device receives the data, converts the data based on the first source object data format, and obtains the first source object data.

[0117] In some embodiments, for other source object data, the terminal device or data management device may also adopt the above-mentioned method 1 or method 2 to obtain other source object data. For example, the terminal device or data management device may also adopt the above-mentioned method 1 or method 2 to obtain the second source object data and / or the fourth source object data. Alternatively, the terminal device or data management device includes other source object data, and the terminal device or data management device obtains the other source object data locally, for example, the terminal device or data management device obtains the second source object data and / or the fourth source object data locally.

[0118] The terminal device or the data governance device may adopt data correction rules to correct other source object data, for example, it may correct the second source object data and / or the fourth source object data.

[0119] Next, the terminal device or the data management device runs a data management program, and performs data management on the first source object data according to the following steps through the data management program.

[0120] Step 504: According to the first source object data and the processing rule, obtain the first target object data, the format of the first target object data satisfies the target object data format, and the first target object data is used to describe the data governance result obtained by performing data governance on the first source object data based on the processing rule.

[0121] In step 504, the terminal device or the data governance device performs data governance on the first source object data based on the processing rule to obtain a data governance result, and then generates first target object data for describing the data governance result in accordance with the data format defined by the target object data format.

[0122] In some embodiments, based on the processing rule, data governance is performed on the first source object data and the other source object data to obtain a data governance result. For example, based on the processing rule, data governance is performed on the first source object data and the second source object data to obtain a data governance result. For another example, based on the processing rule, data governance is performed on the first source object data, the second source object data, and the fourth source object data to obtain a data governance result.

[0123] In some embodiments, the processing rules include at least one data governance operation and a first processing rule, the first processing rule including at least one first attribute field of a first source object data format, at least one second attribute field of a second source object data format, and at least one first rule condition.

[0124] Thus, in step 504, operations are performed on the content corresponding to the at least one first attribute field included in the first source object data and the content corresponding to the at least one second attribute field included in the second source object data to obtain at least one first operation result; when the at least one first operation result satisfies the at least one first rule condition, the at least one data governance operation is performed on the first source object data to obtain a data governance result.

[0125] The first processing rule includes at least one first sub-processing rule, each of which includes a first attribute field in a first source object data format, a second attribute field in a second source object data format, and a first rule condition. The at least one first operation result satisfies the at least one first rule condition, including:

[0126] A first operation result is obtained by operating the content corresponding to the first attribute field included in the first source object data and the content corresponding to the second attribute field included in the second source object data. The first operation result satisfies the first rule condition.

[0127] In some embodiments, the processing rule includes at least one data governance operation and a second processing rule, the second processing rule including at least one third attribute field of the first source object data format, at least one target content, and at least one second rule condition.

[0128] In this way, in step 504, the content corresponding to the at least one third attribute field included in the first source object data and the at least one target content are operated to obtain at least one second operation result; when the at least one second operation result satisfies the at least one second rule condition, the at least one data governance operation is performed on the first source object data to obtain a data governance result.

[0129] The second processing rule includes at least one second sub-processing rule, each of which includes a third attribute field in the first source object data format, a target content, and a second rule condition. The at least one second operation result satisfies the at least one second rule condition, including:

[0130] A second operation result is obtained by operating the content corresponding to the third attribute field included in the first source object data and the target content, and the first and second operation results satisfy the second rule condition.

[0131] In some embodiments, the processing rule includes at least one data governance operation, a first processing rule, and a second processing rule, so that in step 504, the content corresponding to the at least one first attribute field included in the first source object data and the content corresponding to the at least one second attribute field included in the second source object data are operated to obtain at least one first operation result. The content corresponding to the at least one third attribute field included in the first source object data and the at least one target content are operated to obtain at least one second operation result. When the at least one first operation result satisfies the at least one first rule condition and the at least one second operation result satisfies the at least one second rule condition, the at least one data governance operation is performed on the first source object data to obtain a data governance result.

[0132] For example, assuming the first source object data format is Figure 8 (a) shows the card swiping information format, the second source object data format is Figure 8 (b) shows the consumption habit format, and the target object data format is Figure 8 (c) shows the abnormal card swiping format. The processing rules are as follows Fig. 9 The processing rules in the rule configuration interface shown include a data governance operation, a first sub-processing rule 1, a first sub-processing rule 2 and a second sub-processing rule.

[0133] Obtain card swiping information in a format that satisfies the card swiping information format, which includes the transaction identifier, account number, time and amount of the user's current card swiping. Also, obtain consumption habit information in a format that satisfies the consumption habit format, which includes the account number that the user is accustomed to swiping the card, the transaction location that the user is accustomed to swiping the card, the user's most recent transaction location and habit label, etc.

[0134] If the amount of money the user is currently swiping the card is greater than or equal to 1500, the transaction location where the user is currently swiping the card is not the transaction location where the user is accustomed to swiping the card, and the transaction location where the user is currently swiping the card and the user's most recent transaction location are in different countries, then the card swiping information is detected as abnormal card swiping information, and the user's current card swiping behavior is intercepted and an alert is issued.

[0135] The first target object data whose format satisfies the abnormal card swiping format is abnormal card swiping information, which is used to describe the result of interception and warning. Figure 8 (c) The abnormal card swiping information includes the card swiping information, the object of interception and warning, etc.

[0136] Step 505: Display one or more of the following information: the amount of acquired source object data, the amount of data-governed source object data, or the amount of modified source object data.

[0137] For the acquired source object data, the number of the acquired source object data can be counted. For the data-governed source object data, the number of the data-governed source object data can be counted. For the modified source object data, the number of the modified source object data can be counted. For the deleted source object data, the number of the deleted source object data can be counted, for example, the identification information of the deleted source object data can be counted to obtain the number of the deleted source object data.

[0138] For example, for acquired first source object data, the number of acquired first source object data can be counted. For data-governed first source object data, the number of data-governed first source object data can be counted. For modified first source object data, the number of modified first source object data can be counted. For deleted first source object data, the number of deleted first source object data can be counted.

[0139] For the acquired second source object data, the number of the acquired second source object data can be counted. For the data-governed second source object data, the number of the data-governed second source object data can be counted. For the modified second source object data, the number of the modified second source object data can be counted. For the deleted second source object data, the number of the deleted second source object data can be counted.

[0140] For the generated first target object data, the number of the first target object data may also be counted.

[0141] Alternatively, see Fig.11 , a data governance result interface can be displayed, which includes one or more of the following information: the number of first source object data acquired, the number of first source object data subject to data governance, the number of first source object data modified, the number of first source object data deleted, the number of second source object data acquired, the number of second source object data subject to data governance, the number of second source object data modified, the number of second source object data deleted, or the number of first target object data.

[0142] In an embodiment of the present application, a rule configuration interface is displayed, and the rule configuration interface is used to instruct the user to configure a processing rule, and the processing rule is used to perform data governance on data whose format satisfies the first source object data format. The processing rule is obtained, and the first target object data is obtained according to the first source object data and the processing rule. The format of the first target object data satisfies the target object data format, and the first target object data is used to describe the data governance result obtained by performing data governance on the first source object data based on the processing rule. Since the rule configuration interface is displayed, the user uses the rule configuration interface to configure the processing rule for data governance, so that the first source object data can be data governed and the first target object data can be obtained based on the processing rule. The time required to configure the processing rule using the rule configuration interface is shorter, and the efficiency of data governance can be greatly improved compared to manually writing a data governance program to perform data governance. The object configuration interface is displayed, and the object configuration interface is used to instruct the user to configure the object data format, and the object data format includes the first source object data format and the target object data format. The first source object data is obtained, and the format of the first source object data satisfies the first source object data format. Since the object configuration interface is displayed, users can use the object configuration interface to configure the object data format. Based on the object data format, the data that users manage are all object data in the object data format. When managing object data, the object data does not need to be saved to the disk, and the object data can be saved in the memory. Since data does not need to be saved to the disk, the efficiency of data management is improved.

[0143] See also Fig.12 The present application embodiment provides a data management device 1200, the device 1200 is applied to Figure 1 or Figure 2 In the network architecture 100 shown, the device 1200 includes:

[0144] A display unit 1201 is used to display an object configuration interface, where the object configuration interface is used to instruct a user to configure an object data format, where the object data format includes a first source object data format and a target object data format;

[0145] The processing unit 1202 is configured to obtain first source object data, where the format of the first source object data satisfies a first source object data format;

[0146] The display unit 1201 is further used to display a rule configuration interface, where the rule configuration interface is used to instruct a user to configure a processing rule, where the processing rule is used to perform data governance on data whose format satisfies the first source object data format;

[0147] Processing unit 1202 is also used to obtain processing rules, and obtain first target object data according to the first source object data and the processing rules. The format of the first target object data satisfies the target object data format, and the first target object data is used to describe the data governance results obtained by performing data governance on the first source object data based on the processing rules.

[0148] Optionally, the detailed implementation process of the display unit 1201 displaying the object configuration interface can be found in Figure 5 The relevant contents of step 501 of the method 500 are not described in detail here.

[0149] Optionally, the detailed implementation process of the processing unit 1202 obtaining the first source object data can be found in Figure 5 The relevant contents of step 503 of the method 500 are not described in detail here.

[0150] Optionally, the detailed implementation process of the display unit 1201 displaying the rule configuration interface can be found in Figure 5 The relevant contents of step 502 of the method 500 are not described in detail here.

[0151] Optionally, the processing unit 1202 obtains a processing rule, and obtains the first target object data according to the first source object data and the processing rule. Figure 5 The relevant contents of step 504 of the method 500 are not described in detail here.

[0152] Optionally, the first source object data format includes at least one attribute field and multiple sub-attribute fields of each attribute field, and the first source object data includes content corresponding to the at least one attribute field and content corresponding to the multiple sub-attribute fields of each attribute field.

[0153] Optionally, for each attribute field, the multiple sub-attribute fields of the attribute field include an identification field, a name field and a type field, and the contents corresponding to the multiple sub-attribute fields of the attribute field include the attribute identifier corresponding to the identification field, the attribute name corresponding to the name field and the attribute type corresponding to the type field.

[0154] Optionally, the object configuration interface includes an identification configuration area, a name configuration area and a type configuration area, the identification configuration area is used to indicate that the user configures the identification field, the name configuration area is used to indicate that the user configures the name field, and the type configuration area is used to indicate that the user configures the type field.

[0155] Optionally, the object data format further includes a second source object data format, and the processing unit 1202 is further configured to:

[0156] Acquire second source object data, where the format of the second source object data satisfies the second source object data format, wherein the processing rule is used to perform data governance on the data whose format satisfies the first source object data format and the data whose format satisfies the second source object data format;

[0157] First target object data is acquired according to the first source object data, the second source object data and the processing rule.

[0158] Optionally, the detailed implementation process of the processing unit 1202 obtaining the second source object data can be found in Figure 5 The relevant contents of step 503 of the method 500 are not described in detail here.

[0159] Optionally, the processing unit 1202 obtains the first target object data according to the first source object data, the second source object data and the processing rule. Figure 5 The relevant contents of step 504 of the method 500 are not described in detail here.

[0160] Optionally, the processing rule includes at least one first attribute field of the first source object data format, at least one second attribute field of the second source object data format, at least one rule condition, and at least one data governance operation;

[0161] The processing unit 1202 is configured to:

[0162] Performing an operation on at least one content corresponding to the at least one first attribute field of the first source object data and at least one content corresponding to the at least one second attribute field of the second source object data to obtain at least one operation result;

[0163] When the operation result satisfies the at least one rule condition, performing at least one data governance operation on the first source object data to obtain a data governance result;

[0164] The first target object data for describing the data governance result is obtained.

[0165] Optionally, the processing unit 1202 operates on at least one content corresponding to the at least one first attribute field of the first source object data and at least one content corresponding to the at least one second attribute field of the second source object data, and the detailed implementation process of obtaining at least one operation result is shown in Figure 5 The relevant contents of step 504 of the method 500 are not described in detail here.

[0166] Optionally, the processing unit 1202 performs at least one data governance operation on the first source object data to obtain a data governance result. For a detailed implementation process, see Figure 5The relevant contents of step 504 of the method 500 are not described in detail here.

[0167] Optionally, the detailed implementation process of the processing unit 1202 obtaining the first target object data for describing the data governance result is shown in Figure 5 The relevant contents of step 504 of the method 500 are not described in detail here.

[0168] Optionally, the device 1200 further includes a receiving unit 1203 and a display unit 1201, which are further used to display a data correction configuration interface, wherein the data correction configuration interface is used to instruct a user to configure a data correction rule, wherein the data correction rule includes a check rule and a correction operation corresponding to each attribute field of the first source object data format;

[0169] The receiving unit 1203 is configured to receive third source object data, where the third source object data includes content corresponding to each attribute field;

[0170] Processing unit 1202 is used to check whether the contents corresponding to each attribute field of the third source object data respectively satisfy the inspection rules corresponding to each attribute field; when it is found that the contents corresponding to an attribute field do not satisfy the inspection rules corresponding to the attribute field, the contents corresponding to the attribute field included in the third source object data are modified based on the correction operation corresponding to the attribute field to obtain the first source object data.

[0171] Optionally, the display unit 1201 displays the detailed implementation process of the data correction configuration interface. Figure 5 The relevant contents of step 502a of the method 500 are not described in detail here.

[0172] Optionally, the detailed implementation process of receiving the third source object data by the receiving unit 1203 is shown in Figure 5 The relevant contents of step 503 of the method 500 are not described in detail here.

[0173] Optionally, the processing unit 1202 modifies the content corresponding to the attribute field included in the third source object data based on the correction operation corresponding to the attribute field, and obtains the detailed implementation process of the first source object data. Figure 5 The relevant contents of step 504 of the method 500 are not described in detail here.

[0174] Optionally, the display unit 1201 is further used to display one or more of the following information: the amount of acquired source object data, the amount of data-governed source object data, or the amount of modified source object data.

[0175] Optionally, the display unit 1201 displays the above one or more information: For a detailed implementation process, see Figure 5The relevant contents of step 505 of the method 500 are not described in detail here.

[0176] In an embodiment of the present application, the display unit displays a rule configuration interface, and the rule configuration interface is used to instruct the user to configure a processing rule, and the processing rule is used to perform data governance on data whose format satisfies the first source object data format. The processing unit obtains the processing rule, and obtains the first target object data according to the first source object data and the processing rule. The format of the first target object data satisfies the target object data format, and the first target object data is used to describe the data governance result obtained by performing data governance on the first source object data based on the processing rule. Since the display unit displays the rule configuration interface, the user uses the rule configuration interface to configure the processing rule for data governance, so that the processing unit can perform data governance on the first source object data based on the processing rule and obtain the first target object data. The time required for the processing unit to configure the processing rule using the rule configuration interface is relatively short, which can greatly improve the efficiency of data governance compared to manually writing a data governance program to perform data governance.

[0177] See also Fig.13 , the present application embodiment provides a computing device 1300. For example, the computing device 1300 may be Figure 1 or Figure 2 The devices included in the network architecture 100 shown, for example, the computing device 1300 may be the application service platform 101, the terminal device 102 or the data governance device 104 in the network architecture 100.

[0178] like Fig.13 As shown, the computing device 1300 includes: a bus 1302, a processor 1304, a memory 1306, and a communication interface 1308. The processor 1304, the memory 1306, and the communication interface 1308 communicate through the bus 1302. The computing device 1300 can be a server or a terminal device. It should be understood that the present application does not limit the number of processors and memories in the computing device 1300.

[0179] The bus 1302 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.13 The bus 1302 may include a path for transmitting information between various components of the computing device 1300 (eg, the processor 1304, the memory 1306, and the communication interface 1308).

[0180] The processor 1304 may include any one or more of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).

[0181] The memory 1306 may include a volatile memory, such as a random access memory (RAM). The memory 1306 may also include a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid state drive (SSD).

[0182] See also Fig.13 , the memory 1306 stores executable program codes, and the processor 1304 executes the executable program codes to respectively implement Fig.12 The functions of the display unit 1201, the processing unit 1202 and the receiving unit 1203 in the device 1200 shown in the figure are implemented to realize the method provided by any of the above embodiments. That is, the memory 1306 stores instructions for executing the method provided by any of the above embodiments. Or,

[0183] The communication interface 1308 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 1300 and other devices or communication networks.

[0184] The embodiment of the present application also provides a data governance cluster. The data governance cluster includes at least one computing device. The computing device can be a server, such as a central server, an edge server, or a local server in a local data center. In some embodiments, the computing device can also be a terminal device such as a desktop, a laptop, or a smart phone.

[0185] like Fig.14 As shown, the data governance cluster includes at least one computing device 1300. The memory 1306 in one or more computing devices 1300 in the data governance cluster may store the same instructions for executing the method provided in any of the above embodiments.

[0186] In some possible implementations, the memory 1306 of one or more computing devices 1300 in the data governance cluster may also store some instructions for executing the above data governance method. In other words, the combination of one or more computing devices 1300 can jointly execute instructions for executing the method provided in any of the above embodiments.

[0187] In some possible implementations, one or more computing devices in a data governance cluster may be connected via a network, which may be a wide area network or a local area network. Fig.15 A possible implementation is shown. Fig.15 As shown, two computing devices 1300A and 1300B are connected via a network. Specifically, they are connected to the network via a communication interface in each computing device.

[0188] In this type of possible implementation, the memory 1306 in the computing device 1300A stores the execution Fig.12 Instructions for the functions of the processing unit 1202 in the illustrated embodiment. Meanwhile, the memory 1306 in the computing device 1300B stores instructions for executing the functions of the processing unit 1202 in the illustrated embodiment. Fig.12 Instructions for the functions of the display unit 1201 and the receiving unit 1203 in the illustrated embodiment.

[0189] It should be understood that Fig.15 The functions of the computing device 1300A shown in FIG. 1300A may also be completed by multiple computing devices 1300. Similarly, the functions of the computing device 1300B may also be completed by multiple computing devices 1300.

[0190] The present application embodiment also provides another data management cluster. The connection relationship between the computing devices in the data management cluster can be similarly referred to as Fig.15 The connection mode of the data governance cluster is different in that the memory 1306 in one or more computing devices 1300 in the data governance cluster may store the same instructions for executing the method provided in any of the above embodiments.

[0191] In some possible implementations, the memory 1306 of one or more computing devices 1300 in the data governance cluster may also store partial instructions for executing the method provided in any of the above embodiments. In other words, the combination of one or more computing devices 1300 may jointly execute instructions for executing the method provided in any of the above embodiments.

[0192] The present application also provides a computer program product including instructions. The computer program product may be software or a program product including instructions that can be run on a computing device or stored in any available medium. When the computer program product is run on at least one computing device, the at least one computing device executes the method provided in any of the above embodiments.

[0193] The embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium can be any available medium that can be stored by a computing device or a data storage device such as a data center containing one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk). The computer-readable storage medium includes instructions that instruct the computing device to execute the method provided in any of the above embodiments.

[0194] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0195] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for data governance, characterized in that: The method comprises: Displaying an object configuration interface, wherein the object configuration interface is used to instruct a user to configure an object data format, wherein the object data format includes a first source object data format and a target object data format; Acquire first source object data, where a format of the first source object data satisfies the first source object data format; Displaying a rule configuration interface, wherein the rule configuration interface is used to instruct the user to configure a processing rule, wherein the processing rule is used to perform data governance on data whose format satisfies the data format of the first source object; Obtaining the processing rule; According to the first source object data and the processing rules, first target object data is obtained, the format of the first target object data satisfies the target object data format, and the first target object data is used to describe the data governance result obtained by performing data governance on the first source object data based on the processing rules.

2. The method according to claim 1, characterized in that The first source object data format includes at least one attribute field and multiple sub-attribute fields of each attribute field, and the first source object data includes content corresponding to the at least one attribute field and content corresponding to the multiple sub-attribute fields of each attribute field.

3. The method according to claim 2, characterized in that For each attribute field, the multiple sub-attribute fields of the attribute field include an identification field, a name field and a type field, and the contents corresponding to the multiple sub-attribute fields of the attribute field include the attribute identifier corresponding to the identification field, the attribute name corresponding to the name field and the attribute type corresponding to the type field.

4. The method according to claim 3, characterized in that The object configuration interface includes an identification configuration area, a name configuration area and a type configuration area. The identification configuration area is used to instruct the user to configure the identification field, the name configuration area is used to instruct the user to configure the name field, and the type configuration area is used to instruct the user to configure the type field.

5. The method according to any one of claims 1 to 4, characterized in that: The object data format also includes a second source object data format, and the method further includes: Acquire second source object data, wherein a format of the second source object data satisfies the second source object data format, wherein the processing rule is used to perform data governance on data having a format that satisfies the first source object data format and data having a format that satisfies the second source object data format; The acquiring first target object data according to the first source object data and the processing rule includes: First target object data is acquired according to the first source object data, the second source object data and the processing rule.

6. The method according to claim 5, characterized in that The processing rule includes at least one first attribute field of the first source object data format, at least one second attribute field of the second source object data format, at least one rule condition, and at least one data governance operation; The acquiring first target object data according to the first source object data, the second source object data and the processing rule comprises: Performing an operation on at least one content corresponding to the at least one first attribute field of the first source object data and at least one content corresponding to the at least one second attribute field of the second source object data to obtain at least one operation result; When the operation result satisfies the at least one rule condition, performing the at least one data governance operation on the first source object data to obtain a data governance result; The first target object data for describing the data governance result is obtained.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: Displaying a data correction configuration interface, wherein the data correction configuration interface is used to instruct the user to configure a data correction rule, wherein the data correction rule includes a check rule and a correction operation corresponding to each attribute field of the first source object data format; The obtaining of the first source object data includes: receiving third source object data, wherein the third source object data includes content corresponding to each attribute field; Checking whether the contents corresponding to the attribute fields of the third source object data respectively satisfy the checking rules corresponding to the attribute fields; When it is found that the content corresponding to the attribute field does not satisfy the check rule corresponding to the attribute field, the content corresponding to the attribute field included in the third source object data is modified based on the correction operation corresponding to the attribute field to obtain the first source object data.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: One or more of the following information is displayed: the amount of acquired source object data, the amount of data-governed source object data, and the amount of modified source object data.

9. A data management device, characterized in that: The device comprises: A display unit, used for displaying an object configuration interface, wherein the object configuration interface is used for instructing a user to configure an object data format, wherein the object data format includes a first source object data format and a target object data format; A processing unit, configured to obtain first source object data, wherein a format of the first source object data satisfies the first source object data format; The display unit is further used to display a rule configuration interface, wherein the rule configuration interface is used to instruct the user to configure a processing rule, wherein the processing rule is used to perform data governance on data whose format satisfies the data format of the first source object; The processing unit is also used to obtain the processing rules, and obtain first target object data according to the first source object data and the processing rules. The format of the first target object data satisfies the target object data format, and the first target object data is used to describe the data governance results obtained by performing data governance on the first source object data based on the processing rules.

10. The device according to claim 9, characterized in that The first source object data format includes at least one attribute field and multiple sub-attribute fields of each attribute field, and the first source object data includes content corresponding to the at least one attribute field and content corresponding to the multiple sub-attribute fields of each attribute field.

11. The device according to claim 10, characterized in that For each attribute field, the multiple sub-attribute fields of the attribute field include an identification field, a name field and a type field, and the contents corresponding to the multiple sub-attribute fields of the attribute field include the attribute identifier corresponding to the identification field, the attribute name corresponding to the name field and the attribute type corresponding to the type field.

12. The device according to claim 11, characterized in that The object configuration interface includes an identification configuration area, a name configuration area and a type configuration area. The identification configuration area is used to instruct the user to configure the identification field, the name configuration area is used to instruct the user to configure the name field, and the type configuration area is used to instruct the user to configure the type field.

13. The device according to any one of claims 9 to 12, characterized in that: The object data format also includes a second source object data format, and the processing unit is further configured to: Acquire second source object data, wherein a format of the second source object data satisfies the second source object data format, wherein the processing rule is used to perform data governance on data having a format that satisfies the first source object data format and data having a format that satisfies the second source object data format; First target object data is acquired according to the first source object data, the second source object data and the processing rule.

14. The device according to claim 13, characterized in that The processing rule includes at least one first attribute field of the first source object data format, at least one second attribute field of the second source object data format, at least one rule condition, and at least one data governance operation; The processing unit is used for: Performing an operation on at least one content corresponding to the at least one first attribute field of the first source object data and at least one content corresponding to the at least one second attribute field of the second source object data to obtain at least one operation result; When the operation result satisfies the at least one rule condition, performing the at least one data governance operation on the first source object data to obtain a data governance result; The first target object data for describing the data governance result is obtained.

15. The device according to any one of claims 9 to 14, characterized in that: The device further comprises a receiving unit, and the display unit is further used to display a data correction configuration interface, wherein the data correction configuration interface is used to instruct the user to configure a data correction rule, wherein the data correction rule comprises a check rule and a correction operation corresponding to each attribute field of the first source object data format; The receiving unit is configured to receive third source object data, wherein the third source object data includes content corresponding to each attribute field; The processing unit is used to check whether the contents corresponding to the attribute fields of the third source object data respectively satisfy the inspection rules corresponding to the attribute fields; when it is found that the contents corresponding to the attribute fields do not satisfy the inspection rules corresponding to the attribute fields, the contents corresponding to the attribute fields included in the third source object data are modified based on the correction operation corresponding to the attribute fields to obtain the first source object data.

16. The device according to any one of claims 9 to 15, characterized in that: The display unit is further used to display one or more of the following information: the amount of source object data obtained, the amount of source object data subject to data governance, or the amount of source object data modified.

17. A computing device cluster, characterized in that: The computing device cluster includes at least one computing device, each of the at least one computing device includes at least one processor and at least one memory, and the at least one memory stores computer-readable instructions; the at least one processor executes the computer-readable instructions so that the computing device cluster executes the method according to any one of claims 1 to 8.

18. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a computer, the method according to any one of claims 1 to 8 is implemented.

19. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images