Data table management method and device
By selecting the standard management and control mode in the data warehouse model, and judging and managing fields matching the data standard database, the problem of poor consistency in data table field naming is solved, and management efficiency and accuracy are improved.
Patent Information
- Application Number
- CN202410947533.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-15
- Publication Date
- 2024-11-12
AI Technical Summary
In the prior art, there are subjectivity and differences in the naming of data table fields in the data warehouse model, resulting in poor consistency of data table field names and increasing the complexity of data table management.
By selecting the standard management and control mode of the number warehouse model, we can judge whether there are fields in the data table that match the data standard database, and manage them based on this field and data standards to realize standard naming of data table fields.
Improve the consistency and accuracy of data table field naming, reduce the complexity of data table management, and realize batch field processing by calling multiple threads in parallel, improving processing efficiency.
Smart Images

Figure CN118939650A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of data processing technology, and in particular to a data table management method and device. Background Art
[0002] Since the data in the data warehouse model usually comes from multiple different data sources and business systems, in order to ensure the consistency and accuracy of the data, the data tables in the data warehouse model need to be managed uniformly. Therefore, in order to facilitate the management of the data table, in the process of data warehouse model design, the fields in the data table need to be named in a standardized manner to ensure the consistency and maintainability of the data warehouse.
[0003] Currently, the fields of the data table in the data warehouse model are mainly named manually one by one (for example, naming with English names). However, due to the subjectivity and variability of manual naming, different namers may give different naming results, resulting in poor consistency in the naming of data table fields and increasing the complexity of data table management. Summary of the invention
[0004] The present disclosure provides a data table management method and device to solve one of the technical problems in the related art at least to a certain extent. The technical solution of the present disclosure is as follows:
[0005] According to a first aspect of an embodiment of the present disclosure, a data table management method is provided, including: in response to a selection operation of standard control, selecting a value of a standard control mode of a data warehouse model; in a case where the value of the standard control mode is a first value, for any data table in the data warehouse model, determining whether a first field exists in any data table, wherein the first field is a field that matches a data standard in a data standard library, and the first value is used to indicate that a field in any data needs to be subject to data standard control; in a case where the first field exists in any data table, managing any data table based on the first field and the matching data standard.
[0006] According to a second aspect of an embodiment of the present disclosure, a data table management device is provided, including: a selection module, for selecting a value of a standard control mode of a data warehouse model in response to a selection operation of standard control; a judgment module, for judging, for any data table in the data warehouse model, whether there is a first field in any data table when the value of the standard control mode is a first value, wherein the first field is a field that matches a data standard in a data standard library, and the first value is used to indicate that a field in any data needs to be subject to data standard control; a management module, for managing any data table based on the first field and the matching data standard when the first field exists in any data table.
[0007] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to implement the data table management method as described in the embodiment of the first aspect of the present disclosure.
[0008] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device can execute the data table management method as described in the embodiment of the first aspect of the present disclosure.
[0009] According to a fifth aspect of an embodiment of the present disclosure, a computer program product is provided, comprising: a computer program, wherein when the computer program is executed by a processor, the data table management method as described in the embodiment of the first aspect of the present disclosure is implemented.
[0010] The technical solution provided by the embodiments of the present disclosure brings at least the following beneficial effects:
[0011] In the technical scheme, the value of the standard control mode of the data warehouse model is selected through the selection operation of the standard control mode of the data warehouse model, and when the value of the standard control mode indicates that the field of the data table in the data warehouse model needs data standard control, it is judged whether there is a first field in the data table, wherein the first field is a field that matches the data standard in the data standard library, and when the first field exists in the data table, the data table is managed based on the first field and the matching data standard. Thus, based on the first field of the data table and the data standard that matches the first field in the data standard library, the standardized naming of the data table is realized, the consistency and accuracy of the naming of the data table fields are improved, and there is no need to manually name the fields of the data table, thereby reducing the complexity of data table management; wherein, when the value of the standard control mode indicates that the field of the data table in the data warehouse model needs data standard control In the case where the first field exists in the data table, when judging whether the first field exists in the data table, multiple threads are called in parallel to perform field searches of multiple target data tables in the target scenario, thereby realizing targeted batch field processing of multiple target data tables in the target scenario and improving the field processing efficiency in the data table; further, when the first field exists in the data table, based on the first field and the matching data standard, when managing the data table, it is judged whether the second field exists in any data table; when the second field exists, any data table is managed according to the first field and the data standard matching the first field, and according to the second field and at least one root word matching the second field; when the second field does not exist, any data table is managed according to the first field and the matching data standard, thereby improving the standardization and flexibility of data table field naming and further improving the accuracy and flexibility of data table management.
[0012] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.
[0014] Figure 1 is a flowchart of a data table management method shown in the first embodiment of the present disclosure;
[0015] Figure 2 is a flowchart of a data table management method shown in the second embodiment of the present disclosure;
[0016] Figure 3 is a flowchart of a data table management method shown in the third embodiment of the present disclosure;
[0017] Figure 4 is a flowchart of a data table management method shown in the fourth embodiment of the present disclosure;
[0018] Figure 5 is a flowchart of a data table management method shown in the fifth embodiment of the present disclosure;
[0019] Figure 6 is a flowchart of a data management method shown in an embodiment of the present disclosure;
[0020] Figure 7 is a schematic diagram of a root library page shown in an embodiment of the present disclosure;
[0021] Figure 8 is a schematic diagram of a data standard library page shown in an embodiment of the present disclosure;
[0022] Fig. 9 It is a schematic diagram of a product structure page corresponding to the data warehouse model shown in the embodiment of the present disclosure;
[0023] Fig.10 It is a schematic diagram of a basic information page of a data warehouse model shown in an embodiment of the present disclosure;
[0024] Fig.11 is a schematic diagram of a field detail page shown in an embodiment of the present disclosure;
[0025] Fig.12 is a schematic diagram of a batch standard recommendation page shown in an embodiment of the present disclosure;
[0026] Fig.13 is a structural diagram of a data table management device shown in the sixth embodiment of the present disclosure;
[0027] Fig.14 It is a schematic diagram of the structure of an electronic device shown in an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION
[0028] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.
[0029] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0030] It should be noted that in the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information are all carried out with the user's consent, and are in compliance with relevant laws and regulations and do not violate public order and good morals.
[0031] During the data warehouse model design process, it is necessary to rely on the enterprise data standard system to perform standard comparison on the fields of the data tables in the data warehouse model to achieve standardization of the data structure. Currently, field standard comparison is usually performed manually based on a table, and the table and field names are manually translated into English to achieve the field name definition of the data warehouse model design.
[0032] However, manual reference to field standards and translation of names is inefficient, requires large investment of resources and takes a long time. In addition, manual naming (such as English translation) is subjective and has differences. Different namers may give different naming results, resulting in poor consistency in the naming of data table fields.
[0033] The data table management method and device according to the embodiments of the present disclosure are described below with reference to the accompanying drawings.
[0034] Figure 1 It is a flowchart of the data table management method shown in the first embodiment of the present disclosure.
[0035] like Figure 1 As shown, the data table management method includes the following steps:
[0036] Step 101, in response to a selection operation of a standard control mode, select a value of a standard control mode of a data warehouse model.
[0037] In order to improve user experience, during the data warehouse model design process, data tables in the data warehouse model are managed based on actual user needs. As an example, in response to a selection operation of the annotation control mode, a value of the standard control mode of the data warehouse model is selected, wherein the value of the annotation control mode includes a first value and a second value, wherein the first value (e.g., the first value is "yes") is used to indicate that each field in the data table needs to be subject to data standard control, and the second value (e.g., the second value is "no") is used to indicate that each field in the data table does not need to be subject to data standard control.
[0038] Step 102: When the value of the standard control mode is the first value, for any data table in the data warehouse model, determine whether there is a first field in any data table.
[0039] Among them, the first field is a field that matches the data standard in the data standard library, and the first value is used to indicate that the field in any data table needs to be subject to data standard control.
[0040] As an example, when the value of the standard control mode is the first value, that is, the fields in each data table need to be subject to data standard control. Therefore, for any data table in the data warehouse model, determine whether there is a field in any data table that matches the data standard in the data standard library, and use that field as the first field.
[0041] As another example, when the value of the standard control mode is the second value, for any data table in the data warehouse model, query whether there is a field in any data table that matches at least one root in the root library, and use the field as the third field, wherein the second value is used to indicate that the field in any data table does not need to be subject to data standard control; then, manage any data table based on the third field and at least one root that matches the third field. For example, the English name of the third field is determined based on at least one root that matches the third field in the root library, so that the management (such as storage or processing) of the corresponding data table is achieved based on the third field and the English name of the third field.
[0042] Step 103: When the first field exists in any data table, manage any data table based on the first field and the matching data standard.
[0043] In order to achieve standardized naming of fields in a data table, as an example, when there is a field in a data table that matches a data standard in a data standard library, based on the field and the data standard that matches the field in the data standard library, the data standard is adopted to achieve standardized naming of fields in the data table (e.g., fields in the data table are replaced with fields in the matching data standard), thereby performing data table management (e.g., data table storage, data table processing, etc.) based on the fields of the data table with standardized naming, reducing the complexity of data table management.
[0044] As an example, take data management as a data table storage as an example, based on the standard naming of the fields in the data table, select the appropriate data type to store the data table. For example, if the field name contains the words "date" or "time", you should select the date or time type data type for data table storage.
[0045] It should be noted that the fields of a data table with standardized names can reduce errors introduced by inconsistent or confusing field naming, thereby improving data quality. Therefore, data table storage based on the fields of a data table with standardized names can make the data table more readable, allowing other developers or users to more easily understand the purpose and meaning of the fields in the data table.
[0046] As another example, taking data management as data table processing, the fields of the data table based on standard naming facilitate accurate processing and conversion of data from the data table to ensure the correctness and consistency of data between different tables and systems; and, in multiple tables or databases, using the same naming convention can make data easier to integrate and share; for example, when data needs to be transferred or synchronized between different systems or tables, the fields of the source data table can be mapped to the corresponding fields of the target data table according to the standard naming of the fields to ensure correct data transmission and consistency; for example, if it is necessary to obtain data from multiple tables or data sources and associate them based on specific fields in the standard named fields (such as primary keys, foreign keys), mismatches or incorrect associations can be avoided when data are merged or connected.
[0047] In summary, by selecting the standard control mode of the data warehouse model, the value of the standard control mode of the data warehouse model is selected, and when the value of the standard control mode indicates that the field of the data table in the data warehouse model requires data standard control, it is determined whether there is a first field in the data table, wherein the first field is a field that matches the data standard in the data standard library. When the first field exists in the data table, the data table is managed based on the first field and the matching data standard. Thus, based on the first field of the data table and the data standard that matches the first field in the data standard library, standardized naming of the data table is achieved, the consistency and accuracy of the naming of the data table fields is improved, and there is no need to manually name the fields of the data table, thereby reducing the complexity of data table management.
[0048] In order to clearly explain how, in the above embodiment, any data table is managed based on the first field and the matching data standard when the first field exists in any data table, the present disclosure proposes another data table management method.
[0049] Figure 2 It is a flowchart of a data table management method shown in the second embodiment of the present disclosure.
[0050] like Figure 2 As shown, the data table management method includes the following steps:
[0051] Step 201, in response to the selection operation of the standard control mode, select the value of the standard control mode of the data warehouse model.
[0052] Step 202: When the value of the standard control mode is the first value, determine whether the first field exists in any data table in the data warehouse model.
[0053] Among them, the first field is a field that matches the data standard in the data standard library, and the first value is used to indicate that the field in any data table needs to be subject to data standard control.
[0054] Step 203: if the first field exists in any data table, determine whether the second field exists in any data table.
[0055] The second field is a field in any data table other than the first field and matches at least one root word in the root word library.
[0056] As an example, when a first field exists in any data table, that is, when a field exists in any data table that matches the data standard in the data standard library, there may also be a field in the data table that does not match the data standard in the data standard library. Therefore, when a first field exists in any data table, it is determined whether a second field exists in any data table, that is, it is determined whether there is a field in any data table other than the first field that matches at least one root word in the root word library.
[0057] Step 204 , in the case where the second field exists, manage any data table according to the first field and the data standard that matches the first field, and according to the second field and at least one root word that matches the second field.
[0058] In order to ensure the consistency of naming of data table fields, as a possible implementation method, when there is a second field, the naming standard of the first field can be implemented according to the first field and the data standard that matches the first field; at the same time, the second field is named in a standard manner according to the second field and at least one root that matches the second field.
[0059] As an example, when there is a first field in any data table, the data standard matching the first field and the English name of the data standard matching the first field are determined from the data standard library based on the first field; the English name of the second field is determined based on at least one root word matched by the second field; and any data table is managed based on the first field and the English name of the first field, and based on the second field and the English name of the second field.
[0060] Among them, in order to further improve the accuracy of field naming, before managing any data table according to the English name of the first field and the first field, and according to the English name of the second field and the second field, the English name of the first field and the first field, and the English name of the second field and the second field are displayed; in response to the confirmation operation of the English name of the first field and the first field, and the English name of the second field and the second field, the English name of the first field and the first field, and the English name of the second field and the second field are confirmed.
[0061] That is to say, after determining the English name of the data standard that matches the first field and the English name of the second field that matches the second field, the first field, the English name of the data standard that matches the first field, the second field, and the English name that matches the second field are displayed on the relevant page; after the user confirms the first field, the English name of the data standard that matches the first field, the second field, and the English name that matches the second field, any data table is managed according to the first field and the English name of the first field, and according to the second field and the English name of the second field.
[0062] It should be noted that the data standard library includes various business fields of business data under multiple data standard directories, and each business field has a corresponding Chinese name, English name, data length, data type, etc.
[0063] Step 205: In the case where the second field does not exist, any data table is managed according to the first field and the matching data standard.
[0064] As another example, in the case that only the first field exists in any data table, any data table is managed according to the first field and the matching data standard.
[0065] It should be noted that, when there are a first field and a second field in any data table, and there are other fields besides the first field and the second field, for the other fields, the historical fields that are the same as the other fields can be queried, and the naming of the other fields can be implemented based on the historical fields, such as determining the English name of the other field based on the English name corresponding to the historical field.
[0066] It should be noted that the execution process of steps 201 to 202 can be implemented in any manner in the embodiments of the present disclosure, and the embodiments of the present disclosure do not limit this and will not be described in detail.
[0067] In summary, by judging whether a second field exists in any data table when a first field exists in any data table; if a second field exists, managing any data table according to the first field and the data standard that matches the first field, and according to the second field and at least one root that matches the second field; if a second field does not exist, managing any data table according to the first field and the matching data standard, thereby improving the standardization and flexibility of data table field naming, and further improving the accuracy and flexibility of data table management.
[0068] In order to clearly illustrate how, in the above embodiment, when the value of the standard control mode is the first value, for any data table in the data warehouse model, it is determined whether the first field exists in any data table, the present disclosure proposes another data table management method.
[0069] Figure 3 It is a flowchart of a data table management method shown in the third embodiment of the present disclosure.
[0070] like Figure 3 As shown, the data table management method includes the following steps:
[0071] Step 301, in response to the selection operation of the standard control mode, select the value of the standard control mode of the data warehouse model.
[0072] Step 302: When the value of the standard control mode is the first value, in response to a scene selection operation, determine a target scene from multiple candidate scenes.
[0073] In order to save resources, as a possible implementation method, the data tables under the target scenario in the data warehouse model are managed in a targeted manner. As an example, when the value of the standard management and control mode is the first value, the user can select the target scenario from multiple candidate scenarios.
[0074] Step 303: Determine multiple target data tables under the target scenario from the data tables of the data warehouse model.
[0075] In order to improve the processing efficiency of data table fields, as a possible implementation method, multiple target data tables in the data warehouse model can be processed in batches. As an example, multiple target data tables that meet the target scenario are screened out from the data tables of the data warehouse model, and then the multiple target data tables are processed in batches. Different scenarios correspond to different data tables, and different data tables have different fields.
[0076] Step 304, calling multiple threads in parallel to execute the field search task.
[0077] The specific execution of the field search task by any thread is as follows: reading a target data table that has not been read by other threads from multiple target data tables; and determining whether the first field exists in the target data table currently being read.
[0078] In order to improve the processing efficiency of fields in a data table, as a possible implementation method, the fields in the data table are processed in batches. As an example, multiple threads are called in parallel to perform field search tasks; wherein each thread reads a target data table and determines whether the first field exists in the read target data table.
[0079] Step 305 : when the first field exists in the target data table read by any thread, the target data table read by any thread is managed based on the first field and the matching data standard.
[0080] Furthermore, for the target data table read by any thread, if the target data table read by any thread has a first field, the data table read by any thread is managed based on the first field and the matching data standard.
[0081] It should be noted that the execution process of step 301 can be implemented in any manner in the embodiments of the present disclosure, and the embodiments of the present disclosure do not limit this and will not be described in detail.
[0082] In summary, when the value of the standard control mode is the first value, in response to the scenario selection operation, the target scenario is determined from multiple candidate scenarios; from the data table of the data warehouse model, multiple target data tables under the target scenario are determined; and multiple threads are called in parallel to perform field search tasks, wherein any thread performs the field search task specifically as follows: from the multiple target data tables, a target data table that has not been read by other threads is read; and it is determined whether the first field exists in the target data table currently being read, thereby performing field processing on multiple target data tables under the target scenario in a targeted manner in batches, saving relevant resources and improving the field processing efficiency in the data table.
[0083] In order to implement standardized naming of fields in the data table in the data warehouse model, as an example, when there is a second field in the data table, the standardized naming of the second field is implemented based on the root library. Therefore, before implementing the standardized naming of the second field based on the root library, a root library needs to be generated. Figure 4 Provide detailed explanation.
[0084] Figure 4 It is a flowchart of a data table management method shown in the fourth embodiment of the present disclosure.
[0085] like Figure 4 As shown, the steps for generating the root library are as follows:
[0086] Step 401, obtaining a root word file.
[0087] The root word file includes root word information of at least one root word.
[0088] In order to improve the efficiency of generating a root word library, as a possible implementation method, multiple root words in a root word file may be imported in batches to generate a root word library.
[0089] As an example, a root word file is obtained from a specified directory, wherein the root word file includes root word information of at least one root word, and the root word information includes at least one of the following information: Chinese name, English name, remark information, and the like.
[0090] Step 402: classify at least one root word according to the root word information of at least one root word to obtain a plurality of classifications.
[0091] As a possible implementation, the root information of at least one root word is obtained, and multiple classification directories of the root word library are determined based on the root information. As an example, multiple classifications are obtained based on the root information of each root word, and thus multiple classification directories of the root word library are determined based on the multiple classifications. For example, the root word is classified according to its meaning, source, and the type of vocabulary it constitutes.
[0092] Step 403, determining multiple classification directories of the root word library to be generated according to multiple classifications.
[0093] In order to facilitate the rapid query of word roots, as an example, multiple categories are used as multiple category directories of the word root library to be generated, such as each category corresponds to a category directory.
[0094] Step 404, for any word root in the at least one word root, add any word root to the classification directory to which the word root belongs, so as to obtain a word root library.
[0095] To facilitate word root management, as an example, any word root is added to the classification directory to which the word root belongs, thereby obtaining a word root library.
[0096] To facilitate query and search of the root library, as an example, the root library is stored. To further improve the accuracy of the root library, in response to an update operation on the root library, the root library is updated and the updated root library is stored.
[0097] Wherein, updating the root word library includes any of the following items: importing multiple root words into the root word library; exporting multiple root words from the root word library; deleting multiple root words in the root word library; modifying multiple root words in the root word library.
[0098] In summary, by obtaining a root file; classifying at least one root according to the root information of at least one root to obtain multiple classifications; determining multiple classification directories of the root library to be generated according to the multiple classifications; for any root in at least one root, adding any root to the classification directory to which any root belongs to obtain a root library, thereby, according to the root information of multiple roots in the root file, determining multiple classification directories of the root library to be generated, adding each root to the corresponding classification directory, the root library can be accurately and effectively generated.
[0099] In order to implement standardized naming of fields in the data table in the data warehouse model, as an example, when there are fields in the data table that match the data standards in the data standard library, standardized naming of fields in the data table is implemented based on the data standards. Therefore, before matching the fields in the data table with the data standards in the data standard library, a data standard library needs to be generated. Figure 5 Provide detailed explanation.
[0100] Figure 5 It is a flowchart of a data table management method shown in the fifth embodiment of the present disclosure.
[0101] like Figure 5 As shown, the steps for generating the data standard library are as follows:
[0102] Step 501, obtaining business documents.
[0103] Among them, the business files include business data under multiple data standards.
[0104] As an example, a business file is read from a database, or, in response to a file input operation, a business file input by a user is obtained, wherein the business file includes business data under multiple data standards, including but not limited to: relevant regional standards, industry standards, and internal standards of an institution.
[0105] Step 502: Determine multiple data standard directories of a data standard library to be generated according to multiple data standards.
[0106] Among them, each data standard corresponds to a data standard directory.
[0107] As an example, each data standard corresponds to a data standard directory. For example, the data standards include: relevant regional standards, industry standards or internal standards of an organization. Each data standard corresponds to a root directory of a data standard library. Furthermore, multiple data standards are used as multiple root directories of the data standard library to be generated.
[0108] Step 503 , for any data standard, each business field of the business data under any data standard is added to the data standard directory corresponding to any data standard to generate a data standard library.
[0109] As an example, add the business fields under each data standard to the root directory corresponding to each data standard to obtain the subdirectories under each data standard directory. For example, if the data standard is an enterprise standard, the root directory corresponding to the enterprise standard may include: participant creation time, participant role, participant name, participant type, etc. Each business field has corresponding Chinese name, English name, business source, data length and other information.
[0110] In summary, by obtaining business files; the business files include business data under multiple data standards, and according to the multiple data standards, multiple data standard directories of the data standard library to be generated are determined; for any data standard, each business field of the business data under any data standard is added to the data standard directory corresponding to any data standard to generate a data standard library, thereby, multiple data standard directories of the data standard library are generated based on multiple data standards, thereby, each business field is added to the corresponding data standard directory, and the data standard library is accurately and effectively generated, and the data standard library includes business fields under multiple data standards, which improves the accessibility and comprehensiveness of the data standard library, and then the data table field is named based on the data standard library, and the consistency and accuracy of the data table field naming are further improved.
[0111] Based on any embodiment of the present disclosure, the implementation process of the data table management method of the embodiment of the present disclosure is as follows: Figure 6 As shown, the specific steps are as follows:
[0112] 1. Root word library management
[0113] As an example, the data table management device provides a root word library management capability to implement a multi-level classification directory management system for root words, and add a root word list of corresponding classification under different end-level directories, such as Figure 7 As shown, the root information of each root in the root library includes: the Chinese name of the root, the full English name, the English abbreviation, remarks and other information. It should be noted that the root library supports batch import of roots, export of roots, deletion of roots and other operations, and also supports root publishing and historical version query.
[0114] 2. Data standard library management
[0115] The data standard management library can manage the business data defined within the organization by categories, such as Figure 8 As shown, the data standard management library includes different systems such as relevant regional standards, industry standards and internal standards of institutions, which can meet the unified integration of multiple standards and standard references. In the data standard library, the maintenance of the data standard directory structure and the standard addition, deletion, modification and query functions can be realized, and batch import / export of data standards can be provided.
[0116] 3. Mandatory compliance control of data warehouse models
[0117] When maintaining basic model information, it is necessary to determine whether the current model requires mandatory standard management. For example, Fig. 9 As shown, by triggering the trigger operation of the reference standard component in the structure page of the data warehouse model platform, the basic information page of the data warehouse model is displayed, where the basic information page of the data warehouse model is as follows Fig.10 As shown, when the value of "Whether to enforce the standard" in the basic information page of the data warehouse model is "Yes", that is, when the value of the standard control mode is the first value, it means that the fields in the data table need to be subject to data standard control. It should be noted that after the fields in the data table in the data warehouse model select the corresponding standard, the field information is not allowed to be modified; otherwise, manual adjustment can be made; when the value of "Whether to enforce the standard" in the basic information page of the data warehouse model is "No", that is, the value of the standard control mode is the second value, it means that the fields in the data table do not need to be subject to data standard control.
[0118] 4. Data table reference standards in data warehouse models
[0119] In the data warehouse model design process, if Fig.11As shown, when editing the data table in the data warehouse model, the field maintenance list provides the function of selecting the corresponding standard for a single field and recommending batch field standards to meet the needs of different standard benchmarking methods. The Chinese name of the field is matched with the Chinese name defined in the standard. If the names are the same, the field benchmarking standard is recommended, and the field benchmarking action is implemented after review and confirmation by the modeling personnel.
[0120] 5. Batch standard recommendation by model topic
[0121] When designing a data warehouse model, Fig.12 As shown, based on the subject domain item (target scenario) selected in the current data warehouse model, batch standard recommendations for multi-table fields are made, that is, multiple threads are called in parallel to perform field search tasks to solve the management problem of large-scale benchmarking of models. After the recommendation is successful, the benchmarking results will be displayed, and the modeling personnel will review and correct the errors to confirm the standardization results of the fields. When matching, the fields are matched according to the Chinese and English names respectively, with Chinese matching given priority. The matching range is based on the fields in the table of the current model subject that have not been benchmarked. The fields that have matched the standards are automatically skipped to improve the matching speed and save operating resources.
[0122] 6. Automatically generate English names for fields
[0123] As an example, both the field standardization and root translation modes are supported at the same time, with the standard standardization being given priority. For fields that do not have a standard, the field name is translated in combination with the root library to meet the standardization of vocabulary and corresponding English words when generating field names, realizing another form of standardization and standardized management. In addition, single field translation and batch table full field translation functions are also provided.
[0124] 7. Single field name translation
[0125] When maintaining a single field, after filling in the Chinese name of the field, click the Translate button to translate the Chinese name of the single field in combination with the root word library, thus enabling the single field to quickly generate an English name.
[0126] 8. Table name translation
[0127] On the table information maintenance page, fill in the Chinese name of the data table, click the Translate button to complete the translation of the English name, and format the name according to the naming format.
[0128] 9. Data table management
[0129] Store or process data tables.
[0130] Corresponding to the data table management method provided in the above-mentioned embodiment, the present disclosure also provides a data table management device. Since the data table management device provided in the embodiment of the present disclosure corresponds to the data table management method provided in the above-mentioned embodiment, the implementation method of the data table management method is also applicable to the data table management device provided in the embodiment of the present disclosure, and will not be described in detail in the embodiment of the present disclosure.
[0131] Fig.13 It is a structural diagram of a data table management device shown in the sixth embodiment of the present disclosure.
[0132] like Fig.13 As shown, the data table management device 1300 includes: a selection module 1310 , a judgment module 1320 and a management module 1330 .
[0133] Among them, the selection module 1310 is used to select the value of the standard control mode of the data warehouse model in response to the selection operation of the standard control mode; the judgment module 1320 is used to judge whether there is a first field in any data table in the data warehouse model when the value of the standard control mode is the first value, wherein the first field is a field that matches the data standard in the data standard library, and the first value is used to indicate that the field in any data needs to be subject to data standard control; the management module 1330 is used to manage any data table based on the first field and the matching data standard when the first field exists in any data table.
[0134] As a possible implementation method, management module 1330 is used to determine whether there is a second field in any data table when a first field exists in any data table; wherein the second field is a field in any data table other than the first field and matching at least one root word in the root word library; when the second field exists, manage any data table according to the first field and the data standard matching the first field, and according to the second field and at least one root word matching the second field; when the second field does not exist, manage any data table according to the first field and the matching data standard.
[0135] As a possible implementation method, the management module 1330 is used to determine, when there is a first field in any data table, a data standard that matches the first field and an English name of the data standard that matches the first field from a data standard library based on the first field; determine the English name of the second field based on at least one root word that matches the second field; and manage any data table based on the first field and the English name of the first field, and based on the second field and the English name of the second field.
[0136] As a possible implementation manner, the data table management device 1300 further includes: a confirmation module.
[0137] Among them, the confirmation module is used to display the first field and the English name of the first field, and the English name of the second field and the second field; in response to the confirmation operation of the first field and the English name of the first field, and the English name of the second field and the second field, confirm the first field and the English name of the first field, and the English name of the second field and the second field.
[0138] As a possible implementation method, the judgment module 1320 is used to determine the target scenario from multiple candidate scenarios in response to the scenario selection operation when the value of the standard control mode is the first value; determine multiple target data tables under the target scenario from the data table of the data warehouse model; and call multiple threads in parallel to perform field search tasks, wherein any thread executes the field search task specifically as follows: read a target data table that has not been read by other threads from multiple target data tables; and determine whether the first field exists in the target data table currently being read.
[0139] As a possible implementation method, a root library is generated by a first generation module, and the first generation module is used to obtain a root file, wherein the root file includes root information of at least one root; at least one root is classified according to the root information of the at least one root to obtain multiple classifications; based on the multiple classifications, multiple classification directories of the root library to be generated are determined; for any root in at least one root, any root is added to the classification directory to which any root belongs to obtain the root library.
[0140] As a possible implementation, the data table management device 1300 further includes: a storage module and an update module.
[0141] Among them, the storage module is used to store the root word library; the update module is used to update the root word library in response to the update operation of the root word library, and store the updated root word library; wherein updating the root word library includes any of the following items: importing multiple roots into the root word library; exporting multiple roots from the root word library; deleting multiple roots in the root word library; modifying multiple roots in the root word library.
[0142] As a possible implementation method, the data standard library is generated by a second generation module, and the second generation module is used to obtain a business file, wherein the business file includes business data under multiple data standards; based on the multiple data standards, multiple data standard directories of the data standard library to be generated are determined; wherein each data standard corresponds to a data standard directory; for any data standard, each business field of the business data under any data standard is added to the data standard directory corresponding to any data standard to generate a data standard library.
[0143] As a possible implementation method, the judgment module 1320 is also used to query whether there is a third field in any data table in the data warehouse model in response to the value of the standard management mode being the second value, wherein the third field matches at least one root in the root library; the second value is used to indicate that the field in any data table does not need to be subject to data standard management; the management module 1330 is used to manage any data table according to the third field and at least one root that matches the third field.
[0144] The data table management device of the embodiment of the present disclosure selects the value of the standard control mode of the data warehouse model through the selection operation of the standard control mode of the data warehouse model, and when the value of the standard control mode indicates that the field of the data table in the data warehouse model requires data standard control, determines whether there is a first field in the data table, wherein the first field is a field that matches the data standard in the data standard library, and when the first field exists in the data table, the data table is managed based on the first field and the matching data standard. Thus, based on the first field of the data table and the data standard that matches the first field in the data standard library, standardized naming of the data table is achieved, the consistency and accuracy of the naming of the data table fields is improved, and there is no need to manually name the fields of the data table, thereby reducing the complexity of data table management.
[0145] In an exemplary embodiment, an electronic device is also provided.
[0146] Among them, electronic equipment includes:
[0147] processor;
[0148] a memory for storing processor-executable instructions;
[0149] The processor is configured to execute instructions to implement the data table management method proposed in any of the aforementioned embodiments.
[0150] As an example, Fig.14 is a schematic diagram of the structure of an electronic device 1400 shown in an exemplary embodiment of the present disclosure, such as Fig.14 As shown, the electronic device 1400 may further include:
[0151] The memory 1410 and the processor 1420, a bus 1430 connecting different components (including the memory 1410 and the processor 1420), the memory 1410 stores a computer program, and when the processor 1420 executes the program, the data table management method described in the embodiment of the present disclosure is implemented.
[0152] Bus 1430 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus architectures. For example, these architectures include but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus and Peripheral Component Interconnect (PCI) bus.
[0153] The electronic device 1400 typically includes a variety of electronic device readable media. These media can be any available media that can be accessed by the electronic device 1400, including volatile and non-volatile media, removable and non-removable media.
[0154] The memory 1410 may also include computer system readable media in the form of volatile memory, such as random access memory (RAM) 1440 and / or cache memory 1450. The server 1400 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 1460 may be used to read and write non-removable, non-volatile magnetic media ( Fig.14 not shown, usually called a "hard drive"). Although Fig.14 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 1430 via one or more data medium interfaces. Memory 1410 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present disclosure.
[0155] A program / utility 1480 having a set (at least one) of program modules 1470 may be stored, for example, in the memory 1410, such program modules 1470 including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 1470 generally perform the functions and / or methods of the embodiments described in the present disclosure.
[0156] The electronic device 1400 may also communicate with one or more external devices 1490 (e.g., keyboard, pointing device, display 1491, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 1400, and / or communicate with any device that enables the electronic device 1400 to communicate with one or more other computing devices (e.g., network card, modem, etc.). Such communication may be performed through an input / output (I / O) interface 1492. In addition, the electronic device 1400 may also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN) and / or public network, such as the Internet) through a network adapter 1493. As shown, the network adapter 1493 communicates with other modules of the electronic device 1400 through a bus 1430. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 1400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0157] The processor 1420 executes various functional applications and data processing by running the programs stored in the memory 1410 .
[0158] It should be noted that the implementation process and technical principles of the electronic device of this embodiment refer to the aforementioned explanation of the data table management method of the embodiment of the present disclosure, and will not be repeated here.
[0159] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory including instructions, and the above instructions can be executed by a processor of an electronic device to complete the data table management method proposed in any of the above embodiments. Optionally, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0160] In an exemplary embodiment, a computer program product is also provided, including a computer program / instruction, characterized in that when the computer program / instruction is executed by a processor, the data table management method proposed in any of the above embodiments is implemented.
[0161] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.
[0162] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A data table management method, It is characterized in that include: In response to the selection operation of the standard control mode, a value of the standard control mode of the data warehouse model is selected; When the value of the standard control mode is the first value, for any data table in the data warehouse model, determine whether a first field exists in any data table, wherein the first field is a field that matches the data standard in the data standard library, and the first value is used to indicate that the field in any data table needs to be subject to data standard control; In the case that the first field exists in any of the data tables, the any of the data tables is managed based on the first field and a matching data standard.
2. The method according to claim 1, It is characterized in that In the case where the first field exists in any of the data tables, managing the any of the data tables based on the first field and a matching data standard includes: In the case where the first field exists in any of the data tables, determining whether a second field exists in any of the data tables; wherein the second field is a field in any of the data tables other than the first field and matches at least one root word in the root word library; In the case where the second field exists, managing the any one data table according to the first field and the data standard that matches the first field, and according to the second field and at least one root word that matches the second field; In the absence of the second field, the any data table is managed according to the first field and the matching data standard.
3. The method according to claim 2, It is characterized in that In the case where the second field exists, managing the any data table according to the first field and a data standard that matches the first field, and according to the second field and at least one root that matches the second field, includes: In the case where a first field exists in any of the data tables, determining, according to the first field, a data standard matching the first field and an English name of the data standard matching the first field from the data standard library; Determine the English name of the second field according to at least one root word matched by the second field; The any data table is managed according to the first field and the English name of the first field, and according to the second field and the English name of the second field.
4. The method according to claim 3, It is characterized in that Before managing any one of the data tables according to the first field and the English name of the first field, and according to the second field and the English name of the second field, the method further includes: Displaying the first field and the English name of the first field, and the second field and the English name of the second field; In response to a confirmation operation on a first field and an English name of the first field, and a second field and an English name of the second field, the first field and the English name of the first field, and the second field and the English name of the second field are confirmed.
5. The method according to claim 1, It is characterized in that When the value of the standard control mode is the first value, for any data table in the data warehouse model, determining whether the first field exists in any data table includes: When the value of the standard control mode is the first value, in response to a scene selection operation, determining a target scene from a plurality of candidate scenes; Determining multiple target data tables under the target scenario from the data table of the data warehouse model; Multiple threads are called in parallel to perform a field search task, wherein any one of the threads performs the field search task specifically as follows: Reading a target data table that has not been read by other threads from the multiple target data tables; It is determined whether the first field exists in the target data table currently being read.
6. The method according to claim 2, It is characterized in that The root library is generated by the following steps: Acquire a root word file, wherein the root word file includes root word information of at least one root word; Classifying the at least one word root according to the word root information of the at least one word root to obtain a plurality of classifications; Determine multiple classification catalogs of the root word library to be generated according to the multiple classifications; For any word root among the at least one word root, the word root is added to the classification catalog to which the word root belongs, so as to obtain the word root library.
7. The method according to claim 6, It is characterized in that The method further comprises: Storing the root word library; In response to an update operation on the root word library, updating the root word library and storing the updated root word library; Wherein, updating the root word library includes any of the following: Importing multiple word roots into the word root library; deriving a plurality of word roots from the word root library; Deleting multiple word roots in the word root library; Modify multiple word roots in the word root library.
8. The method according to claim 1, It is characterized in that The data standard library is generated by the following steps: Acquire a business file, wherein the business file includes business data under multiple data standards; Determine, according to the multiple data standards, multiple data standard directories of the data standard library to be generated; wherein each data standard corresponds to a data standard directory; For any data standard, each business field of the business data under the any data standard is added to the data standard directory corresponding to the any data standard to generate the data standard library.
9. The method according to any one of claims 1 to 8, It is characterized in that The method further comprises: In response to the value of the standard control mode being the second value, for any data table in the data warehouse model, querying whether a third field exists in any data table; wherein the third field matches at least one root word in the root word library; and the second value is used to indicate that the field in any data table does not need to be subject to data standard control; The any one data table is managed according to the third field and at least one root word matched by the third field.
10. A data table management device, It is characterized in that include: A selection module, configured to select a value of a standard control mode of a data warehouse model in response to a selection operation of the standard control mode; a judgment module, configured to judge, for any data table in the data warehouse model, whether a first field exists in the data table when the value of the standard control mode is a first value, wherein the first field is a field that matches the data standard in the data standard library, and the first value is used to indicate that the field in the data needs to be subject to data standard control; A management module is used to manage any data table based on the first field and a matching data standard when there is a first field in any data table.
