A data table identification method, device, equipment, medium and program product
By automatically identifying data table types, the problem of low efficiency in manual classification in existing technologies is solved, and efficient classification and application scenario adaptation are achieved in the data processing process.
Patent Information
- Application Number
- CN202210551384.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-05-18
- Publication Date
- 2025-12-30
- Estimated Expiration
- 2042-05-18
AI Technical Summary
In existing technologies, the identification of data table types during data processing relies on manual classification, which is inefficient and cannot meet the needs of big data processing.
By acquiring data processing design documents, data tables and their field information are extracted, and the type of data table is automatically identified based on the field information, classifying them into target tables, temporary tables, and source tables, suitable for different application scenarios.
It enables automated identification and classification of data table types, improves data processing efficiency, and supports application scenarios such as automatic code generation, quality inspection, and data lineage analysis.
Smart Images

Figure CN114841281B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present invention relate to the field of data processing technology, and in particular to a method, apparatus, device, medium and program product for a data table. Background Technology
[0002] Data processing is the process of transforming and processing a batch of data into another batch of result data. The execution result of data processing is the generation of a target table. A target table can be processed from one or more source database tables. During processing, temporary tables may be created for data transfer and storage. Therefore, the processing of a target table involves source tables, target tables, temporary tables, and common temporary tables. When writing script code, different processing methods are needed depending on the table type. For example, for a target table, to rerun the processing, existing data needs to be deleted before starting the processing. For a temporary table, the `truncate` method is used to delete all data in the table. For a source table, it is necessary to check if the table is in the source table set; if not, an error should be displayed to detect and resolve errors early. Furthermore, in application scenarios such as development quality checks and data lineage analysis, different processing or analysis strategies need to be selected based on the table type.
[0003] During data processing, different developers need to perform different processing based on their personal experience and abilities according to different table types. However, manual classification is inefficient and cannot meet the needs of big data processing. Summary of the Invention
[0004] This invention provides a method, apparatus, device, medium, and program product for identifying data tables. The identification method automatically identifies the type of data table during data processing to make it suitable for different application scenarios.
[0005] In a first aspect, embodiments of the present invention provide a method for identifying a data table, comprising:
[0006] Obtain at least one data processing design document;
[0007] Extract the data table and the corresponding field information from the data processing design document;
[0008] The type of the data table is identified based on the field information.
[0009] Optionally, the step of extracting the data table and corresponding field information from the data processing design document includes:
[0010] Based on the data processing design document, obtain all relevant data tables;
[0011] Locate the position of the data table in the data processing process;
[0012] Based on the location, determine the field information corresponding to the data table.
[0013] Optionally, determining the field information corresponding to the data table based on the location includes:
[0014] Obtain the program segment of the data table during the data processing process;
[0015] Extract the command statements that perform operations on the data table from the program segment, and use them as field information corresponding to the data table.
[0016] Optionally, identifying the type of the data table based on the field information includes:
[0017] Determine whether the field information includes a creation statement;
[0018] If so, the data table will be identified as a temporary table.
[0019] Optionally, after determining whether the field information includes a creation statement, the method further includes:
[0020] If not, determine whether the field information includes an insert statement;
[0021] If so, the data table will be identified as either a target table or a temporary table.
[0022] Optionally, after identifying the data table as a target table or a temporary table, the method further includes:
[0023] Determine whether the field information includes a reference statement;
[0024] If so, the data table will be identified as a temporary table.
[0025] Optionally, after determining whether the field information includes a reference statement, the method further includes:
[0026] If not, the data table will be identified as the target table.
[0027] Optionally, after determining whether the field information includes an insert statement, the method further includes:
[0028] If not, the data table will be identified as the source table.
[0029] Optionally, after identifying the type of the data table based on the field information, the method further includes:
[0030] Based on the field information, the data table types in at least one of the multiple data processing processes in the data processing design document are processed.
[0031] Optionally, processing the data table types in at least one of the multiple data processing steps of the data processing design document includes:
[0032] Merge data tables of the same type identified during multiple data processing processes.
[0033] Optionally, after merging the data tables of the same type identified in multiple data processing processes, the method further includes:
[0034] If a table with the same name includes both a temporary table and a data table, then adjust the name of the temporary table.
[0035] Optionally, after merging the data tables of the same type identified in multiple data processing processes, the method further includes:
[0036] If a data table with the same name includes both a source table and a target table, then based on type priority, the data table will be uniformly identified as a target table.
[0037] Optional, also includes:
[0038] Determine whether the data table with the unified identifier as the target table is located in the preset table model document;
[0039] If not, mark the data table as a public temporary table.
[0040] Optionally, after determining whether the data table uniformly identified as the target table is located in the table model document, the method further includes:
[0041] If so, mark the data table as the target table.
[0042] Secondly, embodiments of the present invention also provide a data table identification device, comprising:
[0043] The acquisition module is used to acquire at least one data processing design document;
[0044] The extraction module is used to extract the data table and the field information corresponding to the data table from the data processing design document;
[0045] The identification module is used to identify the type of the data table based on the field information.
[0046] Thirdly, embodiments of the present invention also provide a data table identification device, comprising:
[0047] One or more processors;
[0048] Memory, used to store one or more programs;
[0049] When the one or more programs are executed by the one or more processors, the one or more processors implement the data table identification method as described above.
[0050] Fourthly, embodiments of the present invention also provide a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the data table identification method as described above.
[0051] Fifthly, embodiments of the present invention also provide a computer program product having a computer program stored thereon, which, when executed by a processor, implements the data table identification method as described above.
[0052] The data table identification method provided in this embodiment of the invention first obtains at least one data processing design document; then extracts all data tables involved in the data processing process and the field information corresponding to the data tables from the data processing document; and then identifies the type of the data table based on the field information, classifying the data tables involved in the processing process into a set of target tables, temporary tables, and source tables to be applicable to different application scenarios. Attached Figure Description
[0053] Figure 1 This is a flowchart illustrating a data table identification method provided in Embodiment 1 of the present invention;
[0054] Figure 2 This is a schematic diagram of the specific process of a data table identification method provided in Embodiment 1 of the present invention;
[0055] Figure 3 This is a flowchart illustrating a data table identification method provided in Embodiment 2 of the present invention;
[0056] Figure 4 This is a flowchart illustrating a data table identification method provided in Embodiment 3 of the present invention;
[0057] Figure 5 This is a flowchart illustrating the data table type identification process in multiple data processes, as provided in Embodiment 3 of the present invention.
[0058] Figure 6 This is a structural block diagram of a data table identification device provided in Embodiment 4 of the present invention;
[0059] Figure 7 This is a schematic diagram of the structure of a data table recognition device provided in Embodiment 5 of the present invention. Detailed Implementation
[0060] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and not intended to limit it. Furthermore, it should be noted that, for ease of description, the accompanying drawings show only the parts relevant to the present invention, and not all of the structures.
[0061] Example 1
[0062] Figure 1 This is a flowchart illustrating a data table identification method according to Embodiment 1 of the present invention. This embodiment is applicable to the automatic classification of database tables during data processing in the data processing field. The identification method can be executed by the data table identification device provided in this embodiment of the invention. This device can be implemented in software and / or hardware and can be integrated into a data table identification equipment, which can be various user terminals or servers. (Reference) Figure 1 The data table identification method provided in this embodiment of the invention includes the following steps:
[0063] S110. Obtain at least one data processing design document.
[0064] A vast amount of data is generated in all areas of social life. In the field of data processing, various processing methods are required, such as data filtering, addition, and subtraction. A data processing design document includes the data to be processed and the data processing procedure. The technical solution in this embodiment is applicable to automatically identifying and classifying all data tables involved in one or more data processing design documents. Specifically, during data processing, the types of data tables include source tables, temporary tables, and target tables. A source table represents a data table containing the original data, whose data content can only be read and not modified; a temporary table represents a data table created during processing for temporary data storage, whose content can be added to or subtracted from; a target table represents a data table storing the processed target data. A target table can be obtained from data from one or more source tables, meaning one target table can correspond to multiple source tables. Once the data table classification types are obtained, they can be used in other application scenarios.
[0065] For example, the data table identification method provided in this embodiment of the invention can be applied to the following scenarios:
[0066] 1) When the code is converted from manual writing to automatic generation, the source table, target table and temporary table can be automatically identified and classified through the embodiments of the present invention, and the corresponding strategy processing mechanism code can be automatically generated.
[0067] 2) It can help quality inspectors identify development quality issues in a timely manner when browsing code. If it is a source table, it can check whether the source table exists, whether a non-existent source table is referenced, whether there is a table name conflict, and when it is determined to be a source table, data insertion operations are not allowed, etc.
[0068] 3) Used for data lineage analysis. When it is determined that a table is a temporary table, it is not necessary to trace the data lineage across multiple data processing processes.
[0069] S120. Extract the data tables and corresponding field information from the data processing design document.
[0070] The data table includes features such as its name. The data extraction process can be automated by a program or performed by developers reading documentation; the choice depends on the specific circumstances. Simultaneously, the corresponding field information, including commands used to manipulate the data table, also needs to be extracted for subsequent identification of the data table type.
[0071] S130. Identify the type of the data table based on the field information.
[0072] Figure 2 This is a schematic diagram illustrating the specific process of a data table identification method provided in Embodiment 1 of the present invention.
[0073] refer to Figure 2 Optionally, the type of the data table can be identified based on the field information, including:
[0074] The system determines whether the field information includes a CREATE statement. In practice, a CREATE statement can include a `Create` statement; if so, the data table is identified as a temporary table and added to the temporary table set. If no CREATE statement is included, the system further determines whether the field information includes an INSERT statement. INSERT statements can include `INSERT` statements; if so, the data table is identified as either a target table or a temporary table. At this point, the specific type of the data table cannot be determined, so the system further determines whether the field information includes a FROM statement. FROM statements can include `FROM` statements; if so, the data table is identified as a temporary table and added to the temporary table set. If no FROM statement is included, the data table is identified as a target table and added to the target table set. If no INSERT statement is included, the data table is identified as a source table and added to the source table set. In other words, in this embodiment, the tables created during data processing are first identified as temporary tables; the second step is to extract the target tables of all INSERT statements; the third step is to extract all other tables in all statements; if a table extracted in the second step is also in the tables extracted in the third step, it is determined to be a temporary table; otherwise, it is a target table; finally, all other remaining tables are identified as source tables. After the entire data processing process undergoes such table type identification, three sets of tables are formed: target tables, temporary tables, and source tables. The tables involved in the data processing must fall into one of the three categories, and a table can only be classified into one category and cannot appear in multiple category sets.
[0075] The technical solution of this invention first obtains at least one data processing design document; then extracts all data tables involved in the data processing process and the field information corresponding to the data tables from the data processing document; then, based on the field information, identifies the type of the data tables and classifies the data tables involved in the processing process into a set of target tables, temporary tables, and source tables to suit different application scenarios.
[0076] Example 2
[0077] Figure 3 This is a flowchart illustrating a data table identification method according to Embodiment 2 of the present invention. This embodiment is an optimization based on the above technical solution. In this embodiment, optionally, extracting the data tables and corresponding field information from the data processing design document includes: obtaining all relevant data tables according to the data processing process in the data processing design document; locating the position of the data table in the data processing process; and determining the field information corresponding to the data table based on the position. Explanations of terms that are the same as or corresponding to those in the above embodiments will not be repeated here.
[0078] refer to Figure 3 The identification method in this embodiment may specifically include the following steps:
[0079] S210. Obtain at least one data processing design document.
[0080] S220. Based on the data processing design document, obtain all relevant data tables.
[0081] By retrieving all the relevant data tables, the type of each table can be identified.
[0082] S230, Position the data table during the data processing process.
[0083] S240. Determine the field information corresponding to the data table based on the location.
[0084] The data processing is typically executed by a written program, which determines the field information corresponding to the data table based on the location, including:
[0085] Retrieve the program segment of the data table during the data processing process;
[0086] The program segment can be a line of program code or a piece of code that executes a certain process. The specific implementation can be selected according to the actual situation, and the embodiments of the present invention do not limit it.
[0087] Extract the command statements that perform operations on the data table from the program segment, and use them as the field information corresponding to the data table.
[0088] Command statements can include creation statements (such as the Create statement), insertion statements (such as the Insert statement), and reference statements (such as the From statement).
[0089] S250. Identify the type of the data table based on the field information.
[0090] Example 3
[0091] Figure 4 This is a flowchart illustrating a data table identification method provided in Embodiment 3 of the present invention. This embodiment is an optimization based on the above-described technical solutions. Optionally, after identifying the data table type based on field information, this embodiment further includes: processing the data table types in multiple data processing operations of at least one data processing design document based on the field information. Explanations of terms identical or corresponding to those in the above embodiments will not be repeated here.
[0092] refer to Figure 4 The identification method in this embodiment may specifically include the following steps:
[0093] S410. Obtain at least one data processing design document.
[0094] S420. Extract the data tables and corresponding field information from the data processing design document.
[0095] S430. Identify the type of the data table based on the field information.
[0096] S440. Based on the field information, process the data table types in multiple data processing steps of at least one data processing design document.
[0097] The technical solution of this invention first identifies the table type in a single data processing process, classifies the tables involved in the processing process into three sets: target table, temporary table, and source table. Then, it summarizes the target table, temporary table, and source table sets identified in multiple data processes, removes duplicates according to classification priority, and finally obtains a complete set of target tables, temporary tables, and source tables for a certain data processing system. Then, in the automated processing process, different strategies are selected for processing according to the identified table types.
[0098] Figure 5 This is a schematic diagram illustrating a data table type identification process across multiple data processes, as provided in Embodiment 3 of the present invention. (Reference) Figure 5 Optionally, the data table types in multiple data processing steps of at least one data processing design document are processed, including:
[0099] Merge data tables of the same type identified during multiple data processing processes.
[0100] The merging process refers to the simple combination of three types of tables identified in multiple data processing processes. In addition to storing the table name and table type, each table in the set also contains a processing process identifier that indicates in which processing process the table was identified.
[0101] Optionally, after merging data tables of the same type identified in multiple data processing processes, the process may also include:
[0102] If a table with the same name includes both a temporary table and another type of table, then adjust the name of the temporary table.
[0103] Understandably, if tables with the same name are both temporary tables and other types of tables, these processing procedures will conflict, and the temporary table name needs to be adjusted.
[0104] If a data table with the same name includes both a source table and a target table, then based on type priority, the data table will be uniformly identified as a target table. Furthermore, if the developers have provided a table model document, it will be determined whether the data table uniformly identified as a target table is located in the preset table model document. If not, the data table will be identified as a public temporary table and deleted from both the target table set and the source table set. If so, the data table will be identified as a target table.
[0105] The technical solutions of this invention can provide table type classification for the automation process of data processing, allowing subsequent automatic processing to select the correct processing strategy; they can also be used for development quality checks to promptly detect references to non-existent source tables or table naming conflicts; if the target table model of the database is designed in advance, this invention can promptly detect whether the target table for data processing already exists; it can also help database model administrators to implement different database table maintenance strategies based on different table types; and it can also be used for data lineage analysis to perform different analysis and processing based on table type.
[0106] Example 4
[0107] Figure 6 This is a structural block diagram of a data table identification device provided in Embodiment 4 of the present invention. This identification device is used to execute the data table identification method provided in any of the above embodiments. This identification device and the data table identification methods of the above embodiments belong to the same inventive concept. Details not described in detail in the embodiments of the data table identification device can be found in the embodiments of the data table identification methods described above. Reference Figure 6 The identification device may specifically include:
[0108] Module 610 is used to acquire at least one data processing design document;
[0109] Extraction module 620 is used to extract data tables and corresponding field information from data processing design documents;
[0110] The identification module 630 is used to identify the type of the data table based on field information.
[0111] Optionally, the extraction module 620 is specifically used for:
[0112] Based on the data processing design document, obtain all relevant data tables;
[0113] Position the data table within the data processing process;
[0114] Based on the location, determine the field information corresponding to the data table.
[0115] Optionally, the extraction module 620 is also used for:
[0116] Retrieve the program segment of the data table during the data processing process;
[0117] Extract the command statements that perform operations on the data table from the program segment, and use them as the field information corresponding to the data table.
[0118] Optionally, the recognition module 630 is specifically used for:
[0119] Determine whether the field information includes a creation statement;
[0120] If the field information includes a creation statement, the data table will be identified as a temporary table.
[0121] Optionally, the identification module 630 is also used to further determine whether the field information includes an insert statement when it is determined that the field information does not include a creation statement;
[0122] If the automatic information is determined to include an insert statement, the data table will be identified as either a target table or a temporary table.
[0123] Optionally, the identification module 630 is also used to further determine whether the field information includes reference statements after the data table is identified as a target table or a temporary table;
[0124] If the field information includes reference statements, the data table will be identified as a temporary table.
[0125] Optionally, the identification module 630 is also used to identify the data table as the target table after determining that the field information does not include a reference statement.
[0126] Optionally, the identification module 630 is also used to identify the data table as the source table after determining that the field information does not include the insert statement.
[0127] Optionally, the identification module 630, after identifying the type of the data table based on the field information, also includes:
[0128] Based on field information, process the data table types in multiple data processing operations within at least one data processing design document.
[0129] Optionally, the data table types in multiple data processing steps of at least one data processing design document are processed, including:
[0130] Merge data tables of the same type identified during multiple data processing processes.
[0131] Optionally, after merging data tables of the same type identified in multiple data processing processes, the process may also include:
[0132] If a table with the same name includes both a temporary table and a data table, then adjust the name of the temporary table.
[0133] Optionally, after merging data tables of the same type identified in multiple data processing processes, the process may also include:
[0134] If a data table with the same name includes both a source table and a target table, then based on type priority, the data table will be uniformly identified as a target table.
[0135] Optional, also includes:
[0136] Determine whether the data table with the unified identifier as the target table is located in the preset table model document;
[0137] If not, mark the data table as a public temporary table.
[0138] Optionally, after determining whether the data table uniformly identified as the target table is located in the table model document, the following steps are also included:
[0139] If so, mark the data table as the target table.
[0140] It is worth noting that in the embodiments of the above-mentioned data table identification device, the modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of each functional module are only for easy differentiation and are not used to limit the scope of protection of the present invention.
[0141] Example 5
[0142] Figure 7 This is a schematic diagram of the structure of a data table recognition device provided in Embodiment 5 of the present invention, as shown below. Figure 7 As shown, the device includes a memory 710, a processor 720, an input device 730, and an output device 740. The number of processors 720 in the device can be one or more. Figure 7 Taking a processor 720 as an example; the memory 710, processor 720, input device 730, and output device 740 in the device can be connected via a bus or other means. Figure 7 Taking the connection between China and Israel via bus 750 as an example.
[0143] The memory 710, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as the program instructions / modules corresponding to the data table identification method in this embodiment of the invention (e.g., the acquisition module 610, extraction module 620, and identification module 630 in the data table identification device). The processor 720 executes various functional applications and data processing of the device by running the software programs, instructions, and modules stored in the memory 710, thereby implementing the aforementioned data table identification method.
[0144] The memory 710 may primarily include a program storage area and a data storage area. The program storage area may store the operating system and at least one application program required for a given function; the data storage area may store data created based on device usage. Furthermore, the memory 710 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory, or other non-volatile solid-state storage device. In some instances, the memory 710 may further include memory remotely located relative to the processor 720, which can be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
[0145] Input device 730 can be used to receive input digital or character information, and to generate key signal inputs related to user settings and function control of the device. Output device 740 may include display devices such as a display screen.
[0146] Example 6
[0147] Embodiment 6 of the present invention provides a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform a data table identification method, the identification method comprising:
[0148] Obtain at least one data processing design document;
[0149] Extract the data tables and corresponding field information from the data processing design document;
[0150] The type of the data table is identified based on the field information.
[0151] Of course, the computer-executable instructions provided in the embodiments of the present invention are not limited to the method operations described above, but can also perform related operations in the data table identification method provided in any embodiment of the present invention.
[0152] This invention also provides a computer program product on which a computer program is stored, which, when executed by a processor, implements the data table identification method provided in any embodiment of this invention.
[0153] Based on the above description of the implementation methods, those skilled in the art can clearly understand that the present invention can be implemented using software and necessary general-purpose hardware, and of course, it can also be implemented using hardware, but in many cases the former is a better implementation method. According to this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory, hard disk, or optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.
[0154] Note that the above description is merely a preferred embodiment of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, readjustments, and substitutions can be made without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of the present invention, the scope of which is determined by the scope of the appended claims.
Claims
1. A method of identifying a data table, characterized by, The method comprises the following steps: acquiring at least one data processing design document; extracting a data table of the data processing design document and field information corresponding to the data table; identifying the type of the data table according to the field information; wherein the step of extracting the data table of the data processing design document and the field information corresponding to the data table comprises the following steps: acquiring all data tables involved according to a data processing process of the data processing design document; locating the position of the data table in the data processing process; determining the field information corresponding to the data table according to the position; the step of determining the field information corresponding to the data table according to the position comprises the following steps: acquiring a program segment of the data table in the data processing process; extracting a command statement in the program segment for executing an operation on the data table as the field information corresponding to the data table; wherein the command statement at least comprises a creation statement, an insertion statement and a reference statement; the step of identifying the type of the data table according to the field information comprises the following steps: judging whether the field information comprises a creation statement; if yes, identifying the data table as a temporary table; if no, judging whether the field information comprises an insertion statement; if no, identifying the data table as a source table; if yes, identifying the data table as a target table or a temporary table; after identifying the data table as a target table or a temporary table, the method further comprises the following steps: judging whether the field information comprises a reference statement; if yes, identifying the data table as a temporary table; if no, identifying the data table as a target table.
2. The identification method according to claim 1, characterized in that, after identifying the type of the data table according to the field information, the method further comprises the following steps: processing the types of the data tables in multiple data processing of at least one data processing design document according to the field information.
3. The identification method according to claim 2, characterized in that, the step of processing the types of the data tables in multiple data processing of at least one data processing design document comprises the following steps: merging the data tables of the same type identified in multiple data processing processes.
4. The identification method according to claim 3, characterized in that, after merging the data tables of the same type identified in multiple data processing processes, the method further comprises the following steps: if the types of the data tables with the same table name comprise a temporary table and another type of data table, adjusting the table name of the temporary table.
5. The identification method according to claim 3, characterized in that, after merging the data tables of the same type identified in multiple data processing processes, the method further comprises the following steps: if the types of the data tables with the same table name comprise a source table and a target table, uniformly identifying the type of the data table as a target table according to a type priority.
6. The identification method according to claim 5, characterized in that, the method further comprises the following steps: judging whether the data table uniformly identified as a target table is located in a preset table model document; if no, identifying the data table as a common temporary table.
7. The identification method according to claim 6, characterized in that, after judging whether the data table uniformly identified as a target table is located in the table model document, the method further comprises the following steps: if yes, identifying the data table as a target table.
8. An apparatus for identifying a data table, characterized by The method comprises the following steps: an acquiring module, configured to acquire at least one data processing design document; an extracting module, configured to extract a data table of the data processing design document and field information corresponding to the data table; an identifying module, configured to identify the type of the data table according to the field information; an acquiring module, configured to acquire at least one data processing design document; an extracting module, configured to extract a data table of the data processing design document and field information corresponding to the data table; an identifying module, configured to identify the type of the data table according to the field information; The extraction module is specifically configured to design a data processing process of the data processing document according to the data processing, acquire all involved data tables, locate positions of the data tables in the data processing process, and determine field information corresponding to the data tables according to the positions. The extraction module is further configured to acquire program segments of the data tables in the data processing process. The extraction module is further configured to acquire program segments of the data tables in the data processing process. The extraction module is further configured to acquire program segments of the data tables in the data processing process.
9. An identification device of a data table, characterized by, The identification module is further configured to determine whether the field information includes a creation statement, identify the data table as a temporary table if the field information includes the creation statement, determine whether the field information includes an insertion statement if the field information does not include the creation statement, identify the data table as a source table if the field information does not include the insertion statement, identify the data table as a target table or the temporary table if the field information includes the insertion statement, and determine whether the field information includes a reference statement after identifying the data table as the target table or the temporary table, identify the data table as the temporary table if the field information includes the reference statement, and identify the data table as the target table if the field information does not include the reference statement. Comprise: One or more processors; Memory for storing one or more programs; 10. A computer-readable storage medium having stored thereon a computer program, characterized in that, When the one or more programs are executed by the one or more processors, the one or more processors implement the data table identification method of any one of claims 1-7. The computer program is executed by the processor to implement the data table identification method of any one of claims 1-7.
11. A computer program product comprising a computer program which, when executed by a processor, implements the data table identification method of any one of claims 1-7.
Citation Information
Patent Citations
Data table extraction method based on Shell, terminal, equipment and storage medium
CN108536745A