Table replacement method in computing task and related equipment
By filtering and matching the calculation models of upstream and downstream tables in the calculation task, the target downstream tables are automatically determined, which solves the problem of insufficient manual and generality in table replacement governance in the existing technology, and realizes efficient execution of computing tasks and resource conservation.
Patent Information
- Application Number
- CN202510073469.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-16
- Publication Date
- 2025-04-25
AI Technical Summary
The prior art has problems in table replacement governance in computing tasks that require a lot of labor costs, are not very versatile, and cannot effectively reduce the amount of calculation.
By filtering downstream tables corresponding to the upstream table, a calculation model is established that characterizes the calculation logic between the upstream table and the downstream table, and matches the calculation task and calculation model to determine the target downstream table, which is used to replace the upstream table.
It realizes that without changing the calculation logic of the calculation task, automatically obtaining target downstream tables, reducing computing resource consumption, speeding up computing task execution, and improving computing efficiency.
Smart Images

Figure CN119884191A_ABST
Abstract
Description
Technical Field
[0001] The present specification relates to the field of data computing, and in particular to a method for replacing a table in a computing task and related equipment. Background Art
[0002] In data governance projects, computing governance of offline data tasks is a very important part. One way to optimize task codes and save computing resources is to find a suitable input table to reduce the amount of computing as much as possible, thereby achieving the purpose of computing governance.
[0003] Currently, the commonly used solutions for table replacement in table replacement management in computing tasks include the following:
[0004] 1. Replace the old table with the new one. The owner of the data table maintains the data table provided to the downstream and the new data table. This data table replacement method is relatively direct, but it often does not change the granularity of the original table, reduce the amount of reading calculations (the new table may have more field information, which can reduce the amount of associated calculations), and requires manual maintenance of the relationship between the new and old tables;
[0005] 2. For invalid calculations / simple calculations, it is recommended to use the upstream table. This method requires the identification of the data table for simple processing between the upstream and downstream data tables (simple processing mainly refers to the calculation logic that only contains where condition restrictions or selects some fields in the task, and does not contain complex logic processing such as group & join). This solution also cannot reduce the amount of calculation of the task after the table is replaced, and the scenario is limited to simple processing, lacking versatility;
[0006] 3. Manual analysis: In general computing management, based on expert experience, relevant management personnel can analyze tasks that consume a lot of resources and select more appropriate tables for code optimization.
[0007] However, the above-mentioned solutions for performing table replacement in the table replacement task in the computing task all have the problems of requiring a large amount of labor cost, being not universal, and being unable to effectively reduce the amount of computing. Summary of the invention
[0008] The embodiments of this specification provide a method and related devices for table replacement in a computing task, which can solve the above problems. The technical solution is as follows:
[0009] In a first aspect, an embodiment of the present specification provides a method for replacing a table in a computing task, the method comprising:
[0010] Filter at least one downstream table corresponding to the upstream table;
[0011] Establishing a calculation model that represents the calculation logic between the upstream table and the downstream table, wherein the calculation model includes downstream table fields calculated from upstream table fields, and also includes a first constraint condition corresponding to the upstream table fields during the calculation process;
[0012] Acquire a computing task, and determine that the computing task includes computing logic between the upstream table and the output table, the computing task also includes output table fields calculated from the upstream table fields, and a second constraint condition corresponding to the upstream table fields during the computing process;
[0013] Match the content included in the computing task with the content included in at least one of the computing models to obtain at least one target computing model and a target downstream table corresponding to the target computing model, and at least one of the target downstream tables is used to replace the upstream table in the computing task.
[0014] In a second aspect, an embodiment of the present specification provides a table replacement device in a computing task, the device comprising:
[0015] A data screening module, used for screening at least one downstream table corresponding to an upstream table;
[0016] A model building module, used to build a calculation model representing the calculation logic between the upstream table and the downstream table, wherein the calculation model includes downstream table fields calculated from upstream table fields, and also includes a first constraint condition corresponding to the upstream table field during the calculation process;
[0017] A task determination module, used to obtain a computing task, determine that the computing task includes a computing logic between the upstream table and the output table, the computing task also includes an output table field calculated from the upstream table field, and a second constraint condition corresponding to the upstream table field during the computing process;
[0018] An optimization replacement module is used to match the content included in the computing task with the content included in at least one of the computing models, to obtain at least one target computing model and a target downstream table corresponding to the target computing model, at least one of the target downstream tables is used to replace the upstream table in the computing task.
[0019] In a third aspect, an embodiment of the present specification provides a computer storage medium, wherein the computer storage medium stores a plurality of instructions, wherein the instructions are suitable for being loaded by a processor and executing the above-mentioned method steps.
[0020] In a fourth aspect, an embodiment of the present specification provides a computer program product, wherein the computer program product stores a plurality of instructions, wherein the instructions are suitable for being loaded by a processor and executing the above-mentioned method steps.
[0021] In a fifth aspect, an embodiment of the present specification provides an electronic device, which may include: a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the above-mentioned method steps.
[0022] The beneficial effects brought by the technical solutions provided by some embodiments of this specification include at least:
[0023] In an embodiment of the present specification, at least one downstream table corresponding to an upstream table is screened, and a calculation model characterizing the calculation logic between the upstream table and the downstream table is established. The calculation model includes downstream table fields calculated from upstream table fields and first constraints corresponding to the upstream table fields during the calculation process. The calculation logic between the upstream table and the output table included in the calculation task, the output table fields calculated from the upstream table fields, and the second constraints corresponding to the upstream table fields during the calculation process are further determined. The content included in the calculation task and the content respectively included in at least one calculation model are further matched to obtain a target downstream table for replacing the upstream table in the calculation task.
[0024] In other words, the embodiments of this specification construct multiple computing models that characterize the computing logic between the upstream table and the downstream table, and match the computing tasks calculated for the upstream table in multiple computing models, so as to determine the target downstream table that can replace the upstream table without changing the computing logic of the computing task. The amount of data in the target downstream table is smaller than that in the upstream table. By replacing the upstream table, the execution of the computing task can be accelerated and the computing efficiency can be improved, while reducing the consumption of computing resources. And based on the steps of screening the downstream table provided by the embodiments of this specification, matching according to the content of the computing model and the content of the computing task, the accuracy of the acquired target downstream table is improved while realizing the automatic acquisition of the target downstream table, and the reliability of the execution of the computing task is ensured. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] In order to more clearly illustrate the embodiments of this specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0026] Figure 1 It is a scenario diagram of a table replacement method in a computing task provided by an embodiment of this specification;
[0027] Figure 2 It is a flowchart of a table replacement method in a computing task provided by an embodiment of this specification;
[0028] Figure 3It is a flowchart of building a computing model provided by an embodiment of this specification;
[0029] Figure 4 It is a flowchart of obtaining a computing task provided by an embodiment of this specification;
[0030] Figure 5 It is a flowchart of a table replacement method in a computing task provided by an embodiment of this specification;
[0031] Figure 6 It is a structural diagram of a table replacement method in a computing task provided by an embodiment of this specification;
[0032] Figure 7 It is a flowchart of a table replacement method in a computing task provided by an embodiment of this specification;
[0033] Figure 8 It is a structural schematic diagram of a table replacement device in a computing task provided by an embodiment of this specification;
[0034] Fig. 9 It is a structural schematic diagram of an electronic device provided in an embodiment of this specification. DETAILED DESCRIPTION
[0035] The following will be combined with the drawings in the embodiments of this specification to clearly and completely describe the technical solutions in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this specification.
[0036] In the description of this specification, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In the description of this specification, it should be noted that, unless otherwise clearly specified and limited, "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. For those of ordinary skill in the art, the specific meanings of the above terms in this specification can be understood in specific circumstances. In addition, in the description of this specification, unless otherwise specified, "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are an "or" relationship.
[0037] The present specification is described in detail below with reference to specific embodiments.
[0038] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in the embodiments of this specification are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the features, information and data involved in this specification are all obtained with full authorization.
[0039] In data governance projects, computing governance of offline data tasks is a very important part. One way to optimize task codes and save computing resources is to find a suitable input table to reduce the amount of computing as much as possible, thereby achieving the purpose of computing governance.
[0040] Currently, the commonly used solutions for table replacement in table replacement management in computing tasks include the following:
[0041] 1. Replace the old table with the new one. The owner of the data table maintains the data table provided to the downstream and the new data table. This data table replacement method is relatively direct, but it often does not change the granularity of the original table, reduce the amount of reading calculations (the new table may have more field information, which can reduce the amount of associated calculations), and requires manual maintenance of the relationship between the new and old tables;
[0042] 2. For invalid calculations / simple calculations, it is recommended to use the upstream table. This method requires identifying the calculation logic between the upstream and downstream data tables, and determining that only the data table with simple processing logic (simple processing mainly refers to the calculation logic that only contains where condition restrictions or selects some fields in the task, and does not contain complex logic processing such as group&join) can be implemented. This solution also cannot reduce the amount of calculation of the task after the table is replaced, and the scenario is limited to simple processing, lacking versatility;
[0043] 3. Manual analysis: In general computing management, based on expert experience, relevant management personnel can analyze tasks that consume a lot of resources and select more appropriate tables for code optimization.
[0044] However, the above-mentioned solutions for performing table replacement in the table replacement task in the computing task all have the problems of requiring a large amount of labor cost, being not universal, and being unable to effectively reduce the amount of computing.
[0045] In view of the above problems, the embodiments of this specification propose a method and related devices for replacing tables in computing tasks to solve them. Figure 1 As shown, Figure 1 It is a schematic diagram of the architecture of a method for table replacement in a computing task provided by an embodiment of this specification.
[0046] Figure 1 The system includes at least a server 101 for executing a method for table replacement in a computing task, and also includes a plurality of electronic devices for uploading and sending data tables and / or sending computing tasks. The plurality of electronic devices includes at least an electronic device 1021, an electronic device 1022, and an electronic device 1023. It is understandable that Figure 1 The number of servers and electronic devices shown in the figure is for illustration only, and the embodiments of this specification do not impose any limitation on this.
[0047] The above-mentioned blockchain node servers include but are not limited to physical or virtual processors, mobile stations (MobileStation, MS), mobile terminal equipment (Mobile Terminal), mobile phones (Mobile Telephone), mobile phones (handsets) and portable equipment (portable equipment), Bluetooth headsets, smart watches and other types. The electronic devices can communicate with one or more core networks via the Radio Access Network (Radio Access Network, RAN).
[0048] For example, the server is a plurality of physical servers, and the plurality of physical servers are independent in hardware. Or, the server is a plurality of virtual servers, and the plurality of virtual servers are deployed in the same hardware resource pool, and the deployment methods of the virtual servers include but are not limited to: VMware, Virtual Box and Virtual PC.
[0049] It is understandable that servers 1011, 1012, 1013, and 1014, which are blockchain node servers, also have other service capabilities and functions to complete the tasks in the following embodiments. For example, server 1011 also provides portal services, resource management services, and CI / CD services.
[0050] In the embodiments of the present specification, electronic devices such as electronic device 1021, electronic device 1022 and electronic device 1023 may also be equipped with display devices, and the display devices may be various devices capable of realizing display functions, for example, the display devices may be cathode ray tube display (Cathode ray tube display, referred to as CR), light-emitting diode display (Light-emitting diode display, referred to as LED), electronic ink screen, liquid crystal display (Liquid crystal display, referred to as LCD), plasma display panel (Plasma display panel, referred to as PDP), etc. For example, a user may use the display device on electronic device 1021 to send threat intelligence or a query request for threat intelligence to server 1011, or view the threat intelligence sent by server 1011.
[0051] Multiple electronic devices and multiple servers can communicate through communication links established by communication protocols, such as the gRPC protocol. gRPC is a high-performance, general-purpose open source remote procedure call (RPC) framework, which is mainly designed for mobile application development and based on the HTTP / 2 protocol standard, based on the protocol buffer (PB) serialization protocol development, and supports many development languages. In addition, the communication link can also be a wireless communication link or a wired communication link, for example, a wired communication link includes an optical fiber, a twisted pair or a coaxial cable, and a wireless communication link includes a Bluetooth communication link, a wireless fidelity (WIreless-FIdelity, Wi-Fi) communication link or a microwave communication link.
[0052] In one embodiment, Figure 2As shown, it is a flowchart of a table replacement method in a computing task provided by an embodiment of this specification, which can be implemented by a computer program and can be run on a table replacement device in a computing task based on a von Neumann system. The computer program can be integrated into an application or run as an independent tool application.
[0053] Specifically, the table replacement method in the computing task includes:
[0054] S102: Filter at least one downstream table corresponding to the upstream table.
[0055] The preset database contains multiple data tables, each of which can involve different fields and types of content, covering all kinds of information from structured data to semi-structured or unstructured data. The format of the data table is different types of formats. For example, the data table can be a traditional relational data table (such as a two-dimensional table format containing rows and columns), or it can be a more complex format, such as JSON, XML or BLOB (large object) and other formats. The data in these data tables can include text, numbers, dates, images, videos, audio and other content. Each table can be used for different transaction scenarios or application requirements, and is associated with each other through foreign keys, indexes or other data relationships.
[0056] Take a data table as the upstream table and filter the downstream table corresponding to the upstream table. The upstream table (UpstreamTable) can be understood as the "source" of the data flow. During the data processing process, the data of the upstream table will be transferred or mapped to the downstream table. For example, the sales order table including order information can be an upstream table, and the data table summarizing the sales data is the downstream table of the upstream table. The downstream table (Downstream Table) refers to the table that depends on the data of the upstream table, that is, the "destination" of the data flow of the upstream table. The downstream table needs to use the data of the upstream table for further calculation, processing or display. For example, the "sales statistics table" can be a downstream table, which summarizes the sales data from multiple sales order tables as upstream tables.
[0057] It is understandable that a certain upstream table may correspond to multiple downstream tables, and a certain downstream table may correspond to multiple upstream tables.
[0058] In the embodiments of this specification, the upstream table and the downstream table need to at least satisfy the relationship of data volume. Specifically, the data volume of the downstream table is smaller than that of the upstream table. For example, the data volume of the upstream table is twice that of the downstream table. Only when the data volume of the downstream table is smaller than that of the upstream table, when executing the computing task, the computing efficiency can be effectively improved by replacing the upstream table with the downstream table to participate in the data computing.
[0059] S104: Establish a calculation model that represents the calculation logic between the upstream table and the downstream table.
[0060] The calculation model represents the calculation logic of the calculation process between the upstream table and the downstream table, one or more downstream table fields calculated by one or more fields of the upstream table during the calculation process, and the first constraint corresponding to each upstream table field used in the calculation. In other words, the calculation model includes the downstream table fields calculated by the upstream table fields, and also includes the first constraint corresponding to the upstream table fields during the calculation process.
[0061] like Figure 3 As shown, Figure 3 It is a flow chart of building a computing model provided by an embodiment of this specification. The upstream table A1 corresponds to at least the downstream table B1, the downstream table B2, and the downstream table B3. The upstream table A1 includes at least the fields a11, a12, a13, a14, and a15, the downstream table B1 includes at least the fields b11, b12, and b13, the downstream table B2 includes at least the fields b21, b22, and b23, and the downstream table B3 includes at least the fields b31, b32, and b33.
[0062] The calculation model AB1 represents the calculation logic of the calculation process between the upstream table A1 and the downstream table B1, the calculation model AB2 represents the calculation logic of the calculation process between the upstream table A1 and the downstream table B2, and the calculation model AB3 represents the calculation logic of the calculation process between the upstream table A1 and the downstream table B1.
[0063] Take the downstream table B1 as an example to explain the establishment process of calculation model AB1:
[0064] The following are the fields included in the downstream table B1:
[0065]
[0066] Note: The b13 and b14 fields in the downstream table B1 belong to the mapping of the upstream tables A2 and A3 to the downstream table B1. Here, only the mapping of the fields of the upstream table A1 to the downstream table B1 is given in the mapping.
[0067] The calculation model AB1 generated at this time to represent the upstream table A1 to the downstream table B1 is:
[0068]
[0069]
[0070] In the above calculation model, the first constraint corresponding to the mapping from the upstream table field to the downstream table field during the calculation process is also included. For example, when mapping the upstream table field a11 of the upstream table A1 to the downstream table B1, the upstream table field a11 must satisfy one of the following first constraints during the mapping process: data range condition, data type condition, non-null / empty value condition, uniqueness condition, logical relationship, time condition, etc.
[0071] Taking data range conditions as an example, when mapping upstream table fields, data range conditions refer to limiting or filtering the field values of upstream table fields to ensure that the field values are within a legal or valid range. These conditions usually involve the valid interval, upper and lower limits, specific value ranges, etc. of the data. When mapping fields between upstream and downstream tables, the data range conditions included in the first constraint corresponding to the upstream table field ensure the consistency and validity of the data during the data transfer and mapping process from the upstream table to the downstream table.
[0072] The embodiments of this specification may also include other types of first constraints.
[0073] S106: Obtain a computing task, and determine that the computing task includes computing logic between an upstream table and an output table.
[0074] A computing task can be understood as processing and computing data on one or more upstream tables, and generating a final output table through specific logic or algorithms. The output table includes data after calculation, conversion or aggregation, including output table fields obtained by extracting and / or processing and / or calculating multiple upstream table fields in the upstream table. The output table is used for subsequent data analysis, report generation or other business decisions.
[0075] For example, the upstream table is a sales order table, and the downstream table is a sales statistics table, which summarizes the sales data from multiple sales order tables as upstream tables. The output table is a sales trend table for several years, and the sales trend of the product is obtained based on the sales data for several years.
[0076] The calculation task also includes the output table fields calculated from the upstream table fields, and the second constraint corresponding to the upstream table fields during the calculation process. Figure 4 As shown, Figure 4 The output table D at least includes a field d1, a field d2, a field d3, a field d4 and a field d5.
[0077] The calculation task includes calculating the upstream table A1, the upstream table A2 and the upstream table A3 to obtain the output table D, the upstream table A1 includes at least the fields a11, a12, a13, a14 and a15, the upstream table A2 includes at least the fields a22, a22, a23 and a24, and the downstream table A3 includes at least the fields a31, a32 and a33.
[0078] The calculation task includes the calculation logic between the upstream table A1 and the output table D, that is, the mapping relationship or calculation process between the upstream table A1 and the output table D. The calculation task also includes the output table fields calculated from the upstream table fields, and the second constraint conditions corresponding to the upstream table fields during the calculation process.
[0079] For example, when mapping the upstream table field a11 of the upstream table A1 to the output table D, the upstream table field a11 must satisfy one of the following second constraints during the mapping process: data range condition, data type condition, non-null / empty value condition, uniqueness condition, logical relationship, time condition, etc.
[0080] S108. Match the content included in the computing task with the content included in at least one computing model to obtain at least one target computing model and a target downstream table corresponding to the target computing model.
[0081] At least one target downstream table is used to replace the upstream table in the computing task and participate in the calculation to obtain the output table. The computing logic included in the computing task is fine-tuned according to the target computing model corresponding to the target downstream table.
[0082] by Figure 3 and Figure 4 As shown in the example, the calculation task includes the calculation logic between the upstream table A1 and the output table D, at least one upstream table field included in the upstream table A1 that obtains the output table field, and a second constraint condition that the upstream table field corresponding to the upstream table A1 must satisfy during the calculation process.
[0083] The upstream table A1 corresponds to the calculation model AB1, the calculation model AB2, and the calculation model AB3. For example, the calculation model AB1 represents the calculation logic of the calculation process between the upstream table A1 and the downstream table B1, the one or more downstream table fields calculated by one or more upstream table fields of the upstream table A1, and the first constraint condition that the upstream table fields must satisfy during the calculation process.
[0084] The target downstream table can replace the upstream table A1, and the calculation logic included in the calculation task must be consistent with the calculation logic of a calculation model in the calculation model AB1, the calculation model AB2, and the calculation model AB3. The output table field of at least one upstream table field in the upstream table A1 after processing can be found in the downstream table that serves as the target downstream table, and the second constraint condition that the upstream table field used to obtain the output table D1 during the calculation process needs to satisfy is consistent with the first constraint condition that the upstream table field used to obtain the downstream table B1 needs to satisfy.
[0085] For example, the calculation task includes calculating the upstream table A1, which needs to be obtained using the upstream table field a11, the upstream table field a12, and the upstream table field a13 included in the upstream table A1. During the calculation process, the upstream table field a11, the upstream table field a12, and the upstream table field a13 need to satisfy the second constraint condition, and the output table D includes the output table field d1, the output table field d2, and the output table field d3 obtained from the above upstream table fields.
[0086] Matching is performed in multiple computing models according to the computing task. Among them, in the downstream table B1 corresponding to the computing model AB1, the downstream table B1 includes the downstream table fields b11, b12, b13, and b14 obtained through the computing logic represented by the computing model AB1 through the upstream table fields a11, a12, and a13. The computing logic represented by the computing model AB1 is consistent with the computing logic represented by the computing task, and the output table fields d1, d2, and d3 of the output table D can all be found directly in the downstream table B1 or through a mapping relationship. In the computing logic represented by the computing model AB1, the upstream table fields a11, a12, and a13 must meet the first constraint condition, and the second constraint condition is consistent with the first constraint condition. Therefore, the downstream table B1 participates in the computing task as the target downstream table instead of the upstream table A1, and some computing processes in the computing task are fine-tuned according to the computing model AB1.
[0087] The embodiments of this specification construct multiple computing models that characterize the computing logic between the upstream table and the downstream table, and match the computing tasks calculated for the upstream table in the multiple computing models, so as to determine the target downstream table that can replace the upstream table without changing the computing logic of the computing task. The amount of data in the target downstream table is smaller than that in the upstream table. By replacing the upstream table, the execution of the computing task can be accelerated and the computing efficiency can be improved, while reducing the consumption of computing resources. And based on the steps of screening the downstream table provided by the embodiments of this specification, matching according to the content of the computing model and the content of the computing task, the accuracy of the acquired target downstream table is improved while realizing the automatic acquisition of the target downstream table, and the reliability of the execution of the computing task is ensured.
[0088] In one embodiment, Figure 5 As shown, it is a flowchart of a table replacement method in a computing task provided by an embodiment of this specification, which can be implemented by a computer program and can be run on a table replacement device in a computing task based on a von Neumann system. The computer program can be integrated into an application or run as an independent tool application.
[0089] Specifically, the table replacement method in the computing task includes:
[0090] S202: Filter at least one downstream table corresponding to the upstream table.
[0091] Refer to the above S102, which will not be repeated here.
[0092] S204: Obtain downstream table fields in the downstream table that are calculated from upstream table fields and meet field mapping conditions.
[0093] The upstream table includes at least one downstream table field, which is calculated by at least one upstream table field in the upstream table and meets the field mapping condition. The field mapping condition represents the mapping relationship between the downstream table field and the upstream table field.
[0094] like Figure 6 As shown, Figure 6 is a schematic diagram of a table replacement method in a computing task provided by an embodiment of this specification. First, at least one downstream table corresponding to an upstream table is selected. Figure 6 Taking the upstream table A1 corresponding to the downstream table B1 as an example, the downstream table fields b11, b12, b13 and b14 in the downstream table A1 that are calculated from the upstream table fields a11, a12, a13 and a14 and meet the field mapping conditions are obtained.
[0095] In one embodiment, obtaining a downstream table field in the downstream table that is calculated from an upstream table field and meets a field mapping condition includes: obtaining a downstream table field in the downstream table that is calculated only from the upstream table field. In other words, if a downstream table field is processed by an upstream table field and another upstream table field, the downstream table field does not meet the requirements and does not participate in the process of matching the computing task with at least one computing model.
[0096] like Figure 6 As shown, downstream table field b11, downstream table field b12, downstream table field b13 and downstream table field b14 are calculated by and only by the upstream table field of upstream table A1.
[0097] S206: Determine the calculation logic and the first constraint condition corresponding to the upstream table field according to the calculation process between the upstream table field and the downstream table field.
[0098] According to the calculation process between at least one upstream table field and at least one downstream table field, the calculation logic corresponding to the calculation process and the first constraint condition corresponding to at least one upstream table field in the calculation process are determined. The constraint condition corresponding to the calculated downstream table field can also be determined. For example, the constraint condition corresponding to the downstream table field can be a value range, a value type, etc. of the downstream table field.
[0099] In one embodiment, the calculation logic includes at least one of the following calculation logics: table-level filtering conditions and field-level calculation conditions. Figure 6 As shown, in the process of calculating the downstream table B1 according to the upstream table A1, at least one filtering condition determined by the filter expression and at least one calculation condition determined by the op expression are included.
[0100] It is understandable that the embodiments of this specification also include other types of calculation logic, such as different corresponding calculation logics when performing connection operations, sorting and grouping, condition judgment and other calculations on the upstream table fields included in the upstream table A1.
[0101] S208: Obtain a computing task, and determine that the computing task includes computing logic between an upstream table and an output table.
[0102] The calculation task also includes the output table fields calculated from the upstream table fields, and the second constraint conditions corresponding to the upstream table fields during the calculation process. See the above S106, which will not be repeated here.
[0103] S210: According to a first mapping relationship between an output table field and an upstream table field, and according to a second mapping relationship between a downstream table field and an upstream table field, matching is performed in at least one downstream table to obtain at least one downstream table to be determined.
[0104] At least one upstream table field can obtain an output table field through a first mapping relationship, at least one upstream table field can obtain a downstream table field through a second mapping relationship, and a downstream table field can obtain an output table field through a mapping relationship related to the first mapping relationship and the second mapping relationship. In other words, the output table fields after processing the upstream table fields required for the calculated output table D can all be found in the downstream table to be determined.
[0105] S212: According to the calculation logic included in the calculation task and the calculation logic included in the calculation model corresponding to the downstream table to be determined, matching is performed in the calculation model corresponding to at least one downstream table to be determined, to obtain at least one calculation model to be determined.
[0106] Furthermore, if Figure 6As shown, the computing models corresponding to at least one downstream table to be determined include computing logic, and matching is performed in at least one computing model according to the computing logic included in the computing task to obtain at least one computing model to be determined.
[0107] The calculation model corresponding to the upstream table A1 is matched according to the calculation logic calculated for the upstream table A1 in the calculation task until the target downstream table corresponding to the upstream table A1 is determined. After the matching is completed, the calculation model corresponding to the upstream table A2 is matched according to the calculation logic calculated for the upstream table A2 in the calculation task until the target downstream table corresponding to the upstream table A2 is determined.
[0108] S214. According to the second constraint condition corresponding to the upstream table field included in the computing task and the first constraint condition corresponding to the upstream table field included in the computing model to be determined, matching is performed in at least one computing model to be determined to obtain a target computing model and a target downstream table corresponding to the target computing model.
[0109] The first constraint included in the target calculation model is consistent with the second constraint included in the calculation task. It is also possible to determine the constraint corresponding to the downstream table field calculated in the calculation model and the constraint corresponding to the output table field obtained in the calculation task and calculated from the upstream table, and the above two constraints are also consistent.
[0110] like Figure 6 As shown, after the above matching process, the downstream table B1 is determined as the target downstream table of the upstream table A1, and the table is replaced in the calculation task, that is, the upstream table A1 is replaced with the downstream table B1, and participates in the calculation process of obtaining the output table M through the upstream tables A2 and A3 until the output table D is obtained.
[0111] The embodiments of this specification construct multiple computing models that characterize the computing logic between the upstream table and the downstream table, and match the computing tasks calculated for the upstream table in the multiple computing models, so as to determine the target downstream table that can replace the upstream table without changing the computing logic of the computing task. The amount of data in the target downstream table is smaller than that in the upstream table. By replacing the upstream table, the execution of the computing task can be accelerated and the computing efficiency can be improved, while reducing the consumption of computing resources. And based on the steps of screening the downstream table provided by the embodiments of this specification, matching according to the content of the computing model and the content of the computing task, the accuracy of the acquired target downstream table is improved while realizing the automatic acquisition of the target downstream table, and the reliability of the execution of the computing task is ensured.
[0112] In one embodiment, Figure 5As shown, it is a flowchart of a table replacement method in a computing task provided by an embodiment of this specification, which can be implemented by a computer program and can be run on a table replacement device in a computing task based on a von Neumann system. The computer program can be integrated into an application or run as an independent tool application.
[0113] Specifically, the table replacement method in the computing task includes:
[0114] S302: Filter at least one downstream table corresponding to the upstream table according to a preset filtering rule.
[0115] The screening rules include at least one of the following screening rules: the upstream table and the downstream table are both formal tables of a common layer, the upstream table and the downstream table are in the same data domain, and the number of upstream tables is greater than the number of downstream tables.
[0116] The common layer can be understood as a layer containing shared or standardized data, which spans multiple transaction systems or data domains and has high sharing. Data tables are cleaned, standardized, and processed in the common layer so that they can be used in different applications or analyses. For example, certain customer information, product information, geographic information, etc. are often regarded as common layer data.
[0117] Formal tables refer to data tables that have been verified and approved in the data warehouse. These data tables are usually the basis of transaction processing and have high quality, reliability and consistency. Formal tables are often data sets that have been normalized, cleaned and verified after the ETL process.
[0118] Data domain refers to the transaction scope or field of data, such as sales domain, financial domain, customer domain, etc. In the data warehouse or database architecture, data domain usually refers to different areas or layers of organizational data. The data in these areas are usually related and belong to similar transaction logic categories.
[0119] The number of upstream tables is greater than the number of downstream tables, for example, the number of upstream tables is two or more times the number of downstream tables.
[0120] In this embodiment, at least one downstream table corresponding to an upstream table is screened according to a preset screening rule, and only when the preset screening rule is satisfied can the two data tables be in a relationship of an upstream table and a downstream table. Based on this embodiment, the efficiency and accuracy of screening the downstream table corresponding to the upstream table can be improved.
[0121] S304: Establish a calculation model that represents the calculation logic between the upstream table and the downstream table.
[0122] The calculation model includes the downstream table fields calculated from the upstream table fields, and also includes the first constraint condition corresponding to the upstream table fields during the calculation process. See S104 above, which will not be described in detail here.
[0123] S306: Obtain a computing task, and determine that the computing task includes computing logic between an upstream table and an output table.
[0124] The calculation task also includes the output table fields calculated from the upstream table fields, and the second constraint conditions corresponding to the upstream table fields during the calculation process. See S106 above, which will not be described in detail here.
[0125] S308. Match the content included in the computing task with the content included in at least one computing model to obtain at least one target computing model and a target downstream table corresponding to the target computing model.
[0126] At least one target downstream table is used to replace the upstream table in the computing task. See S108 above, which will not be described in detail here.
[0127] S310: According to the timeliness requirement of the obtained output table, determine whether the completion time of replacing the upstream table with the target downstream table to complete the calculation task meets the timeliness requirement;
[0128] The time required to complete the calculation task by replacing the upstream table with the target downstream table includes at least the time required to split the calculation logic between multiple upstream tables and the output table according to the calculation task, the output table fields calculated from the upstream table fields, and the second constraint corresponding to the upstream table fields during the calculation process, the time required to find a matching target calculation model among a large number of calculation models according to the calculation task, and the time required to replace the target downstream table and the target calculation model into the calculation task. Taking the above multiple time periods into consideration, determine whether the timeliness requirement for obtaining the output table can be met.
[0129] S312: When it is determined that the completion time of the computing task completed by replacing the upstream table with the target downstream table can meet the timeliness requirement, it is determined to replace the upstream table with the target downstream table.
[0130] Only when it is determined that the completion time of the calculation task completed by replacing the upstream table with the target downstream table can meet the timeliness requirement, it is determined to replace the upstream table with the target downstream table.
[0131] For example, it takes 24 hours to directly calculate multiple upstream tables according to the computing task. According to the method of replacing tables in the computing task, the time required to replace the upstream table to execute the computing task is 25 hours until at least one target computing model and target downstream table are determined. Based on the timeliness requirement, the upstream table may not be replaced by the target downstream table.
[0132] S314: Generate a computing optimization suggestion for the computing task according to at least one target computing model and at least one target downstream table.
[0133] A computing task may include multiple upstream tables that can be replaced by downstream tables. The multiple upstream tables correspond to at least one target downstream table and the target computing model corresponding to each target downstream table. The computing optimization suggestions for computing tasks may include the following: replacing a certain upstream table and replacing the used downstream table, fine-tuning the computing process for the upstream table in the computing task through the target computing model, and the expected efficiency improvement rate after replacing the downstream table.
[0134] The computing optimization suggestions for the computing tasks are displayed or sent to the target device for display, so that relevant personnel can judge whether it is necessary to replace the upstream table in the computing task and how to replace the upstream table according to the computing optimization suggestions, thereby improving the efficiency of table replacement for relevant personnel.
[0135] The embodiments of this specification construct multiple computing models that characterize the computing logic between the upstream table and the downstream table, and match the computing tasks calculated for the upstream table in the multiple computing models, so as to determine the target downstream table that can replace the upstream table without changing the computing logic of the computing task. The amount of data in the target downstream table is smaller than that in the upstream table. By replacing the upstream table, the execution of the computing task can be accelerated and the computing efficiency can be improved, while reducing the consumption of computing resources. And based on the steps of screening the downstream table provided by the embodiments of this specification, matching according to the content of the computing model and the content of the computing task, the accuracy of the acquired target downstream table is improved while realizing the automatic acquisition of the target downstream table, and the reliability of the execution of the computing task is ensured.
[0136] The following are device embodiments of this specification, which can be used to implement the method embodiments of this specification. For details not disclosed in the device embodiments of this specification, please refer to the method embodiments of this specification.
[0137] See also Figure 8 , which shows a schematic diagram of the structure of a table replacement device in a computing task provided by an exemplary embodiment of the specification. The table replacement device in a computing task can be implemented as all or part of the device through software, hardware or a combination of both. The device includes a data screening module 401, a model building module 402, a task determination module 403 and an optimization replacement module 404.
[0138] A data screening module 401, used for screening at least one downstream table corresponding to an upstream table;
[0139] A model building module 402 is used to build a calculation model representing the calculation logic between the upstream table and the downstream table, wherein the calculation model includes downstream table fields calculated from upstream table fields, and also includes a first constraint condition corresponding to the upstream table field during the calculation process;
[0140] The task determination module 403 is used to obtain a computing task, determine that the computing task includes the computing logic between the upstream table and the output table, the computing task also includes the output table field calculated from the upstream table field, and the second constraint condition corresponding to the upstream table field during the computing process;
[0141] The optimization replacement module 404 is used to match the content included in the computing task with the content included in at least one of the computing models, to obtain at least one target computing model and a target downstream table corresponding to the target computing model, and at least one of the target downstream tables is used to replace the upstream table in the computing task.
[0142] In one embodiment, the model building module 402 includes:
[0143] A field acquisition unit, used to acquire the downstream table fields in the downstream table that are calculated from the upstream table fields and meet the field mapping conditions;
[0144] A calculation establishing unit is used to determine the calculation logic and the first constraint condition corresponding to the upstream table field according to the calculation process between the upstream table field and the downstream table field.
[0145] In one embodiment, the field acquisition unit includes:
[0146] The field acquisition subunit is used to acquire the downstream table fields in the downstream table that are calculated only from the upstream table fields.
[0147] In one embodiment, the calculation logic includes at least one of the following calculation logics: table-level filtering conditions and field-level calculation conditions.
[0148] In one embodiment, the optimization replacement module 404 includes:
[0149] A first determining unit, configured to obtain at least one downstream table to be determined by matching in the at least one downstream table according to a first mapping relationship between the output table field and the upstream table field and according to a second mapping relationship between the downstream table field and the upstream table field;
[0150] A second determining unit, configured to match, according to the calculation logic included in the calculation task and the calculation logic included in the calculation model corresponding to the downstream table to be determined, at least one calculation model corresponding to the downstream table to be determined is matched to obtain at least one calculation model to be determined;
[0151] The third determination unit is used to match at least one of the to-be-determined computing models according to the second constraint condition corresponding to the upstream table field included in the computing task and the first constraint condition corresponding to the upstream table field included in the to-be-determined computing model to obtain a target computing model and a target downstream table corresponding to the target computing model.
[0152] In one embodiment, the data screening module 401 includes:
[0153] A rule screening unit is used to screen at least one downstream table corresponding to an upstream table according to a preset screening rule, wherein the screening rule includes at least one of the following screening rules: the upstream table and the downstream table are both formal tables of a common layer, the upstream table and the downstream table are in the same data domain, and the number of the upstream tables is greater than the number of the downstream tables.
[0154] In one embodiment, the apparatus for table replacement in a computing task further includes:
[0155] A timeliness judgment module, used to judge whether the completion time of replacing the upstream table with the target downstream table to complete the computing task meets the timeliness requirement according to the timeliness requirement of the output table;
[0156] A replacement determination module is used to determine to replace the upstream table with the target downstream table when it is determined that the completion time of completing the computing task by replacing the upstream table with the target downstream table can meet the timeliness requirement.
[0157] In one embodiment, the apparatus for table replacement in a computing task further includes:
[0158] The optimization suggestion module is used to generate a computing optimization suggestion for the computing task according to the at least one target computing model and the at least one target downstream table.
[0159] The embodiments of this specification construct multiple computing models that characterize the computing logic between the upstream table and the downstream table, and match the computing tasks calculated for the upstream table in the multiple computing models, so as to determine the target downstream table that can replace the upstream table without changing the computing logic of the computing task. The amount of data in the target downstream table is smaller than that in the upstream table. By replacing the upstream table, the execution of the computing task can be accelerated and the computing efficiency can be improved, while reducing the consumption of computing resources. And based on the steps of screening the downstream table provided by the embodiments of this specification, matching according to the content of the computing model and the content of the computing task, the accuracy of the acquired target downstream table is improved while realizing the automatic acquisition of the target downstream table, and the reliability of the execution of the computing task is ensured.
[0160] It should be noted that the table replacement device in the computing task provided in the above embodiment only uses the division of the above functional modules as an example when executing the table replacement method in the computing task. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the table replacement device in the computing task provided in the above embodiment and the table replacement method in the computing task embodiment belong to the same concept, and the implementation process thereof is detailed in the method embodiment, which will not be repeated here.
[0161] The serial numbers of the embodiments of this specification are for description only and do not represent the advantages or disadvantages of the embodiments.
[0162] The present specification also provides a computer storage medium, which can store multiple instructions, and the instructions are suitable for being loaded and executed by a processor as described above. Figure 1 - Figure 7 The table replacement method in the computing task of the embodiment shown in the figure can be specifically executed by referring to Figure 1 - Figure 7 The specific description of the illustrated embodiment will not be repeated here.
[0163] The present specification also provides a computer program product, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor as described above. Figure 1 - Figure 7 The table replacement method in the computing task of the embodiment shown in the figure can be specifically executed by referring to Figure 1 - Figure 7 The specific description of the illustrated embodiment will not be repeated here.
[0164] See also Fig. 9 , is a schematic diagram of the structure of an electronic device provided in the embodiment of this specification. Fig. 9As shown, the electronic device 500 may include: at least one processor 501 , at least one network interface 504 , a user interface 503 , a memory 505 , and at least one communication bus 502 .
[0165] The communication bus 502 is used to realize the connection and communication between these components.
[0166] The user interface 503 may include a display screen (Display) and a camera (Camera), and the optional user interface 503 may also include a standard wired interface and a wireless interface.
[0167] The network interface 504 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).
[0168] Among them, the processor 501 may include one or more processing cores. The processor 501 uses various interfaces and lines to connect various parts within the entire server 500, and executes various functions and processes data of the server 500 by running or executing instructions, programs, code sets or instruction sets stored in the memory 505, and calling data stored in the memory 505. Optionally, the processor 501 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 501 can integrate one or more combinations of a processor (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 501, and it can be implemented separately through a chip.
[0169] Among them, the memory 505 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 505 includes a non-transitory computer-readable storage medium. The memory 505 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 505 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 505 may also be optionally at least one storage device located away from the aforementioned processor 501. As Fig. 9 As shown, the memory 505 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a table replacement application in a computing task.
[0170] exist Fig. 9 In the electronic device 500 shown, the user interface 503 is mainly used to provide an input interface for the user and obtain data input by the user; and the processor 501 can be used to call the table replacement application in the computing task stored in the memory 505, and specifically perform the following operations:
[0171] Filter at least one downstream table corresponding to the upstream table;
[0172] Establishing a calculation model that represents the calculation logic between the upstream table and the downstream table, wherein the calculation model includes downstream table fields calculated from upstream table fields, and also includes a first constraint condition corresponding to the upstream table fields during the calculation process;
[0173] Acquire a computing task, and determine that the computing task includes computing logic between the upstream table and the output table, the computing task also includes output table fields calculated from the upstream table fields, and a second constraint condition corresponding to the upstream table fields during the computing process;
[0174] Match the content included in the computing task with the content included in at least one of the computing models to obtain at least one target computing model and a target downstream table corresponding to the target computing model, and at least one of the target downstream tables is used to replace the upstream table in the computing task.
[0175] In one embodiment, the processor 501 executes the establishment of a calculation model representing the calculation logic between the upstream table and the downstream table, specifically performing:
[0176] Obtain the downstream table fields in the downstream table that are calculated from the upstream table fields and meet the field mapping conditions;
[0177] According to the calculation process between the upstream table field and the downstream table field, the calculation logic and the first constraint condition corresponding to the upstream table field are determined.
[0178] In one embodiment, the processor 501 executes the step of obtaining the downstream table field in the downstream table that is calculated from the upstream table field and meets the field mapping condition, specifically performing:
[0179] Get the downstream table fields in the downstream table that are calculated only from the upstream table fields.
[0180] In one embodiment, the calculation logic includes at least one of the following calculation logics: table-level filtering conditions and field-level calculation conditions.
[0181] In one embodiment, the processor 501 performs the matching of the content included in the computing task with the content respectively included in at least one of the computing models to obtain at least one target computing model and a target downstream table corresponding to the target computing model, specifically performing:
[0182] According to the first mapping relationship between the output table field and the upstream table field, and according to the second mapping relationship between the downstream table field and the upstream table field, matching is performed in the at least one downstream table to obtain at least one downstream table to be determined;
[0183] According to the calculation logic included in the calculation task and the calculation logic included in the calculation model corresponding to the downstream table to be determined, matching is performed in at least one calculation model corresponding to the downstream table to be determined to obtain at least one calculation model to be determined;
[0184] According to the second constraint condition corresponding to the upstream table field included in the computing task, and according to the first constraint condition corresponding to the upstream table field included in the computing model to be determined, matching is performed in at least one of the computing models to be determined to obtain a target computing model and a target downstream table corresponding to the target computing model.
[0185] In one embodiment, the processor 501 performs the filtering of at least one downstream table corresponding to the upstream table, specifically performing:
[0186] According to preset filtering rules, at least one downstream table corresponding to the upstream table is filtered, and the filtering rules include at least one of the following filtering rules: the upstream table and the downstream table are both formal tables of a common layer, the upstream table and the downstream table are in the same data domain, and the number of the upstream tables is greater than the number of the downstream tables.
[0187] In one embodiment, after the processor 501 performs the matching of the content included in the computing task with the content respectively included in at least one of the computing models to obtain at least one target computing model and a target downstream table corresponding to the target computing model, it further performs:
[0188] According to the timeliness requirement of the output table, determining whether the completion time of replacing the upstream table with the target downstream table to complete the computing task meets the timeliness requirement;
[0189] When it is determined that the completion time of completing the computing task by replacing the upstream table with the target downstream table can meet the timeliness requirement, it is determined to replace the upstream table with the target downstream table.
[0190] In one embodiment, after the processor 501 performs the matching of the content included in the computing task with the content respectively included in at least one of the computing models to obtain at least one target computing model and a target downstream table corresponding to the target computing model, it further performs:
[0191] A computing optimization suggestion for the computing task is generated according to the at least one target computing model and the at least one target downstream table.
[0192] The embodiments of this specification construct multiple computing models that characterize the computing logic between the upstream table and the downstream table, and match the computing tasks calculated for the upstream table in the multiple computing models, so as to determine the target downstream table that can replace the upstream table without changing the computing logic of the computing task. The amount of data in the target downstream table is smaller than that in the upstream table. By replacing the upstream table, the execution of the computing task can be accelerated and the computing efficiency can be improved, while reducing the consumption of computing resources. And based on the steps of screening the downstream table provided by the embodiments of this specification, matching according to the content of the computing model and the content of the computing task, the accuracy of the acquired target downstream table is improved while realizing the automatic acquisition of the target downstream table, and the reliability of the execution of the computing task is ensured.
[0193] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only storage memory, or a random access memory, etc.
[0194] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0195] The above disclosure is only the preferred embodiment of this specification, which certainly cannot be used to limit the scope of rights of this specification. Therefore, equivalent changes made according to the claims of this specification are still within the scope covered by this specification.
Claims
1. A method for table replacement in a computing task, the method comprising: Filter at least one downstream table corresponding to the upstream table; Establishing a calculation model that represents the calculation logic between the upstream table and the downstream table, wherein the calculation model includes downstream table fields calculated from upstream table fields, and also includes a first constraint condition corresponding to the upstream table fields during the calculation process; Acquire a computing task, and determine that the computing task includes computing logic between the upstream table and the output table, the computing task also includes output table fields calculated from the upstream table fields, and a second constraint condition corresponding to the upstream table fields during the computing process; Match the content included in the computing task with the content included in at least one of the computing models to obtain at least one target computing model and a target downstream table corresponding to the target computing model, and at least one of the target downstream tables is used to replace the upstream table in the computing task.
2. According to the method for table replacement in a computing task of claim 1, the step of establishing a computing model that characterizes the computing logic between the upstream table and the downstream table comprises: Obtain the downstream table fields in the downstream table that are calculated from the upstream table fields and meet the field mapping conditions; According to the calculation process between the upstream table field and the downstream table field, the calculation logic and the first constraint condition corresponding to the upstream table field are determined.
3. According to the method for replacing a table in a computing task in claim 2, the step of obtaining the downstream table field in the downstream table that is calculated from the upstream table field and meets the field mapping condition comprises: Get the downstream table fields in the downstream table that are calculated only from the upstream table fields.
4. According to the method for replacing a table in a computing task according to claim 1 or 2, the computing logic comprises at least one of the following computing logics: table-level filtering conditions and field-level computing conditions.
5. The method for replacing a table in a computing task according to claim 1, wherein the step of matching the content of the computing task with the content of at least one computing model to obtain at least one target computing model and a target downstream table corresponding to the target computing model comprises: According to the first mapping relationship between the output table field and the upstream table field, and according to the second mapping relationship between the downstream table field and the upstream table field, matching is performed in the at least one downstream table to obtain at least one downstream table to be determined; According to the calculation logic included in the calculation task and the calculation logic included in the calculation model corresponding to the downstream table to be determined, matching is performed in at least one calculation model corresponding to the downstream table to be determined to obtain at least one calculation model to be determined; According to the second constraint condition corresponding to the upstream table field included in the computing task, and according to the first constraint condition corresponding to the upstream table field included in the computing model to be determined, matching is performed in at least one of the computing models to be determined to obtain a target computing model and a target downstream table corresponding to the target computing model.
6. The method for replacing a table in a computing task according to claim 1, wherein the step of screening at least one downstream table corresponding to an upstream table comprises: According to preset filtering rules, at least one downstream table corresponding to the upstream table is filtered, and the filtering rules include at least one of the following filtering rules: the upstream table and the downstream table are both formal tables of a common layer, the upstream table and the downstream table are in the same data domain, and the number of the upstream tables is greater than the number of the downstream tables.
7. The method for table replacement in a computing task according to claim 1, wherein after matching the content of the computing task with the content of at least one computing model to obtain at least one target computing model and a target downstream table corresponding to the target computing model, the method further comprises: According to the timeliness requirement of the output table, determining whether the completion time of replacing the upstream table with the target downstream table to complete the computing task meets the timeliness requirement; When it is determined that the completion time of completing the computing task by replacing the upstream table with the target downstream table can meet the timeliness requirement, it is determined to replace the upstream table with the target downstream table.
8. The method for table replacement in a computing task according to claim 1, after matching the content included in the computing task with the content respectively included in at least one computing model to obtain at least one target computing model and a target downstream table corresponding to the target computing model, further comprising: A computing optimization suggestion for the computing task is generated according to the at least one target computing model and the at least one target downstream table.
9. A table replacement device in a computing task, the device comprising: A data screening module, used for screening at least one downstream table corresponding to an upstream table; A model building module, used to build a calculation model representing the calculation logic between the upstream table and the downstream table, wherein the calculation model includes downstream table fields calculated from upstream table fields, and also includes a first constraint condition corresponding to the upstream table field during the calculation process; A task determination module, used to obtain a computing task, determine that the computing task includes a computing logic between the upstream table and the output table, the computing task also includes an output table field calculated from the upstream table field, and a second constraint condition corresponding to the upstream table field during the computing process; An optimization replacement module is used to match the content included in the computing task with the content included in at least one of the computing models, to obtain at least one target computing model and a target downstream table corresponding to the target computing model, at least one of the target downstream tables is used to replace the upstream table in the computing task.
10. A computer storage medium storing a plurality of instructions, wherein the instructions are suitable for being loaded by a processor and executing the method steps according to any one of claims 1 to 8.
11. A computer program product, wherein the computer program product stores a plurality of instructions, wherein the instructions are suitable for being loaded by a processor and executing the method steps according to any one of claims 1 to 8.
12. An electronic device, characterized in that: include: A processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the method steps as claimed in any one of claims 1 to 8.