Data processing method and device, electronic equipment and storage medium

Abstract

The invention discloses a data processing method and device, electronic equipment and a storage medium. The method comprises the steps of determining a main data processing code according to a received main data query statement of a target object; determining a data aperture of the affiliated attribute of the target object based on a data field contained in the main data processing code; determining an association code of the main data and the affiliated attribute according to the data aperture; and obtaining a data processing code according to the main data processing code and the associated code. The user only needs to set the query statement according to specific requirements without writing specific codes, so that the data processing code development difficulty can be reduced, errors and vulnerabilities caused by manual code writing are reduced, the quality and reliability of the data processing codes are improved, the user defines the required data by setting the query statement, and the user experience is improved. Code generation behaviors can be adjusted according to requirements, and different data processing requirements are met.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data processing method, device, electronic device and storage medium. Background Art

[0002] In the field of data processing and analysis, data processing tools based on Python (an object-oriented programming language) are widely used. For example, PySpark provides APIs (Application Programming Interface) and functions related to data processing and analysis. Developers can use simple codes to perform complex data processing tasks.

[0003] In the related art, some general code generation tools are used to generate data processing codes to implement data processing tasks. However, existing code generation tools require developers to be familiar with specific APIs and libraries, and also require developers to write codes, which is difficult for people who are not familiar with these tools or lack development experience. In addition, the data processing codes output by the tools are not optimized enough, so the code execution performance is not high. Summary of the invention

[0004] The purpose of the present application is to propose a data processing method, device, electronic device and storage medium to address the deficiencies of the above-mentioned prior art, and this purpose is achieved through the following technical solutions.

[0005] The first aspect of the present application provides a data processing method, the method comprising:

[0006] Determine the master data processing code according to the received master data query statement of the target transaction;

[0007] Determine the data scope of the target thing's subsidiary attributes based on the data fields included in the master data processing code;

[0008] Determine the association code between the main data and the subsidiary attributes according to the data caliber;

[0009] A data processing code is obtained according to the main data processing code and the associated code, so as to implement data processing of the target transaction by running the data processing code.

[0010] A second aspect of the present application provides a data processing device, the device comprising:

[0011] A master data code determination module is used to determine the master data processing code according to the received master data query statement of the target thing;

[0012] A caliber determination module, used to determine the data caliber of the target thing's subsidiary attributes based on the data fields included in the master data processing code;

[0013] An association code determination module, used to determine the association code between the main data and the subsidiary attributes according to the data caliber;

[0014] The code merging module is used to obtain a data processing code according to the main data processing code and the associated code, so as to realize the data processing of the target transaction by running the data processing code.

[0015] The third aspect of the present application proposes an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the method described in the first aspect above.

[0016] A fourth aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, wherein the program is executed by a processor to implement the method described in the first aspect above.

[0017] Based on the data processing method and device described in the first and second aspects above, the present application has at least the following beneficial effects or advantages:

[0018] By receiving the master data query statement input by the user, the master data processing code is determined, and based on the data fields contained in the master data processing code, the data caliber of the subsidiary attributes of the target object is determined, and the association code between the master data and the subsidiary attributes is determined according to the data caliber of the subsidiary attributes, so as to realize the association of different data sets, simplify the development process of data processing tasks, improve data processing efficiency, and finally automatically obtain the data processing code according to the master data processing code and the association code, so as to realize the data processing of the target object by executing the data processing code. Since the user only needs to set the query statement according to specific needs and does not need to write specific code, it can reduce the difficulty of data processing code development, reduce the errors and loopholes of manually written code, and improve the quality and reliability of data processing code. In addition, by setting the query statement to define the required data, the user can adjust the generated code behavior according to the needs to meet different data processing needs.

[0019] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0021] Figure 1 is a flow chart of an embodiment of a data processing method according to an exemplary embodiment;

[0022] Figure 2 This is a diagram of a master data configuration interface according to an exemplary embodiment;

[0023] Figure 3 This is a diagram of a subsidiary attribute configuration interface according to an exemplary embodiment;

[0024] Figure 4 A diagram of a code output data configuration interface according to an exemplary embodiment is shown;

[0025] Figure 5 This is a diagram of a data push configuration interface according to an exemplary embodiment;

[0026] Figure 6 is a structural schematic diagram of a data processing device according to an exemplary embodiment;

[0027] Figure 7 is a schematic diagram of a hardware structure of an electronic device according to an exemplary embodiment;

[0028] Figure 8 The figure is a schematic diagram of the structure of a storage medium according to an exemplary embodiment. DETAILED DESCRIPTION

[0029] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0030] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms of "a", "said" and "the" used in this application and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0031] It should be understood that although the terms first, second, third, etc. may be used in the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0032] As mentioned above, existing code generation tools require developers to manually write code when generating data processing code, and generate data processing code based on the code input by the developer. This is difficult for people who lack development experience, and manual code writing is affected by experience factors, resulting in the data processing code output by the tool not being optimized enough.

[0033] In view of this, the present application proposes a data processing method, which determines the master data processing code by receiving the master data query statement input by the user, and obtains the data caliber of the subsidiary attributes of the target thing based on the data field contained in the master data processing code, and determines the association code between the master data and the subsidiary attributes according to the data caliber of the subsidiary attributes, so as to realize the association of different data sets, simplify the development process of data processing tasks, and finally automatically obtain the data processing code according to the master data processing code and the association code, so as to realize the data processing of the target thing by executing the data processing code. Since the user only needs to set the query statement according to specific needs and does not need to write specific code, the difficulty of data processing code development can be reduced, the errors and loopholes of manually written code can be reduced, and the quality and reliability of data processing code can be improved. In addition, the user defines the required data by setting the query statement, and can adjust the generated code behavior according to the needs to meet different data processing needs.

[0034] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The several specific embodiments listed can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0035] Figure 1 The flowchart of a data processing method according to an exemplary embodiment includes the following steps:

[0036] Step 101: Determine the master data processing code according to the received master data query statement of the target transaction.

[0037] In the embodiment of the present application, the target thing refers to a type of thing that needs to be processed. For example, if the source data of a product needs to be processed, then the target thing is the product.

[0038] In this step, the master data query statement is a query statement for the main attribute data of the target object. The query statement can be input by the developer according to actual needs. The query statement contains the core information describing the target object. Through this core information, the master data of the target object can be queried. The master data is the core data that users need to process and analyze. Taking commodities as an example, the master data query statement contains some core information such as commodity ID, commodity name, commodity price, commodity category description, etc.

[0039] The master data processing code is a logical code used to process the master data of the target transaction into a data form that meets user requirements.

[0040] In an optional embodiment, a master data query statement for a target object is received, and then the master data of the target object is obtained according to the master data query statement, and a data structure code is determined according to the obtained master data, and finally the master data processing code is obtained using the data structure code and the master data query statement.

[0041] The data structure code defines how to map each data field contained in the master data to a specific data structure. By analyzing the representation of each data field in the master data, each data field is mapped to the data structure. The data structure can be set by the user or by default. The data structure helps to achieve fast query. Optionally, the data structure can be a Data Frame in PySpark, and the user uses Spark SQL (Structured Query Language) to query the Data Frame.

[0042] Specifically, when acquiring master data according to a master data query statement, the query may be performed by limiting the amount of data returned by the master data query statement, thereby avoiding querying all master data and reducing processing efficiency.

[0043] Regarding the process of receiving a master data query statement for a target thing, in a specific implementation, by displaying a master data configuration interface and receiving configuration operations of the master data configuration interface, a configured master data query statement is obtained for use in determining a master data processing code, which is both intuitive and simple.

[0044] In specific implementation, Figure 2In the master data configuration interface shown, the user can select the database to be queried in the database selection box, and obtain the master data query statement for the selected database input by the user in the master data sql input box. After detecting that the user clicks "Query", the master data obtained by executing the master data query statement is displayed under "Execution Result:", and the field name, field default value (default fill value for missing field value), field type, etc. of the data field contained in the data structure code determined according to the master data are displayed under "Preview:", so that the user can view the detailed information of the data field that can be obtained when executing the master data processing code.

[0045] It should be noted here that through Figure 2 In the master data configuration interface shown, the user can also add and delete data fields included in the master data processing code by clicking "+" and "-". Specifically, by clicking "+", the user can add the field name, field default value, and field type of the data field included in the master data processing code, and by clicking "-", the corresponding data field can be deleted.

[0046] Step 102: Based on the data fields included in the master data processing code, determine the data scope of the target transaction's attributes.

[0047] In this step, the subsidiary attributes of the target object are different from the main attributes of the target object, and the data of the subsidiary attributes and the main data of the main attributes are located in different database tables. The subsidiary attributes include the business attribute data of the target object. Taking a product as an example, the subsidiary attributes can be the sales volume, click-through rate, exposure rate, and estimated recommendation score of the product.

[0048] In the embodiment of the present application, the data caliber of the subsidiary attribute describes the association between the subsidiary attribute and the related data in the main data.

[0049] In an optional embodiment, the subsidiary attribute configuration interface is displayed, and the first configuration operation of the subsidiary attribute configuration interface is received to obtain the configured subsidiary attribute query statement, and the second configuration operation of the subsidiary attribute configuration interface is received to obtain the configured association condition between the main data and the subsidiary attribute, and finally the subsidiary attribute query statement and the association condition are determined as the data caliber of the subsidiary attribute. By displaying the subsidiary attribute configuration interface, it is convenient for the user to configure the data caliber of the subsidiary attribute, so as to determine the association code between the main data and the subsidiary attribute, which is both intuitive and simple.

[0050] The association conditions include an association key, an association method, an aggregation operation after association, etc. The association key is a target data field selected from the data fields included in the master data processing code.

[0051] Furthermore, the association condition is used to associate the data of the same data field in the master data and the subsidiary attribute data. Taking a product as an example, assuming that the data fields included in the master data processing code of the product include product ID, product name, product price, etc., and the data fields included in the subsidiary attribute query statement of the product include product estimated recommendation score in addition to product ID, the product ID can be used as the association key to achieve the association between the product estimated recommendation score and the master data, so the target data field product ID is selected as the association key.

[0052] Optionally, the association method in the association condition may include join, union, leftjoin and other association operators, and the aggregation operation may include conversion, filtering and other operations.

[0053] Furthermore, the subsidiary attribute query statement is a query statement for the subsidiary attribute data of the target object. The query statement can be input by the developer according to actual needs. The subsidiary attribute query statement contains subsidiary information describing the target object, and the subsidiary data of the target object can be queried through this subsidiary information.

[0054] Step 103: Determine the association code between the main data and the subsidiary attributes according to the data caliber.

[0055] In a specific implementation, the field processing code of the data field specified in the subsidiary attribute query statement can be determined according to the association condition between the main data and the subsidiary attribute, and the association code between the main data and the subsidiary attribute can be obtained by using the subsidiary attribute query statement and the field processing code.

[0056] The specified data field in the subsidiary attribute query statement is a field used to describe the subsidiary attributes of the target thing, such as product sales, product exposure rate, etc. The field processing code is used to associate the data of the specified data field queried by the subsidiary attribute query statement with the master data.

[0057] For the process from step 102 to step 103, see Figure 3 The subsidiary attribute configuration interface shown in the figure obtains the subsidiary attribute query statement input by the user in the input box of the subsidiary data sql, and then parses the detailed information of the data fields contained in the subsidiary attribute query statement and displays it for the convenience of user viewing, and obtains the target data field selected by the user from the data fields contained in the main data processing code as the association key in the selection box corresponding to "Association key:", and obtains the association method and aggregation method selected by the user in the selection box corresponding to "Association method:", so that the data caliber composed of the association key, association method, and aggregation method and the subsidiary attribute query statement are used as the data caliber of the subsidiary attribute.

[0058] When it is detected that the user clicks "Confirm", the field name, field default value (default fill value for missing field value), field type and data fields included in the association code of the master data and subsidiary attributes determined according to the data caliber are displayed under "Preview:", so that the user can view the detailed information of the data fields that can be obtained when executing the master data processing code and the association code.

[0059] It should be noted that after executing step 103, that is, after the configuration of the subsidiary attributes is completed, the data fields contained in the main data processing code and the data fields contained in the associated code can also be obtained, and the detailed information of the obtained data fields can be displayed to facilitate the user to configure the preprocessing logic before the output of each data field, so as to determine the preprocessing code of the selected data field according to the received preprocessing instructions for the selected data field, so as to provide flexible data processing and output options to meet different needs.

[0060] Optionally, the preprocessing instructions may include any one or more of a default fill value when a field value is missing, a field value range restriction, and a field type.

[0061] In specific implementation, Figure 4 The code output data configuration interface diagram shown includes the default values ​​of the data fields that will be output when the master data processing code and the associated code are executed, the field type, and the special logical expression input box corresponding to each data field; the user can change the field type of each field when it is output and the default fill value in the case of missingness, and the user can also enter additional logic for the field in the special logical expression input box, such as the logical expression for field value range limitation, the logical expression for conditional filtering, etc.

[0062] When it is detected that the user clicks "Confirm", the data field whose detailed information is detected to be changed will be selected as the data field, and the corresponding preprocessing code will be determined based on the changes in the selected data field, that is, the preprocessing instructions, such as changes in the field type, changes in the default value, and expression input in the special logical expression input box.

[0063] Step 104: Obtain a data processing code according to the main data processing code and the associated code, so as to implement data processing of the target transaction by running the data processing code.

[0064] It should be noted that before determining the data processing code, the data push configuration interface is displayed, and the configured data push selected item information is obtained by receiving the user's configuration operations in the data push configuration interface, and then the output data push code is determined based on the obtained data push selected item information, thereby providing more flexible data output options to facilitate subsequent data storage and query operations, thereby bringing a more efficient, flexible and optimized data processing and analysis experience.

[0065] The data push selected item information includes relevant information of the storage system to which the code output data is pushed.

[0066] In this step, the determined data processing code may be an executable script code, and by executing the code script, the data processing and association tasks can be realized, and the data of the obtained data field can be output. It should be noted here that the determined data processing code includes not only the main data processing code and the association code, but also the pre-processing code and data push code of the output data field.

[0067] In specific implementation, Figure 5 The data push configuration interface shown includes the selected items of the ES (Elastic Search) storage system and the Redis storage system. After receiving the selected items of the storage system selected by the user, the data push code is determined. When the operation instruction of exporting the code is detected, the data processing code is determined, and the code output data in json format is displayed in the input box area of ​​"json example" of the data push configuration interface.

[0068] At this point, the above Figure 1 The data processing flow shown in the figure determines the master data processing code by receiving the master data query statement input by the user, and determines the data caliber of the subsidiary attributes of the target thing based on the data fields contained in the master data processing code, and determines the association code between the master data and the subsidiary attributes according to the data caliber of the subsidiary attributes, thereby realizing the association of different data sets to simplify the development process of data processing tasks, and finally automatically obtains the data processing code according to the master data processing code and the association code, so as to realize the data processing of the target thing by executing the data processing code. Since the user only needs to set the query statement according to specific needs and does not need to write specific code, the difficulty of data processing code development can be reduced, and the errors and loopholes of manually written code can be reduced, so that the quality and reliability of data processing code are improved, and the user can define the required data by setting the query statement, and can adjust the generated code behavior according to the needs to meet different data processing needs.

[0069] Based on the above Figure 1 Based on the embodiment shown, a specific solution for implementing data processing is given below, including steps 1 to 4:

[0070] Step 1: Display the master data configuration interface, respond to the configuration operation of the master data configuration interface, obtain the configured master data query statement, and determine the data structure code of the master data by executing the master data query statement. The data structure code can be a DataFrame code, which is a data structure used to represent distributed data sets in PySpark. The master data contains the core data that needs to be processed and analyzed.

[0071] Step 2: Display the subsidiary attribute configuration interface, respond to the configuration operation of the subsidiary attribute configuration interface, obtain the subsidiary attribute query statement, and receive the association condition between the main data and the subsidiary attribute, thereby obtaining the data caliber including the subsidiary attribute query statement and the association condition, and then determine the association code between the main data and the subsidiary attribute according to the data caliber. The subsidiary attribute query statement in the data caliber describes the data query information of other data sets related to the main data, and specifies the association method with the main data.

[0072] Step 3: Display the code output data configuration interface, respond to the configuration operation of the code output data configuration interface, obtain the preprocessing instructions of the configured data field, and determine the preprocessing code of the corresponding data field according to the preprocessing instructions. The preprocessing instructions include the selection of field type, the default fill value when the field value is missing, and the additional logic of the field value.

[0073] Step 4: Display the data push configuration interface, respond to the configuration operation of the data push configuration interface, obtain the configured data push selected item information, determine the output data push code based on the obtained data push selected item information, thereby packaging the main data processing code, association code, preprocessing code of the output data field, and data push code to generate executable data processing code, and implement the data processing task by executing the data processing code.

[0074] Based on the data processing process described above, the development process of data processing and analysis tasks can be simplified. Developers can customize settings according to specific needs, and developers can adjust the behavior and functions of the generated code according to the main data configuration interface, auxiliary attribute configuration interface, code output data configuration interface, and data push configuration interface to meet different data processing needs. Since developers do not need to write code, they can reduce errors and vulnerabilities in manually written code, and improve the quality and reliability of the code. In addition, the determined data processing code also has an output data push function, which can provide more flexible data output options, thereby bringing a more efficient, flexible and optimized data processing and analysis experience.

[0075] The execution subject of the embodiment of the present application may be an application, service, instance, functional module in software form, virtual machine (VM), container or cloud server, etc., or a hardware device (such as a server or terminal device) or hardware chip (such as CPU, GPU, FPGA, NPU, AI acceleration card or DPU) with data processing function. The device for implementing data processing can be deployed on the computing device of the application party providing the corresponding service or on the cloud computing platform providing computing power, storage and network resources. The mode of providing services to the outside world by the cloud computing platform may be IaaS (Infrastructure as a Service), PaaS (Platform as a Service), SaaS (Software as a Service) or DaaS (Data as a Service). Taking the platform providing SaaS software as a service (Software as a Service) as an example, the cloud computing platform can use its own computing resources to provide training of data processing models or functional execution of data processing modules, and the specific application architecture can be built according to service requirements. For example, the platform can provide construction services based on the above model to application parties or individuals who use platform resources, and further call the above model and implement online or offline data processing functions based on data processing requests submitted by related clients or servers and other devices.

[0076] Corresponding to the above-mentioned data processing method embodiment, the present application also provides an embodiment of a data processing device.

[0077] Figure 6 FIG. 1 is a schematic diagram of a data processing device according to an exemplary embodiment. The device is used to execute the data processing method provided in any of the above embodiments. Figure 6 As shown, the data processing device includes:

[0078] A master data code determination module 610 is used to determine a master data processing code according to a received master data query statement of a target transaction;

[0079] A caliber determination module 620, for determining the data caliber of the target transaction's subsidiary attributes based on the data fields included in the master data processing code;

[0080] The association code determination module 630 is used to determine the association code between the main data and the subsidiary attribute according to the data caliber;

[0081] The code merging module 640 is used to obtain a data processing code according to the main data processing code and the associated code, so as to implement data processing of the target transaction by running the data processing code.

[0082] The implementation process of the functions and effects of each unit in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and will not be repeated here.

[0083] For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present application scheme. A person of ordinary skill in the art can understand and implement it without paying any creative work.

[0084] The embodiment of the present application also provides an electronic device corresponding to the data processing method provided in the above embodiment to execute the above data processing method.

[0085] Figure 7 6 is a hardware structure diagram of an electronic device according to an exemplary embodiment, the electronic device includes: a communication interface 601, a processor 602, a memory 603 and a bus 604; wherein the communication interface 601, the processor 602 and the memory 603 communicate with each other through the bus 604. The processor 602 can execute the data processing method described above by reading and executing the machine executable instructions corresponding to the control logic of the data processing method in the memory 603. The specific content of the method is referred to the above embodiment, which will not be repeated here.

[0086] The memory 603 mentioned in this application can be any electronic, magnetic, optical or other physical storage device, and can contain storage information, such as executable instructions, data, etc. Specifically, the memory 603 can be RAM (Random Access Memory), flash memory, storage drive (such as hard disk drive), any type of storage disk (such as optical disk, DVD, etc.), or similar storage medium, or a combination thereof. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 601 (which can be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. can be used.

[0087] The bus 604 may be an ISA bus, a PCI bus or an EISA bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. The memory 603 is used to store programs, and the processor 602 executes the programs after receiving execution instructions.

[0088] Processor 602 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in processor 602 or an instruction in software form. The above-mentioned processor 602 can be a general-purpose processor, including a network processor (Network Processor, referred to as NP), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a readily available programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The disclosed methods, steps and logic block diagrams in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly embodied as a hardware decoding processor to execute, or the hardware and software modules in the decoding processor are combined to execute.

[0089] The electronic device provided in the embodiment of the present application and the data processing method provided in the embodiment of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented therein.

[0090] The present application also provides a computer-readable storage medium corresponding to the data processing method provided in the above embodiment. Figure 8 As shown, the computer-readable storage medium shown is a CD 30 on which a computer program (ie, a program product) is stored. When the computer program is run by a processor, the data processing method provided by any of the aforementioned embodiments will be executed.

[0091] It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical or magnetic storage media, which are not listed here one by one.

[0092] The computer-readable storage medium provided in the above-mentioned embodiments of the present application and the data processing method provided in the embodiments of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented by the application programs stored therein.

[0093] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0094] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0095] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A data processing method, characterized in that: The method comprises: Determine the master data processing code according to the received master data query statement of the target transaction; Determine the data scope of the target thing's subsidiary attributes based on the data fields included in the master data processing code; Determine the association code between the main data and the subsidiary attributes according to the data caliber; A data processing code is obtained according to the main data processing code and the associated code, so as to implement data processing of the target transaction by running the data processing code.

2. The method according to claim 1, characterized in that The determining the master data processing code according to the received master data query statement of the target transaction includes: Receive master data query statements for target things; Acquire the master data of the target thing according to the master data query statement; Determining a data structure code of the master data according to the acquired master data; The master data processing code is obtained by using the data structure code and the master data query statement.

3. The method according to claim 2, characterized in that The receiving of a master data query statement for a target transaction includes: Display the main data configuration interface; In response to the configuration operation of the master data configuration interface, a configured master data query statement is obtained.

4. The method according to claim 1, characterized in that: The step of determining the data scope of the target transaction's subsidiary attributes based on the data fields included in the master data processing code includes: Display the auxiliary attribute configuration interface; In response to a first configuration operation of the subsidiary attribute configuration interface, obtaining a configured subsidiary attribute query statement; In response to the second configuration operation of the subsidiary attribute configuration interface, an association condition between the configured master data and the subsidiary attribute is obtained; the association condition includes an association key and an association method, and the association key is a target data field selected from the data fields included in the master data processing code; The subsidiary attribute query statement and the association condition are determined as the data caliber of the subsidiary attribute.

5. The method according to claim 4, characterized in that The step of determining the association code between the main data and the subsidiary attributes according to the data caliber includes: Determining a field processing code of a specified data field in the subsidiary attribute query statement according to an association condition between the main data and the subsidiary attribute; The association code between the main data and the subsidiary attributes is obtained by using the subsidiary attribute query statement and the field processing code.

6. The method according to any one of claims 1 to 5, characterized in that: After determining the association code between the main data and the subsidiary attribute according to the data caliber, the method further includes: Acquire the data fields included in the master data processing code and the data fields included in the association code, and display detailed information of the acquired data fields; A preprocessing code for the selected data field is determined according to the received preprocessing instruction for the selected data field.

7. The method according to claim 6, characterized in that The processing instructions include any one or more of a default fill value when a field value is missing, a field value range restriction, and a field type.

8. The method according to any one of claims 1 to 5, characterized in that: After determining the association code between the main data and the subsidiary attribute according to the data caliber, the method further includes: Display the data push configuration interface; In response to a configuration operation on the data push configuration interface, acquiring configured data push selected item information; The output data push code is determined according to the acquired data push selected item information.

9. A data processing device, characterized in that: The device comprises: A master data code determination module is used to determine the master data processing code according to the received master data query statement of the target thing; A caliber determination module, used to determine the data caliber of the target thing's subsidiary attributes based on the data fields included in the master data processing code; An association code determination module, used to determine the association code between the main data and the subsidiary attributes according to the data caliber; The code merging module is used to obtain a data processing code according to the main data processing code and the associated code, so as to realize the data processing of the target transaction by running the data processing code.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: The processor executes the program to implement the method according to any one of claims 1 to 8.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement the method according to any one of claims 1 to 8.

Images