A data processing method and device, electronic equipment and storage medium

Abstract

Embodiments of the present application are suitable for the technical field of information processing, and provide a data processing method and device, electronic equipment and storage medium, wherein the data processing method comprises: obtaining at least one configuration information; the at least one configuration information represents the characteristics of response data corresponding to a set operation event; analyzing the at least one configuration information to generate a first script; the first script is used to obtain the response data matched with the at least one configuration information from a first database; executing the first script to obtain a result set; the result set represents the set of response data matched with the at least one configuration information in the first database.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of information processing, and in particular to a data processing method and device, electronic equipment and storage medium. BACKGROUND

[0002] In the daily operation and development of an application, there are various data information, such as user behavior data, marketing data, transaction data, and portrait data. Related technologies need to be customized according to the characteristics of the data when reporting and analyzing the data. The server needs to develop corresponding application programming interfaces (APIs) in advance, and the client adds new software development kits (SDKs) based on the interface specifications, and integrates and releases them uniformly, so as to complete the data reporting process. The client and the server perform point-to-point and one-to-one customized data reporting and analysis based on the pre-agreed interfaces and reporting fields. Related technologies lack flexibility and cannot quickly respond to changes in business requirements. SUMMARY

[0003] To solve the above problems, the embodiments of the present application provide a data processing method, device, electronic equipment and storage medium to at least solve the problem of lack of flexibility in related technology data reporting and analysis, and the inability to quickly respond to changes in business requirements.

[0004] The technical solution of the present application is as follows:

[0005] In a first aspect, the embodiments of the present application provide a data processing method, which comprises:

[0006] Obtaining at least one configuration information; the at least one configuration information represents the characteristics of the response data corresponding to the set operation event;

[0007] Analyzing the at least one configuration information to generate a first script; the first script is used to obtain the response data matched with the at least one configuration information from a first database;

[0008] Executing the first script to obtain a result set; the result set represents a set of response data in the first database matched with the at least one configuration information.

[0009] In the above solution, the analyzing the at least one configuration information to generate a first script comprises:

[0010] Analyzing the at least one configuration information to obtain the type of the set operation event and the attribute of the set operation event;

[0011] generate the first script based on the type of the set operation event and the attribute of the set operation event.

[0012] In the above scheme, the parsing the at least one configuration information and generating the first script comprises:

[0013] parsing the at least one configuration information to obtain a joint index; one field in the joint index represents one configuration information in the at least one configuration information;

[0014] generating the first script based on an index column of the joint index.

[0015] In the above scheme, the executing the first script to obtain a result set comprises:

[0016] determining whether the first script is executed within a set time length;

[0017] in a case where the first script is not executed within the set time length, executing the first script and writing the result set into a second database;

[0018] in a case where the first script is executed within the set time length, obtaining the result set corresponding to the first script from the second database.

[0019] In the above scheme, before the executing the first script, the method further comprises:

[0020] verifying a configuration parameter in the first script to obtain a verification result; the verification result represents whether the configuration parameter in the first script is valid.

[0021] In the above scheme, before the executing the first script, the method further comprises:

[0022] inputting the first script into a set execution engine to perform simulation execution to obtain a simulation execution result; the simulation execution result represents whether the first script can be correctly executed.

[0023] In the above scheme, the determining whether the first script is executed within a set time length comprises:

[0024] determining a parameter value of a first parameter corresponding to the first script;

[0025] in a case where the parameter value is a first set value, determining that the first script is executed within the set time length;

[0026] in a case where the parameter value is a second set value, determining that the first script is not executed within the set time length.

[0027] In a second aspect, an embodiment of the present application provides a data processing apparatus, the apparatus comprising:

[0028] an obtaining module configured to obtain at least one configuration information, the at least one configuration information representing a characteristic of response data corresponding to a set operation event;

[0029] a parsing module configured to parse the at least one configuration information to generate a first script, the first script being used to obtain the response data matching the at least one configuration information from a first database;

[0030] an executing module configured to execute the first script to obtain a result set, the result set representing a set of the response data matching the at least one configuration information in the first database.

[0031] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, the processor and the memory being connected to each other, wherein the memory is configured to store a computer program, the computer program comprising program instructions, and the processor is configured to invoke the program instructions to execute the steps of the data processing method provided in the first aspect of the present application.

[0032] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, comprising: the computer readable storage medium storing a computer program. The computer program is executed by a processor to implement the steps of the data processing method provided in the first aspect of the present application.

[0033] The embodiment of the present application obtains at least one configuration information, parses the at least one configuration information to generate a first script, and obtains a result set by executing the first script. The result set represents a set of response data matching the at least one configuration information in a first database, the at least one configuration information represents a characteristic of response data corresponding to a set operation event, and the first script is used to obtain the response data matching the at least one configuration information from the first database. Compared with the prior art which needs to be customized for different business requirements, the embodiment of the present application parses the configuration information to generate the first script, and obtains the response data matching the configuration information through the first script, so that the embodiment of the present application can quickly respond to changes in business requirements, has high flexibility, and can meet various data reporting and analysis scenarios. BRIEF DESCRIPTION OF DRAWINGS

[0034] Figure 1 is an implementation flow diagram of a data processing method provided by an embodiment of the present application;

[0035] Figure 2 is an implementation flow diagram of another data processing method provided by an embodiment of the present application;

[0036] Figure 3is another implementation flow diagram of a data processing method provided by an embodiment of the present application;

[0037] Figure 4 is another implementation flow diagram of a data processing method provided by an embodiment of the present application;

[0038] Figure 5 is a schematic diagram of a data processing flow provided by an embodiment of the present application;

[0039] Figure 6 is a schematic diagram of another data processing flow provided by an embodiment of the present application;

[0040] Figure 7 is a schematic diagram of another data processing flow provided by an embodiment of the present application;

[0041] Figure 8 is a schematic diagram of a data reporting structure provided by an application embodiment of the present application;

[0042] Figure 9 is a schematic diagram of a data processing device provided by an embodiment of the present application;

[0043] Figure 10 is a schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0044] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0045] With the rapid development of the Internet, the development of small programs is also getting faster and faster. As a new carrier in the new retail environment, small programs have been widely recognized and spread due to their rich entry points, diverse scenes, strong communication ability, easy access, and the characteristics of being used and gone. In the daily operation and development of small programs, there are various data information, such as user behavior data, marketing data, transaction data, and portrait data, and various data. In the face of such rich data information, how to analyze and mine these raw data in a timely, efficient and flexible manner, quickly grasp the fluctuation of small program data, and understand the changes in small program user behavior is a problem that domestic small program platforms are constantly striving to break through. Only by continuously improving the data analysis efficiency can the data analysis capability be improved, and then the deep potential value of data can be used to empower the business development of small programs.

[0046] The related art needs to be customized according to the characteristics of the data when reporting and analyzing the data, and cannot meet the changing data analysis scenarios. Especially, it is not capable of facing the small program multi-scene, multi-ecological, high flexibility and high freedom data analysis scene. Therefore, if the custom data reporting and analysis mechanism can be added in the small program data analysis scene, it can help the business to analyze and focus on the small program data more flexibly, and greatly improve the commercial value of the small program.

[0047] At present, most of the products in the related art are fixed, pre-set and poor in expandability for the data analysis process of the small program. For example, when various application programs (APP, Application) and websites analyze data, the client and the server usually perform point-to-point and one-to-one customized data reporting and analysis based on the pre-agreed interface and reporting field. The server needs to develop a corresponding application programming interface (API, Application Programming Interface) in advance, and the client adds a new point software development kit (SDK, Software Development Kit) based on the interface specification, and integrates and releases uniformly, so as to pass through the data reporting process. The client and the server perform point-to-point and one-to-one customized data reporting and analysis based on the pre-agreed interface and reporting field. The current mode and technical solution cannot quickly respond to business changes, lack flexibility, and have a lag, which seriously affects the vitality and development of the small program.

[0048] In view of the above-mentioned shortcomings of the related art, the embodiments of the present application provide a data processing method, which can at least obtain an optimized data processing scheme under a lower time complexity. In order to describe the technical solutions of the present application, specific embodiments will be described below.

[0049] Figure 1 is a flowchart of the implementation of a data processing method provided by the embodiments of the present application. The execution subject of the data processing method is an electronic device, which includes desktop computers, notebook computers, servers and the like. Referring to Figure 1 , the data processing method comprises:

[0050] S101, at least one configuration information is obtained; the at least one configuration information represents the characteristics of the response data corresponding to the set operation event.

[0051] For example, in an e-commerce scenario, the set operation event can be a user ordering event, a payment event, an adding shopping cart event, a deleting order event, etc. The configuration information represents the characteristics of the response data corresponding to the set operation event. For example, the response data corresponding to the user ordering event can be order data, and the response data corresponding to the payment event can be payment data. The response data corresponding to the set operation event can be stored in the first database. The configuration information corresponding to the user ordering event can be event ID (Identity document), event name, order number, user ID, order amount, address, etc.

[0052] In actual application, the at least one configuration information can include a report event ID, a report event name, a query index, a filtering index, and a grouping index. For example, the configuration event event_id is “apples_open”; the configuration event query index is appName, and the total number count value of the occurrence of the index is counted; the configuration event grouping index is appName; and the configuration event filtering index is city=“Beijing”.

[0053] The user can prewrite various configuration information in a database, and select some of the configuration information from the database for use when needed.

[0054] S102, parsing the at least one configuration information to generate a first script; the first script is used to obtain response data matching the at least one configuration information from a first database.

[0055] Here, the first script is essentially a dynamic code, for example, the first script can be a sql script.

[0056] Reference Figure 2 In an embodiment, the parsing the at least one configuration information to generate a first script includes:

[0057] S201, parsing the at least one configuration information to obtain the type of the set operation event and the attribute of the set operation event.

[0058] S202, generating the first script based on the type of the set operation event and the attribute of the set operation event.

[0059] In the embodiment of the present application, the at least one configuration information comprises setting a type of operation event and setting a property of the operation event. For example, the type of operation event is set as a buy event, and the property of the operation event is set as an amount field, and the generated first script is select amount from tb_app where event_id='buy'. The first script can obtain response data of the type of operation event being set as a buy event and the property of the operation event being set as an amount field from the first database.

[0060] Reference Figure 3 In an embodiment, the parsing the at least one configuration information and generating the first script comprises:

[0061] S301, parsing the at least one configuration information to obtain a joint index; one field in the joint index represents one configuration information in the at least one configuration information.

[0062] Two or more indexes on columns are called joint indexes, and the joint index is an index composed of multiple fields, and one field corresponds to one configuration information in the at least one configuration information. Taking a joint index (a, b, c) as an example, establishing such an index is equivalent to establishing three indexes a, ab, and abc. For the joint index, Mysql uses the fields in the index from left to right, and one query can only use a part of the index, but only the leftmost part. For example, the index is key index(a, b, c), which can support a, ab, and abc for searching, but does not support bc for searching. When the leftmost field is a constant reference, the index is very effective.

[0063] The configuration information in the at least one configuration information is equivalent to the field in the joint index, and the joint index is obtained by parsing the at least one configuration information, and the first script is generated according to the joint index.

[0064] S302, generating the first script based on the index column of the joint index.

[0065] Here, the generated dynamic sql script will preferentially generate rules for index columns. For example, the existing joint index (A, B), the at least one configuration information is C=XXX, B=XX, A=X, and the first script where A=XXX and B=XXX and C=XXX is generated by parsing the at least one configuration information.

[0066] The advantage of this is that the leftmost prefix matching principle of index query can be fully utilized, and the efficiency of data query can be improved. The leftmost prefix matching means that the where condition must have the first field of the joint index, and the use of the joint index is irrelevant to the order of writing the where condition.

[0067] In actual application, the configuration event event_id is 'apples_open'; the configuration event query index is appName, and the total number count of the occurrence of the index is counted; the configuration event grouping index is appName; and the configuration event filtering index is city='Beijing'.

[0068] The generated to-be-executed sql script is:

[0069] SELECT appName, count(*)

[0070] FROM tb_click

[0071] where event_id='apples_open' and city='Beijing'

[0072] group by appName

[0073] After the first script is obtained, the response data matched with the at least one configuration information can be obtained from the first database by executing the first script. Before the first script is executed, the first script needs to be verified according to the present embodiment.

[0074] In an embodiment, before the first script is executed, the method further includes:

[0075] verifying the configuration parameters in the first script to obtain a verification result; the verification result represents whether the configuration parameters in the first script are valid.

[0076] In the present embodiment, the configuration parameters in the first script are verified to determine whether the configuration parameters are valid. For example, it is determined whether the data type and the field length of the configuration parameters meet the standard, such as whether the data type is a string type and whether the character length exceeds 255 bytes.

[0077] Only when the verification result represents that all the configuration parameters in the first script are valid, the first script can be executed.

[0078] In an embodiment, before the first script is executed, the method further includes:

[0079] The first script is input into the set execution engine for simulation execution, and the simulation execution result is obtained; the simulation execution result indicates whether the first script can be executed correctly.

[0080] The first script is input into the designated execution engine for simulation execution. The simulation execution mainly verifies whether the first script is correct and whether it can execute queries normally. Specifically, it verifies whether the databases and tables queried in the first script exist, whether the field names are valid, and whether the generated filtering and aggregation scripts are correctly concatenated.

[0081] For example, the generated execution script is `select id, name from tb_app where name = 'Mini Program'`; if the `id` and `name` fields do not exist in the `tb_app` table, an exception will be thrown, indicating that the user's configuration parameters are incorrect.

[0082] If the simulation execution result of the first script indicates that the first script can be executed correctly, the first script can be executed.

[0083] S103, execute the first script to obtain a result set; the result set represents a collection of response data in the first database that matches the at least one configuration information.

[0084] refer to Figure 4 In one embodiment, executing the first script to obtain a result set includes:

[0085] S401, determine whether the first script has been executed within the set time period.

[0086] For example, determine whether the first script was executed within the previous 10 minutes.

[0087] In one embodiment, determining whether the first script has been executed within a set time period includes:

[0088] Determine the parameter value of the first parameter corresponding to the first script.

[0089] If the parameter value is a first set value, it is determined that the first script has been executed within the set duration; if the parameter value is a second set value, it is determined that the first script has not been executed within the set duration.

[0090] For example, if the first script is executed within the set time period, the parameter value is set to 1; if the first script is not executed within the set time period, the parameter value is set to 0.

[0091] S402, if the first script has not been executed within the set time period, execute the first script and write the result set into the second database.

[0092] S403, in the case where the first script is executed within the set duration, obtaining the result set corresponding to the first script from the second database.

[0093] When the first script is executed for the first time, the result set corresponding to the first script is written into the second database, and the result set corresponding to the first script can be directly obtained from the second database subsequently, avoiding repeated execution of the first script.

[0094] Some malicious requests can cause the first script to be repeatedly executed in a short time, occupying computing resources, so the first script is not executed again if it has been executed within the set duration, avoiding repeated execution of the first script and preventing malicious requests.

[0095] The embodiment of the application obtains at least one configuration information, parses the at least one configuration information, generates a first script, and obtains a result set by executing the first script. The result set represents a collection of response data in the first database that matches the at least one configuration information, the at least one configuration information represents a feature of response data corresponding to a set operation event, and the first script is used to obtain response data that matches the at least one configuration information from the first database. Compared with the prior art that needs to be customized and developed for different business requirements, the embodiment of the application parses the configuration information to generate the first script, and obtains the response data that matches the configuration information through the first script, which can quickly respond to changes in business requirements, has high flexibility, and can meet various data reporting and analysis scenarios.

[0096] The application is not limited to the scene of custom data reporting and analysis of a small program, and also has reuse value and reference significance in the statistics and analysis of various APPs and website data indicators.

[0097] Reference Figure 5 , Figure 5 is a schematic diagram of a data processing flow provided by the embodiment of the application, and the data processing flow comprises:

[0098] The user configures configuration information of custom data reporting in the configuration module, including configuration attribute information such as reporting event Id, reporting event name, query indicator, filtering indicator, and grouping indicator.

[0099] The analysis module analyzes the configuration information to generate a dynamic script. The analysis module can also perform legality verification on the dynamic script, and when the verification is passed, the script will be sent to the data storage layer for real-time data query, and the data analysis result will be returned to the user.

[0100] The execution module is configured to execute the dynamic script, obtain a result set, and store the result set in the result data storage module.

[0101] The acquisition module is configured to acquire business data of the application program, such as user behavior data, marketing data, transaction data, and portrait data.

[0102] The data detection and verification module is configured to be responsible for data cleaning and business verification, and can formulate corresponding data cleaning rules according to various business data analysis scenarios, and synchronize the required data to the downstream module.

[0103] The unified data acquisition module is configured to synchronously batch data to the data storage module based on a message queue, and the data storage module is responsible for distributed storage of massive raw reported data.

[0104] Reference Figure 6 Figure 6 is a schematic diagram of another data processing flow provided by an embodiment of the application, and the data processing flow comprises:

[0105] The configuration information of the user-defined data reporting is saved to a database (DB) for persistent storage, and when real-time data query is performed, the configuration information of the previous step is acquired first.

[0106] According to the configuration information request rule parser, the rule parser parses the configuration information and issues a rule engine. The rule engine generates a dynamic script according to the configuration information, the execution engine acquires original data and executes the dynamic script, obtains a result set, writes the result set into a cache, and asynchronously calls back to a data query view layer.

[0107] Reference Figure 7 Figure 7 is a schematic diagram of another data processing flow provided by an embodiment of the application, and the data processing flow is applied to the rule engine of the above-mentioned embodiment. The entire rule engine analysis process needs to use an event parser, a query index parser, a grouping index parser, and a filtering condition parser to cooperate to build and generate a complete sql syntax tree.

[0108] The data processing flow comprises:

[0109] First, the event parser parses the reporting event configuration rule. The event parser is responsible for parsing the event Id configured by the user, which is used to limit different event types. The event Id is a globally unique reporting data identifier, which is used to distinguish different reporting data. The data structure reported by the user is as follows: Figure 8 ​​​​​​​​​​​​​As shown, the reported data mainly includes event_id, report_time, and data content in a map structure. The use of the map structure can greatly improve the scalability of the data.

[0110] The event parser checks whether the configured event is legal, such as checking whether the event ID exists. If not, the process ends.

[0111] The query index parser is responsible for parsing the specific query index configured by the user, and supports querying multiple index dimensions. Based on the index and index data type, the corresponding data aggregation analysis method can be dynamically constructed, such as setting a de-duplication function for a string type index; for a numerical type index, statistical aggregation methods such as maximum value, minimum value, average value, and sum value can be set.

[0112] The query index parser checks whether the query index is empty. If it is empty, the process ends.

[0113] The filter index parser parses dynamic filtering conditions and is responsible for data filtering and screening, supporting combination logic operations such as and and or, and supporting judgment logic operations such as “=”, “!=”, and “between and”. In this way, multiple logic operation units are combined to construct the filtering and screening conditions of the reported data, and data meeting the conditions is screened out. If the dynamic condition is empty, the built-in default filtering and screening condition is obtained. If it is not empty, the dynamic aggregation condition is parsed.

[0114] The grouping index parser is responsible for the grouping conditions of the index. For the configured grouping conditions, data dynamic grouping rules can be generated, such as grouping and merging data according to dimensions such as province and model.

[0115] After all the parsing is completed, a dynamic script is constructed in real time, the script is issued, and the response result is obtained.

[0116] For example, the configured event event_id is ‘apples_open’; the configured event query index is appName, and the total number of occurrences of the index count value is counted; the configured event grouping index is appName; and the configured event filter index is city=‘Beijing’.

[0117] The generated to-be-executed sql script is:

[0118] SELECT appName, count(*)

[0119] FROM tb_click

[0120] where event_id='apples_open' and city='Beijing'

[0121] group by appName

[0122] The sql script is issued to the data storage layer, and the above sql script is executed to obtain data satisfying the above index conditions.

[0123] The embodiment of the application does not need to develop an API, generates a dynamic script by parsing user-defined configuration information, and obtains target data by executing the dynamic script. The embodiment of the application can quickly respond to changes in business requirements, has high flexibility, and can meet changing data reporting and analysis scenarios.

[0124] It should be understood that the size of the serial number of each step in the above embodiment does not mean the order of execution, and the execution order of each process should be determined according to its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the application.

[0125] It should be understood that when used in the specification and the appended claims, the terms "include" and "contain" indicate the presence of described features, whole, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, whole, steps, operations, elements, components and / or sets thereof.

[0126] It should be noted that the technical solutions described in the embodiments of the application can be combined arbitrarily without conflict.

[0127] In addition, in the embodiments of the application, "first", "second", etc. are used to distinguish similar objects, and do not necessarily describe a specific order or sequence.

[0128] Reference Figure 9 , Figure 9 is a schematic diagram of a data processing device provided by the embodiment of the application, as shown in Figure 9 The device comprises an acquisition module, an analysis module and an execution module.

[0129] The acquisition module is configured to acquire at least one configuration information; the at least one configuration information represents the characteristics of the response data corresponding to the set operation event;

[0130] The analysis module is configured to analyze the at least one configuration information to generate a first script; the first script is used to acquire the response data matched with the at least one configuration information from a first database;

[0131] The execution module is configured to execute the first script to obtain a result set; the result set represents a set of response data in the first database matched with the at least one configuration information.

[0132] In an embodiment, the parsing module, when parsing the at least one configuration information to generate the first script, is configured to:

[0133] parsing the at least one configuration information to obtain a type of the set operation event and an attribute of the set operation event;

[0134] generating the first script based on the type of the set operation event and the attribute of the set operation event.

[0135] In an embodiment, the parsing module, when parsing the at least one configuration information to generate the first script, is configured to:

[0136] parsing the at least one configuration information to obtain a joint index; one field in the joint index represents one configuration information in the at least one configuration information;

[0137] generating the first script based on an index column of the joint index.

[0138] In an embodiment, the execution module, when executing the first script to obtain the result set, is configured to:

[0139] determining whether the first script is executed within a set time length;

[0140] in a case that the first script is not executed within the set time length, executing the first script and writing the result set into a second database;

[0141] in a case that the first script is executed within the set time length, obtaining the result set corresponding to the first script from the second database.

[0142] In an embodiment, the apparatus further comprises:

[0143] a verification module configured to verify a configuration parameter in the first script to obtain a verification result; the verification result represents whether the configuration parameter in the first script is valid.

[0144] In an embodiment, the apparatus further comprises:

[0145] a simulation module configured to input the first script into a set execution engine to perform simulation execution to obtain a simulation execution result; the simulation execution result represents whether the first script can be executed correctly.

[0146] In an embodiment, the execution module, when determining whether the first script is executed within a set time length, is configured to:

[0147] determining a parameter value of a first parameter corresponding to the first script;

[0148] In a case where the parameter value is a first setting value, it is determined that the first script is executed within a setting duration;

[0149] In a case where the parameter value is a second setting value, it is determined that the first script is not executed within a setting duration.

[0150] In practice, the obtaining module, the parsing module and the executing module can be implemented by a processor in an electronic device, such as a central processing unit (CPU), a digital signal processor (DSP), a microcontroller unit (MCU) or a field-programmable gate array (FPGA).

[0151] It should be noted that: the data processing apparatus provided in the above embodiments is only used for example in the division of the above modules during data processing. In actual application, the above processing can be completed by different modules according to the needs, that is, the internal structure of the apparatus is divided into different modules to complete all or part of the above processing. In addition, the data processing apparatus and the data processing method provided in the above embodiments belong to the same concept, and the specific implementation process is described in the method embodiments, which will not be repeated here.

[0152] Based on the hardware implementation of the above program modules, and in order to realize the method of the embodiments of the present application, the embodiments of the present application also provide an electronic device. Figure 10 The hardware composition structure of the electronic device of the embodiments of the present application is shown in FIG. 1. Figure 10 As shown in FIG. 1, the electronic device includes:

[0153] A communication interface capable of information interaction with other devices such as network devices;

[0154] A processor connected with the communication interface to realize information interaction with other devices, used for running a computer program to execute the method provided by one or more technical solutions of the electronic device. The computer program is stored on the memory.

[0155] Of course, in actual application, each component in the electronic device is coupled together through a bus system. It can be understood that the bus system is used to realize the connection and communication between the components. The bus system includes a data bus, a power bus, a control bus and a state signal bus. However, in order to clearly illustrate, all kinds of buses are marked as a bus system in the Figure 10 .

[0156] The memory in the embodiments of the present application is used to store various types of data to support the operation of the electronic device. Examples of these data include: any computer programs for operating on the electronic device.

[0157] It can be understood that the memory can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a ferromagnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM). The magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM) used as an external cache. By way of example but not limitation, many forms of RAM can be used, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), sync link dynamic random access memory (SLDRAM), and direct rambus random access memory (DRRAM).The memory described in the embodiments of the present application is intended to include, but not limited to, these and any other suitable type of memory.

[0158] The method disclosed in the embodiments of the present application can be applied to a processor or implemented by the processor. The processor can be an integrated circuit chip with a signal processing capability. In the implementation process, the steps of the above method can be completed by hardware integrated logic circuit or software form of instructions in the processor. The processor can be a general processor, DSP, or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. The processor can implement or execute the disclosed methods, steps and logic block diagrams in the embodiments of the present application. The general processor can be a microprocessor or any conventional processor, etc. In combination with the steps of the method disclosed in the embodiments of the present application, the hardware decoding processor can be directly embodied to execute the above method, or the combination of hardware and software modules in the decoding processor can be executed. The software module can be located in a storage medium, which is located in a memory, and the processor reads the program in the memory to complete the steps of the above method in combination with the hardware thereof.

[0159] Alternatively, the processor implements the corresponding processes realized by the electronic device in each method of the embodiments of the present application when executing the program, which will not be described herein again for brevity.

[0160] In the exemplary embodiments, the embodiments of the present application also provide a storage medium, i.e., a computer storage medium, specifically a computer readable storage medium, for example, including a first memory for storing a computer program, which can be executed by the processor of the electronic device to complete the steps of the above method. The computer readable storage medium can be FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface memory, optical disc, or CD-ROM, etc.

[0161] In several embodiments provided in the present application, it should be understood that the disclosed apparatus, electronic device and method can be implemented by other manners. The apparatus embodiments described above are only schematic, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed components can be indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0162] The units described as separate components above can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., can be located in one place or distributed on multiple network units; part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0163] In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the integrated unit can be realized in the form of hardware or in the form of hardware plus software functional unit.

[0164] Those skilled in the art can understand that all or part of the steps of the above-mentioned method embodiments can be completed by program instruction related hardware, and the above-mentioned program can be stored in a computer readable storage medium, and the program executes the steps including the above-mentioned method embodiments when executed; and the above-mentioned storage medium includes mobile storage device, ROM, RAM, magnetic disc or optical disc and various storage program codes.

[0165] Alternatively, the integrated unit of the present application, if realized in the form of software functional module and sold or used as an independent product, can also be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application can be embodied in the form of software products, which are stored in a storage medium and include a number of instructions for making a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the methods described in the embodiments of the present application. The above-mentioned storage medium includes mobile storage device, ROM, RAM, magnetic disc or optical disc and various storage program codes.

[0166] It should be noted that the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.

[0167] In addition, in the present application, "first", "second", etc. are used to distinguish similar objects, and do not necessarily describe a specific order or sequence.

[0168] The above is only a specific embodiment of the present application, but the protection scope of the present application is not limited thereto, and any skilled person in the art can easily think of changes or replacements within the technical range disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A data processing method, characterized by, The method comprises: obtaining at least one configuration information; the at least one configuration information represents the characteristics of response data corresponding to a set operation event; the at least one configuration information comprises the type of the set operation event and the attribute of the set operation event; parsing the at least one configuration information to obtain the type of the set operation event and the attribute of the set operation event; generating a first script based on the type of the set operation event and the attribute of the set operation event; the first script is used to obtain the response data matched with the at least one configuration information from a first database; executing the first script to obtain a result set; the result set represents the set of response data matched with the at least one configuration information in the first database.

2. The method of claim 1, wherein, The parsing of the at least one configuration information and the generation of the first script comprise: parsing the at least one configuration information to obtain a joint index; one field in the joint index represents one configuration information in the at least one configuration information; generating the first script based on the index column of the joint index.

3. The method of claim 1, wherein, The execution of the first script to obtain the result set comprises: determining whether the first script is executed within a set time length; in the case that the first script is not executed within the set time length, executing the first script and writing the result set into a second database; in the case that the first script is executed within the set time length, obtaining the result set corresponding to the first script from the second database.

4. The method of claim 1, wherein, Before executing the first script, the method further comprises: verifying the configuration parameters in the first script to obtain a verification result; the verification result represents whether the configuration parameters in the first script are valid.

5. The method of claim 1, wherein, Before executing the first script, the method further comprises: inputting the first script into a set execution engine to perform simulation execution to obtain a simulation execution result; the simulation execution result represents whether the first script can be correctly executed.

6. The method of claim 3, wherein, The determination of whether the first script is executed within a set time length comprises: determining the parameter value of a first parameter corresponding to the first script; in the case that the parameter value is a first set value, determining that the first script is executed within a set time length; in the case that the parameter value is a second set value, determining that the first script is not executed within a set time length.

7. A data processing apparatus, characterized by comprise: an obtaining module, configured to obtain at least one configuration information; the at least one configuration information represents the characteristics of response data corresponding to a set operation event; the at least one configuration information comprises the type of the set operation event and the attribute of the set operation event; a parsing module, configured to parse the at least one configuration information to obtain the type of the set operation event and the attribute of the set operation event; generate a first script based on the type of the set operation event and the attribute of the set operation event; an executing module, configured to execute the first script to obtain a result set; the result set represents the set of response data matched with the at least one configuration information in the first database.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, The processor executes the computer program to implement the data processing method in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, the computer program comprising program instructions which, when executed by a processor, cause the processor to perform the data processing method according to any one of claims 1 to 6.

Images