Data processing method and device, computer equipment, storage medium and program product

Abstract

The invention relates to a data processing method and device, computer equipment, a storage medium and a program product. The method comprises the steps of obtaining a configuration file corresponding to a source database where to-be-processed data is located; the configuration file comprises natural language operator information pre-configured by a user based on a configuration interface of the data processing system and a flow direction relationship among a source database, a destination database and a natural language operator. And analyzing the configuration file by utilizing a natural language processing engine, obtaining natural language operator information and a flow direction relationship, processing the to-be-processed data by utilizing the natural language processing engine according to the natural language operator information and the flow direction relationship, and writing a processing result into a destination database. The method can be applied to a scene of large-scale data processing.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular, to a data processing method, apparatus, computer device, storage medium, and program product. Background Art

[0002] With the popularization of Internet technology, the generation speed of digital data has increased exponentially, and the amount of data that needs to be processed and analyzed is increasing. Based on this, Natural Language Processing (NLP) technology has emerged. NLP technology can use the natural language used by humans for communication to interact with machines and process data.

[0003] In traditional technologies, the processing and analysis of data can be achieved by calling the Baidu AI interface and using NLP technology. However, there are scenarios in traditional technologies that are not applicable to large-scale data processing. Summary of the Invention

[0004] Based on this, in order to solve the above technical problems, it is necessary to provide a data processing method, apparatus, computer device, storage medium, and program product that can be applied to large-scale data processing scenarios.

[0005] In a first aspect, this application provides a data processing method, including:

[0006] Obtain a configuration file corresponding to the source database where the data to be processed is located; the configuration file includes natural language operator information pre-configured by the user based on the configuration interface of the data processing system, as well as the flow relationship between the source database, the destination database, and the natural language operator;

[0007] Use a natural language processing engine to parse the configuration file to obtain the natural language operator information and the flow relationship;

[0008] According to the natural language operator information and the flow relationship, use the natural language processing engine to process the data to be processed and write the processing result into the destination database.

[0009] In the above data processing method, since the configuration file corresponding to the source database where the data to be processed is located is pre-configured by the user based on the configuration interface of the data processing system, and the configuration file includes natural language operator information and the flow relationship between the source database, the destination database, and the natural language operator. Therefore, when processing the data to be processed, the configuration file corresponding to the source database where the data to be processed is located can be determined in the pre-configured configuration file, the configuration file is parsed by the natural language processing engine to obtain the natural language operator information and the flow relationship, and the data to be processed is processed by the natural language processing engine according to the natural language operator information and the flow relationship, and the processing result is written into the destination database. In this way, as long as the computer device obtains the configuration file corresponding to the source database where the data to be processed is located, the data to be processed can be processed using this configuration file, enabling the computer device to simultaneously process multiple different data to be processed according to the configuration files corresponding to different data to be processed, that is, the computer device can concurrently process multiple data to be processed, so that this data processing method can be applied to the scenario of large-scale data processing.

[0010] In one embodiment, the processing the data to be processed by the natural language processing engine according to the natural language operator information and the flow relationship, and writing the processing result into the destination database includes:

[0011] Processing the data to be processed by the natural language processing engine according to the natural language operator information to obtain the processing result;

[0012] Writing the processing result into the destination database by the natural language processing engine according to the flow relationship.

[0013] In this embodiment, by processing the data to be processed by the natural language processing engine according to the natural language operator information to obtain the processing result, and writing the processing result into the destination database by the natural language processing engine according to the flow relationship, since the processing result can be automatically written into the destination database according to the flow relationship in the configuration file, the fluency of the data processing task is enhanced.

[0014] In one embodiment, the processing the data to be processed by the natural language processing engine according to the natural language operator information to obtain the processing result includes:

[0015] Determining the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator according to the natural language operator information;

[0016] Using this natural language processing engine, call the natural language operator corresponding to this name, and process the data to be processed according to this object of action and this processing path to obtain the processing result.

[0017] In this embodiment, by determining the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator according to the natural language operator information. Then, using the natural language processing engine, call the natural language operator corresponding to the name, and process the data to be processed according to the object of action and the processing path to obtain the processing result. Since the natural language operator can be called according to the natural language operator information in the configuration file to complete the data processing work of the data to be processed, the natural language operator information can be flexibly configured according to the task requirements, and thus the data processing task can be completed according to the natural language operator pointed to by the natural language operator information, improving the flexibility of data processing.

[0018] In one of the embodiments, the configuration interface includes a database configuration interface and a natural language operator configuration interface; the method further includes:

[0019] Based on the first selection operation triggered by the user in the database configuration interface of the configuration interface, determine the source database and the destination database;

[0020] Based on the second selection operation triggered by the user in the natural language operator configuration interface of the configuration interface, determine the natural language operator information;

[0021] Based on the pointing operation of the source database, the destination database, and the natural language operator triggered by the user on the configuration interface, determine the flow relationship;

[0022] According to the natural language operator information and the flow relationship, establish the configuration file.

[0023] In this embodiment, by determining the source database and the destination database based on the first selection operation triggered by the user in the database configuration interface of the configuration interface, determining the natural language operator information based on the second selection operation triggered by the user in the natural language operator configuration interface of the configuration interface, and determining the flow relationship based on the pointing operation of the source database, the destination database, and the natural language operator triggered by the user on the configuration interface. According to the natural language operator information and the flow relationship, establish the configuration file, the user can independently configure the source database, the destination database, and the natural language operator according to the task requirements of data processing, and further call the configuration file for data processing later, improving the flexibility of data processing while being able to process a large amount of data.

[0024] In one embodiment, determining the source database and the destination database based on a first selection operation triggered by the user in the database configuration interface of the configuration interface includes:

[0025] Based on the first selection operation, display a list of source databases corresponding to the type of source database selected by the user and a list of destination databases corresponding to the type of destination database selected by the user;

[0026] Based on a third selection operation triggered by the user in the source database list, determine the source database;

[0027] Based on a fourth selection operation triggered by the user in the destination database list, determine the destination database.

[0028] In this embodiment, by based on the first selection operation, displaying a list of source databases corresponding to the type of source database selected by the user and a list of destination databases corresponding to the type of destination database selected by the user, based on a third selection operation triggered by the user in the source database list, determining the source database, and based on a fourth selection operation triggered by the user in the destination database list, determining the destination database, it is possible to display corresponding lists to the user according to the user's selection for the user to make further selections and configurations of information, avoiding the generation of inapplicable configuration files due to selecting incorrect information. At the same time, the user experience is enhanced.

[0029] In one embodiment, determining the natural language operator information based on a second selection operation triggered by the user in the natural language operator configuration interface of the configuration interface includes:

[0030] Based on the second selection operation, display a list of natural language operators;

[0031] Based on a fifth selection operation triggered by the user in the natural language operator list, determine the natural language operator information; the natural language operator information includes the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator.

[0032] In this embodiment, by based on the second selection operation, displaying a list of natural language operators, and based on a fifth selection operation triggered by the user in the natural language operator list, determining the natural language operator information; the natural language operator information includes the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator, it is possible to perform data processing according to the natural language operator information configured by the user. When multiple natural language operators are configured, multiple operators can execute in parallel, reducing the data processing time.

[0033] In a second aspect, the present application further provides a data processing device, including:

[0034] A first acquisition module, configured to acquire a configuration file corresponding to a source database where data to be processed is located; the configuration file includes natural language operator information pre-configured by a user based on a configuration interface of a data processing system, and a flow relationship between the source database, a destination database, and the natural language operator.

[0035] A second acquisition module, configured to use a natural language processing engine to parse the configuration file to acquire the natural language operator information and the flow relationship.

[0036] A processing module, configured to process the data to be processed by using the natural language processing engine according to the natural language operator information and the flow relationship, and write a processing result into the destination database.

[0037] In a third aspect, the present application further provides a computer device, including a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, steps of the method in the first aspect are implemented.

[0038] In a fourth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, steps of the method in the first aspect are implemented.

[0039] In a fifth aspect, the present application further provides a computer program product, including a computer program. When the computer program is executed by a processor, steps of the method in the first aspect are implemented.

[0040] The above data processing method, apparatus, computer device, storage medium, and program product obtain a configuration file corresponding to the source database where the data to be processed is located; the configuration file includes natural language operator information pre-configured by a user based on the configuration interface of the data processing system, as well as the flow relationship between the source database, the destination database, and the natural language operator. Use a natural language processing engine to parse the configuration file to obtain the natural language operator information and the flow relationship, and according to the natural language operator information and the flow relationship, use the natural language processing engine to process the data to be processed and write the processing result into the destination database. Since the configuration file obtained corresponding to the source database where the data to be processed is located is pre-configured by the user based on the configuration interface of the data processing system, and the configuration file includes natural language operator information and the flow relationship between the source database, the destination database, and the natural language operator, therefore, when processing the data to be processed, the configuration file corresponding to the source database where the data to be processed is located can be determined in the pre-configured configuration file, use the natural language processing engine to parse the configuration file to obtain the natural language operator information and the flow relationship, and according to the natural language operator information and the flow relationship, use the natural language processing engine to process the data to be processed and write the processing result into the destination database. In this way, as long as the computer device obtains the configuration file corresponding to the source database where the data to be processed is located, the configuration file can be used to process the data to be processed, so that the computer device can simultaneously process multiple different data to be processed according to the configuration files corresponding to different data to be processed, that is, the computer device can process multiple data to be processed concurrently, thereby enabling the data processing method to be applied to the scenario of large-scale data processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following will briefly introduce the drawings required for use in the description of the embodiments or related technologies. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0042] Figure 1 It is an application environment diagram of the data processing method in an embodiment;

[0043] Figure 2 It is a flowchart of the data processing method in an embodiment;

[0044] Figure 3 It is a schematic diagram of a configuration interface in an embodiment;

[0045] Figure 4 It is a schematic diagram of a configuration interface in another embodiment;

[0046] Figure 5 It is a schematic flowchart of a data processing method in another embodiment;

[0047] Figure 6 It is a schematic flowchart of a data processing method in another embodiment;

[0048] Figure 7 It is a schematic flowchart of a data processing method in another embodiment;

[0049] Figure 8 Schematic flowchart of a data processing method in another embodiment;

[0050] Figure 9 It is a schematic flowchart of a data processing method in another embodiment;

[0051] Figure 10 It is a schematic diagram of a configuration interface in another embodiment;

[0052] Figure 11 It is a schematic flowchart of a data processing method in another embodiment;

[0053] Figure 12 It is a schematic diagram of a configuration interface in another embodiment;

[0054] Figure 13 It is a structural block diagram of a data processing apparatus in one embodiment;

[0055] Figure 14 It is a structural block diagram of a data processing apparatus in another embodiment. Detailed implementation manners

[0056] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0057] References to "embodiments" in this application mean that specific features, structures, or characteristics described in connection with the embodiments can be included in at least one embodiment of the application. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. It is explicitly and implicitly understood by those of ordinary skill in the art that the embodiments described in this application can be combined with other embodiments without conflict. The terms "a", "an", "one", "the" and similar words used in this application do not indicate a limitation of quantity and can mean singular or plural. The terms "including", "comprising", "having" and any variations thereof used in this application are intended to cover non-exclusive inclusion. The meaning of "a plurality" in this application is at least two, such as two, three, etc., unless otherwise specifically defined. It should be noted that the beneficial effects brought about by the embodiments of this application or the technical problems solved are not limited to this one, and there may also be other implicit or related problems. For specific details, please refer to the description of the following embodiments. The technical solutions of this application and how the technical solutions of this application solve the above technical problems will be described in detail below with specific embodiments.

[0058] With the popularization of Internet technology, the generation speed of digital data has increased exponentially, and the amount of data that needs to be processed and analyzed is increasing. Based on this, Natural Language Processing (NLP) technology has emerged. NLP technology can use the natural language used by humans for communication to interact with machines and process data.

[0059] In traditional technologies, the processing and analysis of data can be achieved by calling the Baidu AI interface and using NLP technology. However, the Baidu AI interface cannot be requested infinitely, and each request can only process one piece of text data. Therefore, there is a scenario in traditional technologies that is not applicable to large-scale data processing.

[0060] In response to the above problems, the data processing method provided by the embodiments of this application has the ability to process big data and natural language processing, and has the functions of data access, data processing, and writing the processing results to the destination database. The data processing method provided by the embodiments of this application can be applied to an application environment as Figure 1 shown. Figure 1 A computer device is provided. The computer device can be a terminal, and its internal structure diagram can be as Figure 1As shown in the figure. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface, the display unit, and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements a method for adjusting page elements. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer covering the display screen, or a button, a trackball, or a touchpad provided on the computer device housing, or an external keyboard, touchpad, or mouse, etc.

[0061] Those skilled in the art can understand that Figure 1 the structure shown in the figure is only a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0062] In one embodiment, as Figure 2 shown, a data processing method is provided. Taking the computer device in Figure 1 as an example for description, the method includes the following steps:

[0063] S201. Obtain a configuration file corresponding to the source database where the data to be processed is located; the configuration file includes natural language operator information pre-configured by the user based on the configuration interface of the data processing system, as well as the flow relationship between the source database, the destination database, and the natural language operator.

[0064] Among them, the data to be processed can be text data, audio data, etc. The source database can be a relational database, a non-relational database, or a file operating system with data storage function. Relational databases such as MySQL, PostgreSQL, Oracle Database, Microsoft SQL Server, etc. Non-relational databases such as MongoDB, Redis, Cassandra, etc. File operating systems such as HDFS, etc.

[0065] In this embodiment, the natural language operator information pre-configured by the user based on the configuration interface of the data processing system may include the name of the natural language operator, the object of action of the natural language operator, the processing path of the natural language operator, etc. Further, it may also include the number of the natural language operator, etc. The flow relationship can be the flow of data among the source database, the destination database, and the natural language operator. For example, the data in the source database flows to the natural language operator, and the processing result obtained by processing the data using the natural language operator flows to the destination database.

[0066] In this embodiment, the user can configure the source database, the destination database, the natural language operator information, and the flow relationship among the source database, the destination database, and the natural language operator on the configuration interface of the data processing system. The computer device generates a configuration file based on the information configured by the user on the configuration interface. When a data processing task is triggered, the configuration file corresponding to the source database where the data to be processed is located can be obtained from the backend storage, or alternatively, the configuration file corresponding to the source database where the data to be processed is located sent by other devices can also be received.

[0067] It should be noted that before configuring the source database and the destination database, in response to the new database operation triggered by the user on the configuration interface of the data processing system, for example, the user can click the "New Database" icon in the interface as Figure 3 shown to add a database and configure the connection information of the newly added database. After the database is created, a database list can be displayed to manage the databases in the database list. Exemplarily, the interface for displaying the database list is as Figure 4As shown, the database can be filtered by name, type, and database source on this interface, and operations such as editing or deleting the database can be performed. It can be understood that the source database and destination database configured by the above user on the configuration interface of the data processing system are configured based on the databases in the database list. Among them, the connection information may include the user name and password used to log in to the database, as well as the uniform resource locator (URL) path, port information, the database name and data table name established in this type of database, etc.

[0068] S202. Use the natural language processing engine to parse the configuration file to obtain natural language operator information and flow relationships.

[0069] Among them, the natural language processing engine is a program that can perform natural language processing on data.

[0070] In this embodiment, the natural language processing engine can be used to parse the configuration file pre-configured by the user based on the configuration interface of the data processing system. After parsing, the natural language operator information in the configuration file, as well as the flow relationship between the source database, destination database, and natural language operator, can be obtained.

[0071] Exemplarily, by using the natural language processing engine to parse the configuration file, the name of the natural language operator, the object of action of the natural language operator, the processing path of the natural language operator, etc. can be obtained. The obtained flow relationship can be that the data in the source database flows to the natural language operator. Further, after the processing result obtained by using the natural language operator to process the data to be processed, the flow relationship of the data can be to flow to the destination database.

[0072] S203. According to the natural language operator information and flow relationship, use the natural language processing engine to process the data to be processed and write the processing result into the destination database.

[0073] In this embodiment, since the natural language processing operator information may include the name of the natural language operator, the number of the natural language operator, the object of action of the natural language operator, the processing path of the natural language operator, etc., therefore, the natural language processing engine can be used to call the natural language operator corresponding to the name or number of the natural language operator in the configuration file according to the name or number of the natural language operator, and process the data to be processed in the source database according to the object of action and processing path of the natural language operator to obtain the processing result, and write the processing result into the destination database.

[0074] It can be understood that if the flow relationship in the configuration file is specific to the source data table in the source database and the destination data table in the destination database, then it can be to process the data to be processed in the source data table of the source database, obtain the processing result, and write the processing result into the destination data table in the destination database.

[0075] It should be noted that before calling the natural language operator corresponding to the name or number of the natural language operator and processing the data to be processed in the source database according to the object of action and processing path of the natural language operator, the data to be processed is cleaned using a preset data cleaning algorithm to remove irregular dirty data, so as to obtain the cleaned data to be processed, and then the cleaned data to be processed is processed.

[0076] Exemplarily, the user can pre-configure natural language operator information, as well as the flow relationship between the source database, the destination database, and the natural language operator, in the UI configuration interface of the data processing system as shown in Figure 5 The computer device will generate a configuration file according to the configured information. The backend service, according to the task requirements of the data processing task, uses the natural language processing engine to parse the configuration file and process the data to be processed in the source database, and writes the processing result into the destination database.

[0077] For the above data processing method, since the configuration file corresponding to the source database where the data to be processed is located is pre-configured by the user based on the configuration interface of the data processing system, and the configuration file includes natural language operator information, as well as the flow relationship between the source database, the destination database, and the natural language operator, therefore, when processing the data to be processed, the configuration file corresponding to the source database where the data to be processed is located can be determined in the pre-configured configuration file, the configuration file is parsed using the natural language processing engine to obtain the natural language operator information and the flow relationship, and according to the natural language operator information and the flow relationship, the natural language processing engine is used to process the data to be processed and write the processing result into the destination database. In this way, as long as the computer device obtains the configuration file corresponding to the source database where the data to be processed is located, it can use this configuration file to process the data to be processed, enabling the computer device to process multiple different data to be processed simultaneously according to the configuration files corresponding to different data to be processed, that is, enabling the computer device to process multiple data to be processed concurrently, so that this data processing method can be applied to the scenario of large-scale data processing.

[0078] The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0079] The following will describe in detail the specific content of processing the data to be processed using the natural language processing engine according to the natural language operator information and the flow relationship, and writing the processing result into the destination database. In one embodiment, as Figure 6 shown, the above S202 includes:

[0080] S301. Process the data to be processed using the natural language processing engine according to the natural language operator information to obtain a processing result.

[0081] Optionally, the natural language operator information may include the number of the natural language operator, the object of action of the natural language operator, and the processing path. In this embodiment, the natural language processing engine can be used to call the natural language operator corresponding to the number of the natural language operator, and process the data to be processed according to the object of action and the processing path of the natural language operator to obtain a processing result.

[0082] S302. Write the processing result into the destination database using the natural language processing engine according to the flow relationship.

[0083] In this embodiment, according to the pre-matched flow relationship between the source database, the destination database, and the natural language operator, the natural language processing engine can be used to write the obtained processing result into the destination database. It can be understood that the corresponding flow relationship for writing the obtained processing result into the destination database using the natural language processing engine is: the processing result obtained by the natural language processing engine according to the processed data flows to the destination database.

[0084] In this embodiment, by processing the data to be processed using the natural language processing engine according to the natural language operator information to obtain a processing result, and writing the processing result into the destination database using the natural language processing engine according to the flow relationship, since the processing result can be automatically written into the destination database according to the flow relationship in the configuration file, the fluency of the data processing task is enhanced.

[0085] Based on the above embodiment, as an alternative embodiment, as Figure 7 shown, the above S301 includes:

[0086] S401. Determine the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator according to the natural language operator information.

[0087] Among them, the name of the natural language operator can be understood as the name of the natural language processing method pointed to by the natural language operator. For example, basic word segmentation, keyword extraction, abstract extraction, entity recognition, ID number parsing, address parsing, word frequency statistics, text classification training, relationship extraction, event extraction, etc. The object of action of the natural language operator can be the column name of the data to be processed; if there are multiple columns, the column names can be separated by commas in English. The processing path of the natural language operator can be the path of the class to be executed by the natural language processing method.

[0088] In this embodiment, the natural language operator information can be parsed to obtain the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator. Or, it can also be directly based on the natural language operator information to determine the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator included in the natural language operator information.

[0089] S402. Use the natural language processing engine to call the natural language operator corresponding to the name, and process the data to be processed according to the object of action and the processing path to obtain the processing result.

[0090] In this embodiment, since the name of the natural language operator is determined through the above steps, the natural language processing engine can be used to call the natural language operator corresponding to the name of the natural language operator, and process the data to be processed according to the object of action of the natural language operator and the processing path of the natural language operator. The computer device obtains the processing result after processing.

[0091] Exemplarily, if the name of the natural language operator is keyword extraction, the natural language processing engine can be used to call the natural language operator corresponding to the natural language processing method of keyword extraction, and process the data to be processed according to the object of action of the natural language processing method of keyword extraction and the processing path. The computer device obtains the processing result after processing.

[0092] In this embodiment, by determining the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator according to the natural language operator information. Then use the natural language processing engine to call the natural language operator corresponding to the name, and process the data to be processed according to the object of action and the processing path to obtain the processing result. Since the natural language operator can be called according to the natural language operator information in the configuration file to complete the data processing work of the data to be processed, the natural language operator information can be flexibly configured according to the task requirements, so as to complete the data processing task according to the natural language operator pointed to by the natural language operator information, improving the flexibility of data processing.

[0093] In the above scenario of obtaining the configuration file corresponding to the source database where the data to be processed is located, it is necessary to pre-configure the configuration files corresponding to different source databases. In one embodiment, the configuration interface of the data processing system includes a database configuration interface and a natural language operator configuration interface; as Figure 8 shown, the above method further includes:

[0094] S501. Based on the first selection operation triggered by the user in the database configuration interface of the configuration interface, determine the source database and the destination database.

[0095] Among them, the first selection operation may be: after the source database type list and the destination database type list are displayed in the database configuration interface, the user determines the destination database according to the source database type list displayed in the database configuration interface, and determines the destination database according to the destination database list.

[0096] In this embodiment, the source database type list and the destination database type list can be displayed. The user clicks on the source database type in the source database type list and clicks on the destination database type in the destination database type list to trigger the first selection operation. The computer device can determine the source database type and the destination database type based on the first selection operation of the user in the database configuration interface. Display the source database list and the destination database list corresponding to the source database type. Based on the selection operation of the user on the source database list, determine the source data source; based on the selection operation of the user on the destination database list, determine the destination data source.

[0097] S502. Based on the second selection operation triggered by the user in the natural language operator configuration interface of the configuration interface, determine the natural language operator information.

[0098] Among them, the second selection operation may be: the selection operation of the user on the trigger control corresponding to the natural language operator configuration interface displayed in the configuration interface.

[0099] In this embodiment, the user clicks on the trigger control corresponding to the natural language operator configuration interface in the configuration interface to trigger the second selection operation. The computer device can display the natural language operator list in the natural language operator configuration interface based on the second selection operation. The user selects the natural language operator according to the natural language operator list displayed in the natural language operator configuration interface, and determines the natural language operator information according to the selected natural language operator.

[0100] It should be noted that each natural language operator corresponds to a data processing function, and the data processing functions corresponding to natural language operators may include: basic word segmentation, keyword extraction, abstract extraction, entity recognition, ID number parsing, address parsing, word frequency statistics, text classification training, relation extraction, and event extraction.

[0101] S503. Determine the flow relationship based on the pointing operations triggered by the user on the configuration interface for the source database, destination database, and natural language operator.

[0102] Among them, the flow relationship can be that the data in the source database flows to the natural language operator, and the processing result obtained after processing the data using the natural language operator flows to the destination database.

[0103] In this embodiment, the user can click on the source database on the configuration interface, point to the natural language operator through a preset pointing line, then click on the natural language operator and point to the destination database through a preset pointing line. Therefore, the computer device can determine, based on the pointing operations of the user on the configuration interface that point the source database to the natural language operator and the natural language operator to the destination database, that the flow relationship is that the data in the source database flows to the natural language operator, and the processing result obtained after processing the data using the natural language operator flows to the destination database.

[0104] It can be understood that multiple natural language operators can be selected. If multiple natural language operators are selected, then the flow relationship of the data in the source database, multiple natural language operators, and the destination database can be determined based on the pointing operations of the user on the configuration interface that point the source database to multiple natural language operators and the multiple operators to the destination database. In this process, the multiple natural language operators execute in parallel.

[0105] S504. Establish a configuration file according to the natural language operator information and the flow relationship.

[0106] In this embodiment, a configuration file including the natural language operator information, the source database, the destination database, and the flow relationship of the natural language operator can be established based on the flow relationship determined by the pointing operations triggered by the user on the configuration interface for the source database, the destination database, and the natural language operator. Optionally, the format of this configuration file can be in json format.

[0107] Further, it should be noted that during the process of establishing the configuration file, the parameter information of the computing engine Spark can also be configured based on the configuration interface, and the parameter information of the computing engine Spark is added to the above-mentioned configuration file. Optionally, the parameter information of the computing engine Spark may include the running mode of Spark, the number of Spark cores, the Spark memory configuration information, the Spark task name, etc. Among them, the running mode of Spark may include the client mode or the cluster mode, and may also include the number of Spark cores and the Spark memory configuration information.

[0108] In this embodiment, based on the first selection operation triggered by the user in the database configuration interface of the configuration interface, the source database and the destination database are determined. Based on the second selection operation triggered by the user in the natural language operator configuration interface of the configuration interface, the natural language operator information is determined. Based on the pointing operation of the source database, the destination database, and the natural language operator triggered by the user on the configuration interface, the flow relationship is determined. According to the natural language operator information and the flow relationship, a configuration file is established, which enables the user to independently configure the source database, the destination database, and the natural language operator according to the task requirements of data processing. Further, the configuration file is called for data processing later, which improves the flexibility of data processing and can process a large amount of data.

[0109] As an alternative implementation, as Figure 9 shown, the above S501 includes:

[0110] S601. Based on the first selection operation, display the source database list corresponding to the source database type selected by the user and the destination database list corresponding to the destination database type selected by the user.

[0111] Among them, the first selection operation may be: after the source database type list and the destination database type list are displayed on the database configuration interface, the user selects the destination database type according to the source database type list displayed on the database configuration interface, and the operation of selecting the destination database according to the destination database list.

[0112] In this embodiment, as Figure 10 shown, the source database type list and the destination database type list can be displayed. The user clicks on the source database type in the source database type list and clicks on the destination database type in the destination database type list to trigger the first selection operation. The computer device can determine the source database type and the destination database type based on the first selection operation of the user on the database configuration interface, and display the source database list corresponding to the source database type and the destination database list.

[0113] S602. Determine the source database based on the third selection operation triggered by the user in the source database list.

[0114] Among them, the third selection operation may be: after the source database list is displayed on the database configuration interface, the user selects the source database according to the source database list displayed on the database configuration interface.

[0115] In this embodiment, the user clicks on the source database in the source database list to trigger the third selection operation, and the computer device can determine the source database based on the third selection operation triggered by the user in the source database list.

[0116] S603. Determine the destination database based on the fourth selection operation triggered by the user in the destination database list.

[0117] Among them, the fourth selection operation may be: after the destination database list is displayed on the database configuration interface, the user selects the destination database according to the destination database list displayed on the database configuration interface.

[0118] In this embodiment, the user clicks on the source database in the destination database list to trigger the fourth selection operation, and the computer device can determine the destination database based on the fourth selection operation triggered by the user in the destination database list.

[0119] In this embodiment, by displaying the source database list corresponding to the source database type selected by the user and the destination database list corresponding to the destination database type selected by the user based on the first selection operation, determining the source database based on the third selection operation triggered by the user in the source database list, and determining the destination database based on the fourth selection operation triggered by the user in the destination database list, it is possible to display the corresponding list to the user according to the user's selection for the user to make the next selection and configuration of information, avoiding the generation of inapplicable configuration files due to selecting incorrect information. At the same time, the user experience is improved.

[0120] Optionally, as Figure 10 shown, the source data table list can be displayed based on the sixth selection operation triggered by the user in the source database. The source data table is determined based on the seventh operation triggered by the user in the source data table list. The destination data table list can also be displayed based on the sixth selection operation triggered by the user in the destination database. The destination data table is determined based on the seventh operation triggered by the user in the destination data table list. It should be noted that the destination data table can be newly created.

[0121] As an alternative implementation, as Figure 11 shown, the above S502 includes:

[0122] S701. Display a list of natural language operators based on a second selection operation.

[0123] Among them, the second selection operation can be: the user's selection operation on the trigger control corresponding to the natural language operator configuration interface displayed in the configuration interface.

[0124] In this embodiment, the user clicks on the trigger control corresponding to the natural language operator configuration interface in the configuration interface to trigger the second selection operation. The computer device can display a list of natural language operators in the natural language operator configuration interface based on the second selection operation.

[0125] S702. Determine natural language operator information based on a fifth selection operation triggered by the user in the natural language operator list; the natural language operator information includes the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator.

[0126] Among them, the fifth selection operation can be: after the natural language operator list is displayed in the natural language operator configuration interface, the user's operation of selecting natural language operator information according to the natural language operator list displayed in the natural language operator configuration interface.

[0127] In this embodiment, the user clicks on the natural language operator in the natural language operator list to trigger the fifth selection operation. The computer device can determine the selected natural language operator based on the fifth selection operation triggered by the user in the natural language operator list, and parse the natural language operator to obtain the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator.

[0128] In this embodiment, by displaying a list of natural language operators based on the second selection operation and determining natural language operator information based on the fifth selection operation triggered by the user in the natural language operator list; the natural language operator information includes the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator, data processing can be performed according to the natural language operator information configured by the user. When multiple natural language operators are configured, multiple operators can be executed in parallel, reducing the data processing time.

[0129] Optionally, as Figure 12 shown, the natural language operator information can be determined based on a fifth selection operation triggered by the user in the natural language operator configuration interface in the configuration interface. Based on an eighth selection operation, the mapping relationship between the fields in the data to be processed and the fields in the processing result is determined, that is, the mapping relationship between the fields in the data in the source data table and the fields in the data in the destination data table can be determined. Fields can also be filtered on this interface. For example, the search fields, field types, whether to connect, etc. controls in Figure 12 can be triggered to filter the fields.

[0130] The following describes an embodiment of the present disclosure in combination with a specific data processing scenario. The method includes the following steps:

[0131] S1. Based on the first selection operation, display the source database list corresponding to the source database type selected by the user and the destination database list corresponding to the destination database type selected by the user.

[0132] S2. Based on the third selection operation triggered by the user in the source database list, determine the source database.

[0133] S3. Based on the fourth selection operation triggered by the user in the destination database list, determine the destination database.

[0134] S4. Based on the second selection operation, display the natural language operator list.

[0135] S5. Based on the fifth selection operation triggered by the user in the natural language operator list, determine the natural language operator information; the natural language operator information includes the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator.

[0136] S7. Based on the pointing operation triggered by the user on the source database, destination database, and natural language operator in the configuration interface, determine the flow relationship.

[0137] S8. Obtain the configuration file corresponding to the source database where the data to be processed is located; the configuration file includes the natural language operator information pre-configured by the user based on the configuration interface of the data processing system, as well as the flow relationship between the source database, destination database, and natural language operator.

[0138] S9. Use the natural language processing engine to parse the configuration file to obtain the natural language operator information and the flow relationship.

[0139] S10. According to the natural language operator information, determine the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator.

[0140] S11. Use the natural language processing engine to call the natural language operator corresponding to the name, and process the data to be processed according to the object of action and the processing path to obtain the processing result.

[0141] S12. According to the flow relationship, use the natural language processing engine to write the processing result into the destination database.

[0142] The above data processing method, apparatus, computer device, storage medium and program product obtain a configuration file corresponding to a source database where data to be processed is located; the configuration file includes natural language operator information pre-configured by a user based on a configuration interface of a data processing system, as well as the flow relationship between the source database, the destination database and the natural language operator. The natural language processing engine is used to parse the configuration file to obtain the natural language operator information and the flow relationship, and based on the natural language operator information and the flow relationship, the natural language processing engine is used to process the data to be processed and write the processing result into the destination database. In the traditional technology, by calling the Baidu AI interface and using NLP technology to implement data processing and analysis, there is a problem that it cannot be applied to scenarios of large-scale data processing. Compared with the traditional technology where the Baidu AI interface cannot be requested infinitely and each request can only process one piece of text data, according to the configuration file pre-configured by the user based on the configuration interface of the data processing system, the present application uses the natural language processing engine to process the data to be processed in the source database and write the processing result into the destination database, and can concurrently process multiple pieces of data to be processed, and thus can be applied to scenarios of large-scale data processing.

[0143] It should be understood that although the steps in the flowcharts involved in the above embodiments are shown in sequence according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear indication in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same moment, but can be executed at different moments, and the execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.

[0144] Based on the same inventive concept, the embodiments of the present application also provide a data processing apparatus for implementing the data processing method involved above. The solution provided by this apparatus to solve the problem is similar to the solution described in the above method. Therefore, the specific limitations in one or more embodiments of the data processing apparatus provided below can refer to the limitations on the data processing method in the above text, and will not be repeated here.

[0145] In an exemplary embodiment, as Figure 13 shown, a data processing apparatus is provided, including: a first acquisition module 11, a second acquisition module 12 and a processing module 13, where:

[0146] A first acquisition module 11, configured to acquire a configuration file corresponding to a source database where data to be processed is located; the configuration file includes natural language operator information pre-configured by a user based on a configuration interface of a data processing system, and a flow relationship between the source database, a destination database, and the natural language operator.

[0147] A second acquisition module 12, configured to parse the configuration file by using a natural language processing engine to acquire the natural language operator information and the flow relationship.

[0148] A processing module 13, configured to process the data to be processed by using the natural language processing engine according to the natural language operator information and the flow relationship, and write a processing result into the destination database.

[0149] The data processing device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be elaborated here.

[0150] In one embodiment, as Figure 14 shown, the above processing module 13 includes: an acquisition unit 131 and a writing unit 132, where:

[0151] The acquisition unit 131 is configured to process the data to be processed by using the natural language processing engine according to the natural language operator information to acquire a processing result.

[0152] The writing unit 132 is configured to write the processing result into the destination database by using the natural language processing engine according to the flow relationship.

[0153] The data processing device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be elaborated here.

[0154] In one embodiment, the above acquisition unit 131 is specifically configured to: determine a name of the natural language operator, an object of action of the natural language operator, and a processing path of the natural language operator according to the natural language operator information. Use the natural language processing engine to call the natural language operator corresponding to the name, and process the data to be processed according to the object of action and the processing path to acquire a processing result.

[0155] The data processing device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be elaborated here.

[0156] In one embodiment, the configuration interface includes a database configuration interface and a natural language operator configuration interface; the above device further includes: a first determination module 14, a second determination module 15, a third determination module 16, and a establishment module 17, where:

[0157] The first determination module 14 is configured to determine a source database and a destination database based on a first selection operation triggered by a user in a database configuration interface of a configuration interface.

[0158] The second determination module 15 is configured to determine natural language operator information based on a second selection operation triggered by a user in a natural language operator configuration interface of the configuration interface.

[0159] The third determination module 16 is configured to determine a flow relationship based on a pointing operation triggered by a user on the source database, the destination database, and the natural language operator in the configuration interface.

[0160] The establishment module 17 is configured to establish a configuration file according to the natural language operator information and the flow relationship.

[0161] The data processing device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be elaborated here.

[0162] In one embodiment, the first determination module 14 includes: a first display unit 141, a first determination unit 142, and a second determination unit 143, where:

[0163] The first display unit 141 is configured to display a source database list corresponding to the source database type selected by the user and a destination database list corresponding to the destination database type selected by the user based on the first selection operation.

[0164] The first determination unit 142 is configured to determine the source database based on a third selection operation triggered by the user in the source database list.

[0165] The second determination unit 143 is configured to determine the destination database based on a fourth selection operation triggered by the user in the destination database list.

[0166] The data processing device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be elaborated here.

[0167] In one embodiment, the second determination module 15 includes a second display unit 151 and a third determination unit 152, where:

[0168] The second display unit 151 is configured to display a natural language operator list based on the second selection operation.

[0169] The third determination unit 152 is configured to determine natural language operator information based on a fifth selection operation triggered by the user in the natural language operator list; the natural language operator information includes the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator.

[0170] The data processing device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effects are similar, which will not be elaborated here.

[0171] Each module in the above data processing device can be implemented in whole or in part by software, hardware, and their combination. The above modules can be embedded in the processor of the computer device in hardware form or be independent of it, or can be stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to the above respective modules.

[0172] In an exemplary embodiment, a computer device is provided, including a memory and a processor. A computer program is stored in the memory. When the processor executes the computer program, the following steps are implemented:

[0173] Obtain the configuration file corresponding to the source database where the data to be processed is located; the configuration file includes the natural language operator information pre-configured by the user based on the configuration interface of the data processing system, as well as the flow relationship between the source database, the destination database, and the natural language operator;

[0174] Use the natural language processing engine to parse the configuration file to obtain the natural language operator information and the flow relationship;

[0175] According to the natural language operator information and the flow relationship, use the natural language processing engine to process the data to be processed, and write the processing result into the destination database.

[0176] In one embodiment, when the processor executes the computer program, the following steps are also implemented:

[0177] According to the natural language operator information, use the natural language processing engine to process the data to be processed to obtain the processing result;

[0178] According to the flow relationship, use the natural language processing engine to write the processing result into the destination database.

[0179] In one embodiment, when the processor executes the computer program, the following steps are also implemented:

[0180] According to the natural language operator information, determine the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator;

[0181] Use the natural language processing engine to call the natural language operator corresponding to the name, and process the data to be processed according to the object of action and the processing path to obtain the processing result.

[0182] In one embodiment, when the processor executes the computer program, the following steps are also implemented:

[0183] Determine the source database and the destination database based on the first selection operation triggered by the user in the database configuration interface of the configuration interface;

[0184] Determine the natural language operator information based on the second selection operation triggered by the user in the natural language operator configuration interface of the configuration interface;

[0185] Determine the flow relationship based on the pointing operations of the source database, the destination database, and the natural language operator triggered by the user on the configuration interface;

[0186] Create a configuration file according to the natural language operator information and the flow relationship.

[0187] In one embodiment, when the processor executes the computer program, the following steps are further implemented:

[0188] Based on the first selection operation, display the list of source databases corresponding to the type of source database selected by the user and the list of destination databases corresponding to the type of destination database selected by the user;

[0189] Determine the source database based on the third selection operation triggered by the user in the source database list;

[0190] Determine the destination database based on the fourth selection operation triggered by the user in the destination database list.

[0191] In one embodiment, when the processor executes the computer program, the following steps are further implemented:

[0192] Based on the second selection operation, display the list of natural language operators;

[0193] Determine the natural language operator information based on the fifth selection operation triggered by the user in the natural language operator list; the natural language operator information includes the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator.

[0194] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented:

[0195] Obtain the configuration file corresponding to the source database where the data to be processed is located; the configuration file includes the natural language operator information pre-configured by the user based on the configuration interface of the data processing system, as well as the flow relationship between the source database, the destination database, and the natural language operator;

[0196] Use the natural language processing engine to parse the configuration file to obtain the natural language operator information and the flow relationship;

[0197] Process the data to be processed using a natural language processing engine according to the natural language operator information and the flow relationship, and write the processing result into the destination database.

[0198] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0199] Process the data to be processed using a natural language processing engine according to the natural language operator information to obtain a processing result;

[0200] Write the processing result into the destination database using a natural language processing engine according to the flow relationship.

[0201] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0202] Determine the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator according to the natural language operator information;

[0203] Use the natural language processing engine to call the natural language operator corresponding to the name, and process the data to be processed according to the object of action and the processing path to obtain a processing result.

[0204] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0205] Determine the source database and the destination database based on the first selection operation triggered by the user in the database configuration interface of the configuration interface;

[0206] Determine the natural language operator information based on the second selection operation triggered by the user in the natural language operator configuration interface of the configuration interface;

[0207] Determine the flow relationship based on the pointing operation triggered by the user on the source database, the destination database, and the natural language operator in the configuration interface;

[0208] Establish a configuration file according to the natural language operator information and the flow relationship.

[0209] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0210] Based on the first selection operation, display the list of source databases corresponding to the type of source database selected by the user and the list of destination databases corresponding to the type of destination database selected by the user;

[0211] Determine the source database based on the third selection operation triggered by the user in the source database list;

[0212] Determine the destination database based on the fourth selection operation triggered by the user in the destination database list.

[0213] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0214] Based on the second selection operation, display a list of natural language operators;

[0215] Based on the fifth selection operation triggered by the user in the natural language operator list, determine the natural language operator information; the natural language operator information includes the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator.

[0216] In one embodiment, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0217] Obtain the configuration file corresponding to the source database where the data to be processed is located; the configuration file includes the natural language operator information pre-configured by the user based on the configuration interface of the data processing system, as well as the flow relationship between the source database, the destination database, and the natural language operator;

[0218] Use the natural language processing engine to parse the configuration file to obtain the natural language operator information and the flow relationship;

[0219] According to the natural language operator information and the flow relationship, use the natural language processing engine to process the data to be processed, and write the processing result into the destination database.

[0220] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0221] According to the natural language operator information, use the natural language processing engine to process the data to be processed to obtain the processing result;

[0222] According to the flow relationship, use the natural language processing engine to write the processing result into the destination database.

[0223] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0224] According to the natural language operator information, determine the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator;

[0225] Use the natural language processing engine to call the natural language operator corresponding to the name, and process the data to be processed according to the object of action and the processing path to obtain the processing result.

[0226] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0227] Determine the source database and the destination database based on the first selection operation triggered by the user in the database configuration interface of the configuration interface;

[0228] Determine the natural language operator information based on the second selection operation triggered by the user in the natural language operator configuration interface of the configuration interface;

[0229] Determine the flow relationship based on the pointing operations of the source database, the destination database, and the natural language operator triggered by the user on the configuration interface;

[0230] Create a configuration file according to the natural language operator information and the flow relationship.

[0231] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented:

[0232] Based on the first selection operation, display the source database list corresponding to the source database type selected by the user and the destination database list corresponding to the destination database type selected by the user;

[0233] Determine the source database based on the third selection operation triggered by the user in the source database list;

[0234] Determine the destination database based on the fourth selection operation triggered by the user in the destination database list.

[0235] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented:

[0236] Based on the second selection operation, display the natural language operator list;

[0237] Determine the natural language operator information based on the fifth selection operation triggered by the user in the natural language operator list; the natural language operator information includes the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator.

[0238] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memories. Non-volatile memories can include read-only memory (ROM), magnetic tapes, floppy disks, flash memories, optical memories, high-density embedded non-volatile memories, resistive random access memories (ReRAM), magnetoresistive random access memories (MRAM), ferroelectric random access memories (FRAM), phase change memories (PCM), graphene memories, etc. Volatile memories can include random access memory (RAM) or external cache memories, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, data processing logics based on quantum computing, etc., without limitation.

[0239] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in this specification.

[0240] The above embodiments only represent several implementation manners of the present application. The description is relatively specific and detailed, but it should not be construed as a limitation on the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. A data processing method, characterized in that The method includes: Obtaining a configuration file corresponding to the source database where the data to be processed is located; the configuration file includes natural language operator information pre-configured by the user based on the configuration interface of the data processing system, as well as the flow relationship between the source database, the destination database, and the natural language operator; Using a natural language processing engine to parse the configuration file to obtain the natural language operator information and the flow relationship; According to the natural language operator information and the flow relationship, using the natural language processing engine to process the data to be processed and write the processing result into the destination database.

2. The method according to claim 1, characterized in that, The step of using the natural language processing engine to process the data to be processed according to the natural language operator information and the flow relationship and writing the processing result into the destination database includes: Processing the data to be processed using the natural language processing engine according to the natural language operator information to obtain the processing result; Writing the processing result into the destination database using the natural language processing engine according to the flow relationship.

3. The method according to claim 2, characterized in that The step of processing the data to be processed using the natural language processing engine according to the natural language operator information to obtain the processing result includes: Determining the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator according to the natural language operator information; Using the natural language processing engine to call the natural language operator corresponding to the name and processing the data to be processed according to the object of action and the processing path to obtain the processing result.

4. The method according to any one of claims 1 to 3, characterized in that The configuration interface includes a database configuration interface and a natural language operator configuration interface; the method further includes: Determining the source database and the destination database based on a first selection operation triggered by the user in the database configuration interface of the configuration interface; Determining the natural language operator information based on a second selection operation triggered by the user in the natural language operator configuration interface of the configuration interface; Determining the flow relationship based on a pointing operation triggered by the user on the configuration interface for the source database, the destination database, and the natural language operator; Establishing the configuration file according to the natural language operator information and the flow relationship.

5. The method according to claim 4, wherein The step of determining the source database and the destination database based on a first selection operation triggered by the user in the database configuration interface of the configuration interface includes: Based on the first selection operation, displaying a list of source databases corresponding to the type of source database selected by the user and a list of destination databases corresponding to the type of destination database selected by the user; Determining the source database based on a third selection operation triggered by the user in the source database list; Determining the destination database based on a fourth selection operation triggered by the user in the destination database list.

6. The method according to claim 4, wherein The step of determining the natural language operator information based on a second selection operation triggered by the user in the natural language operator configuration interface of the configuration interface includes: Present a list of natural language operators based on the second selection operation; Determine the natural language operator information based on the fifth selection operation triggered by the user in the natural language operator list; the natural language operator information includes the name of the natural language operator, the object of action of the natural language operator, and the processing path of the natural language operator.

7. A data processing device, characterized in that, The device includes: A first acquisition module for acquiring a configuration file corresponding to the source database where the data to be processed is located; the configuration file includes natural language operator information pre-configured by the user based on the configuration interface of the data processing system, as well as the flow relationship between the source database, the destination database, and the natural language operator; A second acquisition module for parsing the configuration file using a natural language processing engine to obtain the natural language operator information and the flow relationship; A processing module for processing the data to be processed using the natural language processing engine according to the natural language operator information and the flow relationship, and writing the processing result into the destination database.

8. A computer device, comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the method according to any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the method according to any one of claims 1 to 6.

Images