Task execution method and device, equipment and storage medium

By identifying user intentions and automatically combining functional blocks, the problem that application creation platforms in the prior art are difficult to flexibly meet user needs, realizing real-time task execution and application generation of natural language interfaces, and improving the efficiency of meeting user needs.

CN119025077APending Publication Date: 2024-11-26BEIJING ZITIAO NETWORK TECH CO LTD +1
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202310594243.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-24
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Existing application creation platforms are difficult to meet users' long-tail needs flexibly and conveniently, especially those who do not want to participate in the application creation process, which cannot provide applications that match the needs in a more flexible way or directly perform tasks of user intentions.

Method used

By identifying user intentions, combining multiple functional blocks and associated data streams, functional blocks are automatically combined to perform tasks, using natural language interfaces to meet user needs instantly, generate applications for performing tasks, and generate when preset conditions are met Apply to improve efficiency.

Benefits of technology

It achieves more flexible and immediate satisfaction of user needs, improves the efficiency of task execution and the convenience of application generation, and can better meet the needs of users expressed in natural language.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119025077A_ABST
    Figure CN119025077A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a task execution method and device, equipment and a storage medium. In a method for executing a task, a task to be executed is determined based on a user intent identified for a user input. A set of functional blocks is determined based on a plurality of functional blocks and a data stream associated with a task. And executing a task by using the group of combined function blocks. Therefore, user requirements can be understood, and indicated tasks can be completed conveniently and flexibly by combining a group of functional blocks.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, apparatuses, devices, and computer-readable storage media for performing tasks. Background Art

[0002] With the development of computer technology, various terminal devices can provide various services to people in work and life. For example, a general application that provides services can be deployed in the terminal device. An application creation platform can also be deployed in the terminal device. Such an application creation platform supports users to create applications that meet their needs. For example, users can build interfaces, build databases, create corresponding processes, and perform operation and maintenance. Summary of the invention

[0003] In a first aspect of the present disclosure, a method for performing a task is provided. The method comprises: determining a task to be performed based on a user intent identified for a user input; determining a set of function blocks based on a plurality of function blocks and a data flow associated with the task; and performing the task using the combined set of function blocks.

[0004] In a second aspect of the present disclosure, a device for executing a task is provided. The device comprises: a task determination module configured to determine a task to be executed based on a user intention identified for a user input; a function block determination module configured to determine a group of function blocks based on a plurality of function blocks and a data flow associated with the task; and an execution module configured to execute the task using the group of function blocks after combination.

[0005] In a third aspect of the present disclosure, a device for performing a task is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device performs the method of the first aspect.

[0007] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0008] In a fifth aspect of the present disclosure, a method for performing a task is provided. The method includes: determining a task to be performed based on a user intent identified for a user input. Performing the task using a set of function blocks provided by a low-code platform. In response to a preset condition being met, generating an application for performing the task based on the set of function blocks.

[0009] In a sixth aspect of the present disclosure, a device for executing a task is provided. The device includes: a task determination module configured to determine a task to be executed based on a user intent identified for a user input; an execution module configured to execute the task using a set of function blocks provided by a low-code platform; and a generation module configured to generate an application for executing the task based on a set of function blocks in response to a preset condition being met.

[0010] In a seventh aspect of the present disclosure, a device for processing a task is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the fifth aspect.

[0011] In an eighth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the fifth aspect.

[0012] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0015] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0016] Figure 2 A schematic diagram showing an example architecture for performing tasks according to some embodiments of the present disclosure;

[0017] Figure 3 A schematic diagram showing an example of performing a ticket booking task according to some embodiments of the present disclosure;

[0018] Figure 4 A flowchart of a method for performing a task according to some embodiments of the present disclosure is shown;

[0019] Figure 5 A block diagram of an apparatus for performing a task according to some embodiments of the present disclosure is shown;

[0020] Figure 6A flowchart of a method for processing a task according to some embodiments of the present disclosure is shown;

[0021] Figure 7 A block diagram showing an apparatus for processing a task according to some embodiments of the present disclosure; and

[0022] Figure 8 A block diagram of a device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0023] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0024] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0025] In this document, unless explicitly stated, executing a step "in response to A" does not mean executing the step immediately after "A", but may include one or more intermediate steps. It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0027] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scopes of use, and usage scenarios of the information involved in the present disclosure should be informed to the relevant users and the authorization of the relevant users should be obtained in an appropriate manner according to relevant laws and regulations, wherein the relevant users may include any type of right holders, such as individuals, enterprises, and groups. For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can autonomously choose whether to provide information to the application creation platform, application, server, or storage medium and other software or hardware that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0028] As an optional but non-limiting implementation, in response to receiving an active request from a relevant user, a prompt message is sent to the relevant user, for example, in the form of a pop-up window, in which the prompt message can be presented in text form. In addition, the pop-up window can also carry a selection control for the user to choose "agree" or "disagree" to provide information to the application creation platform.

[0029] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0030] As briefly mentioned above, developers can build, deploy, use, update, and manage applications through application creation platforms according to their needs, and then provide users with applications that meet their needs. However, it is limited by the capabilities of the application creation platform, or in other words, such an application creation platform can only create applications. For those users who only care about the services it can provide and do not want to participate in creating applications, such an application creation platform cannot meet the long-tail needs of users in a more flexible and convenient way. In addition, sometimes the specific needs of users may not be met by these created applications. Therefore, providing users with applications that match their needs or directly executing the tasks indicated by the needs is a technical issue that needs to be explored at present.

[0032] Due to the more accurate semantic understanding and contextual reasoning capabilities brought by the model, users can express user intent (for example, using multimodal forms involving natural language) and interact with applications, and applications can interact with models through natural language interfaces. In this case, it is expected that applications can make more full use of natural language to make applications more flexible. It will be understood that in the context of this disclosure, a "model" can be a machine learning model.

[0033] To this end, an embodiment of the present disclosure proposes a scheme for executing a task. According to various embodiments of the present disclosure, first, based on the user intention identified for the user input, a task to be executed is determined. Based on multiple function blocks and data flows associated with the task, a group of function blocks is determined. Then, the task is executed using the combined group of function blocks.

[0034] According to the embodiments of the present disclosure, the function blocks required to meet the user's needs can be determined based on the user's intention identified from the user input. According to the functions of each function block and the dependencies behind it, a call chain is automatically formed, and these function blocks are combined to meet the user's needs. Thus, the user's needs can be met instantly and flexibly using a natural language interface.

[0035] Example embodiments of the present disclosure are described below with reference to the accompanying drawings.

[0036] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In the environment 100, an application creation platform 110 (e.g., a platform implemented based on low-code technology, also referred to as a low-code platform) can be used by a user 140 who desires to create and maintain an application to create and maintain an application 150. In some embodiments, the application creation platform 110 can also be regarded as an application that provides application creation services. In some embodiments, the application creation platform 110 can be a platform based on application platform as a service (aPaas). The application creation platform 110 can understand the input of the user 140 through the model 120. In some embodiments, the application creation platform 110 can select appropriate functional blocks from the functional block library 130 and generate an application 150 based on part or all of the selected functional blocks.

[0037] In some embodiments, the application creation platform 110 can run a digital assistant 115. The digital assistant 115 can be integrated into the application creation platform 110 to be used to interact with the user 140. The digital assistant 115 can also run independently outside the application creation platform 110. The digital assistant 115 can be called or awakened by an appropriate method (e.g., a shortcut key, a button, or a voice), and then present an interactive window (e.g., a conversation window) with the user 140. Such a conversation window can be presented in the client interface of the application creation platform 110. The conversation window may include interface elements for information interaction, such as an input box, a message list, a message bubble, and the like. As a smart assistant, the digital assistant 115 has intelligent dialogue and information processing capabilities. The digital assistant 115 can receive a conversation message entered by the user 140 in the conversation window and provide a reply message. In some embodiments, the digital assistant 115 can be acquired based on a model different from the model 120.

[0039] The application creation platform 110 may run on a suitable electronic device. In some embodiments, the function block library 130 may be stored as part of the application creation platform 110. In some embodiments, the model 120 and the application creation platform 110 run on different electronic devices.

[0040] The electronic device here can be any type of device with computing capabilities, including terminal devices or server devices. The terminal device can be any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication systems (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio broadcast receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. The server device can include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like.

[0041] In some embodiments, the electronic device may run a client of the application creation platform 110, and the client may support interaction with the application creation platform 110. When the application creation platform 110 runs on the user's terminal device, the user 140 may interact with the application creation platform 110 through the client. When the application creation platform 110 runs on a server device, the application creation platform 110 may provide services to the client running in the terminal device based on the communication connection between the server device and the terminal device.

[0042] It should be understood that the structure and functionality of environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0044] Figure 2 1 is a schematic diagram of an example architecture 200 for performing tasks according to some embodiments of the present disclosure. The example architecture 200 can be implemented in the environment 100. Figure 1 An example architecture 200 is described.

[0045] According to an exemplary implementation of the present disclosure, user input may describe user intent and may involve a multimodal form. The multimodal form herein may, for example, include at least one of the following: text input, voice input, image input, and video input that describe the user intent in a natural language. For ease of description, the process of performing a task will be described below using only a text format as an example of a user input represented in a natural language.

[0046] exist Figure 2 In the example of FIG. 1 , the application creation platform 110 receives user input 210 in natural language from the user 140. In this way, the immediacy and flexibility of performing tasks can be improved. Such natural language can include text, voice, or a combination thereof. The application creation platform 110 can provide any suitable type of interface to receive the user input 210.

[0047] The user input 210 may indicate a task 220 to be performed. The task 220 may be determined by parsing the user input 210. In one example, the application creation platform 110 receives the user input 210 in text form, for example, "Please order two cups of coffee for me." The application creation platform 110 parses the text and determines that the task to be performed is "order coffee." In another example, the application creation platform 110 receives the user input 210 in speech form, for example, the user 140 says "book a flight to a certain place." The application creation platform 110 parses the speech and determines that the task to be performed includes booking a flight.

[0048] The task parsing described herein may be performed by the application creation platform 110 itself, or may be performed by the application creation platform 110 using the model 120. In some embodiments, the application creation platform 110 may determine the task to be performed by means of the model 120. The model 120 is, for example, a language model. The application creation platform 110 may send the user input 210 to the model 120. It should be understood that any appropriate language model may be used to determine the task to be performed based on the user input 210 represented in a natural language, and the present disclosure is not intended to limit the determination process.

[0049] The application creation platform 110 can determine a group of function blocks 240 based on the data flow associated with the task and multiple function blocks. The data flow associated with the task includes various data and flow directions required to complete the task. As an example, the task is "help me generate a photo album and send it to me by email". In order to complete this task, the materials (for example, each image) required to generate the photo album, the requirements for the photo album and other data need to be provided to the photo album generation module, and the user's email address needs to be provided to the email sending module. In addition, the generated photo album needs to be provided from the photo album generation module to the email sending module. For example, upstream function blocks, intermediate function blocks, downstream function blocks, etc. can be determined based on the data flow, and these function blocks are used as a group of function blocks 240. Further, the application creation platform 110 can use the combined group of function blocks 240 to perform the task 220. In this way, the user needs can be flexibly combined according to the functions of each function block itself and the dependencies behind it.

[0051] In some embodiments, the group of function blocks 240 may be determined from a function block library 130 including a plurality of function blocks 230. That is, these function blocks 230 are provided by the function block library 130. The plurality of function blocks 230 may include applications and / or components in applications. Applications may include any type of applications, not limited to office applications, tool applications, entertainment applications, shopping applications, social applications, etc. Components may include, but are not limited to, audio and video conference components, mail components, calendar components, schedule components, payment components, chat components, and the like. Components in applications are, for example, calendar components in office applications, voiceprint recognition components in tool applications, and the like. Each of the plurality of function blocks 230 may be either an application or a component in an application. Compared with applications, components in applications are used to implement more refined functions. Therefore, in these embodiments, these function blocks may be used to implement functions of different degrees of refinement (also referred to as granularity). In this way, the selection and combination of function blocks are made more flexible to better meet the needs of users in natural language. Additionally or alternatively, the application creation platform 110 may store newly installed applications or components in the applications in the function block library 130 to perform more diverse tasks.

[0052] In some embodiments, the application creation platform 110 can determine the function block that matches the task 220 from the multiple function blocks 230 based on the respective description information of the multiple function blocks 230, and use it as at least a part of a group of function blocks 240. The description information of each function block includes at least a semantic description of the function of the function block. Such a semantic description is in a form that the model 120 can understand. The understandable form means that the language, format, etc. of the text meet the preset requirements of the model 125. The description information can also indicate the input and output of the function block, as well as the requirements for the input and output (for example, format). In this way, the model 120 can select a function block that matches the task 220.

[0054] In some embodiments, the application creation platform 110 may send the user input 210 and the description information of the plurality of function blocks 230 to the model 120. The model 120 may determine the task 220 to be performed based on the semantic analysis of the user input 210, and determine the function of each function block based on the semantic analysis of the description information, so as to select the function block that performs the task.

[0055] In some embodiments, the application creation platform 110 may generate a prompt word input based on the description information of each of the multiple function blocks 230 and the user input 210. Such prompt word input is also called a prompt word, a guide word, etc. to the model. Further, the application creation platform 110 provides the description information of each of the multiple function blocks 230, the user input 210, and the prompt word input to the model 120. The model 120 can better understand the user input 210 based on the prompt word input, so as to select a more appropriate function block that matches the task 220. The application creation platform 110 obtains an indicator of the function block that matches the task 220 from the model 120. That is, the model 120 can indicate or notify the application creation platform 110 of the determined function block, so that the application creation platform 110 can combine it later.

[0056] In some embodiments, the application creation platform 110 can receive user input 210 and interact with the user 140 through the digital assistant 115. The digital assistant 115 can be a model-based assistant. The digital assistant 115 has intelligent dialogue and information processing capabilities (e.g., processing text, voice, image or video, etc.). For example, in the conversation window between the user 140 and the digital assistant 115, the user 140 can enter a conversation message, and the digital assistant 115 can provide a reply message or provide option information for the user 140 to select in response to the conversation message. In this way, a convenient interface can be provided for the user to express and clarify needs.

[0057] As an example, for the task of “ordering coffee”, the digital assistant 115 receives a conversation message “Please order two cups of coffee for me” sent by the user 140. In order to further clarify the user's needs, the digital assistant 115 sends a question to the user 140: “Which store / brand of coffee do you want to order?” After receiving the reply message from the user 140, the application creation platform 110 may provide the entire conversation message or the processed conversation message to the model 120.

[0058] As another example, user 140 says "I want to borrow a book from the library". After analyzing the voice, application creation platform 110 determines that the user's demand is "borrow a book". In order to further clarify the user's demand, digital assistant 115 can present a list of new books in the conversation window. After receiving the trigger operation of user 140 (such as clicking on a book), digital assistant 115 can present the cover, preface, trial chapters and other information of the book. Digital assistant 115 can also provide this information to model 120 together after receiving the confirmation operation of user 140 (for example, user 140 says "borrow this book for me").

[0060] Alternatively or additionally, the explicit or clarified requirements described above may also be implemented by the application creation platform 110 using the model 120 .

[0061] In some embodiments, the application creation platform 110 may interact with the user 140 (e.g., through the digital assistant 115) during the parsing or execution of the task 220. The interactive information may be in the format of text, image, audio, video, or any other appropriate format. For example, for the task of "booking a flight ticket", the application creation platform 110 queries multiple matching flight information through the function block that supports flight booking. Furthermore, the application creation platform 110 may send the flight information to the user 140 in text format through the digital assistant 115 for the user 140 to make a selection.

[0062] In some embodiments, the application creation platform 110 may generate a strategy or auxiliary information based on the user input 210 and provide it to the model 120. Such a strategy or auxiliary information is at least used to guide the model 120 to understand the user input 210 and select a functional block. Considering that the model 120 may be a general model, it may not be able to determine the information processing strategy in a specific field or a specific scenario. By providing such a strategy or auxiliary information to the model 120, it can help the model 120 to perform analysis and processing according to the preset strategy, so that the tasks to be performed and the selected functional blocks determined by it can better meet expectations.

[0063] In some embodiments, the functional block matched to task 220 may include multiple candidate modules for performing at least a portion of the task. These candidate modules at least partially implement the same or similar functions. For example, these candidate modules can all implement ticket booking. In this case, the application creation platform 110 can provide instructions for these candidate modules to the user 140. The user can select a target candidate module from these candidate modules. The application creation platform 110 can remove other candidate modules other than the target candidate module based on the user 140's selection of the target candidate module. In this way, the task can be performed efficiently in a manner that is more in line with the user's expectations.

[0064] In some scenarios, when the application creation platform 110 analyzes user input and selects a function block through the model 120, the model 120 may split the task 220 into multiple subtasks. When selecting a function block based on these subtasks and the description information of multiple function blocks 230, the model 120 may give feedback that there is no function block available to perform one or some subtasks. In some embodiments, the application creation platform 110, in response to such feedback, can create a function block for performing such a subtask by rewriting a function block in the multiple function blocks 230. Additionally or alternatively, the application creation platform 110 can create a new function block. For example, split the existing function block into a function block with a smaller granularity, or recreate a new function block. In this way, user needs can be met to the greatest extent possible. The rewritten function block and / or the newly created function block can be combined with the function block selected from the function block library 130 to perform the task 220.

[0066] An example of combining a group of function blocks 240 is described below. In some embodiments, the application creation platform 110 can determine the execution order of a group of function blocks 240 based on the data flow associated with the task 220, and combine the group of function blocks 240 according to the execution order. Such a data flow may include data transmitted between each function block. According to the flow direction of the data, the application creation platform 110 can combine a group of function blocks 240 in sequence. Such a sequential combination can be, for example, serial, parallel, or at least partially parallel.

[0067] In some embodiments, the application creation platform 110 may determine an endpoint function block in a set of function blocks 240 based on endpoint data in a data stream associated with the task 220. Such endpoint data may include input data, output data, or a combination of input data and output data in the data stream. Such an endpoint function block may include a start module, an end module, or both in a set of function blocks 240. The application creation platform 110 may determine the start module based on the input data, and may also determine the end module based on the output data. Continuing with the example task of "booking a flight ticket", the input data may include user information (e.g., "my" information), and the output data may include information of the booked flight ticket. The application creation platform 110 may select a function block for identifying the user's identity based on the input data (which is the start module in this example), and select a function block for supporting flight ticket booking based on the output data (which is the end module in this example).

[0068] As another example, for the task of "ordering coffee", the input data may include parameter information such as coffee type, cup type, hot or cold, and may also include information such as delivery address and payment account number. The output data may include coffee order information. Based on such an endpoint data flow, the application creation platform 110 may determine a functional block that supports coffee delivery, a functional block that stores user preferences, and a functional block that contains storage payment account information from multiple functional blocks 230. In some scenarios, the application creation platform 110 determines multiple functional blocks that support coffee delivery from multiple functional blocks 230. The application creation platform 110 may use these functional blocks as candidate modules and send options to the user 140. Based on the selection of the user 140, the application creation platform 110 determines a set of functional blocks for performing the "ordering coffee" task.

[0070] The application creation platform 110 may perform semantic analysis on the textual user input 210 through the model 120 (e.g., language model). In some embodiments, the application creation platform 110 may select a natural language recognition module from a plurality of functional blocks 230 to parse the user input 210 to assist the model 120 in determining the task to be performed 220. Such language recognition modules include, but are not limited to, a voiceprint recognition module, a speech recognition module, a facial expression recognition (e.g., lip shape recognition, eye tracking) module, a gesture recognition module, and the like.

[0071] In some embodiments, the application creation platform 110 determines an adjacent function block adjacent to the endpoint function block from a group of function blocks 240 based on the interface data of the endpoint function block. The endpoint function block and the adjacent function block can communicate via the interface data. Such an adjacent function block can include a predecessor module and / or a successor module of the endpoint function block. The interface data can include input interface data and / or output interface data.

[0072] Continuing with the example task of "booking a flight ticket", the application creation platform 110 selects a function block that supports flight ticket booking based on the output data. The input interface data of the endpoint function block may include user information, invoice information, and payment account information. Further, the application creation platform 110 selects a predecessor module based on these interface data, such as a function block that stores user information (such as name, ID number, etc.), a function block that stores invoice information, and a function block that stores payment account numbers. The output interface data of the endpoint function block may include outputting invoices, flights, etc. The application creation platform 110 selects a successor module based on such interface data, such as a function block that supports sending text messages to the user 140, a function block that supports sending pictures to the user 140, etc.

[0073] Additionally or alternatively, the application creation platform 110 selects a feedback module from the plurality of function blocks 230 to send the execution result 250 to the user 140. The feedback module includes, but is not limited to, a calendar module, a schedule module, etc. For example, the application creation platform 110 can add the flight itinerary as a task reminder through the calendar module. Additionally or alternatively, the application creation platform 110 can directly send the execution result 250 to the user 140. For example, the application creation platform 110 announces the success of the flight booking and detailed booking information in voice form.

[0075] The application creation platform 110 can select a group of function blocks 240 from multiple function blocks 230. Such a group of function blocks 240 may include multiple adjacent function blocks, such as adjacent first and second function blocks. In some embodiments, the application creation platform 110 determines that the format of the output data of the first function block is consistent with the format of the input data of the second function block, and the two function blocks can be combined. For example, in the example task of "booking a flight ticket", the first function block is a voiceprint recognition module that can identify the identity of the user 140, thereby outputting the user's name in text format. The second function block is a function block that supports flight booking, which can receive the user's name in text format and select the added certificate information, thereby outputting the booked flight information. As a result, the application creation platform 110 can directly combine two such matching function blocks.

[0076] In some embodiments, the combined first and second function blocks can be added to a cache of a function block library including a plurality of function blocks to form a third function block. Here, the input data of the third function block formed is the same as the input data of the first function block, and the output data of the third function block is the same as the input data of the second function block. In other words, a temporary function block generated using an existing function block can be stored in the cache, and the temporary function block can be used as the basis for subsequent combined functions. At this time, the temporary function module can implement more complex functions, and the temporary function block can be combined with other function blocks in the function block library. In some embodiments, the cache can be updated regularly, for example, when a temporary function block has not been used for a long time (for example, more than one month or other time period), the temporary function block is deleted. For another example, if a temporary function block is frequently used later, the temporary function block can be moved from the cache to the function block library.

[0077] In some scenarios, the first format of the output data of the first functional block is inconsistent with the second format of the input data of the second functional block. In some embodiments, the application creation platform 110 first uses the conversion module to convert the data in the first format into the data in the second format, and then combines the first functional block, the conversion module, and the second functional block. For example, in the example task of "borrowing books", the first functional block is a functional block that stores the library card of the user 140, and its output data is the library card in the image format. The second functional block is a functional block that supports book borrowing, and its input data is the certificate number in the text format. Therefore, the application creation platform 110 can use the format conversion module to convert the output data in the image format into the input data in the text format, thereby combining the two functional blocks through the format conversion module.

[0079] In some embodiments, the application creation platform 110 uses the customized function block based on the first format and the second format as the conversion module. Additionally or alternatively, the application creation platform 110 obtains a third-party function block based on the first format and the second format and uses it as the conversion module.

[0080] In some embodiments, the application creation platform 110 may add the conversion module to the plurality of function blocks 230. For example, the format conversion module is stored in the function block library 130 so that it can be directly selected and combined with other function blocks when necessary.

[0081] In some embodiments, the combined set of function blocks 240 can be used to perform other tasks. For example, the application creation platform 110 can receive another user input expressed in natural language from a user (who can be another user different from the user 140), and determine another task to be performed by parsing the other user input. Further, the application creation platform 110 responds to determining that the other task is of the same type as the previously executed task, and then uses the combined set of function blocks 240 to continue to perform the other task. In this way, the efficiency of performing tasks can be improved. For example, after the application creation platform 110 completes the task of "booking a flight ticket" for user A using a set of function blocks 240, it receives the task of "booking a flight ticket" from user B. The application creation platform 110 can continue to use a set of function blocks 240 to perform the task of "booking a flight ticket" for user B without reselecting function blocks from multiple function blocks 230 and combining them again.

[0082] In some embodiments, the application creation platform 110 generates an application using a group of combined function blocks 240, and stores the application, for example, adding the application to the function block library 130. That is, such an application can be added to multiple function blocks 230 as a function block with greater granularity. Such an application can also directly provide services to the user 140 like other general applications. Additionally or alternatively, the user 140 can update, manage, run, maintain, etc. the generated application through the application creation platform 110.

[0083] In some embodiments, the combined set of function blocks can be directly used to perform tasks, and no new application is generated. Alternatively and / or additionally, the combined set of function blocks can be used to generate a new application, and the new application can be added to the function block library so that the new application is used as another function block, and the number of function blocks in the function block library will change.

[0085] In some embodiments, it can be determined whether to generate an application using a group of function blocks after combination based on whether a preset condition is satisfied. Here, the preset condition may involve multiple aspects such as the number of executions of a task, the frequency of execution of a task, and whether a generation instruction is received. For example, the application creation platform 110 accumulates the number of executions associated with a certain type of task 220. When it is determined that the number of times the task of this type is executed exceeds a threshold number, the application creation platform 110 generates an application for executing the task of this type using a group of function blocks 240 after combination. Alternatively and / or additionally, the application creation platform 110 accumulates the execution frequency associated with a certain type of task 220. When it is determined that the execution frequency exceeds a threshold frequency (e.g., 3 times a week, and / or other values), the application creation platform 110 generates an application using a group of function blocks 240 after combination. Alternatively and / or additionally, an application can be generated using a group of function blocks 240 after combination in response to receiving a generation instruction (e.g., a generation instruction input by a user, and / or a generation instruction set in the application creation platform 110). In this way, tasks that are executed more frequently can be handled efficiently.

[0086] In summary, according to various embodiments of the present disclosure, the application creation platform 110 can use the model 120 to analyze the user input 210 to determine the task 220, and can also determine a group of function blocks 240 that can execute the task 220 based on the description information of multiple function blocks 230. The application creation platform 110 can combine a group of function blocks 240 in sequence to directly execute a temporary task, or generate an application to be called at any time when needed to execute the same type of task. Furthermore, the application creation platform 110 can improve the immediacy, flexibility, and comprehensiveness of executing tasks by adjusting function blocks, creating new function blocks, or adding generated applications to the function block library.

[0087] In order to more clearly understand the task execution scheme of the fundamental disclosed embodiment, the following reference Figure 3 Describe a specific example. Figure 3 A schematic diagram of an example 300 of performing a ticket booking task according to some embodiments of the present disclosure is shown. Example 300 is, for example, an office scenario, where multiple users can share the application creation platform 110. Example 300 can be implemented in environment 100. Figure 3 Example 300 is described.

[0088] For example, user A says "book a flight ticket to a certain place". The application creation platform 110 receives the voice input of user A and sends the voice input and the description information of each function block in the function block library 130 to the model 120. The model 120 or the application creation platform 110 can perform semantic analysis on the voice input or convert the voice input into text and then perform semantic analysis to determine that the task to be performed is "book a flight ticket". The data flow associated with the task may include user information, invoice information, payment account information, etc. Based on such a data flow, the model 120 determines the function of each function block according to the semantic analysis of the description information, so that the function block that performs the task can be selected. For example, the model 120 analyzes the input data as "I" in voice form, and thus selects the voiceprint recognition module 301 (for example, as the starting module) to determine the user information, such as name, ID number, etc. The model 120 analyzes the output data as "flight ticket", and thus selects the ticketing module 305 (for example, as the ending module) to book the flight ticket. After determining the starting module and the ending module, the model 120 continues to analyze the data flow or description information to determine the adjacent function blocks. For example, the ticketing module 305 requires data such as user name, ID number, destination, travel date, payment account, etc. Therefore, the model 120 selects the personnel module 302, the schedule module 303, and the financial module 304 as the predecessor modules, and selects the email module 306 as the successor module.

[0090] Furthermore, the application creation platform 110 receives the selection of the above functional blocks from the model 120 and combines them in order to perform the "booking air tickets" task. In the process of executing the task, the voiceprint recognition module 301 processes the voice input to output the user's identification information (for example, name, employee number, etc.). The personnel module 302 receives the user's identification information and outputs the user's ID number and the user's name. The schedule module 303 receives the user's name and outputs the destination and travel date. The financial module 304 receives the user's name and outputs the payment account number, invoice information, etc. The ticketing module 305 receives the above information and outputs the electronic ticket. The email module 306 receives the electronic ticket and outputs an email containing flight information. Thus, the task of booking an air ticket for user A is completed through the combination of a group of functional blocks.

[0091] Furthermore, the application creation platform 110 receives a task of booking a flight ticket from another user B. The application creation platform 110 can use a combination of the above functional blocks or a stored application to execute the task of booking a flight ticket for user B again.

[0092] In some scenarios, the model 120 analyzes that the output data format of the ticket module 305 is inconsistent with the input data format of the email module 306, and the conversion module 320 can be selected for data format conversion. Therefore, the application creation platform 110 can combine the above functional blocks through the conversion module 320.

[0094] Figure 4 4 is a flowchart of a method 400 for performing a task according to some embodiments of the present disclosure. The method 400 may be implemented at an electronic device running the application creation platform 110. Figure 1 Method 400 is described.

[0095] At block 410, a task to be performed is determined based on the user intent identified for the user input. At block 420, a set of functional blocks is determined based on a plurality of functional blocks and data flows associated with the task. At block 430, the task is performed using the combined set of functional blocks.

[0096] In some embodiments, based on the respective description information of the multiple functional blocks, a functional block matching the task can be determined from the multiple functional blocks as at least a part of a group of functional blocks, wherein the description information of each functional block includes at least a semantic description of the function of the functional block.

[0097] In some embodiments, a prompt word input may be generated based on the description information of each of the plurality of functional blocks and the user input; the prompt word input may be provided to the model; and an indicator of the functional block matching the task may be obtained from the model.

[0098] In some embodiments, method 400 also includes: in response to determining that the functional block matching the task includes multiple candidate modules for performing at least a portion of the task, providing a prompt of multiple candidate modules to the user; and based on the user's selection of a target candidate module among the multiple candidate modules, removing other candidate modules other than the target candidate module from the functional block matching the task.

[0099] In some embodiments, the method 400 further includes: determining an order of the set of functional blocks based on the data flow; and combining the set of functional blocks in the order.

[0100] In some embodiments, an endpoint function block in a set of function blocks can also be determined based on endpoint data in the data stream, the endpoint data including at least any one of the following in the data stream: input data, output data, and the endpoint function block including at least any one of the following in a set of function blocks: a start module, an end module.

[0101] In some embodiments, based on the interface data of the endpoint functional block, an adjacent functional block adjacent to the endpoint functional block can also be determined from a group of functional blocks, and the endpoint functional block and the adjacent functional block communicate via the interface data, and the adjacent functional block includes at least any one of the following of the endpoint functional block: a predecessor module and a successor module.

[0102] In some embodiments, for a first functional block and a second functional block in a group of functional blocks, in response to determining that a first format of output data of the first functional block is consistent with a second format of input data of the second functional block, the first functional block and the second functional block can be combined, and the first functional block and the second functional block are adjacent functional blocks arranged in sequence.

[0104] In some embodiments, method 400 also includes: adding the combined first functional block and second functional block to a cache of a functional block library comprising multiple functional blocks to form a third functional block, the input data of the third functional block being the same as the input data of the first functional block, and the output data of the third functional block being the same as the input data of the second functional block.

[0105] In some embodiments, the method 400 further includes: in response to determining that the first format and the second format are inconsistent, converting the first format to the second format using a conversion module; and combining the first function block, the conversion module, and the second function block.

[0106] In some embodiments, the method 400 further includes: adding the conversion module to a function block library including a plurality of function blocks.

[0107] In some embodiments, the conversion module is obtained based on at least any one of the following: a function block defined based on the first format and the second format; a third-party function block obtained based on the first format and the second format.

[0108] In some embodiments, method 400 also includes: in response to determining that multiple functional blocks cannot perform at least a portion of the tasks, creating a functional block for performing at least a portion of the tasks based on any of the following: rewriting a functional block among the multiple functional blocks; and creating a new functional block different from the multiple functional blocks.

[0109] In some embodiments, method 400 also includes: receiving another user input expressed in a natural language from the user; parsing the other user input to determine another task to be performed; and in response to determining that the task is of the same type as the other task, performing the other task using the combined set of functional blocks.

[0110] In some embodiments, the method 400 further includes: generating an application using the combined set of functional blocks; and adding the application to a functional module library including the plurality of functional blocks.

[0111] In some embodiments, the application may also be generated in response to determining that a received user input associated with the type of task satisfies a threshold condition.

[0112] In some embodiments, method 400 further includes: determining that the user input satisfies a threshold condition in response to at least any one of the following: the number of user inputs exceeds a threshold number; the frequency of user inputs exceeds a threshold frequency.

[0113] In some embodiments, the plurality of function blocks are provided by a function block library and include at least any one of the following: an application, a component in an application.

[0114] In some embodiments, the user input includes a multimodal form, and the multimodal form includes at least any one of the following: text input describing the user's intention in natural language, voice input, image input, video input.

[0115] Figure 5 A schematic structural block diagram of an apparatus 500 for performing a task according to some embodiments of the present disclosure is shown. The apparatus 500 may be implemented as or included in an electronic device running the application creation platform 110. Each module / component in the apparatus 500 may be implemented by hardware, software, firmware, or any combination thereof.

[0116] As shown in the figure, the device 500 includes a task determination module 510, which is configured to determine the task to be performed based on the user intention identified for the user input. The device 500 also includes a function block determination module 520, which is configured to determine a group of function blocks based on multiple function blocks and data flows associated with the task. The device 500 also includes an execution module 530, which is configured to execute the task using the combined group of function blocks.

[0117] In some embodiments, the function block determination module 510 is configured to determine a function block matching the task from a plurality of function blocks as at least a part of a group of function blocks based on the respective description information of the plurality of function blocks, wherein the description information of each function block includes at least a semantic description of the function of the function block.

[0118] In some embodiments, the function block determination module 510 is further configured to generate a prompt word input based on the description information of each of the plurality of function blocks and the user input; provide the prompt word input to the model; and obtain an indicator of a function block matching the task from the model.

[0119] In some embodiments, the device 500 also includes a providing module, configured to provide a prompt of multiple candidate modules to the user in response to determining that the functional block matching the task includes multiple candidate modules for performing at least a portion of the task; and a removing module, configured to remove other candidate modules other than the target candidate module from the functional block matching the task based on the user's selection of the target candidate module among the multiple candidate modules.

[0120] In some embodiments, the apparatus 500 further includes an order determination module configured to determine an order of a group of functional blocks based on a data flow; and a combination module configured to combine the group of functional blocks in order.

[0122] In some embodiments, the sequence determination module is further configured to determine an endpoint function block in a set of function blocks based on endpoint data in the data stream, the endpoint data including at least any one of the following in the data stream: input data, output data, and the endpoint function block including at least any one of the following in a set of function blocks: a start module, an end module.

[0123] In some embodiments, the sequence determination module is further configured to determine an adjacent functional block adjacent to the endpoint functional block from a group of functional blocks based on the interface data of the endpoint functional block, the endpoint functional block and the adjacent functional block communicate via the interface data, and the adjacent functional block includes at least any one of the following of the endpoint functional block: a predecessor module and a successor module.

[0124] In some embodiments, the combination module is further configured to combine a first functional block and a second functional block in a group of functional blocks in response to determining that a first format of output data of the first functional block is consistent with a second format of input data of the second functional block, wherein the first functional block and the second functional block are adjacent functional blocks arranged in sequence.

[0125] In some embodiments, the device 500 also includes: an adding module, configured to add the combined first functional block and second functional block to a cache of a functional block library comprising multiple functional blocks to form a third functional block, the input data of the third functional block being the same as the input data of the first functional block, and the output data of the third functional block being the same as the input data of the second functional block.

[0126] In some embodiments, the apparatus 500 further includes a format conversion module configured to convert the first format into the second format using the conversion module in response to determining that the first format and the second format are inconsistent; and a second combination module configured to combine the first functional block, the conversion module and the second functional block.

[0127] In some embodiments, the apparatus 500 further includes an adding module configured to add a conversion module to a function block library including a plurality of function blocks.

[0128] In some embodiments, the conversion module is obtained based on at least any one of the following: a function block defined based on the first format and the second format; a third-party function block obtained based on the first format and the second format.

[0129] In some embodiments, the device 500 also includes a creation module, which is configured to create a functional block for performing at least a portion of the tasks based on any of the following in response to determining that multiple functional blocks cannot perform at least a portion of the tasks: rewriting a functional block among the multiple functional blocks; and creating a new functional block different from the multiple functional blocks.

[0131] In some embodiments, the device 500 also includes a second receiving module configured to receive another user input expressed in a natural language from the user; a parsing module configured to parse the other user input to determine another task to be performed; and a second execution module configured to execute the other task using a combined set of functional blocks in response to determining that the task is of the same type as the other task.

[0132] In some embodiments, the apparatus 500 further includes a generating module configured to generate an application using the combined set of function blocks; and a second adding module configured to add the application to a function block library including a plurality of function blocks.

[0133] In some embodiments, the generation module is further configured to generate the application in response to determining that the received user input associated with the type of task satisfies a threshold condition.

[0134] In some embodiments, the generation module is further configured to: determine that the user input meets the threshold condition in response to at least any one of the following: the number of user inputs exceeds a threshold number; the frequency of user inputs exceeds a threshold frequency.

[0135] In some embodiments, the plurality of function blocks are provided by a function block library and include at least any one of the following: an application, a component in an application.

[0136] In some embodiments, the user input includes a multimodal form, and the multimodal form includes at least any one of the following: text input describing the user's intention in natural language, voice input, image input, video input.

[0137] Figure 6 A flow chart of a method 600 for processing a task according to some embodiments of the present disclosure is shown. At box 610, based on the user intent identified for the user input, a task to be performed is determined. At box 620, the task is performed using a set of function blocks provided by a low-code platform. At box 630, in response to a preset condition being met, an application for performing the task is generated based on the set of function blocks.

[0138] In some embodiments, the method 600 further includes determining that the preset condition is satisfied in response to at least one of the following: the number of times the task is executed exceeds a threshold number; the frequency of executing the task exceeds a threshold frequency; an application generation instruction input by a user is received. In some embodiments, the method 600 further includes: adding the application to a function block library including a plurality of function blocks.

[0140] Figure 7 FIG. 7 is a block diagram of an apparatus 700 for processing tasks according to some embodiments of the present disclosure. Figure 7 As shown, the device 700 includes: a task determination module 710, configured to determine the task to be executed based on the user intent identified with respect to the user input; an execution module 720, configured to execute the task using a set of function blocks provided by the low-code platform; and a generation module 730, configured to generate an application for executing the task based on the set of function blocks in response to preset conditions being met.

[0141] In some embodiments, the generation module 730 is further configured to: determine that the preset condition is met in response to at least any one of the following: the number of times the task is executed exceeds a threshold number; the frequency of executing the task exceeds a threshold frequency; an application generation instruction input by the user is received.

[0142] In some embodiments, the apparatus 700 further comprises: an adding module configured to add an application to a function block library comprising a plurality of function blocks.

[0143] Figure 8 A block diagram of an electronic device 800 is shown in which one or more embodiments of the present disclosure may be implemented. It should be understood that Figure 8 The electronic device 800 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Figure 8 The electronic device 800 shown can be used to operate Figure 1 The application creation platform 110 is provided.

[0144] like Figure 8As shown, the electronic device 800 is in the form of a general application creation platform. The components of the electronic device 800 may include, but are not limited to, one or more processors or processing units 810, a memory 820, a storage device 830, one or more communication units 840, one or more input devices 850, and one or more output devices 860. The processing unit 810 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 820. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 800.

[0145] The electronic device 800 typically includes a plurality of computer storage media. Such media can be any accessible media that can be obtained by the electronic device 800, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 820 can be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory) or some combination thereof. The storage device 830 can be a removable or non-removable medium, and can include a machine-readable medium, such as a flash drive, a disk, or any other medium, which can be used to store information and / or data and can be accessed within the electronic device 800.

[0147] The electronic device 800 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 8 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 820 may include a computer program product 825 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0148] The communication unit 840 implements communication with other application creation platforms through a communication medium. Additionally, the functions of the components of the electronic device 800 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 800 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0149] The input device 850 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 860 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 800 may also communicate with one or more external devices (not shown) through the communication unit 840 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 800, or communicate with any device (e.g., a network card, a modem, etc.) that allows the electronic device 800 to communicate with one or more other application creation platforms. Such communication may be performed via an input / output (I / O) interface (not shown).

[0150] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0152] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0153] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0154] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0155] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0157] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A method for performing a task, comprising: determining a task to be performed based on the user intent identified with respect to the user input; determining a set of functional blocks based on a plurality of functional blocks and a data flow associated with the task; as well as The task is performed using the combined set of functional blocks.

2. The method of claim 1 , wherein determining the set of functional blocks comprises: Based on the respective description information of the multiple function blocks, a function block matching the task is determined from the multiple function blocks as at least a part of the group of function blocks, and the description information of each function block at least includes a semantic description of the function of the function block.

3. The method according to claim 2, wherein determining a functional block matching the task comprises: Generate a prompt word input based on the description information of each of the plurality of function blocks and the user input; Providing the prompt word input to the model; as well as An indicator of the functional block matching the task is obtained from the model.

4. The method according to claim 3, further comprising: In response to determining that the function block matched to the task includes a plurality of candidate modules for performing at least a portion of the task, providing a prompt of the plurality of candidate modules to the user; as well as Based on the user's selection of a target candidate module among the plurality of candidate modules, other candidate modules except the target candidate module are removed from the functional blocks matching the task.

5. The method according to claim 1, further comprising: determining an order of the set of functional blocks based on the data flow; as well as The set of functional blocks are combined in the order described.

6. The method of claim 5, wherein determining the order of the set of functional blocks comprises: Based on the endpoint data in the data stream, an endpoint function block in the set of function blocks is determined, wherein the endpoint data includes at least any one of the following in the data stream: input data, output data, and the endpoint function block includes at least any one of the following in the set of function blocks: a start module, an end module.

7. The method of claim 6, wherein determining the order of the set of functional blocks further comprises: Based on the interface data of the endpoint functional block, an adjacent functional block adjacent to the endpoint functional block is determined from the group of functional blocks, the endpoint functional block and the adjacent functional block communicate via the interface data, and the adjacent functional block includes at least any one of the following of the endpoint functional block: a predecessor module and a successor module.

8. The method of claim 5, wherein combining the set of functional blocks in the order comprises: For a first functional block and a second functional block in the group of functional blocks, in response to determining that a first format of output data of the first functional block is consistent with a second format of input data of the second functional block, the first functional block and the second functional block are combined, and the first functional block and the second functional block are adjacent functional blocks arranged in the order.

9. The method according to claim 8, further comprising: The combined first function block and the second function block are added to a cache of a function block library including the plurality of function blocks to form a third function block, the input data of the third function block being the same as the input data of the first function block, and the output data of the third function block being the same as the input data of the second function block.

10. The method according to claim 9, further comprising: In response to determining that the first format and the second format are inconsistent, Converting the first format into the second format using a conversion module; as well as The first functional block, the conversion module, and the second functional block are combined.

11. The method according to claim 8, further comprising: The conversion module is added to a function module library including the plurality of function blocks.

12. The method according to claim 8, wherein the conversion module is obtained based on at least any one of the following: a function block defined based on the first format and the second format; A third-party function block is obtained based on the first format and the second format.

13. The method according to claim 1, further comprising: In response to determining that the plurality of function blocks cannot perform at least a portion of the tasks, creating a function block for performing the at least a portion of the tasks based on any one of the following: rewriting a functional block among the plurality of functional blocks; as well as A new function block different from the plurality of function blocks is created.

14. The method according to claim 1, further comprising: receiving another user input in natural language from the user; parsing the other user input to determine another task to be performed; as well as In response to determining that the task and the another task are of the same type, the another task is performed using the combined set of function blocks.

15. The method according to claim 1, further comprising: generating an application using the combined set of functional blocks; as well as The application is added to a function block library including the plurality of function blocks.

16. The method of claim 15, wherein generating the application comprises: In response to a preset condition being satisfied, the application is generated.

17. The method according to claim 16, further comprising determining that the preset condition is satisfied in response to at least any one of the following: the number of times the task is performed exceeds a threshold number; The frequency of performing the task exceeds a threshold frequency; The application generates an instruction received from the user.

18. The method according to claim 1, wherein the plurality of function blocks are provided by a function block library and include at least any one of the following: an application, a component in an application.

19. The method according to claim 1, wherein the user input comprises a multimodal form, and the multimodal form comprises at least any one of the following: text input, voice input, image input, video input that describes the user intention in a natural language.

20. An apparatus for performing a task, comprising: a task determination module configured to determine a task to be performed based on the user intention identified with respect to the user input; a function block determination module configured to determine a group of function blocks based on a plurality of function blocks and a data flow associated with the task; as well as The execution module is configured to execute the task by utilizing the group of combined functional blocks.

21. A device for performing a task, comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the device to perform the method according to any one of claims 1 to 19.

22. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 19.

23. A method for processing a task, comprising: determining a task to be performed based on the user intent identified with respect to the user input; Utilize a set of functional blocks provided by the low-code platform to perform the tasks; as well as In response to a preset condition being satisfied, an application for executing the task is generated based on the set of functional blocks.

24. The method according to claim 23, further comprising determining that the preset condition is satisfied in response to at least any one of the following: the number of times the task is performed exceeds a threshold number; The frequency of performing the task exceeds a threshold frequency; The application generates an instruction received from the user.

25. The method of claim 23, further comprising: The application is added to a function block library including the plurality of function blocks.

26. An apparatus for processing a task, comprising: a task determination module configured to determine a task to be performed based on the user intent identified with respect to the user input; An execution module, configured to execute the task using a set of function blocks provided by the low-code platform; as well as The generating module is configured to generate an application for executing the task based on the set of function blocks in response to a preset condition being satisfied.

27. An apparatus for processing a task, comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the device to perform a method according to any one of claims 23 to 25 when executed by the at least one processing unit.

28. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 23 to 25.

Citation Information

Cited By

  • Method, apparatus, device, and medium for generating workflow

    WO2026112899A1