Methods, apparatus, devices, and storage media for application processing.

Abstract

Embodiments of this disclosure provide methods, apparatus, devices, and storage media for application processing. The method includes receiving a first session message from the user in a session window between the user and a digital assistant indicating a user request for creation or modification of a target application; determining a number of sub-demands included in the user request based on capability information related to the application processing capabilities of the application creation platform and interaction information within the session window; and, in response to receiving confirmation from the user of the sub-demands, performing application processing operations associated with the sub-demands. This makes it easier to clarify user requests through interaction with a digital assistant during application creation or modification and allows the user request to be broken down into specific sub-demands that the application creation platform can support and fulfill. This helps to ensure consistency between user requests and platform capabilities and improve the user experience.

Description

Technical Field

[0001] Cross-reference to Related Applications This application claims the priority of a Chinese patent application filed on May 24, 2023, with the invention name of "Method, Apparatus, Device and Storage Medium for Application Processing" and the application number of 202310594216.4. The entire content of this application is incorporated herein by reference.

[0002] Exemplary embodiments of the present disclosure generally relate to the field of computers, and particularly to a method, apparatus, device for application processing and a computer-readable storage medium.

Background Art

[0003] With the rapid development of Internet technology, various applications have already become important tools in people's daily lives. Different applications have different functions, and users can realize specific services with specific applications having specific functions. Application creation platforms, especially low-code platforms, can support users to efficiently develop applications and realize operations such as application creation and application function adjustment.

Summary of the Invention

[0004] A first aspect of this disclosure provides a method for application processing. This method includes receiving a first session message from the user in a session window between the user and a digital assistant indicating a user request for creation or modification of a target application; determining a plurality of sub-requests included in the user request based on capability information relating to the application processing capabilities of the application creation platform and interaction information within the session window, wherein the plurality of sub-requests are associated with application processing operations provided by the application creation platform; and performing the application processing operations associated with the plurality of sub-requests in response to receiving confirmation from the user for the plurality of sub-requests.

[0005] A second aspect of the present disclosure provides an apparatus for application processing. The apparatus includes a message receiving module configured to receive a first session message from a user in a session window between the user and a digital assistant indicating a user request for creation or modification of a target application; a sub-demand determination module configured to determine a plurality of sub-demands included in the user request based on capability information relating to the application processing capabilities of an application creation platform and interaction information in the session window, wherein the plurality of sub-demands are associated with application processing operations provided by the application creation platform; and an operation execution module configured to perform application processing operations associated with the plurality of sub-demands in response to receiving user confirmation for the plurality of sub-demands.

[0006] A third aspect of the present disclosure provides an electronic device, which includes at least one processing unit and at least one memory coupled to the at least one processing unit, and at least one memory for storing instructions to be executed by the at least one processing unit. The instructions cause the electronic device to perform the method of the first aspect when executed by the at least one processing unit.

[0007] A fourth aspect of this disclosure provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the method of the first aspect is realized.

[0008] It should be understood that the content described in this section is not intended to limit the main or important features of the embodiments of this disclosure, nor to limit the scope of this disclosure. Other features of this disclosure will be readily apparent from the following description. [Brief explanation of the drawing]

[0009] The above and other features, advantages and aspects of each embodiment of this disclosure will become more apparent when viewed in conjunction with the drawings and the following detailed description. In the drawings, the same or similar drawing marks represent the same or similar elements. [Figure 1] A schematic diagram of an exemplary environment capable of realizing the embodiments of this disclosure is shown. [Figure 2] A flowchart illustrating the application processing steps according to some embodiments of this disclosure is shown. [Figure 3A] A schematic diagram of a session window according to some embodiments of this disclosure is shown. [Figure 3B] A schematic diagram of a session window according to some embodiments of this disclosure is shown. [Figure 4] A schematic diagram of a session window according to several other embodiments of this disclosure is shown. [Figure 5]The following are exemplary structural block diagrams of application processing apparatus according to some embodiments of this disclosure. [Figure 6] A block diagram of an electronic device capable of carrying out one or more embodiments of this disclosure is shown. [Modes for carrying out the invention]

[0010] The embodiments of this disclosure will be described in more detail below with reference to the drawings. While the drawings show some embodiments of this disclosure, it should be understood that this disclosure can be implemented in various forms and should not be interpreted as being limited to the embodiments described herein. Rather, these embodiments are provided to provide a clearer and more complete understanding of this disclosure. It should be understood that the drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0011] In the descriptions of the embodiments of this disclosure, “including” and similar terms should be understood as open inclusion, i.e., “including, but not limited to.” The term “based on” should be understood as “at least partially based on.” The term “one embodiment” or “this embodiment” should be understood as “at least one embodiment.” The term “several embodiments” should be understood as “at least several embodiments.” The following may also include other explicit and implicit definitions.

[0012] In this specification, unless otherwise specified, performing a step in response to "A" does not mean performing that step immediately after "A," and may include one or more intermediate steps.

[0013] To ensure that this is understood, all data relating to this proposed technology (including, but not limited to, the data itself, its acquisition, use, storage, or deletion) shall comply with the requirements of applicable laws, regulations, and related provisions.

[0014] To ensure understanding, before using any of the technical proposals disclosed in each embodiment of this disclosure, you must notify the relevant user in an appropriate manner in accordance with applicable laws and regulations of the type of information related to this disclosure, the scope of use, and the circumstances of use, and obtain the permission of the relevant user, where the relevant user may include any type of rights holder, such as an individual, a company, or an organization.

[0015] For example, when responding to a user's voluntary request, prompt information is sent to the relevant user, clearly indicating to the relevant user that the operation requested to be performed requires the acquisition and use of the relevant user's information, thereby allowing the relevant user to autonomously choose whether or not to provide information to software or hardware such as electronic devices, application programs, servers, or storage media that perform the operation of the proposed technical method of this disclosure based on the prompt information.

[0016] As a selective but non-restrictive form of implementation, a method for responding to a voluntary request from a relevant user and sending prompt information to that user may be, for example, a pop-up window, in which the prompt information can be presented in text. The pop-up window may also include selection controls for the user to choose whether to "agree" or "disagree" to providing information to the electronic device.

[0017] To ensure that this is understood, the above notice and user permission process are illustrative only and not limited to the forms of implementation of this disclosure. Other methods that comply with applicable laws and regulations may be used to implement this disclosure.

[0018] In the early stages of development, users may need to rely on extensive manual research to gather demand for the application, and then input specific demands into the application creation platform. As a result, traditional methods are labor-intensive and relatively costly. Furthermore, if users do not fully understand the application creation platform, they may mistakenly believe that some of the collected demands will not be met by the platform, or that some of the demands cannot be realized by the platform. Therefore, accurately determining and meeting the specific needs of the users of the developed application is a crucial task in the application development cycle.

[0019] The embodiments of this disclosure provide a proposed improvement to application processing in an application creation platform. Based on this proposal, the application creation platform receives session messages from the user within a session window with the user and the digital assistant, indicating user needs. Based on capability information related to the application processing capabilities of the application creation platform and interaction information within the session window, it determines multiple sub-needs associated with application processing operations provided by the application creation platform that are included in the user needs. If user confirmation for multiple sub-needs is received, the application processing operations associated with the multiple sub-needs are executed. In this way, user needs can be easily clarified through interaction with the digital assistant during application creation or adjustment, and user needs can be broken down into specific sub-needs that the application creation platform can support and fulfill. This helps to ensure consistency between user needs and platform capabilities and improve the user experience.

[0020] Figure 1 shows a schematic diagram of an exemplary environment 100 that can be realized herein by embodiments of the present disclosure. As shown in Figure 1, the application creation platform 110 can provide an application development and deployment environment. In some embodiments, the application creation platform 110 may be a low-code platform that provides a collection of application development tools. The application creation platform 110 can accelerate the application development cycle and cost by supporting visualized development for applications, thereby skipping the process of manual coding by developers. The application creation platform 110 can support any suitable platform for user-developed applications, which may include, for example, a platform based on an application platform, i.e., aPaaS (a Platform as a Service).

[0021] The application creation platform 110 can run on a suitable electronic device. The electronic device here may be a device having any type of computing ability, including a terminal device or a service terminal device. The terminal device may be any type of mobile terminal, fixed terminal or portable terminal, such as a mobile phone, desktop computer, laptop computer, notebook computer, netbook computer, tablet computer, media computer, multimedia tablet, personal communication system (PCS) device, personal navigation device, personal digital assistant (PDA), audio / video player, digital camera / video camera, positioning device, television receiver, radio broadcast receiver, e-book device, game device or any arbitrary combination of the above, including accessories and peripheral devices of these devices or any arbitrary combination thereof. The service terminal device may include, for example, a computing system / server, such as a mainframe, edge computing node, computing device in a cloud environment, etc.). In some embodiments, the application creation platform 110 can be realized based on cloud services.

[0022] The application creation platform 110 may be deployed locally on the user's terminal device and / or supported by a remote server. In some embodiments, a client of the application creation platform 110 may be run on the terminal device, and this client can support the interaction between the user and the application creation platform 110. When the application creation platform 110 runs locally on the user's terminal device, the user can directly use the client to interact with the local application creation platform 110. When the application creation platform 110 runs on the service terminal device, the service terminal device can realize the supply of the service of the client running on the terminal device based on the communication connection with the terminal device.

[0023] A digital assistant 120 may be deployed on the application creation platform 110. The user 140 can interact with the digital assistant 120 via the application creation platform 110. The digital assistant 120 is used for the interaction with the user 140. The client of the application creation platform 110 can present an interaction window, such as a session window, between the user 140 and the digital assistant 120 through a client interface. The digital assistant 120, as a smart assistant, has smart interaction and information processing capabilities. The user 140 can input session messages within the session window, and the digital assistant 120 provides reply messages in response to the user's session messages. In some embodiments, the session messages within the session window may include messages in a multimodal format, such as text messages (e.g., natural language text), voice messages, image messages, video messages, etc.

[0024] In the application creation platform 110, the digital assistant 120 can be invoked or woken up by an appropriate method (e.g., a shortcut key, button, or voice) to present a session window with the user. In some embodiments, the digital assistant 120 may be included as the user's contact in the current user's contact list in the application creation platform 110, or it may be included in the information flow of a chat component. A session window with the digital assistant 120 can be opened by selecting the digital assistant 120. In some embodiments, a session window with the digital assistant 120 can also be presented by launching the digital assistant 120 in one or more components supported by the application creation platform 110.

[0025] The application creation platform 110 can acquire interaction information (including session messages from the user and response messages from the digital assistant 120) within a session window between the user 140 and the digital assistant 120. In some embodiments, the application creation platform 110 can rely on a model 125 to understand the user's session messages and determine the next steps to be performed. The application creation platform 110 can interact with the model 125 to provide model inputs and obtain corresponding model outputs from the model 125. The model 125 can run on a local or remote server of the application creation platform 110. In some embodiments, the model 125 may be an instrument learning model, a deep learning model, a learning model, a neural network, etc. In some embodiments, the model 125 can be based on a language model (LM). The language model can acquire question-and-answer capabilities by learning from a large vocabulary. The model 125 can also be based on other suitable models.

[0026] The database 130 is used to store data or information necessary for application processing operations performed by the application creation platform 110. For example, the database 130 can store code and descriptive information corresponding to each functional block that makes up the application. The application creation platform 110 can further perform operations such as calling, adding, deleting, and updating functional blocks in the database 130. The database 130 can also store operations that can be performed on different functional blocks. For example, in a scenario where application 150 is created, the application creation platform 110 can construct application 150 by calling the corresponding functional blocks from the database 130.

[0027] It should be understood that the structure and function of Environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0028] Hereinafter, several exemplary embodiments of this disclosure will be described in detail with reference to the drawings.

[0029] Figure 2 shows a flowchart of the application processing step 200 according to some embodiments of the present disclosure. The step 200 may be implemented on the application creation platform 110. For ease of consideration, the step 200 will be described with reference to the environment 100 in Figure 1.

[0030] In block 210, the application creation platform 110 receives a first session message from user 140 within the session window between user 140 and digital assistant 120, the first session message indicating the user's need to create or modify a target application.

[0031] In some embodiments, a client corresponding to the application creation platform 110 may present a session window between the user 140 and the digital assistant 120 in the client interface. The session window may be of any shape, size, color, and position. The session window may include interface elements for information interaction, such as input boxes, message lists, message bubbles, etc. Session messages may contain content in one or more formats, such as text, images, audio, video, etc. The digital assistant 120 can be used to interact with the user 140 while the application creation platform 110 is creating or adjusting an application. The first session message received within the session window may be a message entered by the user 140 via the input box in the session window or by other means (e.g., voice input). Through interaction with the digital assistant 120, the user may indicate whether they wish to develop a new application on the application creation platform or adjust an application that is under development.

[0032] In some cases, the user demand indicated by the first session message may not be accurately understood. For example, if the first session message received by the application creation platform 110 from user 140 is "to make the interface of application A neater," the application creation platform 110 and / or model 125 may not be able to determine, based on this session message, exactly how user 140 wants the interface to be adjusted. In such cases, the application creation platform 110 may not be able to determine the exact sub-demand based on the first session message, and as a result, the operation ultimately performed may not satisfy the user demand. To solve this problem, embodiments of the present disclosure introduce a human-machine interaction mechanism to help the application creation platform 110 and / or model limit the problem domain of the user demand through interaction between the user and a digital assistant.

[0033] Specifically, in block 220, the application creation platform 110 determines multiple sub-demands included in the user demand based on capability information related to the application processing capabilities of the application creation platform 110 and interaction information within the session window, and these multiple sub-demands are associated with application processing operations provided by the application creation platform 110.

[0034] In the embodiments of this disclosure, it is possible to support users in providing relatively broad and general user needs, and to clearly and subdivide these user needs through an interaction process. In the decomposition process, the determined sub-needs are capabilities that the application creation platform 110 can fulfill. In this way, it is possible not only to ensure that the decomposed sub-needs are what the user wants and likes, but also to ensure that the decomposed sub-needs can be fulfilled on the application creation platform 110. In particular, this can significantly improve application development efficiency for users who lack application development capabilities and do not fully understand the specific capabilities of the application creation platform 110.

[0035] In some embodiments, the capability information of the application creation platform 110 can describe each application processing capability that the application creation platform 110 provides at each stage of application creation and application adjustment. In some embodiments, the capability information of the application creation platform 110 can indicate at least one of several candidate functional blocks for composing an application, or at least one candidate operation for the corresponding functional block of the application. Candidate functional blocks can be thought of as modules with a finer granularity than an application, which as a whole can realize a specific function and can be called to build various applications. During application creation or application adjustment, the application creation platform 110 can further provide different candidate operations for various functional blocks. Candidate operations include, but are not limited to, adjustment operations such as calling, adding, modifying, and deleting functional blocks, defining and modifying page layouts, data tables, and data streams corresponding to the adjusted functional blocks.

[0036] In some embodiments, if the user request indicated by the first session message is a request to create a target application, the application creation platform 110 can determine multiple sub-requests for multiple functional blocks to create the target application based on its own capability information and interaction information within the session window. Each sub-request indicates that the corresponding functional block should be added as part of the target application. In some embodiments, after receiving the first session message, the application creation platform 110 can use a pre-defined screening policy to select multiple functional blocks from the database 130, which contains a large number of application functional blocks, that satisfy the user request indicated by this first session message. For example, if the user request is to create a library management system application, the application creation platform 110 can screen the database 130 for book addition functional blocks, book search functional blocks, book modification functional blocks, book deletion functional blocks, borrowing functional blocks, statistical report functional blocks, etc., that can constitute the library management system application, according to this user request. These functional blocks may be functional blocks that the application creation platform 110 has already generated or can generate.

[0037] In some embodiments, if the user request indicated by the first session message is a user request for adjustments to the target application, the application creation platform 110 can determine at least one candidate operation for the corresponding functional block of the application 150 that satisfies this user request and that the platform itself can implement. For example, if the user request indicates an adjustment to the page layout corresponding to functional block A in the target application, the application creation platform 110 can determine at least one candidate operation that the platform itself can perform on the page layout of functional block A, such as adding, deleting, or displacing each operation control on the page, in response to this user request.

[0038] In some embodiments, the application creation platform 110 can further rely on the model 125 to decompose user demand and determine multiple sub-demands included in the user demand. The application creation platform 110 can generate keyword inputs for the model 125 based on session messages and capability information from the user 140 in the interaction information, and the keyword inputs describe at least a portion of the user demand indicated by the session messages and the capability information of the platform itself. Specifically, after obtaining session information from the user 140, the application creation platform 110 determines at least a portion of the capability information from the platform itself that is associated with the user demand indicated by the session messages. The application creation platform 110 can then populate the input template of the model 125 with these session messages and at least a portion of the capability information using prompt engineering to obtain keyword inputs that conform to the input format of the model 125. Furthermore, after generating the keyword inputs, the application creation platform 110 can provide the keyword inputs to the model 125 to obtain instructions from the model 125 related to multiple sub-demands. Instructions related to multiple sub-demands may include, for example, the names and identifiers of the multiple sub-demands, and the application processing operations associated with the multiple sub-demands. For example, if the multiple sub-demands correspond to multiple functional blocks for creating an application, Model 125 can specify the functions realized by the multiple functional blocks, the identifiers of the multiple functional blocks in the application creation platform 110, and descriptions of the specific components within the functional blocks. If the multiple sub-demands correspond to multiple operations for adjusting the application, Model 125 can specify the names of the multiple operations, the targets realized by the multiple operations, and the specific execution methods of the multiple operations. In some embodiments, the instructions provided by Model 125 may include instructions related to candidate sub-demands.The application creation platform 110 selects multiple sub-demands based on the output from model 125.

[0039] In the process of determining multiple sub-demands included in user demand, the user and the digital assistant can be allowed to interact once or more to accurately determine multiple sub-demands that meet the user's expectations. In some embodiments, after receiving a first session message, the application creation platform 110 can determine multiple candidate sub-demands that satisfy the user demand based on the information from the first interaction, in conjunction with its own capability information, and then adjust the multiple candidate sub-demands based on the information from at least one subsequent interaction to determine the multiple sub-demands included in the user demand.

[0040] Specifically, the application creation platform 110 can respond to a first session message from the user 140 and determine several candidate sub-demands included in the user demand based on capability information. The application creation platform 110 can then present a response message to the first session message within the session window, corresponding to the determined candidate sub-demands. This response message includes at least descriptions of the candidate sub-demands. In this way, the user can understand how the application creation platform 110 will fulfill the user's needs for application creation or modification.

[0041] In some embodiments, the decision on multiple candidate sub-demands can also be achieved by Model 125. The application creation platform 110 can generate keyword inputs for Model 125 based on the first session message and at least some of the capability information. The application creation platform 110 provides these keyword inputs to Model 125 and obtains instructions from Model 125 for multiple candidate sub-demands that satisfy the user demand. The application creation platform 110 presents the user with multiple candidate sub-demands within the user-digital assistant dialogue window, allowing the user to confirm or input adjustment feedback.

[0042] Figure 3A shows a schematic diagram of a session window 300A according to some embodiments of the present disclosure. User A in session window 300A may be the user display (e.g., name) of User 140 in the session window in Figure 1. Hereinafter, User A will refer to User 140. As shown in Figure 3A, the application creation platform 110 can obtain session message 310-1, "Build a library management system," from User A in session window 300A. Session message 310-1 is the first session message mentioned above. The application creation platform 110 can provide session message 310-1 and its own capability information together to Model 125.

[0043] In some embodiments, since the user demand indicated by session message 310-1 is a user demand that instructs the creation of a target application, the determined capability information of the application creation platform 110 can indicate multiple candidate functional blocks for constituting the application 150. After obtaining session message 310-1 and the capability information of the application creation platform 110, Model 125 can determine multiple functional blocks for constituting the target application from the multiple candidate functional blocks indicated by the capability information, based on session message 310-1. Model 125 can determine multiple candidate sub-demands corresponding to these multiple functional blocks. The relationship between the candidate sub-demands and functional blocks here may be one-to-one; for example, the sub-demand for statistical reports may correspond to statistical functional blocks.

[0044] In some embodiments, the application creation platform 110 can provide the model with a sub-demand determination policy, capability information, and session message 310-1 together. The sub-demand determination policy can be configured so that the output from the model 110 conforms to the specifications of the application creation platform 110 or to the specific requirements of a particular scene. The sub-demand determination policy can be customized and configured according to the platform configuration or specific application scenario. For example, the application creation platform 110 can configure the sub-demand determination policy to be a limit on the number of determined candidate sub-demands, for example, "the number of determined candidate sub-demands is 10 or less." Based on the sub-demand determination policy and session message 310-1, the model 110 can determine multiple functional blocks to constitute the target application from multiple candidate functional blocks indicated by the capability information. The model 125 can determine the number of these multiple functional blocks, and if the number is greater than 10, it can determine 10 functional blocks from the multiple functional blocks and further determine 10 candidate sub-demands corresponding to these 10 functional blocks. The ten functional blocks here may be determined randomly by Model 125 from multiple functional blocks, or they may be determined based on the relevance of multiple functional blocks to user demand. If the number is 10 or less, Model 110 can determine multiple candidate sub-demands corresponding to these multiple functional blocks. By providing additional sub-demand determination policies, the output of Model 125 can be more constrained, and by more closely aligning Model 125's decisions on sub-demands with the specific requirements of a particular scene and platform, the model output can be used more effectively to complete subsequent application processing.

[0045] The application creation platform 110 can obtain multiple candidate sub-demands output from the model 125 and determine a response message 320-1 to the session message 310-1 based on these candidate sub-demands. The application creation platform 110 further presents the response message 320-1 to the session window 300A, and the response message 320-1 includes at least descriptions 322 (descriptions for the corresponding functional blocks) for the multiple candidate sub-demands. To understand this, the session message 310-1 and the response message 320-1 constitute the information for the first interaction between user A and the digital assistant.

[0046] In some embodiments, the session window 300A further includes an input box 305 and a plurality of operation controls, which may include, for example, a preview control 301, an application generation control 302, a collection addition control 303, and a data model viewing control 304. In some embodiments, the plurality of operation controls can be associated with interaction information within the session window 300A. For example, if the interaction information is associated with application creation, the operation controls within the session window 300A may include operation controls associated with application creation (e.g., a collection addition control 303), and if the interaction information is associated with a tuning application, the operation controls within the session window 300A may include operation controls associated with the tuning application (e.g., a size adjustment control).

[0047] In some embodiments, the application creation platform 110 can further respond to receiving a selection operation on an operation control by user A by presenting a corresponding session message in the session window 300A. The selection operation may be, for example, a click operation, a long press operation, or a slide operation on the operation control. As shown in Figure 3A, the application creation platform 110 can respond to receiving a selection operation on the collection addition control 303 by presenting a corresponding session message 310-2, "Add Collection Function," in the session window 300A. In some embodiments, the session message 310-2 may be a message entered by user A through the input box 305.

[0048] The application creation platform 110 can determine multiple sub-demands based on user feedback to response messages from user 140. This user feedback may include, for example, selection operations on the relevant operation controls within the user's session window. Exemplarily, the application creation platform 110 can present a response message and, at the same time, display operation controls associated with the user feedback within the session window, such as an add control or a delete control. The application creation platform 110 can respond to receiving a selection operation on a certain operation control and determine that it has received the corresponding user feedback (for example, in response to receiving a selection operation on an operation control indicating additional function A, it can determine that it has received user feedback for adding a sub-demand, and that this newly added sub-demand indicates a function block corresponding to additional function A). This user feedback may further include, for example, session messages in response to response messages from user 140 within the session window.

[0049] The application creation platform 110 can continue to receive further interaction information within the session window, such as a second session message from user 140. If the second session message includes confirmation of multiple candidate sub-demands, the application creation platform 110 can determine that the multiple candidate sub-demands are the sub-demands desired by the user. If the second session message includes adjustments to the multiple candidate sub-demands, the application creation platform 110 can adjust the multiple candidate sub-demands previously determined based on the second session message. This interaction process can be executed multiple times until the user can determine the multiple sub-demands they like.

[0050] In some embodiments, adjustments to multiple candidate sub-demands include at least one of the following: adding at least one new sub-demand; removing at least one of the multiple candidate sub-demands; and modifying at least one of the multiple candidate sub-demands. For example, if the multiple candidate sub-demands include sub-demand A, sub-demand B, and sub-demand C, adding at least one new sub-demand might be, for example, adding sub-demand D, and the multiple sub-demands thus determined would include sub-demand A, sub-demand B, sub-demand C, and sub-demand D. Removing at least one of the multiple candidate sub-demands might be, for example, removing sub-demand C, and the multiple sub-demands thus determined would include only sub-demand A and sub-demand B. Modifying at least one of the multiple candidate sub-demands might be, for example, modifying sub-demand A to sub-demand A1, and the multiple sub-demands thus determined would include sub-demand A1, sub-demand B, and sub-demand C.

[0051] Similarly, in some embodiments, the application creation platform 110 can generate keyword inputs based on a second session message and provide them to the model 125, and retrieve multiple sub-demands obtained after adjusting multiple candidate sub-demands output from the model 125. In some embodiments, the second session message may include not only instructions for adjusting candidate sub-demands, but also a description of the previously outputted multiple candidate sub-demands. The application creation platform 110 can generate keyword inputs for the model 125 based on the second session message. Since each process in the model 125 may need to re-extract contextual information of the interaction in order to facilitate understanding of the session message input by the user, explicitly indicating sufficient information such as what is being adjusted in the session message (i.e., multiple candidate sub-demands) and specific adjustment targets can significantly reduce model processing time and improve the overall efficiency of demand confirmation.

[0052] Figure 3B shows a schematic diagram of a session window 300B according to some embodiments of the present disclosure. Similarly, user A in session window 300B may be the user display in the session window of user 140 in Figure 1. As shown in Figure 3B, the application creation platform 110 can obtain a session message 310-2, "Add Collection Function," from user A in session window 300B. Session message 310-2 is the second session message mentioned above. The application creation platform 110 can provide session message 310-2 to model 125. In some embodiments, the application creation platform 110 can further first identify session message 310-2 and determine the capability information associated with session message 310-2. The application creation platform can provide session message 310-2 and the capability information associated with session message 310-2 together to model 125 (for example, by constructing a keyword input scheme). In some examples, although not illustrated, session message 310-2 may further include descriptions of several second candidate sub-demands given in session message 320-1.

[0053] Model 125 can determine the type of adjustment (i.e., addition, deletion, modification, etc.) for multiple candidate sub-demands indicated based on session message 310-2. After determining the instruction to add a sub-demand in session message 310-2, Model 125 can determine at least one second candidate sub-demand that satisfies the newly added sub-demand in conjunction with the capability information associated with session message 310-2. Since candidate sub-demands and functional blocks correspond to each other, the second candidate sub-demand here may correspond to a sub-function of a functional block. The working process of Model 125 can be understood as a decomposition process of demands, and Model 125 can decompose the user demand indicated by the first session message into at least one candidate sub-demand, and further decompose the sub-demand indicated by the second session message into at least one second candidate sub-demand (i.e., determine the functional block that constitutes the target application, and the sub-function that constitutes the functional block).

[0054] The application creation platform 110 can obtain multiple second candidate sub-demands output from the model 125 and determine a response message 320-2 for the session message 310-2 based on the multiple second candidate sub-demands. The application creation platform 110 further presents the response message 320-2 to 300B in the session window, and the response message 320-2 includes at least descriptions of the multiple second candidate sub-demands. To understand this, the session message 310-2 and the response message 320-2 constitute second interaction information between user A and the digital assistant.

[0055] To make it clearer, the application creation platform 110 can further acquire a third session message, a fourth session message, and so on from user A within the session window. The embodiments of this disclosure do not limit the number of interaction information. In this way, the application creation platform 110 can accurately decompose user demands into multiple sub-demands based on interaction information between user 140 and the digital assistant 120 over multiple occasions, which helps improve the accuracy of performing application processing operations associated with subsequent sub-demands.

[0056] In some embodiments, the application creation platform 110 can determine multiple sub-demands by adjusting at least one candidate sub-demand based on multiple session messages. In addition to decomposing user demand, in some embodiments, the application creation platform 110 can further decompose a sub-demand based on multiple session messages, which helps to further improve the accuracy of the determined sub-demands and further enhance the user experience.

[0057] The above describes an example where the user demand is a user demand instructing the creation of a target application, linking Figures 3A and 3B. The following describes the case where the user demand is a user demand instructing the modification of at least a part of the target application. In some embodiments, when the user demand is a user demand instructing the modification of at least a part of the target application, the application creation platform 110 can determine multiple sub-demands that instruct multiple operations to modify the target application, or at least multiple operations to complete the modification of the target application, based on its own capability information and interaction information within the session window. Similar to the case where the user demand is a user demand instructing the creation of a target application, the application creation platform 110 can determine multiple sub-demands included in the user demand based on interaction information between the user 140 and the digital assistant 120, linked to its own capability information.

[0058] Figure 4 shows a schematic diagram of a session window 400 according to some embodiments of the present disclosure. Similarly, User A in the session window 400 may be the user representation of User 140 in the session window in Figure 1. As shown in Figure 4, the application creation platform 110 can obtain a session message 410 from User A in the session window 400, which is "How to connect to an external target within Application A?". The application creation platform 110 can provide capability information and the session message 410 to Model 125 and obtain a number of candidate sub-demands that satisfy the user demand and platform capability information output from Model 125. Since the user demand indicated by the session message 410 is a user demand that instructs adjustments to at least a part of the target application (i.e., the method of connecting Application A to the external), the determined capability information of the application creation platform 110 can instruct at least one candidate operation for the functional block of Application A corresponding to the method of connecting to the external. After acquiring the session message 410 and capability information from the application creation platform 110, Model 125 can determine at least one target operation for a functional block from a plurality of candidate operations indicated by the capability information, based on the session message 410. Model 125 can determine a plurality of sub-demands corresponding to these multiple target operations. Here, the sub-demands and target operations may have a one-to-one correspondence. The application creation platform 110 acquires the plurality of sub-demands output from Model 125 and can determine a response message 420 to the session message 410 according to these plurality of sub-demands. The application creation platform 110 further presents the response message 420 to 400A in the session window.

[0059] In some embodiments, the application creation platform 110 may further receive a second session message from user A in the session window 400, instructing adjustments to multiple candidate sub-demands. Similarly, in some embodiments, the application creation platform 110 may provide the second session message to model 125 and retrieve the multiple sub-demands obtained after adjusting the multiple candidate sub-demands output from model 125. As can be understood, the application creation platform 110 may further retrieve a third session message, a fourth session message, and so on from user 140 in the session window 400. The embodiments of this disclosure do not limit the number of interaction information.

[0060] In some embodiments, if it is not possible to determine multiple sub-demands that satisfy the user demand, the application creation platform 110 may present a response message in the session window indicating that it is not possible to determine the demand. For example, if the first session message from user 140 is "How do you make scrambled eggs with tomatoes?", and the application creation platform 110 determines that there are no multiple sub-demands that satisfy the user demand, it may present a response message in the session window such as "Sorry, this is the application creation assistant. I cannot answer your question about scrambled eggs with tomatoes."

[0061] In some embodiments, if the user needs indicated by the first session message from user 140 are unclear, the application creation platform 110 can provide clear guidance on the user needs within the session window. For example, if the first session message from the user is "Please make this interface nicer," and the application creation platform 110 is unable to determine how the user should specifically modify the interface, it can provide a response message within the session window such as "Okay, but could you tell me how you want it to be nicer?"

[0062] Alternatively or additionally, in some embodiments, the application creation platform 110 may further guide the user 140 to clarify user needs by adding clear guidance in an optional appropriate response message. Refer back to Figure 3A. As shown in Figure 3, the response message 320 further includes clear guidance 324 for user needs. The clear guidance 324 may guide the user to further describe the user needs of the user itself, and if the candidate sub-demands described in the response message cannot fully meet the user needs, the user has a chance to further clarify the demands (e.g., additions or modifications) to ensure consistency between the determined sub-demands and the user needs.

[0063] Continuing to refer to Figure 2, in block 230, the application creation platform 110 responds to receiving confirmation from user 140 for multiple sub-demands and executes application processing operations associated with the multiple sub-demands.

[0064] In some embodiments, the application creation platform 110 may receive session messages instructing confirmation of multiple sub-demands from user 140 within a session window. For example, if the user demand is to instruct the creation of a target application, the session messages instructing confirmation of the multiple sub-demands may be, for example, "decide to create the application."

[0065] In some embodiments, the application creation platform 110 can further determine that it has received confirmation for multiple sub-demands from user 140 in response to receiving a selection operation for an operation control that instructs application creation within the session window. Returning to Figure 3A, the application creation platform 110 can determine that it has received confirmation for multiple sub-demands in response to receiving a selection operation for an application generation control 302.

[0066] The multiple sub-demands here are the final multiple sub-demands determined by the multiple adjustments described above. In response to receiving confirmation from user 140 regarding the multiple sub-demands, the application creation platform 110 can perform operations associated with the multiple sub-demands (for example, creating an application and adjusting at least one component of the application). In some embodiments, the application creation platform 110 can save the acquired candidate sub-demands in the form of a form and modify this form in response to modifications to the candidate sub-demands. The demands finally saved in this form are the multiple sub-demands that satisfy the finally determined user demands. Based on this form, the application creation platform 110 can directly perform operations associated with the multiple sub-demands. Saving the sub-demands in the form of a form helps to avoid missing adjustments for a given round and helps to ensure the accuracy of the finally determined sub-demands. In some embodiments, this form can be provided to model 125 as capability information.

[0067] In some embodiments, the application creation platform 110 can respond to user 140's preview requests during and after the execution of an operation, and present the user 140 with the final effect corresponding to the operation. For example, using application creation as an example, the application creation platform 110 can respond to user 140's preview requests and present the user 140 with the final created application. This makes it easy for the user to modify the created application in a timely manner and ensures consistency between the final generated application and the user.

[0068] According to embodiments of this disclosure, a session message indicating user needs is received from the user within a session window between the user and the digital assistant. Based on capability information related to the application processing capabilities of the application creation platform and interaction information within the session window, multiple sub-demands associated with application processing operations provided by the application creation platform, which are included in the user needs, are determined. If user confirmation for multiple sub-demands is received, the application processing operations associated with the multiple sub-demands are executed. In this way, user needs can be easily clarified through interaction with the digital assistant during application creation or adjustment, and user needs can be broken down into specific sub-demands that the application creation platform can support and fulfill. This helps to ensure consistency between user needs and platform capabilities and improve the user experience.

[0069] Figure 5 shows an exemplary structural block diagram of an application processing apparatus 500 according to some embodiments of the present disclosure. The apparatus 500 may be implemented or included in, for example, an application creation platform 110. Each module / component within the apparatus 500 may be implemented by hardware, software, firmware, or any combination thereof.

[0070] As shown in the figure, the device 500 includes a message receiving module 510 configured to receive a first session message from the user in a session window between the user and the digital assistant, indicating a user request for creation or modification of a target application. The device 500 further includes a sub-demand determination module 520 configured to determine a plurality of sub-demands included in the user request based on capability information related to the application processing capabilities of the application creation platform and interaction information within the session window, the plurality of sub-demands being associated with application processing operations provided by the application creation platform. The device 500 further includes an operation execution module 530 configured to perform the application processing operations associated with the plurality of sub-demands in response to receiving user confirmation for the plurality of sub-demands.

[0071] In some embodiments, capability information indicates at least one of several candidate functional blocks for configuring the application and at least one candidate operation for the corresponding functional block of the application.

[0072] In some embodiments, the sub-demand determination module 520 includes a first keyword input generation module configured to generate a first keyword input to a model based on a first session message and capability information, wherein the first keyword input describes at least a portion of the user demand and capability information; a first input providing module configured to provide the first keyword input to the model; and a first instruction acquisition module configured to acquire instructions related to a plurality of sub-demands from the model.

[0073] In some embodiments, the sub-demand determination module 520 includes a first sub-demand determination module configured to determine a plurality of sub-demands for creating a target application based on capability information of the application creation platform and interaction information within the session window, when user demand instructs the creation of a target application, and the plurality of sub-demands instruct at least a plurality of functional blocks for comprising the target application.

[0074] In some embodiments, the sub-demand determination module 520 includes a second sub-demand determination module configured to determine a plurality of sub-demands for adjusting the target application based on capability information of the application creation platform and interaction information within the session window, when user demand indicates adjustments to at least a portion of the target application, and the plurality of sub-demands indicate at least a plurality of operations for completing the adjustments to the target application.

[0075] In some embodiments, the sub-demand determination module 520 includes a candidate sub-demand determination module configured to respond to a first session message from the user and determine a plurality of candidate sub-demands that satisfy the user demand based on capability information of the application creation platform; a response message presentation module configured to present a response message to the first session message within a session window, wherein the response message includes a response message presentation module which includes at least a description of the plurality of candidate sub-demands; and a third sub-demand determination module configured to determine a plurality of sub-demands based on user feedback to the response message from the user.

[0076] In some embodiments, the third sub-demand determination module is a second session message receiving module configured to receive a second session message from a user within a session window, the second session message receiving module comprising a second session message receiving module wherein the second session message comprises at least adjustments to a plurality of candidate sub-demands, and a fourth sub-demand determination module configured to determine a plurality of sub-demands based on at least the second session message.

[0077] In some embodiments, adjustments to multiple candidate sub-demands include at least one of the following: increasing at least one new sub-demand; removing at least one of the multiple candidate sub-demands; or modifying at least one of the multiple candidate sub-demands.

[0078] In some embodiments, the second session message further includes descriptions of multiple candidate sub-demands. In some embodiments, the fourth sub-demand determination module includes a second keyword input generation module configured to generate a second keyword input to the model based on the second session message, a second input providing module configured to provide the second keyword input to the model, and a second instruction retrieval module configured to retrieve instructions related to multiple sub-demands from the model.

[0079] In some embodiments, the response message further includes clear guidance on user needs to guide the user toward clarifying their needs.

[0080] In some embodiments, the application creation platform includes a platform based on an application platform, i.e., a service (aPaaS).

[0081] The modules included in the device 500 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more modules can be implemented using software and / or firmware, for example, executable instructions for the device stored on a storage medium. In addition to, or as an alternative to, executable instructions for the device, some or all modules within the device 500 can be implemented by at least partially one or more hardware logic components. Examples of hardware logic components that can be used, but are not limited to, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standards (ASSPs), systems on a chip (SOCs), and complex programmable logic devices (CPLDs).

[0082] Figure 6 shows a block diagram of an electronic device 600 that can implement one or more embodiments of the present disclosure. It should be understood that the electronic device 600 shown in Figure 6 is illustrative only and should not constitute any limitation to the functionality and scope of the embodiments described herein. The electronic device 600 shown in Figure 6 can be used to operate the application creation platform 110 of Figure 1.

[0083] As shown in Figure 6, the electronic device 600 is a general-purpose electronic device. The components of the electronic device 600 may include, but are not limited to, one or more processors or processing units 610, memory 620, storage devices 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. The processing unit 610 may be an actual or virtual processor and can perform various processes based on a program stored in memory 620. In a multiprocessor system, multiple processing units execute executable instructions of the computer in parallel to enhance the parallel processing capability of the electronic device 600.

[0084] The electronic device 600 typically includes multiple computer storage media. Such media may be any obtainable media accessible to the electronic device 600, and may include, but are not limited to, volatile and non-volatile media, removable and non-removable media. Memory 620 may be volatile memory (e.g., registers, fast cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or any combination thereof. Storage device 630 may be removable or non-removable media, and may include machine-readable media, such as flash memory drives, magnetic disks, or any other media, which can be used to store information and / or data and can be accessed within the electronic device 600.

[0085] The electronic device 600 may further include other removable / non-removable, volatile / non-volatile storage media. Not shown in Figure 6, a magnetic disk drive for reading from or writing to a removable, non-volatile magnetic disk (e.g., “floppy disk”) and a disk drive for reading from or writing to a removable, non-volatile disk can be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data medium interfaces. The memory 620 may include a computer program product 625 which has one or more program modules, these program modules configured to perform various methods or operations of various embodiments of the present disclosure.

[0086] The communication unit 640 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 600 can be realized by a single computing cluster or multiple computing devices, which can communicate via a communication connection. Therefore, the electronic device 600 can operate in a network environment using logical connections with one or more other servers, network personal computers (PCs), or other network nodes.

[0087] The input device 650 may be one or more input devices, such as a mouse, keyboard, or trackball. The output device 660 may be one or more output devices, such as a display, speaker, or printer. The electronic device 600 may further communicate with one or more external devices (not shown) via a communication unit 640 as needed, and these external devices, such as a storage device or display device, may communicate with one or more devices for user-to-electronic device 600 interaction, or with any devices (e.g., a network card or modem) that communicate with one or more other electronic devices. Such communication may be performed via an input / output (I / O) interface (not shown).

[0088] An exemplary embodiment of the present disclosure provides a computer-readable storage medium in which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to realize the method described above. An exemplary embodiment of the present disclosure further provides a computer program product, which is tangibly stored in a non-transient computer-readable medium and includes computer-executable instructions, wherein the computer-executable instructions are executed by a processor to realize the method described above.

[0089] Each aspect of this disclosure is described here with reference to flowcharts and / or block diagrams of methods, apparatus, devices, and computer program products implemented pursuant to this disclosure. It should be understood that each block in a flowchart and / or block diagram, and each combination of blocks in a flowchart and / or block diagram, can all be implemented by computer-readable program instructions.

[0090] These computer-readable program instructions are provided to a processing unit of a general-purpose computer, a computer for specific purposes, or other programmable data processing device, thereby creating a device that, when executed by the processing unit of the computer or other programmable data processing device, produces a device that implements the functions / operations defined in one or more blocks in a flowchart and / or block diagram. These computer-readable program instructions may be stored in a computer-readable storage medium, and by operating the computer, programmable data processing device, and / or other device in a specific manner, the computer-readable medium on which the instructions are stored includes a product containing instructions in each mode that implements the functions / operations defined in one or more blocks in a flowchart and / or block diagram.

[0091] By loading computer-readable program instructions into a computer, other programmable data processing device, or other device, and by executing a series of operational steps on the computer, other programmable data processing device, or other device, the instructions executed on the computer, other programmable data processing device, or other device can realize the functions / operations defined in one or more blocks in a flowchart and / or block diagram.

[0092] The flowcharts and block diagrams in the drawings illustrate the implementable system architectures, functions, and operations of the systems, methods, and computer program products of the multiple implementations of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or part of an instruction, and a module, program segment, or part of an instruction may contain one or more executable instructions for implementing a defined logical function. In some alternative implementations, the functions represented in the blocks may occur in an order different from the order shown in the drawings. For example, two consecutive blocks may actually be executed almost in parallel, or in reverse order depending on the related functions. Note that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented in a dedicated, hardware-based system that performs the function or operation defined, or in a combination of dedicated hardware and computer instructions.

[0093] The above descriptions of the various implementations of this disclosure are illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and changes will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The choice of terms used herein is intended to best interpret the principles, practical applications, or technological advancements in the market of each implementation, or to enable those skilled in the art to understand each implementation disclosed herein.

Claims

1. An application processing method, Receiving a first session message from the user within the session window between the user and the digital assistant, indicating the user's need to create or modify a target application; Based on capability information related to the application processing capabilities of the application creation platform and interaction information in the session window, a plurality of sub-demands included in the user demand are determined, wherein the plurality of sub-demands are associated with application processing operations provided by the application creation platform. A method comprising receiving confirmation from the user for the plurality of sub-demands and performing the application processing operations associated with the plurality of sub-demands.

2. The aforementioned capability information is, Multiple candidate functional blocks for configuring the application, The method according to claim 1, which directs at least one of at least one candidate operation for the relevant functional block of the application.

3. Determining the aforementioned multiple sub-demands means Based on the first session message and the capability information, a first keyword input is generated for the model, and the first keyword input describes at least a portion of the user demand and the capability information. Providing the aforementioned first keyword input to the model, The method according to claim 1, comprising obtaining instructions related to the plurality of sub-demands from the model.

4. Determining the aforementioned multiple sub-demands means The method according to claim 1, wherein, when the user demand instructs the creation of the target application, a plurality of sub-demands for creating the target application are determined based on the capability information of the application creation platform and the interaction information in the session window, and the plurality of sub-demands instruct a plurality of functional blocks for constituting the target application.

5. Determining the aforementioned multiple sub-demands means The method according to claim 1, wherein, if the user demand instructs adjustments to at least a portion of the target application, a plurality of sub-demands for adjusting the target application are determined based on the capability information of the application creation platform and the interaction information in the session window, and the plurality of sub-demands instruct a plurality of operations for completing the adjustments to the target application.

6. Determining the aforementioned multiple sub-demands means Responding to the first session message from the user, determining a number of candidate sub-demands that satisfy the user's demands based on the capability information of the application creation platform, The session window presents a response message to the first session message, and the response message includes at least a description of the plurality of candidate sub-demands. The method according to claim 1, further comprising determining the plurality of sub-demands based on user feedback to the response message from the user.

7. Determining the multiple sub-demands based on the user's feedback is The session window receives a second session message from the user, and the second session message includes at least an adjustment to the plurality of candidate sub-demands. The method according to claim 6, further comprising determining the plurality of sub-demands based on at least the second session message.

8. The adjustments to the aforementioned multiple candidate sub-demands are, To increase at least one new sub-demand, To remove at least one of the aforementioned multiple candidate sub-demands, The method according to claim 7, comprising modifying at least one of the above-mentioned multiple candidate sub-demands.

9. The second session message further includes a description of the plurality of candidate sub-demands, and hereby, determining the plurality of sub-demands is To generate a second keyword input for the model based on the second session message, Providing the aforementioned second keyword input to the model, The method according to claim 7, comprising obtaining instructions related to the plurality of sub-demands from the model.

10. The method according to claim 7, wherein the response message further includes clear guidance to the user needs to guide the user to clarify the user needs.

11. The method according to any one of claims 1 to 10, wherein the application creation platform includes a platform based on an application platform, i.e., a service (aPaaS).

12. A device for application processing, A message receiving module configured to receive a first session message from the user within a session window between the user and the digital assistant, which indicates the user's request to create or adjust a target application; A sub-demand determination module configured to determine a plurality of sub-demands included in the user demand based on capability information related to the application processing capabilities of the application creation platform and interaction information in the session window, wherein the plurality of sub-demands are associated with application processing operations provided by the application creation platform, Apparatus comprising: an operation execution module configured to perform the application processing operations associated with the plurality of sub-demands in response to receiving confirmation from the user for the plurality of sub-demands.

13. It is an electronic device, At least one processing unit, Electronic device comprising at least one memory, which is coupled to the at least one processing unit and stores instructions to be executed by the at least one processing unit, and which causes the electronic device to perform the method according to any one of claims 1 to 11 when the instructions are executed by the at least one processing unit.

14. A computer-readable storage medium having a computer program stored in it, wherein the computer program can be executed by a processor to realize the method according to any one of claims 1 to 11.

Images