Application creation method and device, equipment and storage medium

By adding configured GUI function blocks to the application, the problems of low user interface efficiency and inflexible interaction methods in the prior art are solved, efficient and flexible user interface interaction are achieved, and task processing efficiency is improved.

CN119088367APending Publication Date: 2024-12-06BEIJING ZITIAO NETWORK TECH CO LTD

Patent Information

Application Number
CN202411132223.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-18
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

The user interface of existing applications is inefficient in handling complex tasks and is difficult to complete interactions through natural language. The traditional GUI interaction method has poor experience and is not flexible enough to provide a rich and diverse graphical user interface and flexible interaction capabilities.

Method used

Provides an application creation method, by receiving instructions to add graphical user interface (GUI) function blocks to the target application, configure the target application to interact with the user in natural language, and add GUI function blocks to the target application based on configuration information to support sessions Interaction and GUI interaction.

Benefits of technology

It realizes rich and changeable GUI function blocks, improves task processing efficiency and interaction efficiency, combines the convenience of CUI and the stability and efficiency of GUI, and supports users' flexible interaction operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119088367A_ABST
    Figure CN119088367A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides an application creation method and device, equipment and a storage medium. The method includes receiving an indication to add a graphical user interface (GUI) function block to a target application. The target application is configured to interact with a user through a natural language, and the GUI functionality is used to present interaction messages in a GUI in a session with the user. The method also includes determining configuration information for the GUI function block. The configuration information at least indicates a presentation style of the interaction message. The method further comprises the step of adding a GUI function block in the target application based on the configuration information. The GUI function block created in this way supports both session type interaction and GUI interaction, so that the functions of the application can be enriched, and the interaction capability of the application can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to application creation methods, devices, apparatuses, and computer-readable storage media. Background Art

[0002] With the development of information technology, various terminal devices can provide various services to people in work and life. Applications that provide services can be deployed in terminal devices. The terminal devices present corresponding content and interact with users through the user interface of the application to meet various needs of users. Therefore, it is expected to present rich content and provide flexible interaction in the user interface of the application. Summary of the invention

[0003] In a first aspect of the present disclosure, an application creation method is provided. The method includes: receiving an instruction to add a graphical user interface (GUI) function block to a target application. The target application is configured to interact with a user through natural language, and the GUI function block is used to present interactive messages in a session with the user in a GUI. The method also includes determining configuration information for the GUI function block. The configuration information at least indicates a presentation style of the interactive message. The method also includes adding the GUI function block to the target application based on the configuration information.

[0004] In a second aspect of the present disclosure, there is provided an apparatus for application creation, comprising: an instruction receiving module configured to receive an instruction to add a graphical user interface (GUI) function block to a target application, the target application being configured to interact with a user through a natural language, and the GUI function block being used to present interactive messages in a session with the user as a GUI; a determination module configured to determine configuration information for the GUI function block, the configuration information at least indicating a presentation style of the interactive messages; and an adding module configured to add the GUI function block to the target application based on the configuration information.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the electronic device executes the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the medium, and when the computer program is executed by a processor, the method of the first aspect is implemented.

[0007] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0010] Figure 2 A flowchart showing an application creation process according to some embodiments of the present disclosure is shown;

[0011] Figure 3 A schematic diagram showing a configuration interface of a GUI functional block according to some embodiments of the present disclosure;

[0012] Figure 4 A block diagram showing an architecture for updating a presentation style of a defined interaction message based on a modification indication according to some embodiments of the present disclosure;

[0013] FIG. 5A to FIG. 5C A schematic diagram showing an example interface for configuring GUI function blocks according to some embodiments of the present disclosure;

[0014] Figure 6 A block diagram showing a process of calling a GUI function block by a session according to some embodiments of the present disclosure;

[0015] Figure 7 An interaction diagram showing a user adding a GUI function block to a target application for session invocation according to some embodiments of the present disclosure;

[0016] FIG. 8A to FIG. 8B A schematic diagram showing an example view of presenting a GUI message to a user according to some embodiments of the present disclosure;

[0017] Fig. 9 A schematic structural block diagram of an application creation device according to some embodiments of the present disclosure is shown;

[0018] Fig.10 A block diagram of an electronic device in which one or more embodiments of the present disclosure may be implemented is shown. DETAILED DESCRIPTION

[0019] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0020] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0021] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0022] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0023] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the types, scopes of use, usage scenarios, etc. of the information involved in the present disclosure should be informed to relevant users and their authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations. The relevant users may include any type of right holders, such as individuals, enterprises, and groups.

[0024] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can independently choose whether to provide information to software or hardware such as an electronic device, application, server or storage medium that executes the operation of the technical solution of the present disclosure based on the prompt message.

[0025] As an optional but non-limiting implementation, in response to receiving an active request from a relevant user, a prompt message is sent to the relevant user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to select "agree" or "disagree" to provide information to the electronic device.

[0026] It is understandable that the above notification and the process of obtaining user authorization are only illustrative and do not limit the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure. The activation of the digital assistant related functions, the acquired data, the processing and storage of the data, etc. in the embodiment of the present disclosure shall obtain the prior authorization of the user and other rights holders associated with the user, and shall comply with the relevant laws and regulations and the agreement rules between the rights holders.

[0027] As used herein, the term "model" can learn the association between the corresponding input and output from the training data, so that after the training is completed, the corresponding output can be generated for a given input. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multi-layer processing units. A neural network model is an example of a model based on deep learning. In this article, "model" may also be referred to as "machine learning model", "learning model", "machine learning network" or "learning network", and these terms are used interchangeably in this article.

[0028] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. Environment 100 involves an application management platform 110, which can support the creation of applications and / or the running of applications. In some embodiments, the portion of the application management platform 110 that supports the creation of applications can also be referred to as an application creation portion. In some embodiments, the portion of the application management platform 110 that supports the running of applications can also be referred to as an application running portion.

[0029] As shown in the figure, the application creation part can provide a user 105 with an environment for creating and publishing applications. User 105 can be referred to as an application creation user or creator. In some embodiments, the application creation part can be a low-code platform that provides a collection of tools for application creation. The application creation part can support visual development of various types of applications, so that developers can skip the process of manual coding and speed up the development cycle and cost of applications. The application creation part can support any appropriate platform for users to develop one or more types of applications, for example, it can include a platform based on application platform as a service (aPaaS). Such a platform can support users to efficiently develop applications and realize operations such as application creation and application function adjustment.

[0030] The application creation part can be deployed locally on the terminal device of user 105, and / or can be supported by a server-side device. For example, the terminal device of user 105 can run a client of the application creation part, which can support the interaction between the user and the application creation part provided by the server. In the case where the application creation part runs locally on the user's terminal device, the user 105 can directly interact with the local application creation part using the terminal device. In the case where the application creation part runs on the server-side device, the server-side device can, based on the communication connection with the terminal device, implement service provision for the client running in the terminal device. The application creation part can present a corresponding page 130 to the user 105 based on the operation of the user 105, so as to output to the user 105 and / or receive from the user 105 information related to application creation.

[0031] In some embodiments, the application creation part can be associated with a corresponding database, which stores data or information required for the application creation process supported by the application creation part. For example, the database can store the code and description information corresponding to each functional module that constitutes the application. The application creation part can also perform operations such as calling, adding, deleting, and updating the functional modules in the database. The database can also store operations that can be performed on different functional blocks. Exemplarily, in a scenario where an application is to be created, the application creation part can call the corresponding functional blocks from the database to build the application.

[0032] In an embodiment of the present disclosure, a user 105 can create a target application 120 as needed on the application creation part and publish the target application 120. The target application 120 can be published to any appropriate application running part, as long as the application running part can support the operation of the target application 120. After publishing, the target application 120 can be used to be operated by one or more terminal users 145. The terminal user 145 can operate the target application 120 through an associated terminal device 146, and then interact with the application management platform 110. The terminal user 145 can be referred to as the terminal user of the target application 120. In some embodiments, the target application 120 may include or be implemented as a digital assistant 122.

[0033] The digital assistant 122 can be configured to have the ability of intelligent dialogue. In the example shown in the figure, the digital assistant 122 can be integrated into the target application 120, as part of the target application 120 to assist in the task processing within the target application 120. In other examples, the digital assistant 122 can be configured as an independently running application, such as a web application or other types of applications. In such an example, the digital assistant 122 and the target application 120 can be regarded as the same application. The digital assistant 122 is provided to assist users in various task processing requirements in different applications and scenarios. In the interaction process with the digital assistant 122, the user inputs an interactive message, and the digital assistant 122 provides a reply message in response to the user input. Typically, the digital assistant 122 can support users to input questions in a natural language, and perform tasks and provide replies based on the understanding of natural language input and logical reasoning ability.

[0034] In some embodiments, digital assistant 122 can interact with end user 145 as a contact of end user 145. For example, digital assistant 122 can be implemented in an instant messaging (IM) application. Digital assistant 122 can interact with end user 145 in a single chat session with end user 145. In some embodiments, digital assistant 122 can interact with multiple users in a group chat session including multiple users.

[0035] For each terminal user 145, the client of the application running part can present an interactive window 142 of the target application 120 or the digital assistant 122 in the client interface, such as a conversation window with the digital assistant 122. The terminal user 145 can enter a conversation message in the conversation window, and the target application 120 can determine the reply message of the digital assistant 122 based on the created configuration information and present it to the user in the interactive window 142. In some embodiments, depending on the configuration of the target application 120, the interactive message with the target application 120 may include a message in a multimodal form, such as a text message (e.g., a natural language text), a voice message, an image message, a video message, and the like.

[0036] Similar to the application creation part, the application running part can be deployed locally on the terminal device of each terminal user 145, and / or can be supported by the server device. For example, the terminal device of the terminal user 145 can run a client with the application running part, and the client can support the interaction between the user and the application running part provided by the server. In the case where the application running part runs locally on the user's terminal device, the terminal user 145 can directly use the terminal device to interact with the local application running part. In the case where the application running part runs on the server device, the server device can realize the service supply to the client running in the terminal device based on the communication connection with the terminal device. The application running part can present the corresponding application page to the terminal user 145 based on the operation of the terminal user 145, so as to output and / or receive information related to the use of the application to the terminal user 145.

[0037] In some embodiments, the implementation of at least part of the functions of the target application 120 and / or the implementation of at least part of the functions of the digital assistant 122 in the target application 120 can be implemented based on the model. During the creation or operation of the target application 120, one or more models 155, such as the capabilities of the model 155, can be called. In the target application 120, the digital assistant 122 can use the model 155 to understand the user input and provide a reply to the user based on the output of the model 155.

[0038] During the creation process, the application management platform 110 needs to use the model 155 to determine whether the operation result of the target application 120 meets expectations when testing the target application 120. During the operation process, in response to different operation requests of the user of the target application 120, the application operation part may need to use the model 155 to determine the response result to the user.

[0039] Although shown as being independent of the application management platform 110, one or more models 155 may run on the application management platform 110, or other remote servers. In some embodiments, the model 155 may be a machine learning model, a deep learning model, a learning model, a neural network, etc. In some embodiments, the model may be based on a language model (LM). The language model can have question-answering capabilities by learning from a large amount of corpus. The model 155 may also be based on other appropriate models.

[0040] The application management platform 110 can run on appropriate electronic devices. The electronic devices here can be any type of device with computing capabilities, including terminal devices or server devices. The terminal device can be any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication systems (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio broadcast receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. The server device can include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. In some embodiments, the management platform 110 can be implemented based on cloud services.

[0041] It should be understood that the structure and functionality of the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure. For example, although a single user interacting with the application creation portion and a single user interacting with the application execution portion are shown, in reality multiple users can access the application management platform 110 to each create a digital assistant, and each digital assistant can be used to interact with multiple users.

[0042] As mentioned above, the terminal device can present the corresponding content and interact with the user through the user interface of the application. In some traditional solutions, the user interface of the application can be a session-based user interface (also referred to as CUI). This CUI can implement certain functions or task processing capabilities through natural language conversations. However, it is often difficult for users to complete complex interface interactions in natural language in such a session-based user interface. For example, in scenarios with high information density and complex operations such as user management and order management, it is usually difficult for users to quickly express complex structured information through simple text conversations. Therefore, this session-based user interface has certain limitations. This pure CUI interaction method is inefficient, and users often need to have multiple conversations with the CUI or model to meet the execution of the task.

[0043] In some other traditional solutions, the user interface of the application may be a GUI with a fixed template. For example, a predetermined form may be set on the GUI for the user to fill in. The user can interact with the GUI by filling in the form. However, this traditional GUI-based interaction method has a poor experience and is not smart enough. Users often need to fill in a large number of cumbersome forms during use. This repetitive and cumbersome form filling often reduces the user's willingness to use.

[0044] At present, in some traditional solutions, the existing components on the GUI can be adjusted. However, this method can only adjust the GUI in a limited combination of components, and cannot provide a more flexible and diverse graphical user interface. In addition, the interactive capabilities provided by this GUI are also very limited.

[0045] Considering the many defects in traditional solutions based on CUI and GUI, how to present rich and varied content and provide flexible interaction in the user interface of the application is an issue worthy of attention.

[0046] In an embodiment of the present disclosure, an improved solution for application creation is provided. In this solution, a user such as an application creator can issue an instruction to add a GUI function block to a target application. The target application is configured to interact with the user through natural language. The GUI function block is used to present interactive messages in a GUI in a session with the user. If an instruction to add a GUI function block to the target application is received, a configuration interface for the GUI function block can be presented to the user, for example. The user can interact with the configuration interface. Configuration information for the GUI function block is determined based on the interaction with the configuration interface. Next, the GUI function block is added to the target application based on the configuration information.

[0047] In this way, on the one hand, the GUI function block can be flexibly configured according to the interaction between the user and the configuration interface of the GUI function block. On the other hand, the configured GUI function block supports both conversation interaction and GUI interaction. This enables the created application to have a richer and more varied GUI function block with various interactive capabilities. Such an application can meet the various task processing needs of users by adding various GUI function blocks, thereby improving the efficiency of task processing. Using the GUI function block configured by this solution, during the interaction between the target application and the user (for example, through a digital assistant), the advantages of the GUI interface can be combined to improve the efficiency of the target application (for example, the application itself or the machine learning model used by the GUI function block) in obtaining the required information or parameters. In this way, the interaction efficiency can be improved.

[0048] Some example embodiments of the present disclosure will be described in detail below with reference to the examples of the accompanying drawings. It should be understood that the pages or interfaces shown in the accompanying drawings are merely examples, and various page or interface designs may actually exist. The various graphical elements in a page or interface may have different arrangements and different visual representations, one or more of which may be omitted or replaced, and one or more other elements may also exist. The embodiments of the present disclosure are not limited in this respect.

[0049] The application creation process described in the embodiments of the present disclosure may be implemented in an application management platform, a terminal device installed with the application management platform, and / or a server corresponding to the application management platform. In the following examples, for the purpose of discussion, the description is from the perspective of the application management platform, for example Figure 1 The application management platform 110 shown. The user interface presented by the application management platform 110, such as a configuration interface of a GUI function block, can be presented via a terminal device of the user 105, and the application management platform 110 can receive user input via the terminal device of the user 105. As an example, the user 105 can be a creator, manager, or maintainer of the target application 120.

[0050] It should be understood that the user interface presented by the application management platform 110 may also be presented via the terminal device of the user 145, and the application management platform 110 may also receive user input via the terminal device of the user 145. In some embodiments of the present disclosure, the user 145 is a terminal user of the target application 120. The user interface corresponding to the GUI functional block in the target application 120 presented by the application management platform 110 may be presented via the terminal device of the user 145.

[0051] Figure 2 FIG. 2 is a flowchart of an application creation process 200 according to some embodiments of the present disclosure. The process 200 may be implemented at the application management platform 110. Figure 1 Process 200 is described. Process 200 may include additional acts not shown and / or may omit acts shown, as the scope of the present disclosure is not limited in this respect.

[0052] In block 210, the application management platform 110 receives an instruction to add a GUI function block to the target application 120. The target application 120 is configured to interact with a user (e.g., an end user) via natural language. The GUI function block is used to present interactive messages in a GUI session with the user. The implementation of at least part of the functions of the target application 120 and / or the GUI function block can be implemented based on a machine learning model, such as a model with natural language processing capabilities. During the creation or operation of the GUI function block, the capabilities of one or more models (e.g., model 155) can be called.

[0053] In this article, a GUI function block may refer to a GUI application with lightweight functions, also referred to as a GUI application (APP) chip or an intelligent GUI function. The GUI function added in the target application 120 may perform a conversation interaction with an end user such as the user 145, and present an interactive message in a GUI during the conversation interaction process.

[0054] Examples of interactive messages presented in the GUI during the session interaction process include, but are not limited to, messages in multimodal forms, such as text messages (e.g., natural language text), voice messages, image messages, video messages, interactive elements, etc. The interactive messages may correspond to session interactions or operations between the user 145 and the target application 120 or other forms of interactions or operations, such as text input, voice input, image upload, form filling, option selection, etc. A machine learning model with corresponding functions may be used to process these interactive messages presented in the GUI in the session.

[0055] As an example, the application management platform 110 may add an instruction to a target application 120 to add a GUI function block. For example, the user 105 may send an instruction to the application management platform 110 to add a GUI function block to a target application 120 such as a skill or a workflow.

[0056] In block 220, the application management platform 110 determines configuration information for the GUI functional block. The configuration information at least indicates a presentation style of an interactive message. Specifically, the elements in the interactive message may include text messages (e.g., natural language text), voice messages, image messages, video messages, interactive elements, etc. The presentation style of the interactive message may be used to define the layout, style, etc. of these elements.

[0057] In some embodiments, if the application management platform 110 receives or detects the above indication, the application management platform 110 may present a configuration interface for the GUI functional block. The user 105 may interact with the application management platform 110 via the configuration interface. The application management platform 110 may determine the configuration information for the GUI functional block based on the interaction with the configuration interface (e.g., the interaction of the user 105 with the configuration interface). In the process of determining the configuration information for the GUI functional block, the application management platform 110 may call upon the capabilities of one or more models (e.g., model 155). For example, the application management platform 110 may use the model 155 to understand the user input and determine the configuration information based on the output of the model 155. This will be discussed below in conjunction with Figure 3 A detailed example of a configuration interface for a GUI function block is described. In this way, a user can design or modify the presentation style of each interactive message presented by the GUI function block by interacting with the configuration interface. The GUI function block thus created has a variety of presentation styles.

[0058] In box 230, the application management platform 110 adds a GUI function block to the target application 120 based on the configuration information. In other words, by using the configuration information determined by the user's interaction with the configuration interface, the corresponding GUI function block can be created and added to the target application 120. Thus, a target application 120 with different GUI function blocks can be created. Such a target application 120 can implement different functions to meet the various needs of users. In addition, the GUI function block of the target application 120 implements different functions in the form of GUI interaction messages in the session with the user, thereby combining the convenience and intelligence of CUI and the stability and efficiency of GUI. By adopting the GUI function block, in the process of interaction with the user, the efficiency of the target application (for example, the machine learning model in the application or GUI function block) to obtain the required information or parameters can be improved by combining the advantages of the GUI interface. Compared with the traditional CUI that requires multiple sessions with the model to meet the task execution, the use of a GUI function block that combines CUI and GUI can improve the efficiency of the target application in executing tasks and the interaction efficiency. This application function implementation method supports a variety of flexible interactions of users, and is simple and efficient to operate.

[0059] As briefly mentioned above, if the user 105 instructs to add a GUI functional block to the target application 120, the application management platform 110 can present a configuration interface for the GUI functional block. In some example embodiments, the configuration interface may include a preview view (also referred to as a preview page) of the presentation style of the interactive message presented in the session in the GUI functional block in the GUI functional block and text information defining the presentation style. As an example, the text information may be a computer language (such as a computer program language or code), a natural language, a combination of a computer language and a natural language, a preset descriptive language for describing the presentation style, and the like. In some of the embodiments below, several examples of computer languages ​​will be described using computer languages ​​as an example, but it should be understood that the text information defining the presentation style in these embodiments may be in other appropriate languages, and the embodiments of the present disclosure are not limited in this regard.

[0060] Figure 3 FIG. 3 is a schematic diagram showing a configuration interface 300 of a GUI functional block according to some embodiments of the present disclosure. Figure 3 As described above, the configuration interface 300 may include an area 310 corresponding to a preview view of a presentation style and an area 320 corresponding to text information. Figure 3 In the example shown in FIG. 3 , the text information in the area 320 is presented as a code, but this is merely exemplary, and the area 320 may include other types of text information.

[0061] In some embodiments, the initial preview view of the GUI function block can be a preset preview view. The preset preview view can correspond to preset text information, such as a computer language. The preset text information can be presented in area 320 for user 105 to edit or modify. Alternatively, in some embodiments, the initial preview view can be a blank view corresponding to blank text information. The user 105 can initialize the preview view in area 310 by entering text information, such as a computer language, in area 320.

[0062] In some embodiments, the application management platform 110 may receive modification instructions for the preview view and / or text information. For example, the user 105 may indicate modification of the preview view in the area 310 and / or the text information in the area 320. It should be understood that modification of the preview view means modification of the text information in the corresponding area 320. Similarly, modification of the text information in the area 320 will change the preview view in the area 310 accordingly. The application management platform 110 may update the text information (e.g., computer language) based on the modification instructions. The application management platform 110 may then determine the updated text information as configuration information.

[0063] The modification instructions of the user 105 to the preview view or text information can be in different forms. As an example, the modification instructions can be modification instructions to the preview view described in natural language. The user 105 can enter natural language describing the modification instructions in box 340. By selecting option 346, the user 105 can send the input natural language to the application management platform 110. If the application management platform 110 receives the above-mentioned modification instructions, it can use the first machine learning model to generate updated text information based on the modification instructions. The first machine learning model can be a pre-trained model for generating text information based on natural language, such as a natural language generation code model.

[0064] As another example, the modification indication may be a reference image indicating a target style of the preview image. The user 105 may select option 344 to take a reference image or upload a reference image. If the application management platform 110 receives the reference image, the updated text information may be generated based on the reference image using a second machine learning model. The second machine learning model may be a pre-trained model for generating computer language based on an image, such as an image generation code model.

[0065] In some embodiments, the first machine learning model and the second machine learning model may be different models. Alternatively, in some embodiments, the first machine learning model and the second machine learning model may be the same model. The model may be a multimodal model that simultaneously has the ability to generate text information based on natural language and the ability to generate text information based on images. The machine learning model used herein may adopt any appropriate model structure and may be pre-trained using any appropriate model. The scope of the present disclosure is not limited in this respect.

[0066] As another example, the modification instruction may be an editing instruction for text information. For example, user 105 may directly edit or modify text information, such as a computer language, presented in area 320. For another example, user 105 may select option 342 to upload a locally stored reference computer language (e.g., code or code segment) to update or replace an existing computer language in area 320.

[0067] Several examples of modification instructions are listed above. The application management platform 110 can receive different types of modification instructions and update the text information accordingly. In this way, the application management platform 110 can use machine learning to improve and edit a single view of a GUI functional block. It should be understood that the above examples of modification instructions are merely illustrative and not restrictive. The embodiments of the present disclosure may use any appropriate modification instructions to modify the preview view or text information. The scope of the present disclosure is not limited in this respect.

[0068] It should be understood that the various user instructions mentioned in this article, such as instructions for adding GUI function blocks or instructions for modifying preview views or text information, can adopt any appropriate instruction methods or triggering methods. These methods include but are not limited to text input or image input through input devices such as keyboards, mice, designated devices or touch screens, image capture or scanning through cameras, language input through microphones, gesture control, etc. In addition, any appropriate selection method can be used for the selection of each option in the interface, including but not limited to mouse selection, finger touch, voice control, gesture control, etc. The embodiments of the present disclosure are not limited in these aspects.

[0069] The above describes several examples of updating the presentation style of an interactive message based on a modification indication. Next, Figure 4 The architecture 400 is used to describe the process of updating the presentation style of a defined interactive message based on a modification indication according to some embodiments of the present disclosure. The architecture 400 may include additional modules not shown and / or may omit the modules shown, and the scope of the present disclosure is not limited in this respect.

[0070] like Figure 4As shown, the architecture 400 may include a GUI development tool 410, also referred to as a GUI studio, and a CUI runtime module 460. The GUI development tool 410 may be implemented at the application management platform 110. The CUI runtime module 460 may be implemented at the application management platform 110 and / or at the terminal device of the end user. The GUI development tool 410 may include an integrated development environment (IDE) 420, a natural language generation code module 430 (also referred to as an NL2Code module), and an optional image generation code (Image2Code) module 440 and a domain specific language (DSL) module 450.

[0071] IDE 420 may provide support for code editing and modification. Code in IDE 420 may be presented in region 320 of configuration interface 300. User 105 may modify code in IDE 420 by editing code in region 320 of configuration interface 300. Additionally or alternatively, text information corresponding to the initial preview view of the GUI function block, such as a computer language, may be created or edited in IDE 420. Computer languages ​​generated via other modules, such as natural language code generation module 430, may also be further modified or edited via IDE 420.

[0072] The natural language generation code module 430 may include or utilize a first machine learning model for generating an updated computer language based on the modification instructions described in natural language by the user 105. Similarly, the image generation code module 440 may include or utilize a second machine learning model for generating an updated computer language based on the reference image in the modification instructions. In addition, the DSL module 450 may also be utilized to convert the updated computer language into a domain-specific computer language.

[0073] In this way, developers can develop GUI functional blocks through the GUI development tool 410. The GUI development tool 410 provides the multiple code generation methods listed above or any other appropriate code generation methods. That is, the GUI development tool 410 supports multiple methods such as source code (also called source code) development, natural language development, image-based development, etc. The final product of the GUI development tool 410 is code, that is, a front-end project that can be edited twice by the IDE 410. The computer language obtained by the GUI development tool 410 using these modules can be transmitted to the CUI runtime module 460 as a GUI front-end project 470 (for example, compiled by code). A local container can be provided by the CUI as the operating environment of the GUI front-end project 470, such as a web page view. The web page view has a presentation style defined by the updated computer language.

[0074] By using the GUI development tool 410, the application management platform 110 can provide the ability to build GUI function blocks, and provide the ability to automatically generate GUIs such as online editing IDE, natural language code generation, image code generation, etc. Users can easily build GUI function blocks capable of processing complex business processes in the target application 120. The constructed GUI function blocks can be suitable for scenarios with high information density and complex operations.

[0075] Several examples of determining the interactive message presentation style of a GUI function block are described above. Figure 3 In some embodiments, a GUI function block may include multiple preview views for presenting interactive messages, and different preview views may correspond to different text information, such as computer languages. The configuration interface 300 may include a view selection area 330 for selecting different preview views of the GUI function block. Different preview views corresponding to the GUI function block may be created or updated in the manner listed above.

[0076] In some example embodiments, the configuration information for the GUI function block also indicates one or more operations that can be called through the interactive message. The one or more operations can provide operation results in response to being called to update the interactive message. As an example, the interactive message can be a selection bar presented to the terminal user. That is, the operation for different options in the selection bar can be called through the interactive message. The terminal user can select the options in the selection bar. Accordingly, the operation corresponding to the option selected by the terminal user is called to generate the operation result. The interactive message can then be updated based on the operation result. Specifically, the option information selected by the terminal user can be presented at the position corresponding to the selection bar. This will be described below in conjunction with Figure 8B Describes more detailed examples of operations invoked through interaction messages.

[0077] In some example embodiments, the configuration interface 300 may include a first entry 302 for configuring a presentation style and a second entry 304 for configuring one or more operations. If the user 105 selects the first entry 302, the presentation style corresponding to the preview view and the corresponding computer language may be presented in the configuration interface 300, such as Figure 3 As shown. The preview view may include multiple views (also referred to as sub-views or sub-pages) under the GUI function block. These views may correspond to different sub-functions. Taking the GUI function block providing the travel function as an example, each sub-function may be a ticket query, a ticket list, a confirmation of travel information, etc. A target view from the multiple views may be selected for editing through area 330.

[0078] If the user 105 selects the second entry 304, preview styles corresponding to various operations and corresponding computer languages ​​(not shown) may be presented in the configuration interface 300. These operations may correspond to application programming interfaces (APIs), functions, logical operations, etc. that can be called within the GUI. In the example of the travel function described above, the operations may include, for example, querying ticket information, submitting ticket information, and the like.

[0079] Additionally, or alternatively, in some embodiments, the configuration interface 300 may further include a third entry 306 for configuring data. The data may be data that can be accessed, bound, and edited within the GUI. The data may be associated with an operation. For example, the data may be the result of a query record. If the user 105 selects the third entry 306, a preview corresponding to the data and a corresponding computer language (not shown) may be presented in the configuration interface 300.

[0080] Each preview view, operation, data, etc. configured by the configuration interface 300 can be stored as different nodes in the GUI project directory in the IDE, for example, an operation node, a view node, and a data node. Selecting different entries in the configuration interface 300 is equivalent to selecting the corresponding node in the GUI project directory. The code corresponding to the node will be presented in the area 320 of the configuration interface 300. The preview content corresponding to the code will be presented in the area 310. The user 105 can edit or modify the preview in the area 310 and / or the code in the area 320 in the various ways described above.

[0081] In some example embodiments, the preview view (i.e., the UI portion) may be driven by source code. For example, source code editing may be supported, such as using a preset software development kit (SDK). Another example may also support machine learning assistance, such as Figure 4 The natural language generation code module 430, the image generation code module 440, and so on. Operations and data can be driven by the GUI and designed using a low-code development approach. In addition, the configuration interface can also present a real-time preview of preview views, operations, and data to provide a more flexible way to create GUI function blocks. By selecting different entries in the configuration interface 300 and editing the corresponding content, machine learning can be used to quickly improve a set of views, operations, and data for a GUI function block.

[0082] Combination of the above Figure 3 and Figure 4Several examples of configuration information for configuring a GUI function block in the configuration interface 300 are described. In some embodiments, a preset template, a preset layout, etc. for configuring a GUI function block may be provided to simplify the creation process of the GUI function block. As an example, if the application management platform 110 receives an instruction to add a GUI function block to the target application 120, descriptive information of a presentation style for presenting an interactive message in a session as a GUI for the GUI function block may be received. The descriptive information at least indicates an initial layout of at least a portion of the elements in the interactive message. Based on the descriptive information, a preview view for the presentation style and text information defining the presentation style may be presented.

[0083] In some embodiments, if the application management platform 110 receives an instruction to add a GUI function block to the target application 120, a configuration entry for the GUI function block may be presented. The application management platform 110 may receive, via the configuration entry, description information of a presentation style for the GUI function block to present interactive messages in a session using a GUI.

[0084] As an example, the description information may include at least a target indicating an initial layout, at least an image indicating an initial layout, and / or at least a computer language describing the initial layout (e.g., a locally stored or edited code), etc. The application management platform 110 may present a preview view for the above presentation style and a computer language defining the presentation style based on the description information. By receiving the description information via the configuration entry, the GUI functional blocks can be configured quickly and efficiently, and the workload of developers can be reduced.

[0085] FIG. 5A to FIG. 5C Schematic diagrams of example interfaces 500A to 500C for configuring GUI function blocks according to some embodiments of the present disclosure are shown. In interfaces 500A to 500C, configuration entries for GUI function blocks are presented. Figure 5A As shown, if the application management platform 110 receives an instruction to add a GUI function block to the target application 120, a configuration entry 510 for the GUI function block may be presented in the interface 500A. Through the configuration entry 510, the user 105 may input descriptive information such as data and operations (e.g., API).

[0086] If the user 105 completes the input of the description information for the configuration entry 510, the application management platform 110 may present the configuration entry 520 in the interface 500B. Through the configuration entry 520, the user may select different preset templates. That is, the description information input by the user 105 indicates the preset template. If the user 105 completes the input of the description information for the configuration entry 520, the application management platform 110 may present the configuration entry 530 in the interface 500C. Through the configuration entry 530, the user 105 may update the preset template. For example, the user 105 may update the preset template through natural language input. For another example, the user 105 may update the preset template using a design drawing by adding a design drawing (i.e., an image indicating the initial layout).

[0087] If the user 105 completes inputting the description information for the configuration entry 530, the application management platform 110 may present a configuration interface similar to the configuration interface 300. In other words, the application management platform 110 may present a preview view of the presentation style and text information defining the presentation style on the configuration interface based on the description information. The user 105 may then further update the preview view of the presentation style and the text information defining the presentation style by interacting with the configuration interface.

[0088] By providing various configuration entries in interfaces 500A to 500C, the application management platform 110 can generate prompt information based on the input of the user 105, the design draft, the data description, etc. In this way, machine learning can be used to initialize, improve, and edit various GUI functions. In other words, the source code of multiple preview views can be intelligently generated and data binding can be completed.

[0089] Combination of the above Figures 2 to 5C Several examples of configuring and adding GUI function blocks to the target application 120 are described. In some example embodiments, the GUI function block may be configured to be called by a session through an API (e.g., an SDK API). In some embodiments, the GUI function block 620 may be a front-end project based on a web page (Web) that can run in a local container. The GUI function block 620 may be used in a manner similar to a function with a UI, and thus may be called and arranged by an agent, a workflow, etc. Figure 6 FIG. 6 is a block diagram of a process 600 of calling a GUI function block by a session according to some embodiments of the present disclosure. The process 600 may be implemented in the application management platform 110. Figure 1 600 is described below.

[0090] like Figure 6As shown, CUI 610 can call GUI. For example, CUI 610 can call GUI function block 620 through a function (e.g., callGUI (params)) with parameters corresponding to GUI function block 620. GUI function block 620 may include view 622 (e.g., a view on a user interface (UI)), operation 624 (e.g., logical operation, function, API, etc.) and optional data 626 (e.g., data of a machine learning model). After the GUI function block is called, the GUI can be ended and returned to CUI 610 through a function such as endGUI (return).

[0091] Taking the travel scenario as an example, the GUI function block 620 can be implemented as having a ticket booking function. The GUI function block 620 supports being called during the user's interaction with the CUI 610, and calls back the CUI after the ticket booking function is completed. The CUI may further suggest other functions, such as a hotel booking function, which may correspond to other GUI function blocks. Specifically, in the GUI function block (also referred to as a CUI node), context information can be obtained through the system object. The corresponding code can be shown in Table 1.

[0092] Table 1

[0093]

[0094] In the CUI workflow orchestration scenario, the GUI can call endGUI() to notify the host that the GUI has ended. The corresponding code can be shown in Table 2.

[0095] Table 2

[0096]

[0097] In the above, combined with Figures 2 to 6 Several examples of configuring GUI function blocks and calling GUI function blocks through API by a session are described. Figure 7 An interaction diagram 700 is described in which a user adds a GUI function block to a target application for session invocation according to some embodiments of the present disclosure. The interaction diagram 700 involves an application management platform 110 and a CUI runtime module 460. The application management platform 110 may include a GUI development tool 410, a GUI function block builder 720, a machine learning model 730, and a repository 740. The CUI runtime module 460 may be implemented at the application management platform 110 and / or at a terminal device of an end user.

[0098] The CUI development tool 410 can be used to generate computer languages ​​such as codes based on input instructions from the user 105. The GUI function block builder 720 can construct GUI function blocks based on the computer language output by the GUI development tool 410. In addition, one or more machine learning models 730 can be used in the process of generating computer languages ​​by the GUI development tool 410. The constructed GUI function blocks can be stored in the repository 740. The CUI runtime module 460 can call the GUI front-end project 470 (i.e., GUI function blocks) stored in the repository 740. A local container, such as a web page, can be provided by the CUI as the operating environment of the GUI front-end project 470.

[0099] Specifically, the user 105 may send an instruction for creating a workflow skill to the GUI development tool 410. The GUI development tool 410 may send the instruction to the GUI function block builder 720. In some embodiments, the GUI function block builder 720 may initialize the GUI function block, for example, initialize the view and / or operation. The initialized GUI function block may be transmitted to the GUI development tool 410.

[0100] Next, the user 105 can edit the code corresponding to the GUI function block through various modules of the GUI development tool 410. For example, the view of the GUI function block can be developed or edited through the GUI development tool 410 using the capabilities of the machine learning model 730 such as natural language code generation and / or image code generation. The user's input or instructions to the GUI development tool 410 can be transparently transmitted to the machine learning model 730 via the GUI function block builder 720, and the processing results are returned to the GUI development tool 410.

[0101] The user 105 may submit the constructed GUI function block, which may be stored in the repository 740. The storage address corresponding to the GUI function block in the repository 740 may be transmitted to the GUI function block builder 720 and / or the GUI development tool 410.

[0102] In this way, a card container that can render a Web can be provided under a CUI host, using a Web robot (Bot) as the main carrier. The terminal device of the end user can send a request to pull the static resources of the GUI function block (e.g., GUI card) in the repository 740, including the view and operation of the GUI function block, so as to render the GUI initial interface. In this way, the GUI function block can be displayed in the conversation interface.

[0103] As described above, the GUI function block added in the target application 120 can be presented to the terminal device of the terminal user. For example, the terminal user can call the GUI function block via the CUI of the terminal device. When the GUI function block is used by the user, it can use the capabilities of one or more models to understand the user input and provide a response to the user based on the output of the model. FIG. 8A to FIG. 8B Schematic diagrams of example interfaces 800A and 800B for presenting GUI functional blocks to an end user according to some embodiments of the present disclosure are shown. Fig. 8A and 8B The GUI function blocks in the figure can be added to the target application through process 200. The style, layout, and elements of each interactive message presented in the figure can be indicated by the configuration information determined in process 200. In the example interfaces 800A and 800B and some other examples mentioned in this article, several examples of GUI function blocks are described by taking travel functions as examples. It should be understood that the GUI function blocks of travel functions are merely exemplary and not restrictive. The GUI function blocks can provide a variety of functions. The embodiments of the present disclosure are not limited in this regard.

[0104] like Fig. 8A As shown, if a terminal user, such as user 145, selects a GUI function block corresponding to a travel function in target application 120 via terminal device 146, interface 800A may be presented on a page of terminal device 146. Interface 800A includes various interactive messages presented in a GUI in a conversation. For example, user 145 may enter a conversation in box 810 for interaction to present an interactive message "I am going on a business trip tomorrow".

[0105] If the user 145 chooses to determine or send the interactive message input in the frame 810 to the GUI function block, the interface 800B can be presented on the terminal device 146. In the frame 820 and frame 830 of the interface 800B, multiple interactive messages are presented. These interactive messages can be associated with the operation in the GUI function block. For example, the user 145 can select the interactive message 822 at the business trip time option for conversation input. In this scenario, the operation (e.g., API or function) of inputting the date can be called, and a pop-up page (not shown) of selecting the date is presented on the interface 800B. After the user 145 operates the interactive message 822 of the input date, the operation result can be provided to the GUI function block to update the corresponding interactive message 822. That is, the updated interactive message 822 can present the date selected by the user. Similarly, other interactive information presented in the frame 820 or frame 830 can be updated.

[0106] In this way, the user 145 can interact in the graphical interface operation during the session with the target application 120 to obtain corresponding data therefrom. In addition, the user 145 consumes the data in the session with the target application 120. By naturally integrating the graphical capability with the machine learning capability in this way, more complex business process problems can be solved.

[0107] The application created by the application creation method of the present disclosure may include various GUI function blocks that combine CUI and GUI capabilities. These GUI function blocks provide terminal users with various functional applications that combine the convenience and intelligence of CUI and the stability and efficiency of GUI. That is, the application is provided with the ability to combine conversational interaction and GUI interaction. These GUI function blocks provide GUI interaction capabilities for the terminal performance of the application, and the user carries scenarios with high information density and complex operations, thereby compensating for the weakness of CUI interaction in such scenarios.

[0108] From the perspective of the end user, the GUI function block can provide an interactive page or card that completes a complete business process. The GUI function block constructed according to the embodiments of the present disclosure can be applied to different scenarios, including but not limited to scenarios including form-type interactive messages, scenarios including interactive messages for custom data display, scenarios including data lists, details, and other interactive message presentations, etc. This GUI function block is simple and convenient to operate, can save the operation time of the end user, and thus improve the efficiency of various task processing.

[0109] In some embodiments, Fig. 9 A schematic structural block diagram of an application creation device 900 according to some embodiments of the present disclosure is shown. The device 900 may be implemented in or included in the application management platform 110. Each module / component in the device 900 may be implemented by hardware, software, firmware or any combination thereof.

[0110] As shown in the figure, the device 900 includes an instruction receiving module 910, which is configured to receive an instruction to add a GUI function block to the target application. The target application is configured to interact with the user through natural language. The GUI function block is used to present interactive messages in a session with the user with a GUI. The device 900 also includes a determination module 920, which is configured to determine configuration information for the GUI function block, and the configuration information at least indicates the presentation style of the interactive message. The device 900 also includes an adding module 930, which is configured to add the GUI function block in the target application based on the configuration information.

[0111] In some embodiments, the determination module 920 is configured to: in response to an indication, present a preview view for a presentation style and text information defining the presentation style; receive an indication of modification to at least one of the preview view or the text information; update the computer language based on the modification indication; and determine the updated text information as configuration information.

[0112] In some embodiments, receiving a modification instruction for at least one of the preview view or the text information includes at least one of the following: receiving a modification instruction for the preview view described in natural language, receiving a reference image, the reference image indicating a target style of the preview view, or receiving an editing instruction for the text information.

[0113] In some embodiments, updating text information based on modification instructions includes: in response to receiving a modification instruction, using a first machine learning model to generate updated text information based on the modification instruction, or in response to receiving a reference image, using a second machine learning model to generate updated text information based on the reference image.

[0114] In some embodiments, the device 900 further includes a description information receiving module, configured to receive description information for the presentation style in response to receiving an instruction to add the GUI function block to the target application, the description information at least indicating an initial layout of at least a portion of the elements in the interactive message. The device 900 further includes a first presentation module, configured to present a preview view for the presentation style and text information defining the presentation style based on the description information.

[0115] In some embodiments, the description information includes at least one of the following: a template indicating at least an initial layout, an image indicating at least the initial layout, or a computer language describing at least the initial layout.

[0116] In some embodiments, the configuration information further indicates one or more operations that can be invoked through the interaction message. In response to being invoked, the one or more operations provide operation results to update the interaction message.

[0117] In some embodiments, the apparatus 900 further includes a second presentation module configured to present, in response to the instruction, a first entry for configuring the presentation style and a second entry for configuring one or more operations.

[0118] In some embodiments, the GUI function blocks are configured to be called by the session through an application programming interface.

[0119] Fig.10 1 shows a block diagram of an electronic device 1000 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Fig.10The electronic device 1000 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Fig.10 The electronic device 1000 shown may include or be implemented as Figure 1 application management platform 110, or Fig. 9 Device 900.

[0120] like Fig.10 As shown, the electronic device 1000 is in the form of a general electronic device. The components of the electronic device 1000 may include, but are not limited to, one or more processors or processing units 1010, a memory 1020, a storage device 1030, one or more communication units 1040, one or more input devices 1050, and one or more output devices 1060. The processing unit 1010 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 1020. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 1000.

[0121] The electronic device 1000 typically includes a plurality of computer storage media. Such media may be any accessible media that is accessible to the electronic device 1000, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1020 may be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1030 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data and may be accessed within the electronic device 1000.

[0122] The electronic device 1000 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig.10 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. Memory 1020 may include a computer program product 1025 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0123] The communication unit 1040 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 1000 can be implemented in a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 1000 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0124] The input device 1050 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 1060 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 1000 may also communicate with one or more external devices (not shown) through the communication unit 1040 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 1000, or communicate with any device that allows the electronic device 1000 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0125] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0126] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0127] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0128] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0129] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0130] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the marketplace, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A method for creating an application, comprising: receiving an instruction to add a graphical user interface (GUI) function block to a target application, wherein the target application is configured to interact with a user through a natural language, and the GUI function block is used to present interactive messages in a session with the user using a GUI; Determining configuration information for the GUI function block, the configuration information at least indicating a presentation style of the interactive message; as well as Based on the configuration information, the GUI function block is added to the target application.

2. The method according to claim 1, wherein determining configuration information for the GUI function block comprises: In response to the indication, presenting a preview view for the presentation style and text information defining the presentation style; receiving a modification instruction for at least one of the preview view or the text information; updating the text information based on the modification indication; as well as The updated text information is determined as the configuration information.

3. The method according to claim 2, wherein receiving a modification indication of at least one of the preview view or the text information comprises at least one of the following: receiving a modification instruction for the preview view described in natural language, receiving a reference image, the reference image indicating a target style of the preview view, or An editing instruction for the text information is received.

4. The method of claim 3, wherein updating the text information based on the modification indication comprises: In response to receiving the modification instruction, using a first machine learning model to generate updated text information based on the modification instruction, or In response to receiving the reference image, using a second machine learning model, the updated text information is generated based on the reference image.

5. The method according to claim 1, further comprising: In response to receiving an instruction to add the GUI function block to the target application, receiving description information for the presentation style, the description information at least indicating an initial layout of at least a portion of elements in the interactive message; as well as Based on the description information, a preview view for the presentation style and text information defining the presentation style are presented.

6. The method according to claim 5, wherein the description information includes at least one of the following: a template indicating at least said initial layout, an image indicating at least said initial layout, or A computer language describing at least said initial layout.

7. The method according to claim 1, wherein the configuration information further indicates one or more operations that can be called through the interaction message, wherein the one or more operations provide operation results in response to being called to update the interaction message.

8. The method according to claim 7, further comprising: In response to the indication, a first entry for configuring the presentation style and a second entry for configuring the one or more operations are presented.

9. The method of claim 1, wherein the GUI function block is configured to be called by the session through an application programming interface.

10. A device for creating an application, comprising: an instruction receiving module, configured to receive an instruction to add a graphical user interface (GUI) function block to a target application, wherein the target application is configured to interact with a user through a natural language, and the GUI function block is used to present an interactive message in a session with the user using a GUI; A determination module, configured to determine configuration information for the GUI function block, wherein the configuration information at least indicates a presentation style of the interactive message; as well as An adding module is configured to add the GUI function block in the target application based on the configuration information.

11. An electronic device, comprising: at least one processing unit; as well as At least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform the method according to any one of claims 1 to 9.

12. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 9.

Citation Information

Patent Citations

  • Method and device for creating digital assistant, equipment and storage medium

    CN118410133A

Cited By

  • Method for user interface update, system for the same, and non-transitory computer readable medium storing computer program for the same

    TWI940083B