Method and device for application creation and information processing, equipment and storage medium
By determining and using the configuration information of a predetermined computer language format in the target application, the problem of insufficient support for multimodal content is solved, and the presentation and interaction efficiency of rich text messages is improved, providing a richer user experience.
Patent Information
- Application Number
- CN202411133015.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-18
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2044-08-18
AI Technical Summary
The existing technology lacks effective support for multimodal content in the creation and information processing of target applications, which limits the richness of interactive content. In addition, traditional computer languages have limited expressiveness in building rich text interactive cards, making it difficult to create rich expressions and Data-driven message content.
By receiving an indication to add a message sending operation to the target application, a configuration information indicating a presentation style of a rich text message is determined, with a format in a predetermined computer language, and based on this configuration information, the message sending operation is added to the target application, and a reply message is generated and presented. , realize multimodal content support for rich text messages.
Improves the quality and efficiency of interaction between end users and created applications, allowing users to intuitively construct and edit presentation styles of rich text messages without deep understanding of the underlying syntax details, supports creating rich-idea and data-driven interactive content, and provides consistent users Experience.
Smart Images

Figure CN119088436A_ABST
Abstract
Description
Technical Field
[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, apparatuses, devices, and computer-readable storage media for task processing for application creation, and methods, apparatuses, devices, and computer-readable storage media for information processing. Background Art
[0002] With the development of information technology, various terminal devices can provide various services to people in work and life. Applications that provide services can be deployed in terminal devices. Terminal devices present corresponding content and interact with users through the user interface of the application to meet various needs of users. In some cases, users may need to create applications for terminal users to use, and then the terminal users use the applications to process information. Therefore, how to improve the efficiency of application creation and information processing is a problem of concern. Summary of the invention
[0003] In a first aspect of the present disclosure, an application creation method is provided. In the method, an instruction to add a message sending operation to a target application is received, and the target application is configured to perform user interaction at least in part using a machine learning model. Further, configuration information indicating a presentation style of a rich text message is determined. The configuration information has a format of a predetermined computer language. In addition, the message sending operation is added to the target application based on the configuration information.
[0004] In a second aspect of the present disclosure, an information processing method is provided. In the method, in response to processing of user input in a target application including a message sending operation, configuration information indicating a presentation style of a rich text message is obtained. The configuration information has a format of a predetermined computer language. The target application is configured to perform user interaction at least in part using a machine learning model. Based on the configuration information, a reply message for the user input is generated. The reply message has an indicated presentation style. Further, the reply message is presented.
[0005] In a third aspect of the present disclosure, a device for application creation is provided. The device includes a receiving module, a determining module, and an adding module. The receiving module is configured to receive an instruction to add a message sending operation to a target application, and the target application is configured to perform user interaction at least in part using a machine learning model. The determining module is configured to: determine configuration information indicating a presentation style of a rich text message, and the configuration information has a format of a predetermined computer language. The adding module is configured to: add the message sending operation to the target application based on the configuration information.
[0006] In a fourth aspect of the present disclosure, a device for information processing is provided. The device includes an acquisition module, a generation module, and a presentation module. The acquisition module is configured to: in response to processing of user input in a target application including a message sending operation, acquire configuration information indicating a presentation style of a rich text message. The configuration information has a format of a predetermined computer language. The target application is configured to perform user interaction at least in part using a machine learning model. The generation module is configured to: based on the configuration information, generate a reply message to the user input. The reply message has an indicated presentation style. The presentation module is configured to present the reply message.
[0007] In a fifth aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the electronic device executes the method of the first aspect or the second aspect.
[0008] In a sixth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the medium, and when the computer program is executed by a processor, the method of the first aspect or the second aspect is implemented.
[0009] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:
[0011] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;
[0012] Figure 2 A flowchart of a method for application creation according to some embodiments of the present disclosure is shown;
[0013] Figure 3 An example interface for creating an application according to some embodiments of the present disclosure is shown;
[0014] Figure 4 shows an example configuration interface according to some embodiments of the present disclosure;
[0015] Figure 5 shows an example rich text editing interface according to some embodiments of the present disclosure;
[0016] Figure 6 shows an example template selection interface according to some embodiments of the present disclosure;
[0017] Figure 7 A flowchart of a method for information processing according to some embodiments of the present disclosure is shown;
[0018] Figure 8 An example process of information processing according to some embodiments of the present disclosure is shown;
[0019] Fig. 9 A block diagram showing an example apparatus for application creation according to some embodiments of the present disclosure is shown;
[0020] Fig.10 A block diagram illustrating an example apparatus for information processing according to some embodiments of the present disclosure; and
[0021] Fig.11 A block diagram is shown of a device in which one or more embodiments of the present disclosure may be implemented. DETAILED DESCRIPTION
[0022] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0023] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.
[0024] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.
[0025] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.
[0026] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the types, scopes of use, usage scenarios, etc. of the information involved in the present disclosure should be informed to relevant users and their authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations. The relevant users may include any type of right holders, such as individuals, enterprises, and groups.
[0027] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can independently choose whether to provide information to software or hardware such as an electronic device, application, server or storage medium that executes the operation of the technical solution of the present disclosure based on the prompt message.
[0028] As an optional but non-limiting implementation, in response to receiving an active request from a relevant user, a prompt message is sent to the relevant user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to select "agree" or "disagree" to provide information to the electronic device.
[0029] It is understandable that the above notification and the process of obtaining user authorization are only illustrative and do not limit the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure. The activation of the digital assistant related functions, the acquired data, the processing and storage of the data, etc. in the embodiment of the present disclosure shall obtain the prior authorization of the user and other rights holders associated with the user, and shall comply with the relevant laws and regulations and the agreement rules between the rights holders.
[0030] As used herein, the term "model" can learn the association between the corresponding input and output from the training data, so that after the training is completed, the corresponding output can be generated for a given input. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multi-layer processing units. A neural network model is an example of a model based on deep learning. In this article, "model" may also be referred to as "machine learning model", "learning model", "machine learning network" or "learning network", and these terms are used interchangeably in this article.
[0031] Figure 1A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. Environment 100 involves an application management platform 110, which can support the creation of applications and / or the running of applications. In some embodiments, the portion of the application management platform 110 that supports the creation of applications can also be referred to as an application creation portion. In some embodiments, the portion of the application management platform 110 that supports the running of applications can also be referred to as an application running portion.
[0032] As shown in the figure, the application creation part can provide a user 105 with an environment for creating and publishing applications. User 105 can be referred to as an application creation user or creator. In some embodiments, the application creation part can be a low-code platform that provides a collection of tools for application creation. The application creation part can support visual development of various types of applications, so that developers can skip the process of manual coding and speed up the development cycle and cost of applications. The application creation part can support any appropriate platform for users to develop one or more types of applications, for example, it can include a platform based on application platform as a service (aPaaS). Such a platform can support users to efficiently develop applications and realize operations such as application creation and application function adjustment.
[0033] The application creation part can be deployed locally on the terminal device of user 105, and / or can be supported by a server-side device. For example, the terminal device of user 105 can run a client of the application creation part, which can support the interaction between the user and the application creation part provided by the server. In the case where the application creation part runs locally on the user's terminal device, the user 105 can directly interact with the local application creation part using the terminal device. In the case where the application creation part runs on the server-side device, the server-side device can, based on the communication connection with the terminal device, implement service provision for the client running in the terminal device. The application creation part can present a corresponding page 130 to the user 105 based on the operation of the user 105, so as to output to the user 105 and / or receive from the user 105 information related to application creation.
[0034] In some embodiments, the application creation part can be associated with a corresponding database, which stores data or information required for the application creation process supported by the application creation part. For example, the database can store the code and description information corresponding to each functional module that constitutes the application. The application creation part can also perform operations such as calling, adding, deleting, and updating the functional modules in the database. The database can also store operations that can be performed on different functional blocks. Exemplarily, in a scenario where an application is to be created, the application creation part can call the corresponding functional blocks from the database to build the application.
[0035] In an embodiment of the present disclosure, a user 105 can create a target application 120 as needed on the application creation part and publish the target application 120. The target application 120 can be published to any appropriate application running part, as long as the application running part can support the operation of the target application 120. After publishing, the target application 120 can be used to be operated by one or more terminal users 145. The terminal user 145 can operate the target application 120 through an associated terminal device 146, and then interact with the application management platform 110. The terminal user 145 can be referred to as the terminal user of the target application 120. In some embodiments, the target application 120 may include or be implemented as a digital assistant 122.
[0036] The digital assistant 122 can be configured to have the ability of intelligent dialogue. In the example shown in the figure, the digital assistant 122 can be integrated into the target application 120, as part of the target application 120 to assist in the task processing within the target application 120. In other examples, the digital assistant 122 can be configured as an independently running application, such as a web application or other types of applications. In such an example, the digital assistant 122 and the target application 120 can be regarded as the same application. The digital assistant 122 is provided to assist users in various task processing requirements in different applications and scenarios. In the interaction process with the digital assistant 122, the user inputs an interactive message, and the digital assistant 122 provides a reply message in response to the user input. Typically, the digital assistant 122 can support users to input questions in a natural language, and perform tasks and provide replies based on the understanding of natural language input and logical reasoning ability.
[0037] In some embodiments, digital assistant 122 can interact with end user 145 as a contact of end user 145. For example, digital assistant 122 can be implemented in an instant messaging (IM) application. Digital assistant 122 can interact with end user 145 in a single chat session with end user 145. In some embodiments, digital assistant 122 can interact with multiple users in a group chat session including multiple users.
[0038] For each terminal user 145, the client of the application running part can present an interactive window 142 of the target application 120 or the digital assistant 122 in the client interface, such as a conversation window with the digital assistant 122. The terminal user 145 can enter a conversation message in the conversation window, and the target application 120 can determine the reply message of the digital assistant 122 based on the created configuration information and present it to the user in the interactive window 142. In some embodiments, depending on the configuration of the target application 120, the interactive message with the target application 120 may include a message in a multimodal form, such as a text message (e.g., a natural language text), a voice message, an image message, a video message, and the like.
[0039] Similar to the application creation part, the application running part can be deployed locally on the terminal device of each terminal user 145, and / or can be supported by the server device. For example, the terminal device of the terminal user 145 can run a client with the application running part, and the client can support the interaction between the user and the application running part provided by the server. In the case where the application running part runs locally on the user's terminal device, the terminal user 145 can directly use the terminal device to interact with the local application running part. In the case where the application running part runs on the server device, the server device can realize the service supply to the client running in the terminal device based on the communication connection with the terminal device. The application running part can present the corresponding application page to the terminal user 145 based on the operation of the terminal user 145, so as to output and / or receive information related to the use of the application to the terminal user 145.
[0040] In some embodiments, the implementation of at least part of the functions of the target application 120 and / or the implementation of at least part of the functions of the digital assistant 122 in the target application 120 can be implemented based on the model. During the creation or operation of the target application 120, one or more models 155, such as the capabilities of the model 155, can be called. In the target application 120, the digital assistant 122 can use the model 155 to understand the user input and provide a reply to the user based on the output of the model 155.
[0041] During the creation process, the application management platform 110 needs to use the model 155 to determine whether the operation result of the target application 120 meets expectations when testing the target application 120. During the operation process, in response to different operation requests of the user of the target application 120, the application operation part may need to use the model 155 to determine the response result to the user.
[0042] Although shown as being independent of the application management platform 110, one or more models 155 may run on the application management platform 110, or other remote servers. In some embodiments, the model 155 may be a machine learning model, a deep learning model, a learning model, a neural network, etc. In some embodiments, the model may be based on a language model (LM). The language model can have question-answering capabilities by learning from a large amount of corpus. The model 155 may also be based on other appropriate models.
[0043] The application management platform 110 can run on appropriate electronic devices. The electronic devices here can be any type of device with computing capabilities, including terminal devices or server devices. The terminal device can be any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication systems (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio broadcast receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. The server device can include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. In some embodiments, the management platform 110 can be implemented based on cloud services.
[0044] It should be understood that the structure and functionality of the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure. For example, although a single user interacting with the application creation portion and a single user interacting with the application execution portion are shown, in reality multiple users can access the application management platform 110 to each create a digital assistant, and each digital assistant can be used to interact with multiple users.
[0045] At present, there are some problems in the creation of target applications and information processing based on target applications. For example, there is a lack of effective support for multimodal content (e.g., pictures, audio and video, files, etc.), which limits the richness of interactive content. In addition, traditional computer languages used to develop applications have limited expressiveness in building rich text interactive cards, making it difficult to create rich and data-driven message content.
[0046] To this end, an embodiment of the present disclosure provides an improved solution for application creation. In this solution, an instruction to add a message sending operation to a target application is received. Further, configuration information indicating the presentation style of a rich text message is determined. The configuration information has a format of a predetermined computer language. Moreover, based on the configuration information, a message sending operation is added to the target application. Additionally, an embodiment of the present disclosure also provides an improved solution for application creation. In this solution, in response to processing of user input including a message sending operation, configuration information indicating the presentation style of a rich text message is obtained. The configuration information has a format of a predetermined computer language. Based on the configuration information, a reply message to the user input is generated, and the reply message is presented. The reply message has the presentation style of the indicated rich text message.
[0047] It will be more clearly understood through the following description that, according to various embodiments of the present disclosure, a predetermined computer language is used to represent the presentation style of a rich text message. On the one hand, configuration information having a format of a predetermined computer language is determined by means of interaction with a configuration interface, and then the presentation style of the rich text message is configured. In this way, it is possible to enable application creation users to more intuitively construct and edit the presentation style of rich text messages in applications without having to deeply understand the underlying grammatical details, thereby conveniently creating rich, data-driven interactive content. Further, this is conducive to improving the quality and efficiency of interaction between terminal users and the created applications. On the other hand, a reply message for user input is generated based on the configuration information indicating the presentation style of the rich text message. In this way, interactive content with rich expressions (such as multimodal content, etc.) can be presented to users, thereby improving the quality and efficiency of interaction between terminal users and the created applications.
[0048] Some example embodiments of the present disclosure will be described in detail below with reference to the examples of the accompanying drawings. It should be understood that the pages shown in the accompanying drawings are only examples, and various page designs may actually exist. The various graphical elements in the page may have different arrangements and different visual representations, one or more of which may be omitted or replaced, and one or more other elements may also exist. The embodiments of the present disclosure are not limited in this respect.
[0049] The task management process described in the embodiments of the present disclosure may be implemented on an application management platform, a terminal device on which the application management platform is installed, and / or a server corresponding to the application management platform. In the following examples, for the sake of discussion, the description is from the perspective of the application management platform, for example Figure 1 The application management platform 110 shown. The user interface presented by the application management platform 110 can be presented via the terminal device of the user 145, and the application management platform 110 can receive user input via the terminal device of the user 145. In some embodiments of the present disclosure, the user 145 is the terminal user of the target application 120. It should be understood that the user interface presented by the application management platform 110 can also be presented via the terminal device of the user 105, and the application management platform 110 can also receive user input via the terminal device of the user 105. In some embodiments of the present disclosure, the user 105 is the creator, manager or maintainer of the target application 120.
[0050] Figure 2 FIG. 2 is a flowchart of a method 200 for creating an application according to some embodiments of the present disclosure. In some embodiments, the method 200 may be performed as follows: Figure 1The application management platform 110 shown is executed. It should be understood that the method 200 may also include additional blocks not shown and / or may omit one (or some) of the blocks shown, and the scope of the present disclosure is not limited in this respect.
[0051] At block 202, an indication to add a message sending operation to a target application 120 is received. The target application (e.g., target application 120) is configured to perform user interactions at least in part using a machine learning model. For example, the target application 120 can interact with a user through a digital assistant 122. During the interaction with the user, the target application can utilize one or more machine learning models in order to perform one or more tasks related to the user input. For example, the target application utilizes a machine learning model according to a configured function or workflow.
[0052] In some embodiments, in response to receiving an instruction to add a message sending operation to the target application 120, a configuration interface for the presentation style of the rich text message may be presented. For example, if the application creation user 105 adds a message sending operation in the function or workflow of the target application 120, a configuration interface for the presentation style of the rich text message may be presented.
[0053] Figure 3 An example interface 300 for creating an application according to some embodiments of the present disclosure is shown. Figure 3 As shown, if the application creation user 105 triggers (e.g., by clicking, long pressing, etc.) a node 310 for adding an operation, the application management platform 110 may present a menu 320 for selecting an operation to be performed next. If the application creation user 105 triggers a send message control 330, a configuration interface for a presentation style of a rich text message may be presented. Figure 4 An example configuration interface 400 is shown according to some embodiments of the present disclosure. Figure 4 As shown, interface 400 may include an editable area 410 , a control 420 for using a rich text editor, and a control 430 for using a template.
[0054] Return to Reference Figure 2 In block 204, configuration information indicating a presentation style of a rich text message is determined. The configuration information has a format of a predetermined computer language. The predetermined computer language can describe various elements required in a rich text message, for example, it can be defined by a rich text expression protocol.
[0055] In some embodiments, the predetermined computer language may include predetermined tags for editing text styles, predetermined tags for multimodal content, predetermined tags for interface interaction elements, and the like. For example, specific tags may be introduced to support the embedding and interaction of multimodal content such as pictures, audio and video, and files. Additionally, a set of grammatical rules for rich text interaction cards may be defined, so that the user 105 can construct card content containing interactive elements such as buttons, forms, and lists. This will be referred to below. Figure 5 Further message description.
[0056] Exemplarily, the predetermined computer language may include the Markdown language or any other suitable language extended for the Markdown language, for example, the rich text protocol Markdown Extension (MDX) language extended based on the Markdown language. It should be understood that the predetermined computer language may be any other suitable computer language, and the scope of the present disclosure is not limited in this respect.
[0057] refer to Figure 4 , the configuration information can be determined based on the interaction between the application creation user 105 and the configuration interface 400. In some embodiments, the application creation user 105 can directly enter the source code in the editable area 410 to edit the desired presentation style of the rich text message. For example, the source code entered by the user 105 can be used as the configuration information.
[0058] In some alternative embodiments, in response to detecting a predetermined operation, a set of editing components for the presentation style may be presented. For example, the predetermined operation may include a trigger operation on a trigger control. The trigger control is used for an editor of a predetermined computer language. An example of a trigger control is Figure 4 420 for using a rich text editor. If the user 105 triggers the control 420, a set of editing components for the presentation style may be presented.
[0059] refer to Figure 5 , which shows an example rich text editing interface 500 according to some embodiments of the present disclosure. Figure 5As shown, a group of editing components 515 for presentation styles are presented in the rich text editing area 510. Exemplarily and not restrictively, the group of editing components 515 may include components for editing text styles. For example, components for bold characters, components for italic characters, components for modifying fonts, components for adjusting indents, components for highlighting characters, and the like. Additionally or alternatively, the group of editing components 515 may include components for adding multimodal content. Examples of multimodal content include, but are not limited to, files, pictures, audio, video, hyperlinks, and the like. In addition, the group of editing components 515 may also include components for adding interface interaction elements. For example, interface interaction elements may include buttons, forms, lists, and the like. In this way, the possibility of creating richer interactive content can be provided to the application creation user 105, thereby enriching the functionality of the created target application 120.
[0060] Further, the received interaction with at least one editing component in the set of editing components may be converted into configuration information. In some embodiments, each editing component may correspond to a tag in a predetermined computer language. For example, a component for bolding characters may correspond to a tag " <bold>", the component used to highlight characters can correspond to the tag " <highlight>", the component for adding a button can correspond to the tag " <button>". If user 105 triggers a certain component for specific content, a mark corresponding to the component can be added for the specific content in the configuration information. Exemplarily, if the application creates a situation where user 105 triggers a highlighting component for the characters "A, B, C, D" (not shown) in the rich text editing area 510, then in the configuration information, a mark " <highlight>",For example," <highlight>A, B, C, D <highlight>It should be understood that the above examples are only for the purpose of facilitating understanding, and the scope of the present disclosure is not limited in this respect.
[0061] In this way, a rich text editor that is used to create message content in an application can be implemented, supporting visual editing and real-time preview, and realizing a WYSIWYG message content editing method. In addition, this does not require the application creator to master the computer language used to describe the presentation style of rich text messages, so that the application creator can more intuitively construct and edit the presentation style of rich text messages in the application without having to deeply understand the underlying syntax details.
[0062] In addition, by triggering control 520, user 105 can also switch back to source code-based interface 400 to further adjust the code generated based on the rich text editor. This provides more freedom and flexibility for adjusting the rich text message presentation style, thereby improving the personalization of the created application.
[0063] In other embodiments, if the user 105 triggers Figure 2 If the control 430 for using the template is shown in , the application management platform 110 can present a selection interface for the presentation style template of the rich text message. Figure 6 An example template selection interface 600 according to some embodiments of the present disclosure is shown. Figure 6 As shown, multiple candidate templates for rich text message presentation styles may be presented to the user 105, such as a data list template, an article list template, a pie chart template, an event push template, a daily report template, a data list template, a bar chart template, etc. These templates may be predetermined, or may be automatically generated by the application management platform 110, or may be obtained from an external device. It should be understood that Figure 6 The templates shown in are merely exemplary and non-limiting, and any other suitable templates may also be provided to the user 105 .
[0064] In response to the selection of a presentation style template from among the plurality of presentation style templates, a code expressed in a predetermined computer language corresponding to the selected presentation style template may be presented. For example, if the user 105 selects a bar graph template in the interface 600, the configuration interface 400 may be jumped to, and the code based on the predetermined computer language corresponding to the selected bar graph template may be automatically filled in the editable area 410.
[0065] Further, the configuration information can be determined based on a code expressed in a predetermined computer language. For example, the code can be directly determined as the configuration information. In this way, the user can be enabled to determine the presentation style of the rich text message directly based on the template. This does not require the application creator to master the computer language used to describe the presentation style of the rich text message, thereby allowing the application creator to more intuitively construct and edit the presentation style of the rich text message in the application without having to deeply understand the underlying syntax details.
[0066] In other embodiments, the user 105 can further edit the code corresponding to the selected presentation style template. For example, in the case of receiving an editing operation on the code, the application management platform 110 can update the code based on the editing operation, and determine the updated code as configuration information. In this way, more flexibility and freedom can be provided for the user 105 to create applications, so that rich and data-driven interactive content can be conveniently created.
[0067] Return to Reference Figure 2 In block 206, a message sending operation can be added to the target application 120 based on the configuration information, thereby completing the configuration of the message sending operation. In some embodiments, the message can be implemented in the form of a message card. Alternatively, the message can be implemented in the form of a pop-up window. The scope of the present disclosure is not limited in this respect.
[0068] It can be seen from the above description that according to the various embodiments of the present disclosure, configuration information in the format of a predetermined computer language is determined by means of interaction with a configuration interface, and then the presentation style of rich text messages is configured. In this way, it is possible for application creation users to more intuitively construct and edit the presentation style of rich text messages in applications without having to deeply understand the underlying grammatical details, so that it is convenient to create rich, data-driven interactive content, thereby improving the quality and efficiency of interaction between terminal users and the created applications. On the other hand, the use of a predetermined computer language (for example, defined by a protocol) can enhance the certainty of the message content generated using a machine learning model, especially the certainty of the format of the message content. Furthermore, the generated message content can be presented to the user in a stable style, so that the user has a consistent experience.
[0069] Figure 7 FIG. 7 is a flowchart of a method 700 for information processing according to some embodiments of the present disclosure. In some embodiments, the method 700 may be performed as follows: Figure 1 The target application 120 shown executes. It should be understood that the method 700 may also include additional blocks not shown and / or may omit one (or some) of the blocks shown, and the scope of the present disclosure is not limited in this respect.
[0070] In block 702, in response to processing user input in a target application including a message sending operation, configuration information indicating a presentation style of a rich text message is obtained. The target application (e.g., target application 120) is configured to perform user interaction at least in part using a machine learning model. For example, the user can be interacted with through a digital assistant. The configuration information has a format of a predetermined computer language. The message sending operation can be based on, for example, the above reference Figures 2 to 6 The described manner is configured and the predetermined computer language has been described in detail above, and the present disclosure will not repeat them here.
[0071] In block 704, based on the configuration information, a reply message for the user input is generated. The reply message has the indicated presentation style. In some embodiments, the reply content of the reply message can be obtained. The reply content has the format of a first computer language. Further, it can be determined based on the configuration information whether the indicated presentation style includes a style defined by a predetermined editing component. In response to the indicated presentation style including a style defined by a predetermined editing component, the style defined by the predetermined editing component can be converted into a first computer language. In addition, a reply message can be generated based on the reply content and the converted style of the first computer language. In the case where the user input and the reply message occur in the target session, the reply content and the converted style having the format of the first computer language can be converted into the format of a second computer language used by the target session to obtain a reply message. Exemplarily, the first computer language can be an Artificial Intelligence Domain Specific Language (AIDSL), and the second computer language can be a Card Domain Specific Language (CardDSL). It should be understood that the first computer language and the second computer language can also be any other suitable computer language, and the scope of the present disclosure is not limited in this respect.
[0072] Figure 8 An example process 800 of information processing according to some embodiments of the present disclosure is shown. The producer of the reply message may include built-in functions and / or the above referenced Figures 2 to 6 The configured functional message node (for example, a node in a function or skill created by an application creator). The reply content generated by the producer may be expressed in AIDSL, for example. At 810, it is determined whether the reply content expressed in AIDSL needs to be converted into CardDSL, that is, whether the reply content needs to be presented in a message card. In the case where conversion is required, further, based on the configuration information, it is determined whether the indicated presentation style includes a style defined by a predetermined editing component, such as a predetermined mark for multimodal content, a predetermined mark for an interface interaction element, a predetermined mark for an editing text style, a widget, and the like. In the case where the indicated presentation style does not include a style defined by a predetermined editing component, AIDSL may be directly converted into CardDSL, and the reply content expressed in CardDSL may be returned. In the case where the indicated presentation style includes a style defined by a predetermined editing component, the MDX describing the defined style may be first converted into AIDSL, and AIDSL may be further converted into CardDSL, and the reply content expressed in CardDSL may be returned. Additionally, if the reply content involves a user ID, the user ID replacement service of each channel can be called to replace the user ID of the channel during the conversion of AIDSL to CardDSL. The above-mentioned computer language conversion process can be implemented in a function as a service (FaaS) platform, for example.
[0073] Furthermore, a card server may be used to generate a card entity corresponding to the rich text message based on the reply content expressed in CardDSL, i.e., a message card for presenting the reply message. When the terminal user 145 is using a digital assistant, the card entity may be directly presented in the digital assistant. When the application creator 105 is debugging the application, the card entity may be presented in the debugging interface.
[0074] In this way, the reply message can be rendered and generated based on the reply content and the configuration information of the presentation style for the rich text message. This makes it possible to support the presentation of rich, data-driven interactive content to the user, thereby improving the quality and efficiency of the interaction between the user and the created application.
[0075] Based on the above description, it can be seen that according to the scheme of each embodiment of the present disclosure, a set of rich text expression protocols based on Markdown syntax extension is proposed, which supports a rich text editor that is visible and available, and an interactive card rendering scheme that is matched with the device. By extending the Markdown syntax, specific tags are introduced to support multimodality such as pictures, audio and video, and files, so that messages can support the embedding and interaction of multimodal content. With the help of a rich text interactive card renderer, a set of grammatical rules for rich text interactive cards are defined, enabling users to construct card content containing interactive elements such as buttons, forms, and lists. These card components can be closely integrated with the logic of the digital assistant to implement complex interactive logic. In addition, the rich text editor supports visual editing and real-time preview, which enables users to intuitively construct and edit rich text interactive cards without having to deeply understand the underlying grammatical details. Therefore, users can easily create rich, data-driven interactive content, thereby improving the quality and efficiency of interaction with digital assistants. On the other hand, the use of a predetermined computer language (for example, defined by a protocol) can enhance the certainty of the message content generated using a machine learning model, especially the certainty of the format of the message content. Furthermore, the generated message content can be presented to the user in a stable style, so that the user has a consistent experience.
[0076] The embodiments of the present disclosure also provide corresponding devices and apparatuses for implementing the above methods or processes. Fig. 9 A block diagram of an example apparatus 900 for application creation according to some embodiments of the present disclosure is shown. The apparatus 900 may be used to implement the method according to various embodiments of the present disclosure. The apparatus 900 may include a receiving module 902, a determining module 904, and an adding module 906.
[0077] The receiving module 902 is configured to receive an instruction to add a message sending operation to the target application. The determining module 904 is configured to: determine configuration information indicating a presentation style of a rich text message, the configuration information having a format of a predetermined computer language. The adding module 906 is configured to add a message sending operation to the target application based on the configuration information.
[0078] In some embodiments, the determination module 904 is further configured to: present a set of editing components for the presentation style in response to detecting a predetermined operation; and convert a received interaction with at least one editing component in the set of editing components into configuration information.
[0079] In some embodiments, a set of editing components includes at least one of the following: a component for editing a text style, a component for adding multimodal content, or a component for adding an interface interaction element.
[0080] In some embodiments, the predetermined operation includes a triggering operation on a triggering control, where the triggering control is used for an editor of a predetermined computer language.
[0081] In some embodiments, the determination module 904 is further configured to: in response to selection of a presentation style template from a plurality of presentation style templates, present code expressed in a predetermined computer language corresponding to the selected presentation style template; and determine configuration information based on the code expressed in the predetermined computer language.
[0082] In some embodiments, determining the configuration information based on the code expressed in the predetermined computer language includes: in response to receiving an editing operation for the code, updating the code based on the editing operation; and determining the updated code as the configuration information.
[0083] In some embodiments, the predetermined computer language includes at least one of the following: a predetermined tag for multimodal content, or a predetermined tag for an interface interaction element.
[0084] Fig.10 A block diagram of an example apparatus 1000 for information processing according to some embodiments of the present disclosure is shown. The apparatus 1000 may be used to implement the methods according to various embodiments of the present disclosure. The apparatus 1000 may include an acquisition module 1002, a generation module 1004, and a presentation module 1006.
[0085] The acquisition module 1002 is configured to: in response to processing the user input including the message sending operation, acquire configuration information indicating the presentation style of the message content. The configuration information has the format of a predetermined computer language. The generation module 1004 is configured to: based on the configuration information, generate a reply message for the user input. The reply message has the indicated presentation style. The presentation module 1006 is configured to present the reply message.
[0086] In some embodiments, the generation module 1004 is also configured to: obtain reply content of the reply message, the reply content having the format of a first computer language; based on the configuration information, determine whether the indicated presentation style includes a style defined by a predetermined editing component; in response to the indicated presentation style including a style defined by a predetermined editing component, convert the style defined by the predetermined editing component into the first computer language; and generate a reply message based on the reply content in the first computer language and the converted style.
[0087] In some embodiments, the user input and the reply message occur in a target session. Generating the reply message based on the reply content and the converted style in the first computer language includes: converting the reply content and the converted style in the format of the first computer language into the format of the second computer language used by the target session to obtain the reply message.
[0088] In some embodiments, the predetermined computer language includes at least one of the following: a predetermined tag for multimodal content, or a predetermined tag for an interface interaction element.
[0089] The modules and / or units included in the apparatus 900 and the apparatus 1000 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units in the apparatus 800 can be implemented at least in part by one or more hardware logic components. As an example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0090] Fig. 9 Forehead Fig.10 The modules and / or units shown in the can be partially or completely implemented as hardware modules, software modules, firmware modules or any combination thereof. In particular, in some embodiments, the processes, methods or procedures described above can be implemented by hardware in the storage system or a host corresponding to the storage system or other computing devices independent of the storage system.
[0091] Fig.11 1 shows a block diagram of a device 1100 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Fig.11 The electronic device 1100 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Fig.11 The electronic device 1100 shown can be used to implement Figure 1 The application management platform 110, the target application 120 and / or the method described above are shown in FIG.
[0092] like Fig.11 As shown, the electronic device 1100 is in the form of a general electronic device. The components of the electronic device 1100 may include, but are not limited to, one or more processors or processing units 1110, a memory 1120, a storage device 1130, one or more communication units 1140, one or more input devices 1150, and one or more output devices 1160. The processing unit 1110 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 1120. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 1100.
[0093] The electronic device 1100 typically includes a plurality of computer storage media. Such media may be any available media accessible to the electronic device 1100, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1120 may be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1130 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data (e.g., training data for training) and may be accessed within the electronic device 1100.
[0094] The electronic device 1100 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig.11 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 1120 may include a computer program product 1125 having one or more program modules that are configured to perform various methods or actions of various implementations of the present disclosure.
[0095] The communication unit 1140 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 1100 can be implemented in a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 1100 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.
[0096] The input device 1150 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 1160 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 1100 may also communicate with one or more external devices (not shown) through the communication unit 1140 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 1100, or communicate with any device that allows the electronic device 1100 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).
[0097] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, the computer program product is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is provided, on which a computer program is stored, and when the program is executed by a processor, the method described above is implemented.
[0098] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.
[0099] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0100] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0101] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.
[0102] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.< / highlight> < / highlight> < / highlight> < / button> < / highlight> < / bold>
Claims
1. A method for creating an application, comprising: receiving an indication to add a message sending operation to a target application, the target application being configured to utilize, at least in part, a machine learning model to perform user interactions; Determining configuration information indicating a presentation style of a rich text message, the configuration information having a format in a predetermined computer language; as well as The message sending operation is added to the target application based on the configuration information.
2. The method of claim 1, wherein determining the configuration information comprises: In response to detecting a predetermined operation, presenting a set of editing components for the presentation style; as well as The received interactions with at least one editing component of the set of editing components are converted into the configuration information.
3. The method of claim 2, wherein the set of editing components includes at least one of: A component for editing text styles. A component for adding multimodal content, or Components for adding interactive elements to the interface. 4 . The method according to claim 2 , wherein the predetermined operation comprises a trigger operation on a trigger control, the trigger control being used for an editor of the predetermined computer language.
5. The method of claim 1 , wherein determining the configuration information comprises: In response to selection of a presentation style template from among the plurality of presentation style templates, presenting a code expressed in the predetermined computer language corresponding to the selected presentation style template; as well as The configuration information is determined based on the code expressed in the predetermined computer language.
6. The method of claim 5, wherein determining the configuration information based on the code expressed in the predetermined computer language comprises: In response to receiving an editing operation on the code, updating the code based on the editing operation; as well as The updated code is determined as the configuration information.
7. The method according to claim 1, wherein the predetermined computer language comprises at least one of the following: Predetermined markup for multimodal content, or Predetermined markup for interactive elements of the interface.
8. An information processing method, comprising: In response to processing of a user input in a target application including a message sending operation, obtaining configuration information indicating a presentation style of a rich text message, the configuration information having a format in a predetermined computer language, and the target application being configured to perform user interaction at least in part using a machine learning model; Based on the configuration information, generating a reply message for the user input, the reply message having the indicated presentation style; as well as The reply message is presented.
9. The method of claim 8, wherein generating a reply message to the user input comprises: Acquire reply content of the reply message, wherein the reply content has a format of a first computer language; Based on the configuration information, determining whether the indicated presentation style includes a style defined by a predetermined editing component; In response to the indicated presentation style including the style defined by the predetermined editing component, converting the style defined by the predetermined editing component into the first computer language; as well as The reply message is generated based on the reply content and the converted style in the first computer language.
10. The method of claim 9, wherein the user input and the reply message occur in a target conversation, and generating the reply message based on the reply content and the transformed style in the first computer language comprises: The reply content and the converted style in the format of the first computer language are converted into the format of a second computer language used by the target session to obtain the reply message.
11. The method according to claim 8, wherein the predetermined computer language comprises at least one of the following: Predetermined markup for multimodal content, or Predetermined markup for interactive elements of the interface.
12. A device for creating an application, comprising: A receiving module configured to: receive an instruction to add a message sending operation to a target application, wherein the target application is configured to perform user interaction at least in part using a machine learning model; A determination module is configured to: determine configuration information indicating a presentation style of a rich text message, wherein the configuration information has a format of a predetermined computer language; as well as The adding module is configured to: add the message sending operation to the target application based on the configuration information.
13. An apparatus for information processing, comprising: an acquisition module configured to: in response to processing of a user input in a target application including a message sending operation, acquire configuration information indicating a presentation style of a rich text message, the configuration information having a format in a predetermined computer language, and the target application being configured to perform user interaction at least in part using a machine learning model; A generating module, configured to: generate a reply message for the user input based on the configuration information, wherein the reply message has the indicated presentation style; as well as The presentation module is configured to present the reply message.
14. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit, the instructions when executed by the at least one processing unit cause the electronic device to perform the method according to any one of claims 1 to 11.
15. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Message sending method and device, electronic equipment and storage medium
CN115600980A
Transmission method and device, equipment and readable storage medium
CN115687733A
Method and device for generating reply information, equipment and medium
CN116521841A
Message processing method and device, equipment and medium
CN118296122A
Method and device for creating digital assistant, equipment and storage medium
CN118410133A
