Information processing method and device, equipment and storage medium

Abstract

The embodiment of the invention provides an information processing method and device, equipment and a storage medium. The method comprises the following steps: in response to a function block configuration instruction received for a session between a user and a digital assistant, presenting a configuration interface of a plurality of function blocks available to the digital assistant; receiving function block configuration information for the session through the configuration interface, wherein the function block configuration information at least indicates at least one candidate function block in an enabled state in the plurality of function blocks; and generating a reply of the digital assistant to the user input of the user based on the function block configuration information.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and in particular, to methods, apparatuses, devices, and computer-readable storage media for information processing. Background Art

[0002] With the development of information technology, various terminal devices can provide various services to users in aspects such as work and life. For example, applications that provide services can be deployed in terminal devices. An application can be designed to provide a digital assistant to a user and present functional blocks for implementing various services or functions. The digital assistant can utilize the functional blocks in the application to assist the user in processing various information. Summary of the Invention

[0003] In a first aspect of the present disclosure, a method for information processing is provided. The method includes: in response to receiving a functional block configuration instruction for a session between a user and a digital assistant, presenting a configuration interface for a plurality of functional blocks available to the digital assistant; receiving, through the configuration interface, functional block configuration information for the session, the functional block configuration information at least indicating at least one candidate functional block among the plurality of functional blocks that is in an enabled state; and generating, based on the functional block configuration information, a reply of the digital assistant to a user input of the user.

[0004] In a second aspect of the present disclosure, an apparatus for information processing is provided. The apparatus includes: a functional block presentation module configured to present a configuration interface for a plurality of functional blocks available to the digital assistant in response to receiving a functional block configuration instruction for a session between a user and the digital assistant; a functional block configuration module configured to receive, through the configuration interface, functional block configuration information for the session, the functional block configuration information at least indicating at least one candidate functional block among the plurality of functional blocks that is in an enabled state; and an information reply module configured to generate, based on the functional block configuration information, a reply of the digital assistant to a user input of the user.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory, the at least one memory being coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the device to execute the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided. A computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] In a fifth aspect of the present disclosure, there is provided a computer program product. The computer program product is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0008] It should be understood that the content described in this content part is not intended to define the key features or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In conjunction with the accompanying drawings and with reference to the following detailed description, the above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent. In the drawings, the same or similar reference numerals denote the same or similar elements, where:

[0010] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0011] Figures 2A to 2F An example interface for information processing according to some embodiments of the present disclosure;

[0012] Figure 3 A schematic diagram showing an example process for information processing according to some embodiments of the present disclosure;

[0013] Figure 4 A flowchart showing an example process for information processing according to some embodiments of the present disclosure;

[0014] Figure 5 A schematic structural block diagram showing an example device for information processing according to some embodiments of the present disclosure; and

[0015] Figure 6 A block diagram of an electronic device capable of implementing multiple embodiments of the present disclosure. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0016] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0017] Note that the titles of any sections / subsections provided in this document are not restrictive. Various embodiments are described throughout this document, and any type of embodiment can be included under any section / subsection. Additionally, the embodiments described in any section / subsection can be combined with any other embodiments described in the same section / subsection and / or different section / subsections in any manner.

[0018] In the description of the embodiments of the present disclosure, the term "comprising" and its like shall be understood as an open inclusion, that is, "including but not limited to". The term "based on" shall be understood as "at least partially based on". The term "an embodiment" or "the embodiment" shall be understood as "at least one embodiment". The term "some embodiments" shall be understood as "at least some embodiments". There may also be other explicit and implicit definitions hereinafter. Terms such as "first", "second", etc. may refer to different or the same objects. There may also be other explicit and implicit definitions hereinafter.

[0019] Embodiments of the present disclosure may involve the user's data, data acquisition and / or use, etc. These aspects all comply with the corresponding laws, regulations and related provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware and confirms. Accordingly, when implementing the embodiments of the present disclosure, the types, usage scopes, usage scenarios, etc. of the data or information that may be involved should be informed to the user and the user's authorization should be obtained through appropriate means in accordance with the relevant laws and regulations. The specific notification and / or authorization methods may vary according to the actual situation and application scenarios, and the scope of the present disclosure is not limited in this regard.

[0020] In the solutions of this specification and embodiments, if personal information processing is involved, it will be processed on the premise of having a legal basis (such as obtaining the consent of the personal information subject, or being necessary for performing a contract, etc.), and will only be processed within the specified or agreed scope. The user's refusal to process personal information other than the necessary information required for basic functions will not affect the user's use of basic functions.

[0021] The following further describes various example implementations of the solution in detail in conjunction with the accompanying drawings.

[0022] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. As Figure 1 shown, the example environment 100 may include a user 110, a terminal device 120 associated with the user 110, and a server 150.

[0023] In environment 100, the terminal device 120 can be any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable game terminals, VR / AR devices, Personal Communication System (PCS) devices, personal navigation devices, Personal Digital Assistant (PDA), audio / video players, digital cameras / video cameras, positioning devices, television receivers, radio broadcast receivers, e-book devices, game devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 120 can also support any type of interface for the user 110 (such as a "wearable" circuit, etc.).

[0024] An application 130 that provides services can be deployed in the terminal device 120. The application 130 can be of various types, which can provide a digital assistant to assist the user 110 in processing information or interacting with the user 110. Therefore, the application 130 can be regarded as an application with intelligent conversation capabilities. In some embodiments, the digital assistant provided by the application 130 can be implemented by a machine learning model (also simply referred to as a model) with certain capabilities (such as language generation, logical reasoning, multi-modal processing, etc.) configured by a server 150 communicatively connected to the application 130. The model can be used to process the information of the interaction between the user 110 and the application 130 to meet the interaction needs of the user 110.

[0025] As an example, the server 150 communicatively connected to the application 130 may be configured with a Large Language Model (LLM). The LLM may perform natural language processing on the text information input by the user 110 through the application 130 to generate a reply to the user input that meets the user's requirements. As another example, the server 150 communicatively connected to the application 130 may be configured with a Computer Vision (CV) model. The CV model may perform image classification, object detection, image segmentation, etc. on the image information input by the user 110 through the application 130 to generate a reply to the image information that meets the user's requirements. As another example, the server 150 communicatively connected to the application 130 may be configured with a multimodal model. The multimodal model may process various modalities of information (e.g., images, text) input by the user 110 through the application 130 to generate a reply to the multimodal information that meets the user's requirements. It should be understood that only example models configured for the server communicatively connected to the application are given here. In actual applications, more, fewer, or other models may be configured for the server communicatively connected to the application according to requirements, and the embodiments of the present disclosure are not limited thereto. The information processed by the digital assistant in the application 130 to assist the user 110 or the information interacted with the user 110 may be various types of information, including: text information, image information, audio-visual information, and so on.

[0026] In some embodiments, the application 130 or the digital assistant provided by the application 130 may be configured or integrated with multiple functional blocks. A functional block refers to a module formed by encapsulating code or instructions for implementing a specific function. Different functional blocks may be used to implement different services or functions. A functional block may be regarded as or implemented as a callable tool. A functional block may at least partially utilize a machine learning model (e.g., LLM) to implement a specific function or service, such as image generation, text translation, data analysis, etc. In some embodiments, a functional block may be implemented as a workflow including one or more processing nodes. A processing node may utilize a machine learning model (e.g., LLM) to process the input information of the node. As an example, the application 130 may be an office management application. The application 130 and / or the digital assistant may be configured or integrated with functional blocks for implementing services such as data analysis, process management, task management, schedule arrangement, address book, etc. As another example, the application 130 may be an artificial intelligence application. The application 130 and / or the digital assistant may be configured or integrated with functional blocks for implementing services such as chat Q&A, picture drawing, translation, writing, etc. It should be understood that only example applications and example functional blocks in the applications are given here. The present disclosure is not limited to applicable applications and functional blocks configured or integrated in the applications.

[0027] It should be understood that only exemplary application examples applicable to the present disclosure are given above. The present disclosure is applicable to any suitable application. User 110 can interact with Application 130 via Terminal Device 120 and / or its attached devices.

[0028] In some embodiments, if Application 130 is in an active state, Terminal Device 120 can present Interface 140 through Application 130. Interface 140 can be any interface in Application 130, including: a setting interface for a digital assistant, a function block configuration interface, an interface for receiving user input, and so on.

[0029] In some embodiments, Terminal Device 120 communicates with Server 150 to implement the supply of services for Application 130.

[0030] Server 150 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 150 can include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and so on. Server 150 can provide background services for Application 130 in Terminal Device 120.

[0031] A communication connection can be established between Server 150 and Terminal Device 120. The communication connection can be established by wired or wireless means. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc. Embodiments of the present disclosure are not limited in this regard.

[0032] It should be understood that the structures and functions of the various elements in Environment 100 are described only for exemplary purposes and do not imply any limitation on the scope of the present disclosure.

[0033] Currently, for applications with intelligent conversation capabilities, due to the limited capabilities of the configured model itself and the limited functions that the configured predetermined function blocks can achieve, it is difficult to meet the personalized and differentiated needs of users. Existing applications usually only support users to select the required function blocks from the predetermined function blocks configured in the application, and cannot support users to customize function blocks according to their own needs. This further causes the application to be unable to meet the personalized needs of users. In addition, if the user selects to use a specific function block before entering information, the application can only call the specific function block selected by the user to process the input message, and cannot flexibly determine whether other function blocks in the application need to be called. This results in poor flexibility of the application and a poor user experience when using the application.

[0034] Embodiments of the present disclosure propose a solution for information processing. In this solution, in response to receiving a function block configuration instruction for a session between a user and a digital assistant, a configuration interface for the function blocks available to the digital assistant is presented. Function block configuration information for the session is received through the configuration interface, and the function block configuration information at least indicates candidate function blocks in the presented function blocks that are in an enabled state. Based on the function block configuration information, a reply from the digital assistant to the user input is generated.

[0035] In this way, the embodiments of the present disclosure can support users to configure the function blocks available to the digital assistant through the configuration interface of the function blocks, and support users to enable the function blocks that need to be used in the configuration interface. That is to say, users can independently configure the function blocks that need to be used through the configuration interface. In this way, the operation flexibility of the function blocks can be improved, the personalized needs of users can be met, and the user experience can be improved. In the interaction, a reply to the user input can be generated based on the function block configuration information of the user. Or rather, a reply to the user input can be generated using the candidate function blocks enabled by the user. In this way, the generated reply can be made more in line with the personalized needs of the user, further improving the user experience.

[0036] Some example embodiments of the present disclosure will be further described below with reference to the accompanying drawings.

[0037] Figures 2A to 2F Example interfaces 200A to 200F according to some embodiments of the present disclosure are shown. The interfaces 200A to 200F can be provided, for example, by Figure 1 the terminal device 120 shown.

[0038] It should be understood that the interfaces shown in the drawings are merely examples, and various interface designs can actually exist. Each graphical element in the interface can have different arrangements and different visual representations, one or more of which can be omitted or replaced, and there can also be one or more other elements. The embodiments of the present disclosure are not limited in this regard. In addition, in the following, example embodiments will be mainly described with respect to the terminal device 120. It should be understood that the actions described with respect to the terminal device 120 can be performed by the application 130 on the terminal device 120, or can be performed by the application 130 in cooperation with its server (for example, the server 150). In some embodiments, in the scenario where the terminal device 120 cooperates with its server (for example, the server 150) to execute, the terminal device 120 can request the server to provide the information to be presented, or the server will actively or in response to the operation of the terminal device 120 provide the information to be presented to the terminal device 120. In this document, the server 150 can use the LLM to generate a reply to the user input. The server 150 can provide the generated reply to the terminal device 120.

[0039] In some embodiments, the terminal device 120 can provide through the application 130 Figure 2A the example interface 200A shown. The interface 200A can indicate the session interface of the user 110 with the digital assistant provided by the application 130. The interface 200A can at least include an area 210 for receiving user input, a component 211 for a function block, and a sending component 212 for the user input. Exemplarily, if the user 110 expects to configure the function block used by the application 130, the component 211 can be triggered. The triggering of the component 211 can generate a function block configuration indication.

[0040] In the embodiments of the present disclosure, the terminal device 211 presents a configuration interface for the function blocks available to the digital assistant in response to receiving a function block configuration indication for the session of the user 110 with the digital assistant. The user 110 can independently configure the function blocks to be used in the configuration interface.

[0041] Figure 2BAn example configuration interface 200B is shown. The configuration interface 200B may at least include a function block configuration area 220. The area 220 may present information about each of a plurality of function blocks available to the digital assistant of the application 130. For example, the area 220 may include corresponding configuration components or configuration areas for these function blocks. In some embodiments, the plurality of function blocks may include at least one predetermined function block pre-configured for the digital assistant. For example, the configuration interface 200B presents a configuration component 221 for function block 1, a configuration component 222 for function block 2, a configuration component 223 for function block 3, a configuration component 224 for function block 4, ……, a configuration component for function block N. The information of the function block may include status information 225 of the function block and a control 226 indicating more configurations for the function block. As an example, function block 1 may be an image processing function block, and the component 226 may indicate the configuration of information such as image resolution and image size of the image processing function block. As another example, function block 1 may be a search engine function block, and the control 226 may indicate the configuration of the search engine adopted by the digital assistant. It should be understood that only examples of function block configuration information are given here. In practical applications, more, less, or other function block configuration information may be presented in the configuration interface according to needs, as long as this configuration information can meet the user's configuration requirements for the function block. The embodiments of the present disclosure are not limited thereto.

[0042] In an embodiment of the present disclosure, the terminal device 120 receives function block configuration information for a session between the user 110 and the digital assistant through the above configuration interface. The function block configuration information can at least indicate candidate function blocks in an enabled state among the function blocks available to the digital assistant. In other words, through the configuration interface, the user 110 can configure the tools expected to be used, such as at least enabling the tools expected to be used. The process of generating a reply to the user input based on the candidate function blocks indicated by the function block configuration information will be described below and will not be elaborated here.

[0043] The following continues to describe an example configuration process for the function block with reference to the drawings.

[0044] Continue to refer to Figure 2BIn the configuration interface 200B shown, user 110 can enable a certain number of function blocks according to their own needs. Exemplarily, if user 110 expects to use function block 1, function block 2, and function block 4, the user can trigger the "turn on" control corresponding to the function block to generate an enable indication for the function block. The terminal device 120 can present a visual element indicating that the function block is in an enabled state in the configuration interface 200B upon receiving the enable indication for the function block. Exemplarily, the visual element can be presenting the "turn on" control corresponding to the enabled function block as a selected state. For example, the terminal device 120 presents the "turn on" control corresponding to function block 1 enabled by user 110 in the form of a thick line frame in the configuration interface 200B to indicate that the "turn on" control corresponding to function block 1 is in a selected state. It should be understood that only an example visual element indicating that the function block is in an enabled state is given here, or rather, only an example presentation form of the control corresponding to the function block enabled by the user being in a selected state is given here. In practical applications, any appropriate visual element can be presented or the control corresponding to the enabled function block can be indicated in any appropriate form, as long as the user can intuitively determine that the function block is in an enabled state through these visual elements or presentation forms. The embodiments of the present disclosure are not limited thereto. It can be understood that the server 150 of application 130 can add the function blocks enabled by user 110 as candidate function blocks to generate a reply to the user input based on the candidate function blocks in the subsequent process.

[0045] In some embodiments, Figure 2B The configuration interface 200B shown can also present a custom component 227 for the function block. If the pre-configured predefined function blocks presented in the configuration interface 200B for the digital assistant cannot meet the needs of user 110, user 110 can trigger the custom component 227. Triggering the custom component 227 can generate a function block customization indication. After the terminal device 120 receives the function block customization indication, it can present information about the custom function block. The custom function block can be provided by any suitable service or provider (e.g., a third-party platform outside application 130). In some embodiments, the custom function block can be provided by the digital assistant creation service. The digital assistant creation service can support user 110 in creating a custom function block, or can provide user 110 with a custom function block corresponding to the permissions that user 110 has. The information of the custom function block can at least include the addition component corresponding to the custom function block. User 110 can add the corresponding custom function block to application 130 by triggering the addition component indication corresponding to the custom function block.

[0046] Exemplarily, after the terminal device 120 receives the function block customization indication through the configuration interface 200B, it can present Figure 2CThe interface 200C shown. The information of the custom function blocks presented by the interface 200C may include the information of the custom function blocks provided by a third-party platform. Exemplarily, as shown in the interface 200C, the third-party platform may include or provide Application 1, Application 2, ……, Application N. Correspondingly, on the interface 200C, a component 230 for Application 1 may be presented. It can be understood that the applications of the third-party platform may provide services different from those provided by Application 130 for the user 110.

[0047] Continuing to refer to Figure 2C the interface 200C shown, if the user 110 expects to select a custom function block provided or built-in by Application 1, the component 230 for Application 1 presented by the interface 200C can be triggered. After the terminal device 120 receives the selection of Application 1 through the interface 200C, components for the custom function blocks under Application 1 can be presented in the interface 200C, including the component 231 for custom function block 1, the component 232 for custom function block 2, the component 233 for custom function block 3, ……, the component for custom function block N. The interface 200C also presents an add control corresponding to the custom function block, such as the add control 234 corresponding to the custom function block 1 231. The user 110 can trigger the add control corresponding to the custom function block through the interface 200C. The terminal device 120 can respond to the trigger of the add control corresponding to the custom function block and update the state of the custom function blocks presented by the interface 200C. Exemplarily, if the terminal device 120 receives the trigger of the add control 235 corresponding to the custom function block 3 through the interface 200C, the custom function block 3 can be presented as the "added" state. It should be understood that only example information about the custom function blocks is given here. In practical applications, more, fewer, or other information about the custom function blocks can be presented as needed, as long as this information can meet the user's custom requirements for the function blocks, and the embodiments of the present disclosure do not limit this.

[0048] In some embodiments, after the terminal device 120 receives an add instruction for function block 3 through Figure 2C the interface 200C shown, it can update the configuration interface 200B of the function blocks available for the digital assistant of Application 130. As Figure 2D shown, the updated configuration interface 200D can present a configuration component 246 for function block M in the enabled state. It can be understood that function block M is function block 3 presented by the interface 200C. The terminal device 120 can also add function block M in the enabled state presented by the interface 200D as a candidate function block.

[0049] In some embodiments, the user 110 can trigger Figure 2ABefore the indicated instruction is sent to the user input component 212, a certain function block is selected from the candidate function blocks. In response to receiving a selection instruction for a certain function block (such as Figure 2D the function block 1 presented in the interface 200D shown), the terminal device 120 may present Figure 2E the interface 200E shown. The interface 200E may present information about the selected function block 1 in the upper area 250 of the area 210 indicating the user input, so as to prompt the user 110 about the selected function block. It should be understood that only an example presentation form of the selected function block is given here. In practical applications, the selected function block may be presented in any appropriate form in the session interface between the user and the digital assistant of the application, and the embodiments of the present disclosure do not limit this.

[0050] In some embodiments, in response to receiving a trigger for the user input sending component 212 through Figure 2E the interface 200E shown, the terminal device 120 may present Figure 2F the interface 200F shown. The area 260 in the interface 200F presents the information input by the user 110. The area 261 in the interface 200F presents the reply of the digital assistant of the application 130 to the information input by the user 110.

[0051] In some embodiments, before providing the user input to the digital assistant, the user 110 may select a function block from the candidate function blocks in the enabled state. The selected function block may be regarded as locked.

[0052] The following refers to the attached Figure 3 to describe an example process of generating a reply to the user input.

[0053] As Figure 3 shown, in some embodiments, the terminal device 120 passes through Figure 2EThe interface 200E shown can receive a trigger for the sending component 212 indicating user input, and can transmit the received user input to the server 150 communicatively connected to the application 130. The server 150 can split the user input into tasks. In some embodiments, the server 150 can utilize an agent with task planning capabilities to perform task splitting. The agent can call a machine learning model (e.g., LLM) based on the user input and the agent's function (or responsibilities) to achieve task splitting and planning. Exemplarily, the user input can be "Please provide the personal information of painter XXX and present their representative paintings". The agent can call the LLM to split the user input into task 1 indicating to search for "the personal information of painter XXX" and task 2 indicating to "present the representative paintings of painter XXX" in image form. It should be understood that only example user input and an example splitting process of the user input are given here. The embodiments of the present disclosure do not limit the information of the user input and the process of splitting the user input into tasks.

[0054] Further, the server 150 can match the split tasks with the candidate function blocks in the application 130 that are in an enabled state to determine a target function block for processing the user input from the candidate function blocks. Refer to Figure 3 processing branch 310 in to describe an example. If no candidate function block is selected or if no candidate function block is locked, the server 150 determines the candidate function block that matches the task as the target function block. Exemplarily, if the server 150 determines that task 1 in the user input does not match candidate function block 1, task 2 matches candidate function block 2, and task N matches candidate function block N, candidate function block 2 and candidate function block N can be determined as the target function blocks. It can be understood that the server 150 can call each target function block to process the task corresponding to the target function block and generate an execution result corresponding to the task.

[0055] It should be noted that if the target function block includes a custom function block of user 110, the server 150 can obtain the input parameter information and output parameter information of the custom function block based on the interface between the application 130 and the provider of the custom function block (such as the application of the third-party platform that provides the custom function block mentioned above). The server 150 can utilize the input parameter information in the user input that matches the custom function block for information processing, and generate a corresponding execution result based on the output parameter information of the custom function block.

[0056] Next, the server 150 can assemble the multiple execution results generated for the user input. The server 150 can call a model to generate a response to the user input based on the assembled results. The server 150 can output the generated response to the user input to the application 130 in the terminal device 120. The terminal device 120 can present the response to the user input through Figure 2F the area 261 in the interface 200F shown.

[0057] Refer to Figure 3 branch 320 in Figure 2D to describe another example. If the user 110 selects a certain candidate function block before sending the user input or a certain candidate function block is locked (for example, Figure 2F the function block 1 presented in the interface 200D shown), the server 150 defaults to calling the function block 1 and generating the corresponding execution result. In addition, the server 150 can also match the target function block for processing the task from the remaining candidate function blocks based on the task corresponding to the user input. After obtaining the corresponding execution result by calling the target function block, the server 150 can assemble the execution result corresponding to the function block 1 with the execution results corresponding to other target function blocks. Then the server 150 can call a model to generate a response to the user input based on the assembled results. The server 150 can output the generated response to the user input to the application 130 in the terminal device 120. The terminal device 120 can present the response to the user input through

[0058] the area 261 in the interface 200F shown.

[0059] In this way, the embodiments of the present disclosure can support a user to freely enable required function blocks through the configuration interface of the function blocks provided by the terminal device, thereby improving the operation convenience of the function blocks. The terminal device 120 also provides, through an application, components that support user-defined function blocks, so that the user can select or create custom function blocks from a third-party platform according to their own needs. In this way, not only the personalized and differentiated needs of the user are met, the user experience of using the application is improved, but also the scalability of the application is improved, enabling the application to be applicable to more fields and / or scenarios. In addition, after the user selects a certain function block before inputting information, the digital assistant of the application can not only generate a reply to the user input based on the function block selected by the user, but also flexibly determine and match whether there is a function block in the candidate function blocks that can assist in completing the task corresponding to the user input. If it is determined that there is a function block in the candidate function blocks that can assist in completing the task corresponding to the user input, the application can also call candidate function blocks other than the function block selected by the user to generate a reply to the user input. In this way, the flexibility of the application is improved, and the user experience of using the application is further improved.

[0060] Figure 4 FIG. 4 shows a flowchart of an example process 400 for information processing according to some embodiments of the present disclosure. The process 400 may be implemented at the terminal device 120. The following describes the process 400 with reference to Figure 1 FIG. 4.

[0061] As Figure 4 shown, at block 410, the terminal device 120 presents a configuration interface for a plurality of function blocks available to the digital assistant in response to receiving a function block configuration instruction for a session between the user 110 and the digital assistant.

[0062] At block 420, the terminal device 120 receives function block configuration information for the session through the configuration interface, and the function block configuration information at least indicates at least one candidate function block in an enabled state among the plurality of function blocks.

[0063] At block 430, the terminal device 120 generates a reply from the digital assistant to the user input of the user 110 based on the function block configuration information.

[0064] In some embodiments, the plurality of function blocks includes at least one predetermined function block pre-configured for the digital assistant, and the terminal device 120 receiving the function block configuration information includes: the terminal device 120 adds one or more predetermined function blocks as at least one candidate function block in response to receiving an enable instruction for one or more of the at least one predetermined function blocks through the configuration interface.

[0065] In some embodiments, the multiple functional blocks include at least one custom functional block accessible to the user 110, and the terminal device 120 receiving functional block configuration information includes: the terminal device 120 presenting information about at least one custom functional block in response to receiving a functional block customization instruction through a configuration interface; and the terminal device 120 adding the selected custom functional block as at least one candidate functional block in response to the selection of the custom functional block among at least one custom functional blocks.

[0066] In some embodiments, at least one custom functional block is provided by a digital assistant creation service.

[0067] In some embodiments, the terminal device 120 obtains input parameter information and output parameter information of the selected custom functional block from the provider of the selected custom functional block for generating a reply.

[0068] In some embodiments, the terminal device 120 presents a visual element in the configuration interface indicating that at least one candidate functional block is in an enabled state.

[0069] In some embodiments, the terminal device 120 generating a reply of the digital assistant to the user input includes: the terminal device 120 determining one or more target functional blocks from at least one candidate functional block based at least on at least one task indicated by the user input; the terminal device 120 obtaining corresponding execution results of the one or more target functional blocks; and the terminal device 120 determining a reply to the user input based on the corresponding execution results of the one or more target functional blocks.

[0070] In some embodiments, the terminal device 120 determining one or more target functional blocks includes: the terminal device 120 determining, in response to at least one candidate functional block not being selected by the user 110, a functional block that matches at least one task among at least one candidate functional blocks as one of the one or more target functional blocks.

[0071] In some embodiments, the terminal device 120 determining one or more target functional blocks includes: the terminal device 120 determining the first functional block as one of the one or more target functional blocks in response to the first functional block among at least one candidate functional blocks being selected by the user 110; and the terminal device 120 determining at least one second functional block that matches at least one task among at least one candidate functional blocks as part of the one or more target functional blocks.

[0072] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above methods or processes. Figure 5A schematic structural block diagram of an example device 500 for information processing according to certain embodiments of the present disclosure is shown. The device 500 can be implemented as or included in a terminal device 120. Each module / component in the device 500 can be implemented by hardware, software, firmware, or any combination thereof.

[0073] As Figure 5 shown, the device 500 includes: a function block presentation module 510, configured to present a configuration interface for a plurality of function blocks available for the digital assistant in response to receiving a function block configuration instruction for a session of the user with the digital assistant; a function block configuration module 520, configured to receive function block configuration information for the session through the configuration interface, the function block configuration information at least indicating at least one candidate function block in an enabled state among the plurality of function blocks; and an information reply module 530, configured to generate a reply of the digital assistant to a user input of the user based on the function block configuration information.

[0074] In some embodiments, the plurality of function blocks include at least one predetermined function block pre-configured for the digital assistant, and the function block configuration module 520 can also be configured to: in response to receiving an enable instruction for one or more of the at least one predetermined function blocks through the configuration interface, the terminal device 120 adds one or more predetermined function blocks as at least one candidate function block.

[0075] In some embodiments, the plurality of function blocks include at least one custom function block accessible to the user 110, and the function block configuration module 520 can also be configured to: in response to receiving a function block customization instruction through the configuration interface, the terminal device 120 presents information about at least one custom function block; and in response to a selection of a custom function block among the at least one custom function blocks, the terminal device 120 adds the selected custom function block as at least one candidate function block.

[0076] In some embodiments, at least one custom function block is provided by a digital assistant creation service.

[0077] In some embodiments, the device 500 further includes: a processing module, configured to obtain input parameter information and output parameter information of the selected custom function block from the provider of the selected custom function block for the terminal device 120 to generate a reply.

[0078] In some embodiments, the device 500 further includes: an interface presentation module, configured to present a visual element indicating that at least one candidate function block is in an enabled state in the configuration interface by the terminal device 120.

[0079] In some embodiments, the information reply module 530 may further be configured such that the terminal device 120 determines one or more target function blocks from at least one candidate function block based on at least one task indicated by a user input; the terminal device 120 obtains corresponding execution results of the one or more target function blocks; and the terminal device 120 determines a reply to the user input based on the corresponding execution results of the one or more target function blocks.

[0080] In some embodiments, the information reply module 530 may further be configured such that the terminal device 120, in response to at least one candidate function block not being selected by the user 110, determines a function block in the at least one candidate function block that matches the at least one task as one of the one or more target function blocks.

[0081] In some embodiments, the information reply module 530 may further be configured such that the terminal device 120, in response to a first function block in the at least one candidate function block being selected by the user 110, determines the first function block as one of the one or more target function blocks; and the terminal device 120 determines at least one second function block in the at least one candidate function block that matches the at least one task as a part of the one or more target function blocks.

[0082] Figure 6 The block diagram of an electronic device 600 capable of implementing one or more embodiments of the present disclosure is shown. As Figure 6 shown, the electronic device 600 is in the form of a general-purpose electronic device. The components of the electronic device 600 may include, but are not limited to, at least one processor 610 or processing unit, a memory 620, a storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. The processor 610 may be an actual or virtual processor and is capable of performing various processes according to the programs stored in the memory 620. In a multi-processor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing ability of the electronic device 600.

[0083] The electronic device 600 generally includes multiple computer storage media. Such media may be any accessible media that can be obtained by the electronic device 600, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 620 may be volatile memory (e.g., registers, caches, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 630 may be removable or non-removable media and may include machine-readable media, such as a flash drive, a magnetic disk, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 600.

[0084] The electronic device 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in Figure 6 , a disk drive for reading from and writing to a removable, non-volatile disk (such as a "floppy disk") and an optical disk drive for reading from and writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 620 may include a computer program product 625 having one or more program modules that are configured to perform the various methods or actions of the various embodiments of the present disclosure.

[0085] The communication unit 640 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 600 may be implemented by a single computing cluster or multiple computer machines that are capable of communicating via a communication connection. Thus, the electronic device 600 may operate in a networked environment using a logical connection to one or more other servers, network personal computers (PCs), or another network node.

[0086] The input device 650 may be one or more input devices, such as a mouse, keyboard, trackball, etc. The output device 660 may be one or more output devices, such as a display, speaker, printer, etc. The electronic device 600 may also communicate with one or more external devices (not shown) as needed via the communication unit 640, such as a storage device, a display device, etc., communicate with one or more devices that enable a user to interact with the electronic device 600, or communicate with any device that enables the electronic device 600 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0087] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, where the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, the computer program product being tangibly stored on a non-transitory computer-readable medium and including computer-executable instructions, and the computer-executable instructions being executed by a processor to implement the method described above.

[0088] Aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0089] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that the instructions, when executed by the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in one or more boxes of the flowchart and / or block diagram. These computer-readable program instructions may also be stored in a computer-readable storage medium that causes a computer, a programmable data processing apparatus, and / or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises a manufacture including instructions which implement various aspects of the functions / acts specified in one or more boxes of the flowchart and / or block diagram.

[0090] The computer-readable program instructions may be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other devices to produce a computer-implemented process such that the instructions executed on the computer, other programmable data processing apparatus, or other devices implement the functions / acts specified in one or more boxes of the flowchart and / or block diagram.

[0091] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various implementations of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, a segment of code, or a portion of an instruction, and the module, segment of code, or portion of an instruction may include one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions noted in the boxes may occur out of the order noted in the figures. For example, two consecutive boxes may, in fact, be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functionality involved. It should also be noted that each box in the block diagrams and / or flowcharts, and combinations of boxes in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system for performing the specified function or act, or by a combination of dedicated hardware and computer instructions.

[0092] The various implementations of the present disclosure have been described above. The above description is exemplary, not exhaustive, and is not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The choice of terms used herein is intended to best explain the principles of the implementations, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. An information processing method, comprising: Presenting a configuration interface for a plurality of function blocks available for the digital assistant in response to receiving a function block configuration instruction for a session between a user and the digital assistant; Receiving, through the configuration interface, function block configuration information for the session, where the function block configuration information at least indicates at least one candidate function block in an enabled state among the plurality of function blocks; And Generating, based on the function block configuration information, a reply of the digital assistant to a user input of the user.

2. The method according to claim 1, where the plurality of function blocks includes at least one predetermined function block preconfigured for the digital assistant, and receiving the function block configuration information includes: Adding, in response to receiving an enabling instruction for one or more of the at least one predetermined function block through the configuration interface, the one or more predetermined function blocks as the at least one candidate function block.

3. The method according to claim 1, where the plurality of function blocks includes at least one custom function block accessible to the user, and receiving the function block configuration information includes: Presenting information about the at least one custom function block in response to receiving a function block customization instruction through the configuration interface; And Adding, in response to selection of a custom function block among the at least one custom function block, the selected custom function block as the at least one candidate function block.

4. The method according to claim 3, where the at least one custom function block is provided by a digital assistant creation service.

5. The method according to claim 1, further comprising: Obtaining input parameter information and output parameter information of the selected custom function block from a provider of the selected custom function block for generating the reply.

6. The method according to claim 1, further comprising: Presenting, in the configuration interface, a visual element indicating that at least one candidate function block is in the enabled state.

7. The method according to claim 1, where generating the reply of the digital assistant to the user input includes: Determining, based at least on at least one task indicated by the user input, one or more target function blocks from the at least one candidate function block; Obtaining corresponding execution results of the one or more target function blocks; And Determining, based on the corresponding execution results of the one or more target function blocks, a reply to the user input.

8. The method according to claim 7, where determining the one or more target function blocks includes: Determining, in response to the at least one candidate function block not being selected by the user, a function block among the at least one candidate function block that matches the at least one task as one of the one or more target function blocks.

9. The method according to claim 7, where determining the one or more target function blocks includes: Determining, in response to a first function block among the at least one candidate function block being selected by the user, the first function block as one of the one or more target function blocks; And Determine at least one second functional block that matches the at least one task in the at least one candidate functional block as part of the one or more target functions.

10. An apparatus for information processing, comprising: A functional block presentation module configured to present a configuration interface for a plurality of functional blocks available to the digital assistant in response to receiving a functional block configuration instruction for a session of a user with the digital assistant; A functional block configuration module configured to receive, through the configuration interface, functional block configuration information for the session, the functional block configuration information at least indicating at least one candidate functional block in the plurality of functional blocks that is in an enabled state; And An information reply module configured to generate, based on the functional block configuration information, a reply of the digital assistant to a user input of the user.

11. An electronic device, comprising: At least one processor; And At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, causing the electronic device to perform the method according to any one of claims 1 to 9.

12. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 9.

13. A computer program product tangibly stored in a computer storage medium and including computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 9.

Images