Instruction management method and device, equipment and storage medium

By receiving and managing user interaction information with the digital assistant, and identifying and displaying shortcuts, the problem of assistant functions being unable to efficiently serve users is solved, achieving more efficient user interaction and experience optimization.

CN119002997APending Publication Date: 2024-11-22BEIJING ZITIAO NETWORK TECH CO LTD

Patent Information

Application Number
CN202310956551.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-07-31
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

In existing technologies, assistant functions are difficult to serve users well, lack effective shortcut management methods, resulting in low user interaction efficiency.

Method used

A method and apparatus for managing instructions are provided. By receiving information related to user and digital assistant interaction, a set of shortcuts is determined, and shortcuts are displayed or created in an interactive window. Shortcuts are managed and distributed using a shortcut management platform, and the display of instructions is recommended and optimized based on the interaction scenario.

Benefits of technology

It improves the efficiency of user interaction with digital assistants, enhances user experience, and meets users' needs for quick operation in different application scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119002997A_ABST
    Figure CN119002997A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides an instruction management method and device, equipment and a storage medium. The method includes receiving, from a first application, interaction-related information associated with an interaction of a user and a digital assistant in the first application; determining a shortcut instruction set comprising at least one shortcut instruction based on the interaction related information; instruction information related to the shortcut instruction set is sent to the first application, so that at least part of shortcut instructions in the shortcut instruction set are displayed in an interaction window of the user and the digital assistant in the first application. Therefore, the shortcut instruction can be displayed more in line with user requirements, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to instruction management methods, devices, apparatuses, and computer-readable storage media. Background Art

[0002] With the development of information technology, various terminal devices can provide various services to people in work and life. For example, applications that provide services can be deployed in terminal devices. Terminal devices or their applications can provide assistant functions to users to assist users in using terminal devices or applications to complete tasks. How to make such assistant functions better serve users is a technical problem currently being explored. Summary of the invention

[0003] In a first aspect of the present disclosure, a method for command management is provided. The method comprises: receiving interaction-related information associated with an interaction between a user and a digital assistant in the first application from a first application; determining a shortcut command set including at least one shortcut command based on the interaction-related information; and sending command information related to the shortcut command set to the first application, so that at least part of the shortcut commands in the shortcut command set are displayed in an interaction window between the user and the digital assistant in the first application.

[0004] In a second aspect of the present disclosure, a method for command management is provided. The method comprises: sending interaction-related information associated with an interaction between a user and a digital assistant in a first application to a command manager; receiving command information related to a shortcut command set including at least one shortcut command from the command manager, the shortcut command set being determined based on the interaction-related information; and presenting at least some shortcut commands in the shortcut command set based on the command information.

[0005] In a third aspect of the present disclosure, a command management method is provided. The method includes: receiving a creation request for a first shortcut command, the first shortcut command being used to be displayed in an interactive window between a user and a digital assistant in a first application; and creating the first shortcut command according to first configuration information of the first shortcut command in response to the creation request.

[0006] In a fourth aspect of the present disclosure, a command management device is provided. The device includes: a receiving module configured to receive interaction-related information associated with an interaction between a user and a digital assistant in the first application from a first application; a determining module configured to determine a shortcut command set including at least one shortcut command based on the interaction-related information; and a sending module configured to send command information related to the shortcut command set to the first application, so that at least part of the shortcut commands in the shortcut command set are displayed in the interaction window between the user and the digital assistant in the first application.

[0007] In a fifth aspect of the present disclosure, a command management device is provided. The device includes: a sending module configured to send interaction-related information associated with an interaction between a user and a digital assistant in a first application to a command management party; a receiving module configured to receive instruction information related to a shortcut command set including at least one shortcut command from the command management party, the shortcut command set being determined based on the interaction-related information; and a presenting module configured to present at least some shortcut commands in the shortcut command set based on the instruction information.

[0008] In a sixth aspect of the present disclosure, a command management device is provided. The device includes: a receiving module configured to receive a creation request for a first shortcut command, the first shortcut command being displayed in an interactive window between a user and a digital assistant in a first application; and a creating module configured to create the first shortcut command according to first configuration information of the first shortcut command in response to the creation request.

[0009] In a seventh aspect of the present disclosure, a computing device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect, the second aspect, or the third aspect.

[0010] In an eighth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect, the second aspect, or the third aspect.

[0011] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0013] Figure 1A A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0014] Figure 1B An example schematic diagram of shortcut instructions in an interactive window in a conversation mode of some embodiments of the present disclosure;

[0015] Figure 1CAn example schematic diagram of shortcut commands in an interactive window in a floating window mode in some embodiments of the present disclosure;

[0016] Figure 2 An example schematic diagram showing a shortcut command management platform architecture according to some embodiments of the present disclosure is shown;

[0017] Figure 3 An example schematic diagram showing a configuration information creation interface according to some embodiments of the present disclosure;

[0018] Figure 4 An example schematic diagram showing a configuration information creation interface according to some embodiments of the present disclosure;

[0019] Figure 5 A schematic diagram of an interaction process of an instruction management method according to some embodiments of the present disclosure is shown;

[0020] Figure 6 A schematic diagram of a flow chart of an instruction management method according to some embodiments of the present disclosure is shown;

[0021] Figure 7 A schematic diagram of a flow chart of an instruction management method according to some embodiments of the present disclosure is shown;

[0022] Figure 8 A schematic diagram of a flow chart of an instruction management method according to some embodiments of the present disclosure is shown;

[0023] Fig. 9 A block diagram of an instruction management device according to some embodiments of the present disclosure is shown;

[0024] Fig.10 A block diagram of an instruction management device according to some embodiments of the present disclosure is shown;

[0025] Fig.11 A block diagram showing an instruction management device according to some embodiments of the present disclosure and

[0026] Fig.12 A block diagram of a device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0027] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0028] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0029] In this article, the term "model" can learn the association between the corresponding input and output from the training data, so that after the training is completed, the corresponding output can be generated for a given input. The generation of the model can be based on machine learning technology. In this article, "model" can also be referred to as "machine learning model", "machine learning network" or "network", and these terms are used interchangeably in this article. A model can also include different types of processing units or networks.

[0030] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0031] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0032] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the types, scopes of use, usage scenarios, etc. of the information involved in the present disclosure should be informed to relevant users and their authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations. The relevant users may include any type of right holders, such as individuals, enterprises, and groups.

[0033] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can independently choose whether to provide information to software or hardware such as an electronic device, application, server or storage medium that executes the operation of the technical solution of the present disclosure based on the prompt message.

[0034] As an optional but non-limiting implementation, in response to receiving an active request from a relevant user, a prompt message is sent to the relevant user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to select "agree" or "disagree" to provide information to the electronic device.

[0035] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0036] Figure 1A A schematic diagram of an example environment 100 in which an embodiment of the present disclosure can be implemented is shown. In the example environment 100, an office suite 120 is installed in a terminal device 110. A user 140 can interact with the office suite 120 via the terminal device 110 and / or an attached device of the terminal device 110. The office suite 120 can provide the user 140 with the integration of multiple components. These components can be used as component modules in the office suite 120. The components integrated in the office suite 120 are sometimes also referred to as "office applications", "office components", "collaborative office platforms", etc. As an example, the components integrated in the office suite 120 may include, but are not limited to, one or more of the following: a chat component (also referred to as an instant messaging (IM) component), a document component, an audio and video conference component, an email component, a calendar component, a schedule component, a task component, and an objective and key result (OKR) component.

[0037] In some embodiments, the office suite 120 can be downloaded as an application and installed on the terminal device 110. In some embodiments, the office suite 120 can also be accessed through other methods, such as through a web page.

[0038] exist Figure 1A In the environment 100, if the office suite 120 is started, the terminal device 110 can present an interface 150 of the office suite 120 to the user 140. The interface 150 is sometimes also referred to as a client interface. The interface 150 may include various interfaces that the office suite 120 can provide, such as a conversation interface for presenting chat content, a video conference interface, a file sharing interface, and the like.

[0039] In some embodiments, the terminal device 110 communicates with the server 130 to implement the provision of services of the office suite 120 .

[0040] The above-mentioned terminal device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including mobile phone, desktop computer, laptop computer, notebook computer, netbook computer, tablet computer, media computer, multimedia tablet, personal communication system (PCS) equipment, personal navigation device, personal digital assistant (PDA), audio / video player, digital camera / camcorder, television receiver, radio broadcast receiver, e-book device, game device or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface for the user (such as "wearable" circuit, etc.). The server 130 can be various types of computing systems / servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0041] It should be understood that the structure and function of each element in the environment 100 are described for exemplary purposes only, and do not imply any limitation on the scope of the present disclosure. For example, the embodiments of the present disclosure can be applied to any suitable one or more applications, and are not limited to office suites.

[0042] In some embodiments of the present disclosure, a digital assistant is configured for user 140. The digital assistant can be implemented in any suitable form. In some embodiments, the digital assistant of user 140 can interact with it as a contact of user 140. Such a digital assistant can correspond uniquely to user 140. In other words, the digital assistant of user 140 can be specific to or exclusive to user 140. For example, in the process of the digital assistant providing assistance or service to user 140, the digital assistant can use the historical interaction related information with user 140, the data authorized by user 140 that it can access, the current conversation content with the user, etc. If user 140 is an individual or an individual, such a digital assistant can be regarded as a personal digital assistant. It can be understood that in the embodiments of the present disclosure, the digital assistant is based on the authorized access to the data granted authority by user 140. Of course, in other embodiments of the present disclosure, the digital assistant may not be specific or exclusive to a certain user. This is only an example description and is not a limitation.

[0043] It should be understood that “uniquely corresponds” or similar expressions in the present disclosure are not intended to limit the digital assistant to be updated accordingly based on the interaction process between the user 140 and the digital assistant.

[0044] In some embodiments, the digital assistant can be implemented in a single component or application, such as an IM component. In some embodiments, the digital assistant can be implemented in multiple components. For example, these components can be different components of an office suite or a collaborative office platform. In some embodiments, the digital assistant can be directly implemented in the terminal device 110 without being attached to any application. In this embodiment, the digital assistant provides assistance to the user 140 in the form of a contact.

[0045] In some embodiments of the present disclosure, the digital assistant is an application or device developed based on artificial intelligence technology. The user can send instructions to the digital assistant through voice, image or natural language text, and the digital assistant can understand the voice, image or natural language input by the user based on the model and respond. The prompt is the input or input template of the model, which can be natural language and / or other modal data, used to guide or stimulate the model to complete specific processing to obtain the desired model output.

[0046] When users interact with digital assistants, in addition to entering commands (voice, images, or natural language text, etc.), they can also use shortcut commands provided by the system.

[0047] In some embodiments, the shortcut command is to encapsulate the fine-tuned prompt and provide it to the user in the form of a control (shortcut command button), so that the user can trigger the encapsulated prompt to be input into the model with one click to obtain the corresponding output result. The shortcut command allows users to obtain relatively stable execution results at a low cost.

[0048] In some embodiments of the present disclosure, shortcut commands may include three types: shortcut commands without parameters, shortcut commands with parameters, and generative or query shortcut commands (also referred to as query commands).

[0049] In some embodiments of the present disclosure, after a shortcut command without parameters is selected, the digital assistant can directly execute the operation corresponding to the shortcut command. For example, a shortcut command without parameters can be to schedule a meeting or summarize a meeting. After a shortcut command with parameters is selected, an input box or a secondary menu may be further presented. After the user fills in the parameters in the input box, the digital assistant may execute the operation corresponding to the shortcut command. For example, the shortcut command with parameters is "Overview". After the user selects the shortcut command, the user is further prompted to enter the object to be summarized. For example: a secondary menu of "Write an overview about XXX" is presented. The user can enter the object to be summarized, such as selecting a document. Inquiry shortcut commands can be generated by a preset model. For example, when the user is in document reading mode, some inquiry shortcut commands can be generated, such as "Do you want to share this document?"

[0050] After the digital assistant is awakened in the application, it can present a conversation mode interaction window or a floating window mode interaction window. As an example, Figure 1B and Figure 1C Schematic diagrams showing shortcut commands presented in the interactive windows of two modes.

[0051] As an example, refer to Figure 1B , the interface currently presented by the terminal device is the document application interface 170. In the interface 170, the digital assistant is awakened and presents an interactive window 180 of the conversation mode. In the interactive window 180 of the conversation mode, shortcut commands 181 are presented, such as the shortcut command "copy meeting notes" and the shortcut command "forward to the group".

[0052] As an example, refer to Figure 1C , the interface currently presented by the terminal device is the interface of the document application, in which the digital assistant is awakened and presents an interactive window 190 in a floating window mode. In the interactive window 190 in the floating window mode, shortcut commands 191 are presented, such as shortcut commands "abbreviation", shortcut commands "insert", shortcut commands "edit", shortcut commands "delete", etc.

[0053] In the embodiment of the present disclosure, a shortcut instruction manager 160 can also be provided in the environment 100, which can manage the shortcut instructions presented in the digital assistant. The management includes, for example, how to create shortcut instructions for different applications, which shortcut instructions can be presented in different application scenarios, when the shortcut instructions can be presented, and how the shortcut instructions are executed. In order to display shortcut instructions in a more user-friendly way to improve the user experience, the embodiment of the present disclosure provides an instruction management method. In this method, the instruction manager (such as the instruction management platform mentioned below) can recommend shortcut instructions to the application based on the current scenario to be presented in the digital assistant. Specifically, the application can send information related to the interaction between the user and the digital assistant in the application to the instruction manager. After receiving the interaction-related information from the application, the instruction manager can determine a shortcut instruction set based on the interaction-related information. After that, the instruction manager can send instruction information to the application. Then, the application can present at least some of the shortcut instructions in the shortcut instruction set based on the instruction information. In this way, the embodiment of the present disclosure provides an instruction management method that can display shortcut instructions in a more user-friendly way, thereby improving the user experience.

[0054] In order to more clearly describe the embodiments of the present disclosure, some example embodiments of the present disclosure will be described with reference to the accompanying drawings. In the following, the office suite is mainly used as an example scenario for description, but this is only exemplary and is not intended to limit the scope of the present disclosure. The digital assistant can be implemented in any other application or scenario, not limited to the office suite.

[0055] As mentioned above, the office suite 120 can integrate multiple components or applications. In the disclosed embodiment, the user can call up and interact with the digital assistant in different components or applications. The shortcut commands displayed in different components or applications may be different.

[0056] The disclosed embodiments provide a shortcut command management platform (hereinafter referred to as the management platform) for managing the creation and distribution of shortcut commands. In some embodiments, the shortcut command management platform can be integrated into the office suite 120 or implemented as an independent platform or device.

[0057] As an example, Figure 2 A schematic diagram of the structure of a shortcut command management platform provided in an embodiment of the present disclosure. Figure 2 In the shortcut command management platform 200 shown, the shortcut command management platform 200 includes a login registration module 210, a user authority management module 220, an instruction creation module 230, a shortcut command review, management and release module 240 and an instruction distribution module 250.

[0058] Understandably, Figure 2 The modules in the shortcut command management platform 200 shown in the figure are only exemplary. The shortcut command management platform 200 may include more or fewer modules, or a module may be further divided into one or more sub-modules, etc. This disclosure is not limited to this.

[0059] The functions of the shortcut command management platform 200 are described in detail below in conjunction with each module.

[0060] In some embodiments, the shortcut command management platform 200 may include a login registration module 210. The main body of the login registration module 210 may be an application. On the one hand, an application or component may register with the management platform through the login registration module 210. Specifically, the application or component is the display party of the shortcut command. Moreover, the application or component may be regarded as the source of the shortcut command. The shortcut command provided to an application or component is generally created by the manager of the application or component based on the capabilities, functions, etc. of the application or component. Therefore, the application or component is the management object of the instruction management platform. In order to display the shortcut command, the application or component needs to be registered with the shortcut command management platform 200. For example, the application may register with the shortcut command management platform 200 using the identification (ID) of the application (APP) and / or the key (secret) of the application. For another example, the shortcut command management platform 200 may manage a whitelist. Applications in the whitelist do not need to register with the shortcut command management platform 200. Alternatively, applications that have successfully registered may be added to the whitelist of the shortcut command management platform 200. On the other hand, the manager of the application or component can register with the management platform 200 through the login registration module 210 and log in to the management platform 200 after successful registration. After logging in to the management platform 200, the manager of the application or component can perform a series of operations for managing shortcut commands, such as creating shortcut commands, modifying shortcut commands, deleting shortcut commands, and reviewing shortcut commands.

[0061] In some embodiments, the shortcut command management platform 200 may include a user authority management module 220 for managing the operating authority of users logged into the management platform 200. For example: after the application is successfully registered on the management platform, users such as the registrant or administrator of the application can be associated with the application. The user may be granted the authority to edit (e.g., add, delete, modify, and search) shortcut commands. Furthermore, the application registrant or administrator may also be granted the authority to review whether shortcut commands can take effect and be displayed in the application.

[0062] In some embodiments, the shortcut command management platform 200 may further include a command creation module 230 for creating shortcut commands. Specifically, as mentioned above, an application registrant or administrator may create shortcut commands. The management platform 200 detects a creation request from a user (such as an application registrant or administrator) to create a shortcut command. The creation request may be, for example, a creation operation performed by the user in a configuration interface provided by the management platform 200 (for example, Figure 3 The "Save and Publish" control 331 in the configuration interface 300 is triggered. Taking the shortcut command created for the first application as the first shortcut command as an example, the creation request of the first shortcut command may include the configuration information of the first shortcut command (the configuration information of the first shortcut command may be referred to as the first configuration information).

[0063] The first configuration information may include, for example, basic information 231. For example, the basic information 231 may include: the name and description of the first shortcut command, such as detailed functions of the first shortcut command.

[0064] As an example, Figure 3 The configuration information creation interface 300 of the management platform 200 provided in the embodiment of the present disclosure. For example, user A creates a shortcut command "draft document" for the digital assistant in the document application. The configuration information creation interface 300 includes a basic information setting area 310 for the shortcut command. In the area 310, the user can enter the basic information of the shortcut command to be created, such as the application ( Figure 3 In the example of "document", the command name is "draft document" and the command description is "rewrite given content". In addition, the configuration information creation interface 300 also includes a shortcut command effect preview area 311, which can show the effect of the shortcut command after being displayed in the application.

[0065] Alternatively or additionally, the first configuration information may further include a trigger condition 232 of the first shortcut command. Figure 3 The configuration information creation interface 300 also displays a setting area 320 for various trigger conditions of shortcut commands.

[0066] The trigger conditions displayed in the trigger condition setting area 320 may include, for example, in which application scenarios, or in which client brand or form (such as mobile phone or PC), or in which awakening form of the digital assistant (such as floating window mode, conversation mode, floating ball mode, etc.), the first shortcut instruction can be displayed. Trigger condition 232 may also include, for example, whether there is selected information, whether there is a cursor, whether the document content is empty, the user's authority to the document (such as reading or editing); the type of object on which the current user performs the operation (such as pictures, text, tables), etc. Optionally, the trigger condition 232 may also include whether the user has selected a tool, etc., for example, the user opens the digital assistant in the document application and selects the "brush" tool.

[0067] Alternatively or additionally, the first configuration information may also include an interactive component / application 233 that may be involved when the first shortcut instruction is executed. For example, if the first shortcut instruction created for the document application is "Open Album", then when the first shortcut instruction is executed in the document application, the interactive application involved in the first shortcut instruction is "Album".

[0068] Alternatively or additionally, the first configuration information may further include an execution mode 234 when the first shortcut instruction is called and executed.

[0069] As an example, the execution method of the shortcut command includes generating a prompt word for a preset model, for example, using a prompt word template for the preset model to generate the prompt word. The execution method can also be to call an application programming interface (API) of the preset model, for example, one or some shortcut commands are bound to the API of the corresponding preset model, and then when one or some shortcut commands are executed, the API can be called to make the preset model perform the corresponding operation.

[0070] For example, still refer to Figure 3 The configuration information creation interface 300 may also include an execution mode setting area 310 for the shortcut command. The execution modes displayed in the setting area 310 include, for example, two execution modes: prompt word template and API. When the prompt word template execution mode is selected, the user can further enter the template name or template ID to search for the prompt word template, and can also select the version, etc.

[0071] refer to Figure 4 , shows an exemplary interface 400 for creating an execution mode of a shortcut command. In the interface 400, the user can set the execution mode of the shortcut command. For example, the execution mode is set to a prompt word template, and the template name, template content, and parameter name corresponding to the execution mode can be further set.

[0072] In some embodiments of the present disclosure, shortcut instructions can be created in the following ways. In the first way, a user can create a shortcut instruction by creating a new shortcut instruction. Still taking the first shortcut instruction as an example, the management platform 200 can detect a creation request for the first shortcut instruction. The creation request for the first shortcut instruction may include first configuration information. In response to this, the management platform 200 can create the first shortcut instruction according to the configuration information of the first shortcut instruction (the first configuration information in the embodiment of the present disclosure).

[0073] In this way, the user can create a new shortcut command in the interface provided by the management platform 200.

[0074] In the second method, the user can also create a new shortcut command by "creating a copy". Taking the creation of the first shortcut command as an example, the creation request can indicate that a shortcut command is created according to the second shortcut command corresponding to the second application. The second shortcut command here is for the created shortcut command. The management platform 200 can save the created shortcut command in a preset database. For the created second shortcut command, the first shortcut command can be created based on the second shortcut command. Then, the creation request can be for the user to select the second shortcut command in the preset database provided by the management platform 200 and further copy the second shortcut command. And the first configuration information of the first shortcut command can also be obtained based on the second configuration information of the second shortcut command. For example: one or more of the basic information, execution method, and trigger conditions in the second configuration information can be modified to obtain the first configuration information.

[0075] For example, the shortcut command "Summary" created for the IM application can also be applied to the "Document" application. You can create a copy of the "Summary" shortcut command created for IM, and modify the trigger conditions, name and other configuration information of the "Summary" shortcut command in the IM application to obtain the "Summary" shortcut command that can be applied to the "Document" application.

[0076] In this way, the user can create a new shortcut command based on the created shortcut command; and the newly created shortcut command (i.e., the first shortcut command) is decoupled from the original shortcut command (i.e., the second shortcut command). The disclosed embodiment can independently maintain the name, execution method, effect, etc. of each shortcut command.

[0077] In the third method, the shortcuts of some applications (such as the third application) can be displayed in the first application as available shortcuts of the first application after they are created. For example: the shortcut created for application A can be applied to be displayed in application B. In this case, a prompt message can be presented via the account associated with the first application. For example, after the manager of the first application logs in to the management platform with his account, the management platform may present a prompt message indicating whether the third shortcut corresponding to the third application is allowed to be displayed in the first application. If an affirmative response to the prompt message is received from the manager of the first application, the third shortcut can be determined as an available shortcut for the first application.

[0078] In the embodiment of the present disclosure, shortcut commands include three types: shortcut commands without parameters, shortcut commands with parameters, and generative or query shortcut commands (also called query commands).

[0079] In the disclosed embodiments, shortcut commands without parameters and shortcut commands with parameters can be created. After a shortcut command without parameters is created, if the digital assistant presents the shortcut command, and after the shortcut command is clicked, the digital assistant can directly execute the operation corresponding to the shortcut command. For example: summary, expansion. After a shortcut command with parameters is created, if the digital assistant presents the shortcut command, after the shortcut command is clicked, an input box or a secondary menu can be further presented. After the user fills in the parameters in the input box, the digital assistant can execute the operation corresponding to the shortcut command.

[0080] In some embodiments of the present disclosure, generative or query shortcut instructions may be generated and recommended by a preset model, such as a language model, according to the current context without being created.

[0081] In the disclosed embodiments, when creating a shortcut command in the shortcut command platform, a shortcut command and a sub-command of the shortcut command can be created. For example, create a "translate" command and its corresponding "translate into English" and "translate into Japanese" sub-commands. In some embodiments, the creator can create each "sub-command" separately. In some embodiments, a parent command with parameters can also be created, and the corresponding sub-command can be generated after the user fills in the parameters.

[0082] In some embodiments, the shortcut command management platform 200 may further include a shortcut command review, management and release module 240. After the shortcut command is submitted for release, the final application creator or manager will review the application to determine whether to allow the shortcut command to be displayed in the application, and release it after passing the review.

[0083] The above describes the process of creating and publishing shortcut commands. The following describes the process of the shortcut command management platform 200 recommending shortcut commands for applications.

[0084] In some embodiments, the shortcut management platform 200 can receive information related to the interaction between the user and the digital assistant in the application (e.g., the first application).

[0085] In some embodiments, the interaction-related information may include application information. The application information may, for example, be an application identifier used to indicate the current application, such as a document application or an email application. The interaction-related information may also include information related to the user's operation. For example, whether the user's current operation in the document application selects content. Alternatively or additionally, the interaction-related information may also include information related to the operation object. For example, the type of operation object, whether it is a document or an email, and the user's authority over the document, such as whether he has editing authority. Alternatively or additionally, the interaction-related information may also include interaction messages between the user and the digital assistant in the interaction window. Alternatively or additionally, the interaction-related information may also include an interaction mode between the user and the digital assistant. For example, a conversation mode or a floating window mode.

[0086] As mentioned above, each shortcut command corresponding to the first application has a pre-configured trigger condition. Then, the management platform 200 can select a target shortcut command whose trigger condition matches the interaction-related information from the multiple shortcut commands corresponding to the first application as at least a part of the shortcut command set. For example, based on the interaction-related information, it can be determined which one or more of these shortcut commands for the first application have their trigger conditions met. The shortcut commands whose pre-configured trigger conditions are met are determined to be at least a part of the shortcut command set. That is, the management platform 200 can determine a shortcut command set including at least one shortcut command based on the interaction-related information.

[0087] For example, the application identifier in the interaction-related information is a document application, and the user selects a piece of content in the document. The management platform 200 can determine that the interaction-related information matches the trigger conditions of the shortcut commands "copy this content", "summarize this content", "delete this content", "modify this content", "open this document" and "close this document". Therefore, the management platform 200 can obtain a shortcut command set composed of these shortcut commands.

[0088] Combination Figure 2 The shortcut command management platform 200 may further include a command distribution module 250. The command distribution module 250 distributes shortcut commands according to a distribution strategy 251 and displays a corresponding distribution effect 252.

[0089] In some embodiments, the distribution strategy 251 may be, for example, a recommendation ranking strategy that can be used to determine the priority order of multiple shortcut commands to be recommended. Specifically, the distribution strategy 251 may be a strategy related to how to recommend shortcut commands and how to set the priority order of shortcut commands.

[0090] In some embodiments of the present disclosure, the priority order of shortcut instructions to be recommended or distributed can be determined based on the degree of association between each of the multiple shortcut instructions and the interaction-related information. The stronger the degree of association between the shortcut instruction and the interaction-related information, the higher the priority of the shortcut instruction. For example, the interaction-related information is that the application opened by the user is a document, and the user selects a section of content in the document. Then the shortcut instructions to be recommended associated with the selected content, such as "Summarize this section of content" and "Copy this section of content", have a higher priority. In contrast, the remaining shortcut instructions to be recommended or distributed, such as "Open this document" and "Close this document", are associated with documents, but have a lower degree of association with the selected content, and the corresponding priority is lower.

[0091] In some embodiments of the present disclosure, the priority order of shortcut instructions to be recommended or distributed can also be determined based on the user's interaction data in the interaction-related information received from the application. The higher the match between the shortcut instruction and the user's interaction data, the higher the priority. For example, a shortcut instruction that better matches the current scene can be determined based on the user's previous interaction data with the digital assistant. Such previous interaction data can, for example, indicate the user's need for a specific behavior, and a matching shortcut instruction can be determined based on the need.

[0092] For example, if the application is a messaging application, and the user enters "The department will soon conduct a first half summary" in a group chat message in the messaging application, it is determined that the shortcut commands to be recommended or distributed may be "Schedule a meeting", "Send an email", "Add a schedule", and "Open a calendar", and it is determined that "Schedule a meeting" is a better match for the interactive behavior of the message entered by the user in the group chat message, and therefore has a higher priority.

[0093] In some embodiments of the present disclosure, the priority order may also be determined based on the execution history of each of the multiple shortcut commands. For example, based on the number of times the multiple shortcut commands are executed, if a shortcut command has a larger number of execution times, its priority is higher.

[0094] In the disclosed embodiment, the recommended sorting strategy is an internal capability of the platform and is not displayed to the application registrant.

[0095] In some embodiments, the shortcut command management platform 200 may determine, based on the interaction-related information, a plurality of shortcut commands that meet corresponding trigger conditions as shortcut commands to be distributed.

[0096] In some embodiments, the shortcut command management platform 200 can select a shortcut command that meets the trigger condition from the shortcut command set created for the first application, and the shortcut command can be, for example, a summary document. In some embodiments, the shortcut command management platform 200 can also send the interaction-related information to a preset model and generate a shortcut command using the preset model.

[0097] Afterwards, the shortcut command management platform 200 can send instruction information related to the shortcut command set to the first application, so that at least part of the shortcut commands in the shortcut command set are displayed in the interactive window between the user and the digital assistant in the first application.

[0098] In some embodiments, the instruction information may include the priority order of each instruction. Alternatively or additionally, the instruction information may include the name of each instruction, the identifier of the instruction, the execution method, etc. The name, identifier, execution method, etc. of the instruction here may be part of the configuration information of the instruction described above, and reference may be made to the description of the configuration information of the shortcut instruction above, which will not be repeated here.

[0099] In some embodiments, after the application receives the shortcut commands recommended by the shortcut command management platform 200, the digital assistant can load these shortcut commands and present them.

[0100] If a certain shortcut command (which may be described as a fourth shortcut command in the embodiment of the present disclosure) presented by the digital assistant is triggered, then, in response to the fourth shortcut command being triggered, the execution of the fourth shortcut command is initiated according to the execution method of the fourth shortcut command. For example, if the execution method of the fourth shortcut command is to call an API, then the API is called to execute the fourth shortcut command using the large model. For another example, if the execution method of the fourth shortcut command is a prompt word template, then the prompt word template is called to execute the fourth shortcut command.

[0101] In some embodiments of the present disclosure, the interface displayed by the management platform 200 may also provide user information for creating and / or updating shortcut commands to facilitate application managers to trace back the creation history of shortcut commands and other information.

[0102] Combine the following Figure 5 The instruction management method of the embodiment of the present disclosure is introduced. The multi-party interaction subjects involved in the method include a user 501, an application registrant / administrator 502, an application 503, a shortcut instruction management platform 504, a digital assistant manager 505 and an executor 506.

[0103] In some embodiments of the present disclosure, the digital assistant manager 505 may also be referred to as an AI platform.

[0104] The instruction management method includes an instruction creation process and an instruction recommendation process. Specifically, in step 510, the application registrant / administrator 502 registers a shortcut instruction with the shortcut instruction management platform 504. As described above, the request to register a shortcut instruction may include basic information, trigger conditions, execution methods, etc.

[0105] In step 520, the shortcut command management platform 504 completes the registration and release of the shortcut command. The registration of the shortcut command is as described above. Figure 4 as described.

[0106] In step 530 , when the user enters a scenario involving a recommended shortcut command, the application 503 may sense the user scenario behavior and send interaction-related information to the shortcut command management platform 504 .

[0107] In step 540 , the shortcut command management platform 504 determines a matching command set according to the interaction-related information.

[0108] In step 550, the shortcut command management platform 504 sorts the determined instruction set according to the recommendation strategy. Then the instruction set is returned to the application. The returned instruction set may include, for example, the instruction information described above, which may include the name, identification, execution method, etc. of each instruction. In the case of multiple shortcut commands, the priority order of these shortcut commands may also be included.

[0109] In step 560 , application 503 displays the shortcut commands included in the command set returned by the shortcut command management platform.

[0110] In step 570 , user 501 clicks on the shortcut command displayed in application 503 .

[0111] Afterwards, according to different execution modes (executing mode 1 and executing mode 2 shown in the figure), application 503 can respectively initiate the execution of the shortcut command clicked by the user. That is, the processing steps indicated by the execution box 580 and box 590 are executed. For example, when the execution mode of the shortcut command is mode 1, application 503 requests the digital assistant manager 505 to execute the shortcut command clicked by the user, and the digital assistant manager 505 calls the executor 506 to perform the operation. Then the executor 506 returns the processing result and sends it to the application 503 after being processed by the digital assistant manager 505. Then application 503 displays the processing result, and the user obtains the answer.

[0112] Figure 6 600 according to some embodiments of the present disclosure. The method 600 may be implemented at the shortcut instruction manager 110. Figure 1A Method 600 is described.

[0113] In box 610, the shortcut manager 610 receives interaction-related information associated with the interaction between the user and the digital assistant in the first application from the first application.

[0114] In block 620 , the shortcut manager 620 determines a shortcut set including at least one shortcut based on the interaction-related information.

[0115] In box 630, the shortcut command manager 630 sends command information related to the shortcut command set to the first application, so that at least part of the shortcut commands in the shortcut command set are displayed in the interactive window between the user and the digital assistant in the first application.

[0116] In some embodiments, determining a shortcut command set including at least one shortcut command based on interaction-related information includes at least one of the following: based on interaction-related information, selecting a target shortcut command from multiple shortcut commands corresponding to the first application as at least a part of the shortcut command set, or based on interaction-related information, generating a shortcut command using a preset model as at least a part of the shortcut command set.

[0117] In some embodiments, selecting a target shortcut instruction from multiple shortcut instructions corresponding to the first application based on the interaction-related information as at least a part of the shortcut instruction set includes: selecting a target shortcut instruction whose trigger condition matches the interaction-related information from multiple shortcut instructions corresponding to the first application as at least a part of the shortcut instruction set; wherein each shortcut instruction corresponding to the first application has a pre-configured trigger condition.

[0118] In some embodiments, the plurality of shortcut instructions corresponding to the first application include a first shortcut instruction, and method 600 further includes: in response to a creation request for the first shortcut instruction, creating the first shortcut instruction according to first configuration information of the first shortcut instruction.

[0119] In some embodiments, the request to create the first shortcut instruction includes first configuration information.

[0120] In some embodiments, the creation request indicates that the first shortcut instruction is to be created according to a second shortcut instruction corresponding to the second application, and method 600 further includes: determining the first configuration information based on second configuration information of the second shortcut instruction.

[0121] In some embodiments, the first configuration information includes at least one of the following: description information of the first shortcut command, a trigger condition of the first shortcut command, or an execution method of the first shortcut command.

[0122] In some embodiments, the execution method of the shortcut command in the shortcut command set includes at least one of the following: generating a prompt word for a preset model, or calling an application programming interface.

[0123] In some embodiments, the shortcut commands in the shortcut command set include at least one of the following: commands that do not require user-specified parameters, commands that require user-specified parameters, or inquiry-type commands generated using a preset model.

[0124] In some embodiments, the instruction information includes at least one of the following: a priority order of multiple shortcut instructions in the shortcut instruction set, corresponding names of the shortcut instructions in the shortcut instruction set, corresponding identifiers of the shortcut instructions in the shortcut instruction set, or corresponding execution methods of the shortcut instructions in the shortcut instruction set.

[0125] In some embodiments, method 600 further includes determining the priority order based on at least one of: the relevance of each of the plurality of shortcut instructions to the interaction-related information, the user's interaction data in the interaction-related information, or the execution history of each of the plurality of shortcut instructions.

[0126] In some embodiments, method 600 also includes presenting a prompt message via an account associated with the first application, the prompt message indicating whether a third shortcut instruction corresponding to a third application is allowed to be displayed in the first application; and in response to receiving an affirmative reply to the prompt message, determining the third shortcut instruction as an available shortcut instruction for the first application.

[0127] In some embodiments, method 600 further includes, before presenting the prompt message, receiving a request initiated by a third application to display a third shortcut instruction in the first application.

[0128] In some embodiments, the interaction-related information includes one or more of the following: information related to the user's operation, information related to the object of the operation, information of the first application, interaction messages between the user and the digital assistant, or interaction modes between the user and the digital assistant.

[0129] Figure 7 1 and 2 also show a flow chart of a method 700 for command management according to some embodiments of the present disclosure. The method 700 may be implemented at the shortcut command manager 160. Figure 1A Method 700 is described.

[0130] In box 710, the shortcut instruction manager 160 receives a creation request for a first shortcut instruction, and the first shortcut instruction is used to be displayed in an interactive window between a user and a digital assistant in a first application.

[0131] In block 720 , the shortcut instruction manager 160 creates a first shortcut instruction according to the first configuration information of the first shortcut instruction in response to the creation request.

[0132] In some embodiments, the request to create the first shortcut instruction includes first configuration information.

[0133] In some embodiments, the creation request indicates that the first shortcut instruction is to be created according to a second shortcut instruction corresponding to the second application, and method 700 further includes: determining the first configuration information based on second configuration information of the second shortcut instruction.

[0134] In some embodiments, the first configuration information includes at least one of the following: description information of the first shortcut command, a trigger condition of the first shortcut command, or an execution method of the first shortcut command.

[0135] Figure 8 800 according to some embodiments of the present disclosure. The method 800 may be implemented at the terminal device 110. Figure 1A Method 800 is described.

[0136] In box 810, the terminal device 110 sends interaction-related information associated with the interaction between the user and the digital assistant in the first application to the instruction manager.

[0137] In box 820, the terminal device 110 receives instruction information related to a shortcut instruction set including at least one shortcut instruction from the instruction manager, where the shortcut instruction set is determined based on the interaction-related information.

[0138] In box 830, the terminal device 110 presents at least part of the shortcut instructions in the shortcut instruction set based on the instruction information.

[0139] In some embodiments, the shortcut command set includes at least one of the following: a target shortcut command selected from a plurality of shortcut commands corresponding to the first application based on the interaction information, or a shortcut command generated using a preset model based on the interaction information.

[0140] In some embodiments, the execution method of the shortcut command in the shortcut command set includes at least one of the following: generating a prompt word for a preset model, or calling an application programming interface.

[0141] In some embodiments, the shortcut commands in the shortcut command set include at least one of the following: commands that do not require user-specified parameters, commands that require user-specified parameters, or inquiry-type commands generated using a preset model.

[0142] In some embodiments, the instruction information includes at least one of the following: a priority order of multiple shortcut instructions in the shortcut instruction set, corresponding names of the shortcut instructions in the shortcut instruction set, corresponding identifiers of the shortcut instructions in the shortcut instruction set, or corresponding execution methods of the shortcut instructions in the shortcut instruction set.

[0143] In some embodiments, method 600 further includes initiating execution of the fourth shortcut instruction according to an execution mode of the fourth shortcut instruction in response to the presented fourth shortcut instruction being triggered.

[0144] In some embodiments, the interaction-related information includes at least one of the following: information related to the user's operation, information related to the object of the operation, information of the first application, interaction messages between the user and the digital assistant, or an interaction mode between the user and the digital assistant.

[0145] Fig. 9 A schematic structural block diagram of an instruction management apparatus 900 according to some embodiments of the present disclosure is shown. The apparatus 900 may be implemented as or included in the shortcut instruction manager 160. Each module / component in the apparatus 900 may be implemented by hardware, software, firmware, or any combination thereof.

[0146] As shown in the figure, the device 900 includes a receiving module 910, which is configured to receive interaction-related information associated with the interaction between the user and the digital assistant in the first application from the first application.

[0147] The apparatus 900 further includes a determining module 920 configured to determine a shortcut command set including at least one shortcut command based on the interaction-related information.

[0148] The device 900 also includes a sending module 930, which is configured to send instruction information related to the shortcut command set to the first application, so that at least part of the shortcut commands in the shortcut command set are displayed in the interactive window between the user and the digital assistant in the first application.

[0149] In some embodiments, the determination module 920 is further configured to perform at least one of the following: based on interaction-related information, selecting a target shortcut instruction from multiple shortcut instructions corresponding to the first application as at least a part of the shortcut instruction set, or based on interaction-related information, generating a shortcut instruction using a preset model as at least a part of the shortcut instruction set.

[0150] In some embodiments, the determination module 920 is also configured to select a target shortcut instruction whose trigger condition matches the interaction-related information from multiple shortcut instructions corresponding to the first application as at least a part of the shortcut instruction set; wherein each shortcut instruction corresponding to the first application has a pre-configured trigger condition.

[0151] In some embodiments, the multiple shortcut instructions corresponding to the first application include a first shortcut instruction, and the device 900 also includes a creation module configured to create the first shortcut instruction according to first configuration information of the first shortcut instruction in response to a creation request for the first shortcut instruction.

[0152] In some embodiments, the request to create the first shortcut instruction includes first configuration information.

[0153] In some embodiments, the creation request indicates that the first shortcut instruction is to be created according to the second shortcut instruction corresponding to the second application, and the determination module 920 is further configured to determine the first configuration information based on the second configuration information of the second shortcut instruction.

[0154] In some embodiments, the first configuration information includes at least one of the following: description information of the first shortcut instruction, a trigger condition of the first shortcut instruction, or an execution method of the first shortcut instruction.

[0155] In some embodiments, the execution method of the shortcut command in the shortcut command set includes at least one of the following: generating a prompt word for a preset model, or calling an application programming interface.

[0156] In some embodiments, the shortcut commands in the shortcut command set include at least one of the following: commands that do not require user-specified parameters, commands that require user-specified parameters, or inquiry-type commands generated using a preset model.

[0157] In some embodiments, the instruction information includes at least one of the following: a priority order of multiple shortcut instructions in the shortcut instruction set, corresponding names of the shortcut instructions in the shortcut instruction set, corresponding identifiers of the shortcut instructions in the shortcut instruction set, or corresponding execution methods of the shortcut instructions in the shortcut instruction set.

[0158] In some embodiments, the device 900 further includes an execution module configured to initiate execution of the fourth shortcut instruction in response to the fourth shortcut instruction being triggered and according to the execution mode of the fourth shortcut instruction.

[0159] In some embodiments, the determination module is further configured to determine the priority order based on at least one of the following: the degree of association of each of the multiple shortcut instructions with the interaction-related information, the user's interaction data in the interaction-related information, or the execution history of each of the multiple shortcut instructions.

[0160] In some embodiments, the determination module is also configured to select a target shortcut instruction whose trigger condition matches the interaction-related information from multiple shortcut instructions corresponding to the first application as at least a part of the shortcut instruction set; wherein each shortcut instruction corresponding to the first application has a pre-configured trigger condition.

[0161] In some embodiments, the device 900 further includes a presentation module configured to present a prompt message via an account associated with the first application, the prompt message indicating whether to allow display of a third shortcut instruction corresponding to the third application in the first application. The determination module is further configured to determine the third shortcut instruction as an available shortcut instruction of the first application in response to receiving an affirmative reply to the prompt message.

[0162] In some embodiments, the device 900 also includes a receiving module configured to receive a request initiated by a third application to display a third shortcut instruction in the first application before presenting the prompt message.

[0163] In some embodiments, the interaction-related information includes one or more of the following: information related to the user's operation, information related to the object of the operation, information of the first application, interaction messages between the user and the digital assistant, or an interaction mode between the user and the digital assistant.

[0164] Fig.10 1 and 2 also show a schematic structural block diagram of an instruction management apparatus 1000 according to some embodiments of the present disclosure. The apparatus 1000 may be implemented at the shortcut instruction management party 160. Figure 1A Apparatus 1000 is described.

[0165] The device 1000 includes a receiving module 1010 configured to receive a creation request for a first shortcut instruction, where the first shortcut instruction is used to be displayed in an interactive window between a user and a digital assistant in a first application.

[0166] The apparatus 1000 further includes a creation module 1020 configured to create a first shortcut instruction according to first configuration information of the first shortcut instruction in response to a creation request.

[0167] The receiving module 1010 is also configured to receive a creation request for a first shortcut instruction, where the first shortcut instruction is used to be displayed in an interactive window between the user and the digital assistant in the first application.

[0168] The creation module 1020 is further configured to create a first shortcut instruction according to the first configuration information of the first shortcut instruction in response to the creation request.

[0169] In some embodiments, the request to create the first shortcut instruction includes first configuration information.

[0170] In some embodiments, the creation request indicates that the first shortcut instruction is created according to the second shortcut instruction corresponding to the second application. The apparatus 1000 further includes a determination module configured to determine the first configuration information based on the second configuration information of the second shortcut instruction.

[0171] In some embodiments, the first configuration information includes at least one of the following: description information of the first shortcut instruction, a trigger condition of the first shortcut instruction, or an execution method of the first shortcut instruction.

[0172] Fig.11 1 shows a schematic structural block diagram of an instruction management apparatus 1100 according to some embodiments of the present disclosure. The apparatus 1100 may be implemented at a terminal device 110. Figure 1AApparatus 1100 is described.

[0173] The device 1100 includes a sending module 1110 configured to send interaction-related information associated with the interaction between the user and the digital assistant in the first application to the instruction manager 160.

[0174] The apparatus 1100 further includes a receiving module 1120 configured to receive instruction information related to a shortcut instruction set including at least one shortcut instruction from the instruction manager 160 , where the shortcut instruction set is determined based on the interaction-related information.

[0175] The device 1100 further includes a presentation module 1130 configured to present at least part of the shortcut instructions in the shortcut instruction set based on the instruction information.

[0176] In some embodiments, the shortcut command set includes at least one of the following: a target shortcut command selected from multiple shortcut commands corresponding to the first application based on the interaction-related information, or a shortcut command generated using a preset model based on the interaction-related information.

[0177] In some embodiments, the execution method of the shortcut command in the shortcut command set includes at least one of the following: generating a prompt word for a preset model, or calling an application programming interface.

[0178] In some embodiments, the shortcut commands in the shortcut command set include at least one of the following: commands that do not require user-specified parameters, commands that require user-specified parameters, or inquiry-type commands generated using a preset model.

[0179] In some embodiments, the instruction information includes a priority order of multiple shortcut instructions in the shortcut instruction set.

[0180] In some embodiments, the interaction-related information includes at least one of the following: information related to the user's operation, information related to the object of the operation, information of the first application, interaction messages between the user and the digital assistant, or an interaction mode between the user and the digital assistant.

[0181] Fig.12 1 shows a block diagram of an electronic device 1200 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Fig.12 The electronic device 1200 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Fig.12 The electronic device 1200 shown may be used to implement the terminal device 110 or the shortcut command management platform 160 of FIG. 1 .

[0182] like Fig.12As shown, the electronic device 1200 is in the form of a general electronic device. The components of the electronic device 1200 may include, but are not limited to, one or more processors or processing units 1210, a memory 1220, a storage device 1230, one or more communication units 1240, one or more input devices 1250, and one or more output devices 1260. The processing unit 1210 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 1220. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 1200.

[0183] The electronic device 1200 typically includes a plurality of computer storage media. Such media may be any accessible media accessible to the electronic device 1200, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1220 may be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1230 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data and may be accessed within the electronic device 1200.

[0184] The electronic device 1200 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig.12 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. Memory 1220 may include a computer program product 1225 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0185] The communication unit 1240 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 1200 can be implemented in a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 1200 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0186] The input device 1250 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 1260 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 1200 may also communicate with one or more external devices (not shown) through the communication unit 1240 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 1200, or communicate with any device that allows the electronic device 1200 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0187] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0188] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0189] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0190] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0191] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0192] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A method for command management, comprising: receiving, from a first application, information related to an interaction between a user and a digital assistant in the first application; Determining a shortcut command set including at least one shortcut command based on the interaction-related information; as well as Instruction information related to the shortcut command set is sent to the first application, so that at least part of the shortcut commands in the shortcut command set are displayed in the interactive window between the user and the digital assistant in the first application.

2. The method according to claim 1, wherein determining a shortcut command set including at least one shortcut command based on the interaction-related information comprises at least one of the following: Based on the interaction-related information, selecting a target shortcut command from a plurality of shortcut commands corresponding to the first application as at least a part of the shortcut command set, or Based on the interaction-related information, a preset model is used to generate shortcut instructions as at least a part of the shortcut instruction set.

3. The method according to claim 2, wherein: The selecting a target shortcut instruction from a plurality of shortcut instructions corresponding to the first application as at least a part of the shortcut instruction set based on the interaction-related information includes: From a plurality of shortcut instructions corresponding to the first application, a target shortcut instruction whose trigger condition matches the interaction-related information is selected as at least a part of the shortcut instruction set; wherein each shortcut instruction corresponding to the first application has a pre-configured trigger condition.

4. The method according to claim 2, wherein the plurality of shortcut instructions corresponding to the first application include a first shortcut instruction, and the method further comprises: In response to the creation request for the first shortcut instruction, the first shortcut instruction is created according to first configuration information of the first shortcut instruction. The method according to claim 4 , wherein the creation request of the first shortcut instruction includes the first configuration information.

6. The method according to claim 4, wherein the creation request indicates that the first shortcut instruction is created according to a second shortcut instruction corresponding to a second application, and the method further comprises: The first configuration information is determined based on second configuration information of the second shortcut instruction.

7. The method according to claim 4, wherein the first configuration information comprises at least one of the following: description information of the first shortcut command, The triggering condition of the first shortcut command, or The execution method of the first shortcut instruction.

8. The method according to claim 1, wherein the execution mode of the shortcut command in the shortcut command set includes at least one of the following: Generate prompt words for a preset model, or Call the application programming interface.

9. The method according to claim 1, wherein the shortcut commands in the shortcut command set include at least one of the following: Commands that do not require user-specified parameters, A command that requires user-specified parameters, or Inquiry instructions generated using preset models.

10. The method according to claim 1, wherein the instruction information includes at least one of the following: The priority order of the multiple shortcut commands in the shortcut command set, the corresponding names of the shortcut commands in the shortcut command set, The corresponding identifier of the shortcut command in the shortcut command set, or The corresponding execution methods of the shortcut commands in the shortcut command set.

11. The method of claim 10, further comprising determining the priority order based on at least one of the following: The relevance of each of the plurality of shortcut instructions to the interaction-related information, The interaction data of the user in the interaction related information, or The execution history of each of the multiple shortcut commands.

12. The method according to claim 1, further comprising: Presenting a prompt message via an account associated with the first application, the prompt message indicating whether to allow displaying a third shortcut instruction corresponding to a third application in the first application; as well as In response to receiving an affirmative reply to the prompt message, the third shortcut instruction is determined as an available shortcut instruction for the first application.

13. The method according to claim 11, further comprising: Before presenting the prompt message, a request initiated by the third application to display the third shortcut instruction in the first application is received.

14. The method according to claim 1, wherein the interaction-related information comprises one or more of the following: Information related to the user's actions, information related to the object of the operation, information of the first application, Interaction messages between the user and the digital assistant, or The interaction mode between the user and the digital assistant.

15. A method for command management, comprising: Sending interaction-related information associated with the interaction between the user and the digital assistant in the first application to the instruction manager; receiving, from the instruction manager, instruction information related to a shortcut instruction set including at least one shortcut instruction, wherein the shortcut instruction set is determined based on the interaction-related information; as well as Based on the instruction information, at least part of the shortcut instructions in the shortcut instruction set is presented.

16. The method according to claim 15, wherein the shortcut command set comprises at least one of the following: A target shortcut command is selected from a plurality of shortcut commands corresponding to the first application based on the interaction related information, or A shortcut command is generated based on the interaction-related information using a preset model.

17. The method according to claim 15, wherein the execution mode of the shortcut command in the shortcut command set includes at least one of the following: Generate prompt words for a preset model, or Call the application programming interface.

18. The method according to claim 15, wherein the shortcut commands in the shortcut command set include at least one of the following: Commands that do not require user-specified parameters, A command that requires user-specified parameters, or Inquiry instructions generated using preset models.

19. The method according to claim 15, wherein the instruction information comprises at least one of the following: The priority order of the multiple shortcut commands in the shortcut command set, the corresponding names of the shortcut commands in the shortcut command set, The corresponding identifier of the shortcut command in the shortcut command set, or The corresponding execution methods of the shortcut commands in the shortcut command set.

20. The method according to claim 19, further comprising: In response to the presented fourth shortcut instruction being triggered, the execution of the fourth shortcut instruction is initiated according to the execution mode of the fourth shortcut instruction.

21. The method according to claim 15, wherein the interaction-related information comprises at least one of the following: Information related to the user's actions, information related to the object of the operation, information of the first application, Interaction messages between the user and the digital assistant, or The interaction mode between the user and the digital assistant.

22. A method for command management, comprising: Receiving a creation request for a first shortcut instruction, wherein the first shortcut instruction is used to be displayed in an interactive window between a user and a digital assistant in a first application; as well as In response to the creation request, the first shortcut instruction is created according to the first configuration information of the first shortcut instruction. The method according to claim 20 , wherein the request for creating the first shortcut instruction includes the first configuration information.

24. The method according to claim 20, wherein the creation request indicates that the first shortcut instruction is created according to a second shortcut instruction corresponding to a second application, and the method further comprises: The first configuration information is determined based on second configuration information of the second shortcut instruction.

25. The method according to claim 20, wherein the first configuration information comprises at least one of the following: description information of the first shortcut command, The triggering condition of the first shortcut command, or The execution method of the first shortcut instruction.

26. An instruction management device, comprising: a receiving module configured to receive, from a first application, interaction-related information associated with an interaction between a user and a digital assistant in the first application; A determination module, configured to determine a shortcut command set including at least one shortcut command based on the interaction related information; as well as A sending module is configured to send instruction information related to the shortcut command set to the first application, so that at least part of the shortcut commands in the shortcut command set are displayed in the interactive window between the user and the digital assistant in the first application.

27. An instruction management device, comprising: a sending module configured to send interaction-related information associated with the interaction between the user and the digital assistant in the first application to the instruction manager; a receiving module configured to receive instruction information related to a shortcut instruction set including at least one shortcut instruction from the instruction management party, wherein the shortcut instruction set is determined based on the interaction-related information; as well as The presentation module is configured to present at least part of the shortcut instructions in the shortcut instruction set based on the instruction information.

28. An instruction management device, comprising: A receiving module is configured to receive a creation request for a first shortcut instruction, where the first shortcut instruction is used to be displayed in an interactive window between a user and a digital assistant in the first application; as well as The creation module is configured to create the first shortcut instruction according to the first configuration information of the first shortcut instruction in response to the creation request.

29. A computing device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform a method according to any one of claims 1 to 14, any one of 15 to 21, or any one of 22 to 25.

30. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 11 to 14, any one of 15 to 21, or any one of 22 to 25.

Citation Information

Patent Citations

  • Session interaction method and device in robot group, equipment and storage medium

    CN113239172A

  • Method and device for automatically triggering shortcut instruction

    CN116107467A

Cited By

  • Artificial intelligence-based itinerary planning method and computer program

    CN121116447A