Method, apparatus, device and storage medium for application operation

Abstract

According to an embodiment of the present disclosure, a method, apparatus, device, and storage medium for application operation are provided. In the method for application operation, in the interaction between a user and a digital assistant, it is determined that the user initiates a need for a first application operation on a target application; it is determined whether the first application operation is to be performed on the client of the target application or on the server of the target application; and in response to determining that the first application operation is to be performed on the client of the target application, the first application operation is executed on the client by calling a first interface corresponding to the first application operation in the client. In this way, when the user operates the target application with the help of a digital assistant, the call to the client capabilities of the target application can be supported, thereby improving the user's interactive experience with the digital assistant.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, apparatuses, devices, and computer-readable storage media for application operations. Background Art

[0002] With the rapid development of Internet technology, the Internet has become an important platform for people to access and share content. Users can access the Internet through terminal devices and enjoy various Internet services. Terminal devices present corresponding content and interact with users and provide services to users through the user interface of the application. Therefore, a rich and colorful application interactive interface is an important means to enhance the user experience. With the development of information technology, various terminal devices can provide people with various services in work and life. For example, terminal devices can be deployed with applications that provide services. Terminal devices or applications can provide users with digital assistant-like functions to assist users in using terminal devices or applications. How to improve the flexibility of user interaction with digital assistants is a technical problem that needs to be explored. Summary of the Invention

[0003] In a first aspect of the present disclosure, a method for application operation is provided. The method includes: determining, during a user interaction with a digital assistant, that the user initiates a request for a first application operation on a target application; determining whether the first application operation is to be performed on a client of the target application or on a server of the target application; and, in response to determining that the first application operation is to be performed on the client of the target application, causing the first application operation to be performed on the client by invoking a first interface corresponding to the first application operation in the client.

[0004] In a second aspect of the present disclosure, a device for application operation is provided. The device includes: a demand determination module configured to determine, during interaction between a user and a digital assistant, a user's demand for a first application operation on a target application; an execution determination module configured to determine whether the first application operation is to be executed on a client of the target application or on a server of the target application; and an operation execution module configured to, in response to determining that the first application operation is to be executed on the client of the target application, cause the first application operation to be executed on the client by calling a first interface corresponding to the first application operation in the client.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram illustrating an example environment in which embodiments of the present disclosure can be implemented;

[0010] Figure 2 A schematic diagram illustrating an architecture for application operation according to some embodiments of the present disclosure is shown;

[0011] Figures 3A to 3C A schematic diagram illustrating an example user interface presenting an interaction window between a user and a digital assistant according to some embodiments of the present disclosure is shown;

[0012] Figure 4 A schematic diagram showing an architecture for application operation according to other embodiments of the present disclosure is shown;

[0013] Figure 5 A schematic diagram illustrating a process for application operation according to other embodiments of the present disclosure is shown;

[0014] Figure 6 A schematic diagram illustrating a process for application operation according to other embodiments of the present disclosure is shown;

[0015] Figure 7 A flowchart illustrating a process for application operation according to some embodiments of the present disclosure is shown;

[0016] Figure 8 A schematic structural block diagram of an apparatus for application operation according to some embodiments of the present disclosure is shown; and

[0017] Figure 9 A block diagram of an electronic device is shown in which one or more embodiments of the present disclosure can be implemented. DETAILED DESCRIPTION

[0018] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0019] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below.

[0020] Herein, unless explicitly stated otherwise, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0021] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0022] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the type, scope of use, usage scenarios, etc. of the information involved in the present disclosure should be informed to relevant users and authorization should be obtained from relevant users in an appropriate manner in accordance with relevant laws and regulations. The relevant users may include any type of right holders, such as individuals, enterprises, and groups.

[0023] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can independently choose whether to provide information to the software or hardware such as the electronic device, application, server or storage medium that executes the operation of the technical solution of the present disclosure based on the prompt message.

[0024] As an optional but non-limiting implementation, in response to receiving an active request from a relevant user, a prompt message may be sent to the relevant user in the form of a pop-up window, in which the prompt message may be presented in text form. Furthermore, the pop-up window may also include a selection control for the user to select "agree" or "disagree" to provide information to the electronic device.

[0025] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0026] Figure 1 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In this example environment 100, an application client 115 and a digital assistant 120 are installed on a terminal device 110. A user 140 can interact with the application client 115 and the digital assistant 120 via the terminal device 110 and / or an attached device of the terminal device 110.

[0027] In some embodiments, the client 115 of the application and the digital assistant 120 (i.e., the client of the digital assistant 120) can be downloaded and installed on the terminal device 110. In some embodiments, the client 115 of the application and the digital assistant 120 can also be accessed through other means, such as through a web page. Figure 1 In the environment 100, the terminal device 115 can present an interface 150. Interface 150 can be, for example, an interface associated with the application client 115. Interface 150 can also be, for example, an interface associated with the digital assistant 120. Interface 150 can include various user interfaces provided by the application client 115 and the digital assistant 120. Interface 150 is sometimes also referred to as a user interface.

[0028] Applications include, but are not limited to, one or more of the following: chat applications (also known as instant messaging applications), document applications, online meeting applications, email applications, task applications, objectives and key results (OKR) applications, and the like. The application client 115 may support the use of plug-ins. Such plug-ins include, but are not limited to, one or more of the following: search plug-ins, contact plug-ins, message plug-ins, document plug-ins, table plug-ins, email plug-ins, calendar plug-ins, schedule plug-ins, task plug-ins, and the like. In some embodiments, the application client 115 and the digital assistant 120 may be integrated into a multi-functional platform. For example, an office collaboration platform (also known as an office suite) may provide integration of various types of applications or components to facilitate people's office work, communication, and other activities. In a multi-functional collaboration platform, people can start different applications or components as needed to complete corresponding information processing, sharing, communication, and the like.

[0029] The digital assistant 120 is used to interact with the user 140. If the interface 150 is a user interface provided by the digital assistant 120 to support the user 140 to conduct a conversation with the digital assistant 120, an interaction window between the user 140 and the digital assistant 120 may be presented in the interface 150. The interaction window between the user 140 and the digital assistant 120 may include a conversation window, in which the interaction between the user 140 and the digital assistant 120 may be presented in the form of conversation messages. Alternatively or additionally, the interaction window between the user 140 and the digital assistant 120 may also include other types of windows, such as a window in floating mode, in which the user 140 triggers the digital assistant 120 to perform corresponding operations by inputting instructions, selecting shortcut instructions, etc. As an intelligent assistant, the digital assistant 120 has intelligent dialogue and information processing capabilities. In the interaction window, the user 140 enters interaction messages, and the digital assistant 120 provides reply messages in response to the user input. In some embodiments, the interface 150 for providing the digital assistant 120 may correspond to a single-function application or a multi-function collaboration platform, such as an office suite or other collaboration platform that can integrate multiple components.

[0030] The digital assistant 120 can be called or awakened in an appropriate manner (for example, a shortcut key, button, or voice) to present an interaction window with the user 140. In some embodiments, the digital assistant 120 can be included in the current user's contact list in the application as a contact of the user 140, or included in the information flow of the chat application. By selecting the digital assistant 120, the interaction window with the digital assistant 120 can be opened. The interaction window may include interface elements for task processing, such as an input box, a message list, a message bubble, and so on. In other embodiments, the digital assistant 120 can be awakened through an entry control or menu provided in the page, or by inputting a preset instruction. In some embodiments described below, for ease of discussion, the interaction window between the user 140 and the digital assistant 120 is mainly illustrated as a conversation window.

[0031] In some embodiments, multiple interaction modes can be provided between user 140 and digital assistant 120, and flexible switching between the multiple interaction modes can be achieved. When a certain interaction mode is triggered, a corresponding interaction area is presented to facilitate interaction between user 140 and digital assistant 120. In different interaction modes, the interaction methods between user 140 and digital assistant 120 are different, which can flexibly adapt to the interaction needs in different application scenarios.

[0032] In some embodiments, the user 140 has a corresponding relationship with the digital assistant 120. For example, the first digital assistant corresponds to the first user, the second digital assistant corresponds to the second user, and so on. That is, the first digital assistant of the first user may be specific to or exclusive to the first user. For example, in the process of the first digital assistant providing assistance or service to the first user, the first digital assistant may utilize its historical interaction information with the first user, the data authorized by the first user that it can access, its current interaction context with the first user, and the like. In response to the first user being an individual or person, the first digital assistant may be regarded as a personal digital assistant. In the disclosed embodiment, the first digital assistant accesses the data to which permission is granted based on the authorization of the first user.

[0033] In some embodiments, information processing or task processing services specific to user 140 can be provided based on historical interaction information between user 140 and digital assistant 120 and / or a data range specific to the user. In some embodiments, historical interaction information of user 140 interacting with digital assistant 120 in multiple interaction modes can be stored in association with user 140. In this way, in one interaction mode (any or a designated interaction mode) among the multiple interaction modes, digital assistant 120 can provide services to user 140 based on the historical interaction information stored in association with user 140.

[0034] In some embodiments, the terminal device 110 communicates with the server 130 to utilize the server 135 of the application installed in the server 130 to implement the provision of services to the client 115 of the application. The server 135 of the application can be, for example, a cloud server corresponding to the client 115 of the application. The terminal device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface for the user (such as "wearable" circuits, etc.). The server 130 can be various types of computing systems / servers that can provide computing capabilities, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0035] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.

[0036] As briefly mentioned above, digital assistants can assist users in using terminal devices or applications. In addition to being able to have free conversations with digital assistants, users can also use natural language instructions to enable digital assistants to complete task processing related to specific applications, such as retrieving project views, creating documents, inviting schedules, creating tasks, etc. However, the interactive functions provided by these applications are not flexible enough, and sometimes it is difficult for digital assistants to help users complete certain operational tasks within the application. For example, for conference applications, during a meeting, if you want to perform some operations on the meeting (such as conference recording operations), you often need to interact in the conference interface provided by the client of the conference application to implement the conference recording operation. Users cannot call the conference recording capabilities provided by the client of the conference application through interaction with the digital assistant. This will affect the user's interactive experience with the digital assistant.

[0037] According to some embodiments of the present disclosure, an improved scheme for application operation is proposed. In an embodiment of the present disclosure, in the interaction between the user and the digital assistant, it is determined that the user initiates the need for a first application operation on the target application. And in the case where it is determined that the first application operation is to be performed at the client of the target application, the first application operation is executed at the client by calling the first interface corresponding to the first application operation in the client. In this scheme, in the case where the application operation is performed at the client of the application, the application operation is implemented by having the digital assistant call the interface corresponding to the application operation in the client of the application. This will allow the call of the client capabilities of the target application to be supported when the user uses the digital assistant to operate the target application, thereby improving the user's interactive experience with the digital assistant.

[0038] Some example embodiments of the present disclosure will be described in detail below with reference to examples in the accompanying drawings.

[0039] Figure 2 Schematic diagram of an architecture 200 for application operation according to some embodiments of the present disclosure is shown. Figure 2 As shown, architecture 200 involves a digital assistant 120 and an operations module 210 .

[0040] In some embodiments, the terminal device 110 wakes up the digital assistant 120 in response to a user (e.g., user 140) through a preset operation (e.g., selecting a digital assistant from a contact list). The interaction window between the digital assistant 120 and the user 140 is presented in the interface 150. After triggering the interaction with the digital assistant 120, the user 140 can input interaction information to the digital assistant 120. For example, the user 140 can interact with the digital assistant 120 in the interaction window. The user 140 can input interaction information to the digital assistant 120 in natural language. The digital assistant 120 determines the need for the user 140 to initiate a first application operation on the target application from the interaction information from the user 140. Taking the target application as an online conference application as an example, the first application operation may include a conference operation on the online conference. Conference operations may include, but are not limited to, conference recording operations, reviewing conference operations, generating to-do operations, generating conference title operations, summarizing conference content operations, and the like.

[0041] In some embodiments, the application interface used for user interaction with the digital assistant is different from the application interface of the target application. For example, the interface used to interact with the digital assistant 120 is in an application that supports digital assistant interaction, such as a messaging application, a chat application, etc. The target application can be another application and therefore has another application interface.

[0042] In some embodiments, digital assistant 120 can use a model to determine whether user 140 has initiated a first application operation on a target application, i.e., to determine whether the user's demand is associated with a specific application, or with a plug-in within the application. Specifically, digital assistant 120 can use a model to process user 140's interaction information to determine whether user 140 has initiated a first application operation on the target application. The model can be any model suitable for processing textual or multimodal data, such as various generative models.

[0043] After the digital assistant 120 determines that the user 140 has initiated a request for a first application operation of the target application, the operation module 210 can perform a series of operations to call a corresponding interface in the target application to perform the first application operation. In some examples, the interface can be an application programming interface (API).

[0044] Specifically, the operation module 210 includes at least a dispatch module 214. The dispatch module 214 can determine whether the first application operation is to be performed on the client side of the target application or on the server side of the target application, that is, determine whether the operation to be performed by the user requires the server capability 222 or the client capability 224 in the capability set 220 of the target application. In some embodiments, the dispatch module 214 can obtain description information of the client capability and the server capability of the target application. The description information of the client capability can indicate the application operation that the client side of the target application supports to complete, and the description information of the server capability can indicate the application operation that the server side of the target application supports to complete. The description information of the client capability and the server capability of the target application can be, for example, pre-set by the user 140 based on the computing capability of the terminal device 110. The dispatch module 214 can determine whether the first application operation currently initiated by the user 140 is to be performed on the client side of the target application or on the server side of the target application based on the description information of the client capability and the server capability of the target application.

[0045] For example, using an online conferencing application as an example, the client capabilities of the online conferencing application may support conference recording, content sharing, hand-raising, microphone on / off, conference mute, conference end, and conference countdown operations. The server capabilities of the online conferencing application may support conference operations such as reviewing a meeting, generating a to-do list, generating a meeting title, and summarizing the meeting content. Therefore, in response to user 140's desire to perform a conference recording operation on the online conferencing application, the dispatch module 214 may determine that the conference recording operation requires support from the client capabilities of the online conferencing application. In response to user 140 initiating a request to perform a conference review operation to the digital assistant 120, the dispatch module 214 may determine that this operation requires support from the server capabilities of the online conferencing application. It should be understood that the description of the client and server capabilities of the target application herein is merely exemplary, and this disclosure does not limit the description of the client and server capabilities of specific target applications. In the following embodiments, for illustrative purposes, the online conferencing application and conference operation scenarios are primarily used as examples, but it should be understood that the described embodiments are equally applicable to other applications.

[0046] In some embodiments, the operation module 210 may further include a link processing module 212. The link processing module 212 is configured to generate and process a first application link indicating a first application operation. The first application link can be used, for example, to call a first interface corresponding to the first application operation in the interface 220. Exemplarily, in some embodiments, the operation module 210 can call the first interface corresponding to the first application operation by sending the first application link generated by the link processing module 212 to the client. The link processing module 212 can, for example, generate the first application link directly based on the first application operation. The link processing module 212 can also, for example, obtain from the dispatch module 214 a determination result of whether the first application operation is to be performed on the client side of the target application or on the server side of the target application, and generate a first application link for calling the interface of the corresponding client based on the determination result.

[0047] In some embodiments, the operation module 210 also includes a security verification module 216. In response to determining that the user 140 initiates a demand for a first application operation on the target application, the security verification module 216 can perform security verification on the first application operation. In some embodiments, the security verification module 216 can verify whether the first application operation is an available operation in the target application. Exemplarily, in the case where the target application is an online conference application, the security verification module 216 can verify whether the first application operation is an available conference operation in the online conference application. For example, if the online conference application supports conference recording, then in the case where the first application operation is a conference recording operation, it can be determined that the first application operation is an available operation in the online conference application, and then it can be determined that the result of the security verification indicates that the verification is passed. In the case where the first application operation is a review conference operation, it can be determined that the first application operation is not an available operation in the online conference application, and then it can be determined that the result of the security verification indicates that the verification is not passed.

[0048] In some embodiments, the security verification module 216 can verify whether the user has the permission to perform the first application operation. The configuration of user permissions for application operations can be configured based on specific applications. Exemplarily, in an online conference scenario, the determination of the user's permission to conference operations may include, but is not limited to: whether the user participates in the online conference to be operated, whether the online conference is in progress, the user's role in the conference, and so on. For example, if user 140 is only a participant in the conference and not the conference host, user 140 may not have the permission to record the conference. In this case, if the first application operation is a conference recording operation, the security verification module 216 can determine whether user 140 has the permission to perform the first application operation based on the identity of user 140 in the conference scenario (whether it is the conference host). In the case of determining that the user has the permission to perform the first application operation, the security verification module 216 determines that the security verification is passed.

[0049] In some embodiments, when it is determined that the first application operation is to be performed at the client of the target application, the security verification module 216 can verify whether the first application operation is executable at the client of the target application. For example, although the client capabilities of the target application support certain application operations, the client version installed at the terminal device of the user 140 may not be updated to adapt to the operation. Exemplary, taking the target application as an online conference application as an example, the client of the target application (that is, the client of the online conference application) can include multiple versions (for example, at least version A and version B). The security verification module 216 can verify whether the version of the client of the target application supports the first application operation when it is determined that the first application operation is to be performed at the client of the target application. For example, if the client of the target application of version A supports the first application operation, and the client of the target application of version B does not support the first application operation, then when the client of the current target application is version A, the security verification module 216 can determine that the version of the client of the target application supports the first application operation, and then determine that the first application operation is executable at the client, and the result of the security verification indicates that the verification is passed. When the client of the current target application is version B, the security verification module 216 can determine that the version of the client of the target application does not support the first application operation, and further determine that the first application operation is not executable at the client, and the result of the security verification indicates that the verification failed.

[0050] It can be understood that in order to ensure the security of the application operation, the first application operation may be allowed to be executed only when the verification result of the security verification module 216 indicates that the verification is passed.

[0051] In the case of determining that the security verification of the first application operation has passed, in response to determining that the first application operation is to be executed at the client of the target application, the dispatch module 214 can dispatch the first application operation to the client of the target application so that the first application operation can be executed by the client capability 224. Specifically, in order to complete the execution of the application operation during the interaction between the user 140 and the digital assistant 120, the first interface (client interface) corresponding to the first application operation in the client can be called by sending a first application link to the client, so that the first application operation is executed at the client of the target application. In some cases, in response to determining that the first application operation is to be executed at the server of the target application, the dispatch module 214 can assign the first application operation to the server of the target application so that the first application operation can be executed by the server capability 222. Specifically, the first application link can be sent to the server to send an execution request for the first application operation via the interface with the server, and the execution result of the first application operation can be received from the server.

[0052] In some embodiments, before calling the interface so that the first application operation is executed, in response to determining that the user initiates a demand for the first application operation on the target application, the digital assistant 120 may also provide the user 140 with a first prompt message confirming the first application operation, and the execution of the first application operation is at least based on receiving the confirmation of the execution of the first application operation by the user 140. The first prompt message may, for example, be a prompt message that matches the first application link, which may at least include a first trigger control for triggering the sending of the first application link to the client or server of the target application. The first trigger control may, for example, include a hyperlink, an operation control, and the like. Exemplarily, the digital assistant 120 may provide the first prompt message to the user 140 by presenting the first prompt message in an interactive window.

[0053] Figures 3A to 3C Schematic diagram of an example user interface presenting an interaction window between a user and a digital assistant according to some embodiments of the present disclosure is shown. The user interface can be implemented at the terminal device 110. Figure 3A As shown, the conversation window between the digital assistant 120 (shown as "XX Assistant" in the figure) and the user 140 is presented in area 310 of the interface 300A. The digital assistant can be regarded as one of the user's contacts and is presented in the information flow of the instant messaging application. The instant messaging application is presented in area 330 of the interface 300A, and the information flow is presented in area 320 of the interface 300A. The user 140 selects the digital assistant in the instant messaging application, thereby entering the conversation window. The conversation window presents the interactive messages between the digital assistant 120 and the user 140. In the conversation window, the user 140 can enter the conversation message through the input box 301 or by other appropriate means (for example, voice), and the digital assistant 120 can provide a reply message based on the input conversation message and in combination with relevant knowledge. Taking the target application as an online conference application as an example, when there is an ongoing online conference, the terminal device 110 can also present a control 302 in the interface 300A. In response to detecting a click operation on the control 302 , the terminal device 110 may switch from the interface 300A to presenting a conference interface provided by the online conference application.

[0054] like Figure 3AAs shown, a conversation message 311 input by the user is presented in the conversation window. Based on the conversation message 311, the digital assistant 120 can determine that the conversation message 311 indicates that the user 140 has initiated a need to record a meeting for the online conference application. The digital assistant 120 can then provide the user 140 with a prompt message 312 for confirming the meeting recording operation. The prompt message 312 is presented in the conversation window. The prompt message 312 includes a trigger control 313 for triggering the sending of an application link to the client or server of the online conference application. The trigger control 313 is, for example, a hyperlink. In response to detecting a selection operation (e.g., a click operation) on the trigger control 313, the digital assistant 120 can confirm the meeting recording operation corresponding to the trigger control 313.

[0055] Combined with the above Figure 3A The execution of the first application operation does not need to rely on the execution of other application operations, and the digital assistant 120 can directly provide the first prompt message. In some cases, the execution of a certain application operation supported by the target application depends on the execution of another application operation. Therefore, in some embodiments, in response to the user initiating a demand for the first application operation of the target application, the digital assistant 120 can also determine the operation execution state of the target application to determine whether the execution of the first application operation needs to rely on the execution of other application operations (such as the second application operation). In some embodiments, the digital assistant 120 can use a model to determine the operation execution state of the target application. A prompt word input for the model can be constructed based on at least the user's demand for the first application operation of the target application to guide the model to determine whether the first application operation in the target application depends on the execution of other application operations and whether the dependent application operations have been executed if there are dependent application operations. The prompt word input can be provided to the model, and the model output is given by the model. The model output can indicate the operation execution state of the target application, which indicates whether the execution of the first application operation depends on the execution of another application operation (such as the second application operation) and whether the second application operation has been executed.

[0056] If the operation execution status indicates that the execution of the first application operation depends on the execution of the second application operation, the digital assistant 120 may also determine whether the second application operation on which the execution of the first application operation depends is executed in the target application. In response to the second application operation on which the execution of the first application operation depends is not executed, the digital assistant 120 may provide the user 140 with a second prompt message for triggering the execution of the second application operation. Figure 3B and Figure 3CTo describe the situation where the execution of the first application operation depends on the execution of other application operations, and the digital assistant 120 needs to provide a second prompt message. Similar to the first prompt message, the second prompt message may at least include a second trigger control for triggering the sending of a second application link indicating the second operation to the client or server of the target application. The second trigger control may, for example, include a hyperlink, an operation control, and the like. That is, the first prompt message or the second prompt message includes a card message or a rich text message containing an application link.

[0057] like Figure 3B and Figure 3C As shown, the conversation windows of interface 300B and interface 300C may further include, for example, an operation control 303 and an operation control 304. Operation control 303 and operation control 304 may be operation controls corresponding to shortcut commands. In response to detecting a selection operation on operation control 303, a conversation message 314 may be presented in the conversation window. In response to detecting a selection operation on operation control 304, a conversation message 317 may be presented in the conversation window. The digital assistant 120 may determine the first application operations corresponding to operation control 303 and operation control 304 (e.g., a review meeting operation and a generate to-do operation, respectively). If the digital assistant 120 determines that the first application operations corresponding to operation control 303 and operation control 304 require a second application operation (e.g., a meeting recording operation) to be executed, and the second application operation has not been executed, the digital assistant 120 may provide a second prompt message (e.g., prompt message 315 and prompt message 318) including a second application link indicating the second application operation. Prompt message 315 may, for example, be a rich text message including application link 316. The prompt message 318 may be, for example, a card message including an operation control 319 .

[0058] In some embodiments, based on receiving confirmation from the user 140 of the execution of the second application operation (for example, receiving a click operation of the user on the hyperlink 316 or the operation control 319), the digital assistant 120 can execute the second application operation by calling a second interface corresponding to the second application operation in the client and / or server, thereby causing the first application operation to be executed at the client or server of the target application.

[0059] Figure 4 FIG. 4 is a schematic diagram of an architecture 400 for application operation according to other embodiments of the present disclosure. Figure 4 As shown, after the user 140 sends the application operation related conversation 401, the digital assistant 120 can determine based on the conversation that the user expects to perform operations related to the target application, and thus determine to use the plug-in corresponding to the target application, that is, the target application plug-in 410 to process the conversation.

[0060] The target application plug-in 410 refers to a call to one or more interfaces (such as API interfaces) corresponding to the target application, which can provide application operations to the digital assistant 120. The target application plug-in 410 may include multiple tools, including application operation tools for performing different application operations and tools for performing application operations corresponding to shortcut instructions. In this way, the target application plug-in 410 can determine which application operation of the target application the user expects to perform from the conversation from the user. In some embodiments, the target application plug-in 410 can also use a model to understand the user's natural language input to determine the user's intention, that is, the specific application operation to be initiated. In response to the user initiating a shortcut instruction related to the target application, the target application plug-in 410 can directly determine the application operation corresponding to the shortcut instruction.

[0061] After the target application plug-in 410 determines the application operation to be initiated by the user in the target application, the digital assistant 120 can provide a prompt message to the user 140 to confirm the application operation. This allows the user to reconfirm the application operation to be executed, avoiding inappropriate operations due to problems such as intention recognition errors. The prompt message can be displayed in the conversation window between the digital assistant 120 and the user 140, for example.

[0062] In some embodiments, the types of prompt messages may include, but are not limited to, ordinary text messages, rich text messages (including hyperlinks), and card messages, wherein the hyperlinks in the rich text messages and the operation controls included in the card messages can be used to indicate the triggering of sending application links. The hyperlinks in the rich text messages (for example, application links) can be the links themselves, or can be text hyperlinks, or text hyperlinks with icons, etc., which can help users quickly identify the indicated application operations. The operation controls of the card messages can also be configured with application links and rendered in the form of text and / or operation icons to facilitate user identification of the corresponding application operations. In some embodiments, the type of message to be displayed and rendered can be determined based on preset rules. For example, different application operations can correspond to different message types.

[0063] In response to detecting a user click operation on an operation control included in a hyperlink and / or card message, the link processing module 212 of the digital assistant 120 generates an application link. In some embodiments, to ensure the security and reliability of the link, the link processing module 212 can encrypt the application link to generate an encrypted application link.

[0064] The client 420 of the target application can intercept the application link generated by the link processing module 212. The client link processing module 430 in the client 420 of the target application is used to process the intercepted application link. The client link processing module 430 can perform PB parsing 431, security verification 421, frequency control 433 and other operations on the application link, wherein the PB parsing 431 can perform a decryption operation on the decrypted application link. The security verification 421 can verify whether the application operation can be executed based on at least the client capability 224. The client capability 224 includes an application operation mapping 442, which can indicate a mapping relationship between the application operation and the interface, and the mapping relationship can be used to determine the interface to be called based on the application operation. The interface here refers to the client interface 444 included in the client of the target application, including interface 1, interface 2, ..., interface N. Based on the mapping relationship and the application operation indicated by the received application link, the interface associated with executing the application operation can be determined from the multiple interfaces included in the client interface 444.

[0065] Target application client 420 also supports transparent transmission of server-side capabilities 450. When a server-side interface needs to be called to execute an application operation, target application client 420 can act as a relay, transparently transmitting the request to the target application's server. Transparent transmission of server-side capabilities 450 includes a command 452 and a request payload 454. Command 452 indicates the transparent transmission of the server-side interface request command word, and request payload 454 indicates the transparent transmission of the server-side interface request parameters.

[0066] The dispatcher 434 in the client link processing module 430 can determine whether the operation indicated by the application link is to be executed in the client or the server of the target application. The dispatcher 434 then calls the corresponding interface from the client or the server to execute the application operation based on the determination result.

[0067] Figure 5 FIG4 is a schematic diagram showing a process 500 for application operation according to some other embodiments of the present disclosure. The process 500 may be implemented by the architecture 400, for example.

[0068] In block 502 , the digital assistant 120 obtains an application operation related session sent by the user 140 .

[0069] At block 504 , the digital assistant 120 infers a plug-in corresponding to the application based on the acquired application operation-related conversation. Specifically, the digital assistant determines the application corresponding to the application operation and determines the plug-in associated with the application.

[0070] In block 506 , the digital assistant 120 determines whether the user 120 has initiated a request for an application operation of the target application, that is, determines whether the application corresponding to the application operation is the target application and whether the application operation is an application operation supported by the target application.

[0071] At block 508 , digital assistant 120 , in response to determining that the user has not initiated a demand for a first application operation of the target application, implements the application operation using the general processing of the model.

[0072] In block 510, the digital assistant 120, in response to determining that the user initiates a first application operation on the target application, calls a plug-in corresponding to the target application. In some embodiments, the digital assistant 120 may also determine an application operation tool associated with the application operation in the plug-in.

[0073] At block 512 , the digital assistant 120 determines whether the application operation is available. For example, the digital assistant 120 may determine whether the target application supports the application operation.

[0074] In response to determining that the application operation is unavailable, the digital assistant 120 returns to provide the user with a general explanation text message at block 514. The general explanation text message here is used to inform the user that the application operation is unavailable, which may be, for example, "Sorry, XX application operation is unavailable."

[0075] At block 516, the digital assistant 120 may generate a card message. At block 518, the digital assistant 120 may generate a rich text message containing an application link. As previously mentioned, whether a card message or a rich text message is to be generated may be determined based on the specific application operation to be performed.

[0076] In block 520 , the digital assistant 120 may render the card message and / or the rich text message in the interaction window to provide the card message or the rich text message to the user.

[0077] In box 522, the digital assistant 120 determines that it has received the user's second confirmation of performing the application operation in response to receiving the user's selection operation on the operation control in the card message and / or the hyperlink in the rich text message (the session actively sent by the user can be determined as the first confirmation).

[0078] At block 524 , the digital assistant 120 determines whether the application operation is being performed at the client.

[0079] In block 526 , in response to determining that the application operation is not executed at the client, the digital assistant 120 transmits a link indicating the application operation for invoking the interface to the server, so that the server executes the application operation based on the link.

[0080] In response to determining that the application operation is executed at the client, the digital assistant 120 determines whether the application operation can pass a security check at block 528. The security check may include, for example, verifying whether the user 140 has permission to execute the application operation and verifying whether the application operation can be executed at the client.

[0081] In response to determining that the security check has failed, at block 530, the digital assistant 120 prompts the user with relevant information. For example, the prompt information may be presented to the user in a conversation window. The prompt information presented may be, for example, "Sorry, the security check failed, and the XX application operation cannot be performed."

[0082] In block 532 , in response to determining that the security check has passed, the digital assistant 120 calls the application's interface at the client of the target application to perform corresponding application operations.

[0083] Figure 6 FIG. 6 is a schematic diagram illustrating a process 600 for application operation according to some other embodiments of the present disclosure. The process 600 may be, for example, a special case of the process 500 .

[0084] In block 601, the digital assistant 120 determines a first application operation to trigger a target application based on a conversation message from the user 140. The conversation message here can be input by the user 140 into the conversation window through an input box, or can be input by the user 140 into the conversation window by triggering an operation control corresponding to a shortcut instruction.

[0085] In block 602 , the digital assistant 120 determines a plug-in 602 corresponding to the target application.

[0086] In block 603 , the digital assistant 120 determines whether the first application operation is dependent on a second application operation that is not enabled.

[0087] At block 604 , the digital assistant 120 performs the first application operation in response to determining that the first application operation is not dependent on the second application operation that is not enabled.

[0088] In block 605 , the digital assistant 120 returns a prompt message for enabling the second application operation in response to determining that the first application operation depends on the second application operation that is not enabled. The digital assistant 120 may, for example, provide the prompt message in a conversation window with the user 140 .

[0089] In box 606, the digital assistant 120 generates an application link corresponding to the second application operation in response to receiving a click operation on the trigger control of the application link corresponding to the second application operation.

[0090] In block 607 , the digital assistant 120 performs a security check on the second application operation.

[0091] In box 608, in response to the failure of the security check, the digital assistant 120 prompts relevant information indicating that the security check failed.

[0092] In box 609, in response to passing the security check, the digital assistant 120 performs the corresponding second application operation at the client or server of the target application.

[0093] In summary, according to the embodiments of the present disclosure, when application operations are performed on the application client, the application operations are implemented by enabling the digital assistant to call the interface corresponding to the application operation in the application client. When the user uses the digital assistant to operate the target application, the client capabilities of the target application can be called, thereby improving the user's interactive experience with the digital assistant.

[0094] Figure 7 FIG. 7 is a flow chart showing a process 700 for application operation according to some embodiments of the present disclosure. The process 700 may be implemented at the terminal device 110. For ease of discussion, reference will be made to FIG. Figure 1 The process 700 is described with reference to the environment 100 .

[0095] In box 710, the terminal device 110 determines that the user needs to initiate a first application operation on the target application during the interaction between the user and the digital assistant.

[0096] In block 720 , the terminal device 110 determines whether the first application operation is to be performed at a client end of the target application or at a server end of the target application.

[0097] In block 730 , in response to determining that the first application operation is to be executed at the client of the target application, the terminal device 110 causes the first application operation to be executed at the client by calling a first interface corresponding to the first application operation in the client.

[0098] In some embodiments, the application interface used for user interaction with the digital assistant is different from the application interface of the target application.

[0099] In some embodiments, a mapping relationship between application operations and interfaces is maintained in the client of the target application, and calling the first interface corresponding to the first application operation in the client includes: calling the first interface corresponding to the first application operation by sending a first application link to the client, and the first application link indicates the first application operation.

[0100] In some embodiments, the first application link is encrypted.

[0101] In some embodiments, process 700 further includes: in response to determining that the first application operation is to be executed at the server of the target application, sending an execution request for the first application operation via an interface with the server; and receiving an execution result of the first application operation from the server.

[0102] In some embodiments, process 700 also includes: in response to the user initiating a demand for a first application operation on the target application, providing the user with a first prompt message for confirmation of the first application operation, wherein the execution of the first application operation is based at least on receiving the user's confirmation of the execution of the first application operation.

[0103] In some embodiments, the first prompt message includes at least a first trigger control for triggering the sending of a first application link to the client or server of the target application, the first application link indicates a first application operation, and the user's confirmation of the first application operation includes the user's selection of the first trigger control.

[0104] In some embodiments, process 700 also includes: in response to a user initiating a demand for a first application operation on a target application, obtaining an operation execution status of the target application; in response to the operation execution status indicating that a second application operation on which the execution of the first application operation depends has not been executed, providing a second prompt message to the user for triggering execution of the second application operation; and based on receiving confirmation from the user of the execution of the second application operation, causing the first application operation to be executed at the client or server of the target application.

[0105] In some embodiments, a prompt word input for a model is constructed based on at least a user's demand for a first application operation of a target application; the prompt word input is provided to the model; and a model output is received from the model, the model output indicating an operation execution status.

[0106] In some embodiments, the first prompt message or the second prompt message includes a card message or a rich text message containing an application link.

[0107] In some embodiments, process 700 further includes: in response to determining that the user initiates a request for a first application operation on the target application, performing security verification on the first application operation, where the security verification includes at least one of the following: verifying whether the first application operation is an available operation in the target application, verifying whether the user has permission to perform the first application operation, and, if it is determined that the first application operation is to be performed on a client of the target application, verifying whether the first application operation is executable on the client. Execution of the first application operation is based at least on an indication that the security verification result is successful.

[0108] In some embodiments, determining whether the first application operation is to be performed on the client side of the target application or on the server side of the target application includes: determining whether the first application operation is to be performed on the client side of the target application or on the server side of the target application based on the description information of the client capabilities and server capabilities of the target application.

[0109] In some embodiments, the target application includes an online conference application, and the first application operation includes a conference operation on the online conference.

[0110] Figure 8 1 shows a schematic structural block diagram of an apparatus 800 for application operation according to some embodiments of the present disclosure. The apparatus 800 may be implemented as or included in a terminal device 110. Each module / component in the apparatus 800 may be implemented by hardware, software, firmware, or any combination thereof.

[0111] The device 800 includes a demand determination module 810, which is configured to determine, during the interaction between the user and the digital assistant, a user's demand for a first application operation on a target application. The device 800 also includes an execution determination module 820, which is configured to determine whether the first application operation is to be performed on the client of the target application or on the server of the target application. The device 800 also includes an operation execution module 830, which is configured to, in response to determining that the first application operation is to be performed on the client of the target application, cause the first application operation to be executed on the client by calling a first interface corresponding to the first application operation in the client.

[0112] In some embodiments, a mapping relationship between application operations and interfaces is maintained in the client of the target application, and the operation execution module 830 includes: an interface calling module, configured to call a first interface corresponding to a first application operation by sending a first application link to the client, where the first application link indicates a first application operation.

[0113] In some embodiments, the first application link is encrypted.

[0114] In some embodiments, the device 800 also includes: a request sending module, configured to send an execution request for the first application operation via an interface with the server in response to determining that the first application operation is to be executed at the server of the target application; and an execution result receiving module, configured to receive the execution result of the first application operation from the server.

[0115] In some embodiments, the device 800 also includes: a first information providing module, configured to provide the user with a first prompt message for confirmation of the first application operation in response to the user initiating a demand for a first application operation on the target application, wherein the execution of the first application operation is based at least on receiving the user's confirmation of the execution of the first application operation.

[0116] In some embodiments, the first prompt message includes at least a first trigger control for triggering the sending of a first application link to the client or server of the target application, the first application link indicates a first application operation, and the user's confirmation of the first application operation includes the user's selection of the first trigger control.

[0117] In some embodiments, the device 800 also includes: a status acquisition module, configured to obtain the operation execution status of the target application in response to a user initiating a demand for a first application operation on the target application; a second message providing module, configured to provide the user with a second prompt message for triggering the execution of the second application operation in response to the operation execution status indicating that the second application operation on which the execution of the first application operation depends has not been executed; and an execution module, configured to cause the first application operation to be executed at the client or server of the target application based on receiving the user's confirmation of the execution of the second application operation.

[0118] In some embodiments, the state acquisition module is configured to: construct a prompt word input for the model based at least on the user's demand for a first application operation of the target application; provide the prompt word input to the model; and receive a model output from the model, the model output indicating the operation execution state.

[0119] In some embodiments, the first prompt message or the second prompt message includes a card message or a rich text message containing an application link.

[0120] In some embodiments, the device 800 also includes: a security verification module, configured to perform security verification of the first application operation in response to determining that the user initiates a need for the first application operation of the target application, the security verification includes at least one of the following: verifying whether the first application operation is an available operation in the target application, verifying whether the user has permission to perform the first application operation, and when it is determined that the first application operation is to be performed at the client of the target application, verifying whether the first application operation is executable at the client; and wherein the execution of the first application operation is at least based on an indication that the result of the security verification has passed.

[0121] In some embodiments, the execution determination module 820 is further configured to determine whether the first application operation is to be executed on the client side or the server side of the target application based on the description information of the client capability and the server capability of the target application.

[0122] In some embodiments, the target application includes an online conference application, and the first application operation includes a conference operation on the online conference.

[0123] It should be understood that one or more steps in the above method can be performed by a suitable electronic device or combination of electronic devices. Such an electronic device or combination of electronic devices may include, for example, Figure 1 The server 130, the terminal device 110 and / or the combination of the server 130 and the terminal device 110.

[0124] Figure 9 FIG. 9 is a block diagram of an electronic device 900 suitable for implementing an embodiment of the present disclosure. It should be understood that Figure 9 The illustrated electronic device 900 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 9 The electronic device 900 shown can be used to implement Figure 1 Terminal device 110 or Figure 8 The device 800 is shown.

[0125] like Figure 9 As shown, electronic device 900 is in the form of a general electronic device. Components of electronic device 900 may include, but are not limited to, one or more processors or processing units 910, memory 920, storage device 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. Processing unit 910 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 920. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to increase the parallel processing capabilities of electronic device 900.

[0126] The electronic device 900 typically includes a plurality of computer storage media. Such media can be any available media accessible to the electronic device 900, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 920 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory) or some combination thereof. The storage device 930 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk or any other medium, which can be used to store information and / or data and can be accessed within the electronic device 900.

[0127] The electronic device 900 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 9As shown in FIG, a magnetic disk drive for reading from or writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. Memory 920 may include a computer program product 925 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0128] The communication unit 940 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 900 can be implemented as a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 900 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0129] The input device 950 may be one or more input devices, such as a mouse, keyboard, or trackball. The output device 960 may be one or more output devices, such as a display, a speaker, or a printer. The electronic device 900 may also communicate with one or more external devices (not shown) through the communication unit 940 as needed, such as a storage device, a display device, or the like, with one or more devices that allow a user to interact with the electronic device 900, or with any device that allows the electronic device 900 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0130] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0131] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0132] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0133] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0134] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0135] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for application operation, comprising: During interaction between a user and a digital assistant, determining a need for the user to initiate a first application operation on a target application; Obtaining an operation execution status of the target application, where the operation execution status indicates whether execution of the first application operation depends on execution of other application operations; Determining whether the first application operation is to be performed on a client of the target application or on a server of the target application; In response to determining that execution of the first application operation does not depend on execution of other application operations, and that the first application operation is to be executed at a client of the target application, causing the first application operation to be executed at the client by calling a first interface corresponding to the first application operation in the client; In response to determining that execution of the first application operation depends on execution of other application operations, and a second application operation on which execution of the first application operation depends has not been executed, providing a second prompt message to the user for triggering execution of the second application operation; as well as Based on receiving the user's confirmation of the execution of the second application operation, the first application operation is executed at the client or server of the target application.

2. The method according to claim 1, wherein the application interface used for the user to interact with the digital assistant is different from the application interface of the target application.

3. The method according to claim 1, wherein calling a first interface corresponding to the first application operation in the client comprises: A first interface corresponding to the first application operation is called by sending a first application link to the client, where the first application link indicates the first application operation. The method of claim 3 , wherein the first application link is encrypted.

5. The method according to claim 1, further comprising: In response to determining that the first application operation is to be executed at a server of the target application, sending an execution request for the first application operation via an interface with the server; as well as Receive the execution result of the first application operation from the server.

6. The method according to claim 1, further comprising: In response to the user initiating a demand for a first application operation on a target application, providing the user with a first prompt message for confirming the first application operation, The execution of the first application operation is at least based on receiving confirmation from the user of the execution of the first application operation.

7. The method according to claim 6, wherein the first prompt message comprises at least a first trigger control for triggering the sending of a first application link to the client or server of the target application, the first application link indicating the first application operation, and The user's confirmation of the first application operation includes the user's selection of the first trigger control.

8. The method according to claim 1, wherein obtaining the operation execution status of the target application comprises: constructing a prompt word input for a model based at least on the user's demand for a first application operation of the target application; providing the prompt word input to the model; as well as A model output is provided by the model, wherein the model output indicates a status of execution of the operation. 9 . The method according to claim 6 , wherein the first prompt message comprises a card message or a rich text message containing an application link. 10 . The method according to claim 1 , wherein the second prompt message comprises a card message or a rich text message containing an application link.

11. The method according to claim 1 , further comprising: In response to determining that the user initiates a demand for a first application operation on the target application, performing security verification on the first application operation, the security verification including at least one of the following: Verifying whether the first application operation is an available operation in the target application, Verify whether the user has permission to perform the first application operation, In a case where it is determined that the first application operation is to be executed at the client of the target application, verifying whether the first application operation is executable at the client; as well as The execution of the first application operation is at least based on the result of the security verification indicating that the verification is passed.

12. The method according to claim 1, wherein determining whether the first application operation is to be performed on the client side of the target application or on the server side of the target application comprises: Based on the description information of the client capability and the server capability of the target application, it is determined whether the first application operation is to be executed at the client of the target application or at the server of the target application.

13. The method according to claim 1, wherein the target application comprises an online conference application, and the first application operation comprises a conference operation on an online conference.

14. A device for application operation, comprising: a demand determination module configured to determine, during interaction between a user and a digital assistant, a demand for the user to initiate a first application operation on a target application; a status obtaining module configured to obtain an operation execution status of the target application, wherein the operation execution status indicates whether the execution of the first application operation needs to depend on the execution of other application operations; an execution determination module, configured to determine whether the first application operation is to be executed on a client of the target application or on a server of the target application; an operation execution module configured to, in response to determining that execution of the first application operation does not depend on execution of other application operations and that the first application operation is to be executed at a client of the target application, cause the first application operation to be executed at the client by calling a first interface corresponding to the first application operation in the client; a second message providing module configured to, in response to determining that execution of the first application operation depends on execution of other application operations, and that the second application operation on which execution of the first application operation depends has not been executed, provide the user with a second prompt message for triggering execution of the second application operation; as well as The execution module is configured to enable the first application operation to be executed at the client or server of the target application based on receiving the user's confirmation of the execution of the second application operation.

15. An electronic device comprising: at least one processing unit; as well as At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 13 when executed by the at least one processing unit.

16. A computer-readable storage medium having a computer program stored thereon, wherein the computer program is executable by a processor to implement the method according to any one of claims 1 to 13.

Images