Information processing method and device, equipment and storage medium

Abstract

The embodiment of the invention provides an information processing method and device, equipment and a storage medium. The method comprises the steps of opening a session in response to a preset operation associated with an application; a target message input by the user in the session is obtained, the user and the digital assistant are members of the session, and the target message is sent by the user for the digital assistant; obtaining operation information of a user in the application; and sending the target message and the operation information to the server. Therefore, the related operation information of the user in the application can be provided, and the semantic meaning of the user can be better understood when the user is replied. Therefore, the reply accuracy of the digital assistant can be improved.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to information processing methods, apparatuses, devices, and computer-readable storage media. Background Art

[0002] With the development of information technology, various terminal devices can provide various services to people in work and life. For example, applications that provide services can be deployed in terminal devices. Terminal devices or their applications can provide assistant functions to users to assist users in using terminal devices or applications to complete tasks. How to make such assistant functions serve users more efficiently and accurately is a technical problem currently being explored. Summary of the invention

[0003] In a first aspect of the present disclosure, an information processing method is provided. The method includes: opening a session in response to a preset operation associated with an application; obtaining a target message input by a user in the session; wherein the user and a digital assistant are both members of the session, and the target message is sent by the user to the digital assistant; obtaining operation information of the user in the application; and sending the target message and the operation information to a server.

[0004] In a second aspect of the present disclosure, a device for information processing is provided. The device includes: a session opening module, configured to open a session in response to a preset operation associated with an application; a target message acquisition module, configured to acquire a target message input by a user in the session; wherein the user and the digital assistant are both members of the session, and the target message is sent by the user to the digital assistant; an operation information acquisition module, configured to acquire operation information of the user in the application; and a sending module, configured to send the target message and the operation information to a server.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect or the second aspect.

[0007] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0010] Figure 2A-2E A schematic diagram showing example interfaces of a main session window and a sub-session window according to some embodiments;

[0011] Figure 3 An example process of delivering interactive messages between a user and a digital assistant according to some embodiments is shown;

[0012] Figure 4 An example process of transmitting user operation information in an application according to some embodiments is shown;

[0013] Figure 5 shows an example of a data structure for operating information according to some embodiments;

[0014] Figure 6 A schematic flow chart of a method for information processing according to some embodiments is shown;

[0015] Figure 7 A block diagram showing an apparatus for information processing according to some embodiments; and

[0016] Figure 8 A block diagram of a device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0017] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0018] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0019] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0020] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0021] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the types, scopes of use, usage scenarios, etc. of the information involved in the present disclosure should be informed to relevant users and their authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations. The relevant users may include any type of right holders, such as individuals, enterprises, and groups.

[0022] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can independently choose whether to provide information to software or hardware such as an electronic device, application, server or storage medium that executes the operation of the technical solution of the present disclosure based on the prompt message.

[0023] As an optional but non-limiting implementation, in response to receiving an active request from a relevant user, a prompt message is sent to the relevant user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to select "agree" or "disagree" to provide information to the electronic device.

[0024] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0025] Figure 1A schematic diagram of an example environment 100 in which an embodiment of the present disclosure can be implemented is shown. In the example environment 100, an office suite 120 is installed in a terminal device 110. A user 140 can interact with the office suite 120 via the terminal device 110 and / or an attached device of the terminal device 110. The office suite 120 can provide the user 140 with the integration of multiple applications or components. These applications can be used as application modules in the office suite 120. The applications integrated in the office suite 120 are sometimes also referred to as "office applications", "office components", "collaborative office platforms", etc. As an example, the applications integrated in the office suite 120 may include, but are not limited to, one or more of the following: a chat application (also referred to as an instant messaging (IM) application), a document application, an audio and video conferencing application, an email application, a calendar application, a schedule application, a task application, and an objective and key result (OKR) application.

[0026] In some embodiments, the office suite 120 can be downloaded as an application and installed on the terminal device 110. In some embodiments, the office suite 120 can also be accessed through other methods, such as through a web page.

[0027] exist Figure 1 In the environment 100, if the office suite 120 is started, the terminal device 110 can present an interface 150 of the office suite 120 to the user 140. The interface 150 is sometimes also referred to as a client interface. The interface 150 may include various interfaces that the office suite 120 can provide, such as a conversation interface for presenting chat content, a video conference interface, a file sharing interface, and the like.

[0028] In some embodiments, the terminal device 110 communicates with the server 130 to provide services for the office suite 120. The terminal device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a television receiver, a radio broadcast receiver, an e-book device, a gaming device, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.). The server 130 can be various types of computing systems / servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0029] It should be understood that the structure and function of each element in the environment 100 are described for exemplary purposes only, and do not imply any limitation on the scope of the present disclosure. For example, the embodiments of the present disclosure can be applied to any suitable one or more applications, and are not limited to office suites.

[0030] As briefly mentioned above, a digital assistant can be provided to the user to help the user complete the target task using a terminal device or application. In an embodiment of the present disclosure, a digital assistant is configured for user 140. The digital assistant can be implemented in any suitable form. In some embodiments, the digital assistant of user 140 can interact with it as a contact of user 140. Such a digital assistant can also correspond uniquely to user 140. In other words, the digital assistant of user 140 can be specific to or exclusive to user 140. In some embodiments, if user 140 is an individual or an individual, such a digital assistant can be regarded as a personal digital assistant. It can be understood that in the embodiment of the present disclosure, the digital assistant is based on the authorization of user 140 to access the data to which permission is granted.

[0031] It should be understood that “uniquely corresponds” or similar expressions in the present disclosure are not intended to limit the digital assistant to be updated accordingly based on the interaction process between the user 140 and the digital assistant.

[0032] In the embodiment of the present disclosure, after waking up the digital assistant through the preset application, the user 140 interacts with the digital assistant through the main session. The interaction window corresponding to the main session may be referred to as the main session window. As an example, the preset application may be an IM application in an office suite. In other examples, the preset application may also be other applications or components.

[0033] refer to Figure 2A An example of a main conversation window in an office suite is described. The terminal device presents an interface 200A of an office suite. The interface 200A includes a navigation bar 230, which displays entry controls for multiple applications and access entries for multiple pages. By selecting these entry controls and access entries, the corresponding application or page can be activated for browsing or operation. In this example, the chat application is activated. Accordingly, the information feed (feed) page 210 of the chat application, that is, the conversation entry list, is presented in the interface 200A. The conversation entry item 211 between the user and the digital assistant ("XX Assistant" in Figure 2) is displayed in the information feed page 210. The user can click on the conversation entry item 211 of "XX Assistant" to present the main conversation window 220.

[0034] In an embodiment of the present disclosure, the conversation entry with the digital assistant may also be in the contact list. The user may open the main conversation window 220 with the digital assistant by triggering the conversation entry of the digital assistant in the contact list.

[0035] In the above examples and the examples below, the digital assistant is shown as having the name of "XX Assistant", but it should be understood that this is merely exemplary and is not intended to limit the scope of the present disclosure. In embodiments of the present disclosure, the digital assistant can have any suitable name, and the user 140 can customize the name of the digital assistant.

[0036] In some embodiments of the present disclosure, the digital assistant can also be awakened and interacted with through other applications other than the preset application. After waking up the digital assistant through these non-preset applications, the user and the digital assistant can interact through a sub-session. The interaction window corresponding to the sub-session can be called a sub-session window. For example, the user can wake up the digital assistant through a page in a document application, and then interact with the digital assistant through a sub-session.

[0037] Of course, in some embodiments, after waking up the digital assistant through these non-preset applications, the user and the digital assistant can also interact through the main session. The following embodiments are described by taking the sub-session as an example.

[0038] refer to Figure 2B An example of a sub-session window in an office suite is described. The terminal device presents an interface 200B of the office suite. In this example, an opened document page 240 is presented in the interface 200B. In the document page 240, options or controls 241 related to the digital assistant are presented. The user can click the control 241 to wake up the digital assistant, thereby presenting a sub-session window 250. In this example, a prompt message "Start collaborating with you - based on AAAA" is displayed in the sub-session window 250. Further, the user can interact with the digital assistant through the sub-session window 250. Interaction messages can be displayed in the sub-session window 250 (as indicated by the dotted box 251).

[0039] The above describes the sub-session between the user and the digital assistant by taking the document application as an example. However, it should be understood that the user can wake up the digital assistant through any other suitable application.

[0040] In some embodiments, the interactive messages in the sub-session windows can be displayed in the main session window in an aggregated form. Figure 2B and Figure 2C, the interactive messages in the sub-session window 250 presented in the interface 200B (as indicated by the dotted frame 251) are displayed in the main session window 220 of the interface 200C in the form of aggregated message records (as indicated by the dotted frame 260). The aggregated form here may mean that the message records in the sub-session window 250 are displayed in a centralized manner, for example, in the position indicated by the dotted frame 260, and no other messages are inserted therein. As a result, the interactive messages between the user and the digital assistant can be uniformly recorded and thus can be traced back. This is conducive to providing users with an efficient assistance experience.

[0041] In the embodiments of the present disclosure, through the main session and the sub-session, the user and the digital assistant can interact on different topics. Figure 2D , a control 272 for starting a new topic is displayed in the sub-conversation window 270. If the user 140 clicks the control 272, the topic involved in the interaction in the dotted box 271 can be ended and a new topic can be started. Accordingly, the message record of the sub-conversation window 270 displayed in the main conversation window may include interactive messages of different topics, and messages under different topics can be distinguished. As an example, refer to Figure 2E , the message record about one topic in the sub-conversation window 270 is displayed in the area 281 of the main conversation window 220, and the message record about another topic is displayed in the area 282. The new topic is separated from the previous topic by the mark 283 of "new topic opened".

[0042] For the same topic, multiple rounds of conversations may be required between the user and the digital assistant. For the same topic, multiple rounds of conversations may be required between the user and the digital assistant. In some scenarios, more natural communication and conversations can be made between the user and the digital assistant by using deep learning and natural language processing technologies. In this case, the conduct of the topic requires the perception of contextual information of multiple rounds of conversations between the user and the digital assistant. Typically, an office suite can provide a variety of applications, such as chat applications (also called messaging applications), document applications, spreadsheet applications, mailbox applications, and so on. In the process of providing the services corresponding to each application, the digital assistant can also be called to communicate with the user.

[0043] That is, the user and the digital assistant can interact in different applications, and the user can perform multiple operations in each application. In this case, the user's request for assistance to the digital assistant is closely related to the user's operation in the application. For example, after the user opens document A, the conversation window (main conversation window or sub-conversation window) with the digital assistant is evoked. After the user selects a text paragraph in document A, the message request "Please translate this paragraph of text into English" is sent to the conversation window with the digital assistant. At this time, the digital assistant side needs to know the content of the document paragraph selected by the user to correctly respond to the user's request. In view of this, an embodiment of the present disclosure provides a scheme for information processing. According to various embodiments of the present disclosure, in response to a preset operation associated with an application, a session is opened, and the user and the digital assistant are both members of the session. The target message entered by the user in the session and the user's operation information in the application are obtained. Then, the target message and the operation information are sent to the server. In this way, the context information of the user in the application can be passed to the server for consideration when replying to the user. This helps the digital assistant better understand the user's semantics, thereby improving the accuracy of the answer in a specific application scenario. Thus, it is advantageous to provide users with an efficient assistance experience in multiple application scenarios.

[0044] The following further describes the exemplary embodiments of the present disclosure in detail with reference to the accompanying drawings. Figure 3 An example process 300 is described for transmitting interaction messages between a user and a digital assistant between a client and a server.

[0045] exist Figure 3 In the example, the client 310 can run at the terminal device 110 to implement the office suite 120. The server 360 can run at the server 130. As an example only, the server 360 may include, but is not limited to, a message service 320, a digital assistant service 330, a machine learning service 340, and an interface 350. The message service 320 can, for example, be used to provide services related to the message application in the office suite 120. The digital assistant service 330 can, for example, be used to provide services related to the digital assistant. The machine learning service 340 can use any suitable machine learning model to provide various suitable services in the office suite 120. For example, a machine learning model can be used when generating a digital assistant's answer to the user. The interface 350 can, for example, be an open application program interface, and the application provides its own capabilities or resources to other applications in the form of an interface for calling or obtaining.

[0046] Specifically, Figure 3 An example process 300 of a single-turn conversation between a user 140 and a digital assistant is shown. The user 140 sends a message to the digital assistant via a client 310. Figure 3As shown, client 310 sends (362) the message from user 140 to message service 320. Message service 320 determines (364) whether the message is received successfully. If successful, message service 320 sends (366) a notification of successful message sending to client 310. Message service 320 then sends (368) the message received from client 310 to digital assistant service 330, and indicates to digital assistant service 330 that user 140 has sent a message to the digital assistant.

[0047] The digital assistant service 330 may determine (370) a topic identifier of the topic to which the message belongs, and obtain context information of the topic based on the topic identifier. The digital assistant service 330 may then send (372) information related to the context information to the machine learning service 340, such as, but not limited to, the message text, the topic identifier, the token, and the like.

[0048] The machine learning service 340 can extract the topic ID from the received information and return it (374) to the digital assistant service 430, thereby indicating that the information about the topic ID has been successfully received. Additionally, in some embodiments, the machine learning service 340 can send (376) a token extracted from the above-mentioned received information to the interface 350 for the application to authenticate whether the message is a legitimate message or whether there is authority to process the message, etc. Accordingly, the interface 350 can perform corresponding authentication and send the authentication result (378) to the machine learning service 340.

[0049] The machine learning service 340 may obtain (380) the message to be replied to the user 140 by performing some processing on the context information, for example, by using a machine learning model. In some embodiments, during the reply process, the message to be replied may be returned (382) to the message service 320 in a streaming form, for example, and then pushed (384) to the client 310 by the message service 320.

[0050] In the case of multiple rounds of dialogue, a process similar to process 300 may be performed for each round of dialogue.

[0051] The above describes an example process of transmitting interactive messages between the client and the server. Figure 4 An example process 400 of transmitting interactive information between a server and a client is described.

[0052] like Figure 4 As shown, in response to a preset operation associated with the application, client 310 can open (410) a session. User 140 and the digital assistant are both members of the session. For example, user 140 can trigger a preset control in the application (such as, Figure 2B Control 241 shown) to open the session.

[0053] In some embodiments, the session may be a group chat session, and the user 140 and the digital assistant are members of the group chat session. In some embodiments, the session may be a single chat session between the user 140 and the digital assistant. Exemplarily, the session may be a sub-session between the user 140 and the digital assistant, such as the one described above with reference to Figure 2B as described.

[0054] The client 310 may obtain (420) a target message input by the user 140 in the conversation. The target message is sent by the user 140 to the digital assistant. For example, in the case of a single chat conversation, the user 140 may input the target message in the conversation window. For another example, in the case of a group chat conversation, the target message may be a message input by the user 140 mentioning the digital assistant, or a message quoting a previous reply of the digital assistant. The target message may be in natural language.

[0055] In some embodiments, the client 310 may send (415) the application information to the server 360. For example, during the session initialization process, the client 310 may send the application information to the server 360. Such application information may be regarded as a fixed parameter of the session.

[0056] The application information may include any suitable information that can assist the digital assistant in understanding the task requested by the user. Exemplarily, the application information may include the type of the application, such as a document application, an email application, a calendar application, etc. Alternatively or additionally, the application information may include a link to a page in the application associated with the session. For example, if the session is triggered by a document in a document application (such as, user 140 clicks on control 241 in the document page), the application information may include a link to the document.

[0057] The client 310 may obtain (425) the operation information of the user 140 in the application. In addition to entering the target message in the conversation window, the user 140 may also perform one or more operations related to the target message in the application. For example, in the case of a document application, the user 140 may enter the target message "help me rewrite this part of the content" and may select a part of the content in the document accordingly. For another example, in the case of a calendar application, the user 140 may enter the target message "help me schedule a meeting starting at 2 pm" and may specify a date in the calendar accordingly.

[0058] Operation information may include any suitable information that can identify a user's operation. Exemplarily, the operation information may include the type of operation performed by user 140 in an application. Alternatively or additionally, the operation information may include the content targeted by the user's operation in the application. Continuing with the above example regarding a document application, the type of operation of "selecting a portion of the content in a document" may be text selection, and the content targeted by the operation may be the content selected by user 140. For the example of a calendar application, the type of operation of "specifying a date in the calendar" may be date specification, and the content targeted by the operation may be the date specified by user 140.

[0059] In some embodiments, in order to facilitate the acquisition of operation information, an interface can be provided to the application, and the operation information sent by the application can be obtained through the interface. For example, when the user 140 performs relevant operations on the client 310, the application can dynamically perceive the context information of the operation. When the user 140 sends a message, the session component (for example, the session is a sub-session component) can provide a callback interface to the application. Accordingly, the application can fill in the operation information through this structure.

[0060] In some embodiments, in order to enhance the uniformity between different applications, a data structure may be predefined for the operation information, which is also referred to as a first data structure. The data structure may include one or more parameters for describing the user's operation in the application. For example, the application may fill in the one or more parameters through a callback interface according to the user's operation in the application.

[0061] refer to Figure 5 Describe an example of a data structure. Figure 5 A data structure 500 named "chat_context" is shown. The data structure 500 includes a structure 510 named "extra" for operation information. In this example, the parameters and parameter values ​​defined in the structure 510 are represented in a string format. It can be seen from the substructure 530 in the structure 510 that the type of operation is text selection, such as shown in the field "selected_text"; and the substructure 530 includes the specific text selected. The data structure in this example has good scalability, so that it can adapt to various different applications and different operations in the application.

[0062] exist Figure 5In the example of , data structure 500 also includes structure 520 for application information. As an example, the "scenario_id" field indicates the type of application, and the value "Doc" of the field indicates that the application is a document application. It should be understood that in some embodiments, the application information is not required in data structure 500. For example, if the application information is sent to server 360 during session initialization, structure 520 may not be included.

[0063] However, it should be understood that Figure 5 The data structure shown and the content filled therein are exemplary and are not intended to limit the embodiments of the present disclosure. In the embodiments of the present disclosure, any suitable data structure may be used.

[0064] Continue to refer Figure 4 . In some embodiments, the server 360 can pre-register (405) the data structure described above. Specifically, the server 360 (for example, the digital assistant service 330) can receive registration information of the application, and the registration information may include definition information of the data structure. For example, the registration information can define various possible parameter names, parameter values, and meanings represented in the data structure. Exemplarily, when the application accesses a sub-session of the digital assistant service 330, a relevant registration statement can be made, listing various types of information to be used subsequently and defining data structures, etc.

[0065] The process 400 is described below. After obtaining (420) the target message and obtaining (425) the operation information, the client 310 may send the target message and the operation information to the server 360. For example, the target message and the operation information may be sent to the server 360 in association or together.

[0066] The target message and the operation information may be sent to the server 360 in any suitable manner through any suitable link. In some embodiments, the target message and the operation information may be sent to the server 360 through a message link. The message link is, for example, the message link described above. Figure 3As described. Exemplarily, the client 310 may send the target message and operation information to the message service 320 in the server 360. The message service 320 may further send the received target message and operation information to the digital assistant service 330. In order to provide a reply to the target message, the digital assistant service 330 may process the target message and operation information. As an example and without any limitation, the processing described herein may include converting the target message and operation information into a form readable by the machine learning model. Additionally, the processing may also include adding some additional information on the basis of the target message and operation information, such as information of the application obtained during the session initialization process. It is understandable that for the same session, the application information is a fixed parameter, while the operation information is a dynamic parameter. By combining fixed parameters with dynamic parameters, complete context information can be represented. Then, the processed target message and operation information can be sent to the machine learning service 340 to generate a task that completes the user's request. For example, the machine learning service 340 can help users summarize documents, schedule meetings, and the like.

[0067] In this way, the machine learning service 340 can perceive the context related to the application when processing the user's message. In this way, the user's semantics can be better understood when processing the user's message, so as to make a more accurate answer. In addition, this advantageously supports the interaction between the user and the digital assistant in multiple application scenarios.

[0068] The above describes the delivery mechanism of application-related context information. In order to more clearly understand this delivery mechanism, an example scenario is described below. Exemplarily, user 140 invokes the digital assistant through a document application, for example, user 140 clicks on the control that invokes the digital assistant from the page of document A. Accordingly, the window of the sub-session can be presented on the client. The user selects a text in document A and enters the message "Please help me continue this paragraph" through the window of the sub-session. The text selected by the user in document A can be filled into a predefined data structure as part of the operation information. Then, the selected text is sent to the digital assistant service together with the message "Please help me continue this paragraph" through a message link, and is further passed to the machine learning service to assist the user in completing the continuation of the selected text.

[0069] In this example, the text selected by the user in the document belongs to the application, while the text sent by the user belongs to the message of the instant messaging application. In the case of a separate session, only the message sent by the user and the message replied by the digital assistant are presented in the client interface, while the relevant information of the application is implicitly passed to the server.

[0070] Figure 66 shows a flow chart of a method 600 for information processing according to some embodiments. The method 600 may be implemented at the terminal device 110 and / or the server 130. Figure 1 Method 600 is described.

[0071] In block 610 , the terminal device 110 opens a session in response to a preset operation associated with the application.

[0072] In block 620, the terminal device 110 obtains a target message input by the user in the conversation. The user and the digital assistant are both members of the conversation, and the target message is sent by the user to the digital assistant.

[0073] In block 630 , the terminal device 110 obtains the user's operation information in the application.

[0074] In some embodiments, obtaining the user's operation information in the application includes: providing an interface to the application; and obtaining the user's operation information in the application sent by the application through the interface.

[0075] In some embodiments, a first data structure is predefined, the first data structure includes one or more parameters, and the operation information has the first data structure.

[0076] In some embodiments, one or more parameters and corresponding parameter values ​​are represented in a string format.

[0077] In some embodiments, method 600 further includes: receiving, by the server, registration information of the application; the registration information includes definition information of the first data structure.

[0078] In some embodiments, the operation information includes at least one of the following: the type of operation performed by the user in the application; and the content targeted by the operation in the application.

[0079] In block 640 , the terminal device 110 sends the target message and the operation information to the server.

[0080] In some embodiments, method 600 further includes: sending application information to a server.

[0081] In some embodiments, the application information includes at least one of the following: a type of application; and a link to a page in the application associated with the session.

[0082] In some embodiments, sending the target message and the operation information to the server includes: sending both the target message and the operation information to the server via a session message link.

[0083] In some embodiments, the session is a one-on-one chat session between the user and the digital assistant.

[0084] It should be understood that one or more steps, features, characteristics or combinations thereof described with reference to the above exemplary information processing method may also be appropriately incorporated into the method without violating the spirit of the method 600. This disclosure will not elaborate on this.

[0085] Figure 7 A schematic structural block diagram of an apparatus 700 for information processing according to some embodiments of the present disclosure is shown. The apparatus 700 may be implemented as or included in a terminal device 110 and / or a server 130. Each module / component in the apparatus 700 may be implemented by hardware, software, firmware, or any combination thereof.

[0086] like Figure 7 As shown, the device 700 includes a session opening module 710, which is configured to open a session in response to a preset operation associated with an application. The device 700 includes a target message acquisition module 720, which is configured to obtain a target message input by a user in a session; wherein the user and the digital assistant are both members of the session, and the target message is sent by the user to the digital assistant. The device 700 includes an operation information acquisition module 730, which is configured to obtain operation information of the user in the application. The device 700 includes a sending module 740, which is configured to send the target message and operation information to the server.

[0087] In some embodiments, the operation information acquisition module 730 is further configured to: provide an interface to the application; and acquire the user's operation information in the application sent by the application through the interface.

[0088] In some embodiments, a first data structure is predefined, the first data structure includes one or more parameters, and the operation information has the first data structure.

[0089] In some embodiments, one or more parameters and corresponding parameter values ​​are represented in a string format.

[0090] In some embodiments, the apparatus 700 further includes a registration module configured to: receive registration information of the application from the server; the registration information includes definition information of the first data structure.

[0091] In some embodiments, the operation information includes at least one of the following: the type of operation performed by the user in the application; and the content targeted by the operation in the application.

[0092] In some embodiments, the sending module 740 is further configured to: send application information to the server.

[0093] In some embodiments, the application information includes at least one of the following: a type of application; and a link to a page in the application associated with the session.

[0094] In some embodiments, the sending module 740 is further configured to: send both the target message and the operation information to the server through the session message link.

[0095] In some embodiments, the conversation is a one-on-one chat conversation between the user and the digital assistant.

[0096] Figure 8 8 is a block diagram of an electronic device 800 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Figure 8 The electronic device 800 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Figure 8 The electronic device 800 shown can be used to implement Figure 1 terminal device 110 or server 130.

[0097] like Figure 8 As shown, the electronic device 800 is in the form of a general electronic device. The components of the electronic device 800 may include, but are not limited to, one or more processors or processing units 810, a memory 820, a storage device 830, one or more communication units 840, one or more input devices 850, and one or more output devices 860. The processing unit 810 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 820. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 800.

[0098] The electronic device 800 typically includes a plurality of computer storage media. Such media can be any accessible media that can be obtained by the electronic device 800, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 820 can be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 830 can be a removable or non-removable medium, and can include a machine-readable medium, such as a flash drive, a disk, or any other medium, which can be used to store information and / or data and can be accessed within the electronic device 800.

[0099] The electronic device 800 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 8As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 820 may include a computer program product 825 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0100] The communication unit 840 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 800 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 800 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0101] The input device 850 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 860 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 800 may also communicate with one or more external devices (not shown) through the communication unit 840 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 800, or communicate with any device that allows the electronic device 800 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0102] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0103] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0104] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0105] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0106] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0107] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. An information processing method, comprising: In response to a preset operation associated with the application, opening a session; Acquire a target message input by a user in the conversation; wherein the user and the digital assistant are both members of the conversation, and the target message is sent by the user to the digital assistant; Obtaining operation information of the user in the application; and The target message and the operation information are sent to the server.

2. The method according to claim 1, wherein obtaining the user's operation information in the application comprises: Providing an interface to the application; The operation information of the user in the application sent by the application is obtained through the interface.

3. The method according to claim 1, wherein: pre-define a first data structure, the first data structure comprising one or more parameters, and The operation information has the first data structure. The method according to claim 3 , wherein the one or more parameters and corresponding parameter values ​​are represented in a string format.

5. The method according to claim 3, further comprising: The server receives registration information of the application; The registration information includes definition information of the first data structure.

6. The method according to claim 1, wherein the operation information includes at least one of the following: The type of operation performed by the user in the application; The content in the application to which the operation is applied.

7. The method according to claim 1, further comprising: Send the application information to the server.

8. The method according to claim 7, wherein the information of the application includes at least one of the following: the type of application; A link to a page in the application that is associated with the session.

9. The method according to claim 1, wherein sending the target message and the operation information to the server comprises: The target message and the operation information are both sent to the server via the session message link.

10. The method of claim 1, wherein the conversation is a one-on-one chat conversation between the user and the digital assistant.

11. An apparatus for information processing, comprising: a session opening module, configured to open a session in response to a preset operation associated with the application; a target message acquisition module, configured to acquire a target message input by a user in the conversation; wherein the user and the digital assistant are both members of the conversation, and the target message is sent by the user to the digital assistant; an operation information acquisition module, configured to acquire the operation information of the user in the application; and The sending module is configured to send the target message and the operation information to the server.

12. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 10 when executed by the at least one processing unit.

13. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 10.

Images