Question-answer interaction method and apparatus, device, storage medium, and program product
By utilizing machine learning models and pre-defined plugins in the server-side device to determine the relevance of user questions to points of interest, and requesting client location information when necessary, the accuracy and privacy protection issues of point-of-interest services in digital assistants are resolved, thus improving the user interaction experience.
Patent Information
- Application Number
- PCT/CN2025/103536
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-30
- Filing Date
- 2025-06-25
- Publication Date
- 2026-01-08
AI Technical Summary
In existing technologies, when providing point-of-interest (POI) related services, digital assistants on terminal devices struggle to effectively determine the relevance between user intent and POIs, and lack privacy protection when acquiring location information, thus impacting the user's interactive experience.
By using machine learning models in the server-side device to determine the relevance between user questions and points of interest, calling pre-defined plugins to query points of interest, and requesting location information from the client device when necessary to generate a response, user privacy and security are ensured.
It improved the accuracy of point-of-interest related services and the user interaction experience, ensured user privacy and security, and enhanced the service capabilities of digital assistants.
Smart Images

Figure CN2025103536_08012026_PF_FP_ABST
Abstract
Description
Method, device, apparatus, storage medium and program product for question and answer interaction
[0001] The present application claims priority to the Chinese patent application No. 202410869995.9, filed on June 30, 2024, entitled “Method, device, apparatus, storage medium and program product for question and answer interaction”, the whole content of which is incorporated herein by reference. TECHNICAL FIELD
[0002] The example embodiments of the present disclosure generally relate to the field of computer, and in particular, to a method, device, apparatus, computer readable storage medium and computer program product for question and answer interaction. BACKGROUND
[0003] With the development of information technology, various terminal devices can provide people with various services in work and life, etc. For example, an application providing services can be deployed in a terminal device. The terminal device or the application can provide a user with a digital assistant type function to assist the user in using the terminal device or the application. The user can complete diversified operations through various interactions with the digital assistant. SUMMARY
[0004] In a first aspect of the present disclosure, a method for question and answer interaction is provided. The method is implemented at a server device, and the method comprises: in response to receiving a question of a user in an interaction between the user and a digital assistant, determining whether the question is related to a point of interest; in response to determining that the question is related to the point of interest, determining location information involved in the question; invoking a predetermined plug-in using the location information to obtain an execution result of the predetermined plug-in, the predetermined plug-in being configured to perform a point of interest query, the execution result indicating at least one point of interest; and generating a response of the digital assistant to the question based on the execution result.
[0005] In a second aspect of the present disclosure, a method for question and answer interaction is provided. The method is implemented at a client device, and the method comprises: in response to receiving a question of a user in an interaction between the user and a digital assistant, sending the question to a server device; in response to receiving a response to the question from the server device, presenting the response via the digital assistant, the response indicating at least one point of interest; and in response to receiving a trigger to a target point of interest in the at least one point of interest, presenting a location of the point of interest in a map interface.
[0006] In a third aspect of the disclosure, an apparatus for question and answer interaction is provided. The apparatus is implemented at a server device, and the apparatus includes: a point of interest determination module configured to, in response to receiving a question of a user in an interaction between the user and a digital assistant, determine whether the question is related to a point of interest; a location information determination module configured to, in response to determining that the question is related to the point of interest, determine location information involved in the question; an execution result obtaining module configured to invoke a predetermined plug-in using the location information to obtain an execution result of the predetermined plug-in, the predetermined plug-in being configured to perform a point of interest query, the execution result indicating at least one point of interest; and an answer generation module configured to generate an answer of the digital assistant to the question based on the execution result.
[0007] In a fourth aspect of the disclosure, an apparatus for question and answer interaction is provided. The apparatus is implemented at a client device, and the apparatus includes: a question sending module configured to, in response to receiving a question of a user in an interaction between the user and a digital assistant, send the question to a server device; an answer presenting module configured to, in response to receiving an answer to the question from the server device, present the answer via the digital assistant, the answer indicating at least one point of interest; and a location presenting module configured to, in response to receiving a trigger to a target point of interest in the at least one point of interest, present a location of the point of interest in a map interface.
[0008] In a fifth aspect of the disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the electronic device to perform the method of the first aspect and / or perform the method of the second aspect.
[0009] In a sixth aspect of the disclosure, a computer-readable storage medium is provided. The medium has stored thereon computer-executable instructions that, when executed by a processor, implement the method of the first aspect and / or implement the method of the second aspect.
[0010] In a seventh aspect of the disclosure, a computer program product is provided. The product includes computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to the first aspect of the disclosure and / or the method according to the second aspect of the disclosure.
[0011] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the disclosure, nor is it used to limit the scope of the disclosure. Other features of the disclosure will become apparent through the following description. BRIEF DESCRIPTION OF DRAWINGS
[0012] The above-mentioned and other features and advantages of various embodiments of the present disclosure will become more apparent by reference to the following detailed description taken in conjunction with the accompanying drawings. In the drawings, like reference numerals denote like elements, wherein:
[0013] FIG. 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;
[0014] FIG. 2 shows a flow diagram of a signaling flow for a question and answer interaction, according to some embodiments of the present disclosure;
[0015] FIG. 3 shows an example, according to some embodiments of the present disclosure;
[0016] FIG. 4 shows an example diagram of a signaling flow for a question and answer interaction, according to some embodiments of the present disclosure;
[0017] FIG. 5 shows an example diagram of a signaling flow for a question and answer interaction, according to some other embodiments of the present disclosure;
[0018] FIG. 6 shows a flow diagram of a method for a question and answer interaction, according to some embodiments of the present disclosure;
[0019] FIG. 7 shows a flow diagram of a method for a question and answer interaction, according to some other embodiments of the present disclosure;
[0020] FIG. 8 shows an example structural block diagram of an apparatus for a question and answer interaction, according to some embodiments of the present disclosure;
[0021] FIG. 9 shows an example structural block diagram of an apparatus for a question and answer interaction, according to some other embodiments of the present disclosure; and
[0022] FIG. 10 shows a block diagram of an electronic device that can implement one or more embodiments of the present disclosure. DETAILED DESCRIPTION
[0023] Embodiments of the present disclosure will be described below in greater detail with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be interpreted as being limited to the embodiments set forth herein, but rather, the embodiments are provided so that the present disclosure can be more thoroughly and completely understood. It is understood that the drawings and embodiments of the present disclosure are for exemplary purposes only and are not intended to limit the scope of protection of the present disclosure.
[0024] In the description of embodiments of the disclosure, the term "comprising" and similar terms are to be interpreted as open-ended, i.e., "including but not limited to". The term "based on" is to be interpreted as "based, at least in part, on". The term "one embodiment" or "the embodiment" is to be interpreted as "at least one embodiment". The term "some embodiments" is to be interpreted as "at least some embodiments". Other explicit and implicit definitions can also be included below.
[0025] In this document, unless explicitly stated, performing a step "in response to A" does not mean performing the step immediately after A, but can include one or more intermediate steps.
[0026] It can be understood that the data involved in the technical solutions of the present disclosure (including but not limited to the data itself, obtaining, using, storing or deleting) should comply with the requirements of relevant laws and regulations and relevant provisions.
[0027] It can be understood that before using the technical solutions disclosed in the embodiments of the present disclosure, the type of information involved in the present disclosure, the scope of use, the use scenario, etc. should be informed to the relevant user and the authorization of the relevant user should be obtained by appropriate means according to relevant laws and regulations, wherein the relevant user can include any type of right subject, such as individual, enterprise, group.
[0028] For example, in response to receiving the active request of the user, the prompt information is sent to the relevant user to explicitly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can voluntarily choose whether to provide information to the software or hardware such as electronic device, application program, server or storage medium, etc. performing the operation of the technical solutions of the present disclosure according to the prompt information.
[0029] As an optional but not limited implementation manner, in response to receiving the active request of the relevant user, the prompt information is sent to the relevant user in the form of a pop-up window, and the prompt information can be presented in the form of text in the pop-up window. In addition, the pop-up window can also carry selection controls for the user to select "agree" or "disagree" to provide information to the electronic device.
[0030] It can be understood that the above notification and user authorization process is only illustrative and does not limit the implementation of the present disclosure, and other ways that meet the relevant laws and regulations can also be applied to the implementation of the present disclosure.
[0031] As used herein, the term “model” can learn the relationship between the corresponding input and output from the training data, so that after the training is completed, the corresponding output can be generated for a given input. The generation of the model can be based on machine learning techniques. Deep learning is a machine learning algorithm that processes input and provides a corresponding output by using multiple layers of processing units. The neural network model is an example of a model based on deep learning. In this article, “model” can also be referred to as “machine learning model”, “learning model”, “machine learning network” or “learning network”, which are used interchangeably herein.
[0032] FIG. 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In the example environment 100, an application service component 112 and a digital assistant 114 are installed in a client device 110. A user 130 can interact with the application service component 112 and the digital assistant 114 via the client device 110 and / or an attached device of the client device 110.
[0033] In some embodiments, the application service component 112 and the digital assistant 114 can be downloaded and installed in the client device 110. In some embodiments, the application service component 112 and the digital assistant 114 can also be accessed by other means, such as accessed through a webpage, etc. In some embodiments, in the environment 100 of FIG. 1, in response to the application service component 112 being launched, the client device 110 can present an interface 140 of the application service component 112 and the digital assistant 114. The interface 140 may, for example, be an interactive interface of the application service component 112 and the digital assistant 114.
[0034] The application service component 112 includes, but is not limited to, one or more of the following: a chat application component (also referred to as an instant messaging application component), a document application component, an audio and video conference application component, a mail application component, a task application component, a calendar application component, an objective and key result (OKR) application component, etc. It can be understood that although a single application service component is shown in FIG. 1, in fact multiple application service components can be installed on the client device 110. In some embodiments, the application service component 112 can include a multi-functional collaboration platform, such as an office collaboration platform (also referred to as an office suite) capable of providing integration of multiple types of service components to facilitate people to carry out office activities, communication, etc. In the multi-functional collaboration platform, people can start different service components as needed to complete corresponding information processing, sharing, communication, etc.
[0035] In some embodiments, the digital assistant 114 can be provided by a separate application service component, or can be integrated in a certain application service component 120 capable of providing content entities. The application service component for providing the client interface of the digital assistant can correspond to a single-function application service component or a multi-function collaboration platform, such as an office suite or other collaboration platform capable of integrating multiple components. It can be understood that similar to the application service component, although a single digital assistant is shown in FIG. 1, there can actually be multiple digital assistants.
[0036] In some embodiments, the digital assistant 114 supports the use of plugins. Each plugin is configured to provide one or more functions of an application. The input parameters and output parameters of each plugin can be specified in the plugin definition. Such plugins include, but are not limited to, one or more of the following: a location recognition plugin, a point of interest plugin, a search plugin, a contact plugin, a message plugin, a document plugin, a table plugin, a mail plugin, a calendar plugin, a schedule plugin, a task plugin, and the like.
[0037] The digital assistant 114 is a smart assistant for the user, with intelligent conversation and information processing capabilities. In embodiments of the present disclosure, the digital assistant 114 is used for interaction with the user 130 to assist the user 130 in using the terminal device or the application. In some embodiments, an interaction window with the digital assistant 114 can be presented in the interface 140. In the interaction window, the user 130 is able to converse with the digital assistant 114 by inputting natural language, pictures, audio files, video files, web page files, and the like, to instruct the digital assistant to assist in completing various tasks, including operations on content entities 126.
[0038] In some embodiments, multiple interaction modes of the user 130 with the digital assistant 114 can be provided, and flexible switching between the multiple interaction modes can be provided. In the case that a certain interaction mode is triggered, a corresponding interaction area is presented to facilitate the interaction of the user 130 with the digital assistant 114. The way the user 130 interacts with the digital assistant 114 is different in different interaction modes, so that the interaction needs in different application scenarios can be flexibly adapted.
[0039] In some embodiments, information processing services specific to the user 130 can be provided based on historical interaction information of the user 130 with the digital assistant 114 and / or a data range specific to the user 130. In some embodiments, the historical interaction information of the user 130 interacting with the digital assistant 114 in multiple interaction modes respectively can all be stored in association with the user 130. In this way, in one of the multiple interaction modes (any one or a specified one), the digital assistant 114 can provide services for the user 130 based on the historical interaction information stored in association with the user 130.
[0040] The digital assistant 114 can be invoked or woken up by appropriate means (e.g., a shortcut, a button, or a voice) to present an interaction window with the user 130. By selecting the digital assistant 114, an interaction window with the digital assistant 114 can be opened. The interaction window can include interface elements for information interaction, such as an input box, a message list, a message bubble, and the like. In other embodiments, the digital assistant 114 can be invoked through an entry control or a menu provided in the interface 140, or through input of a preset instruction.
[0041] In some embodiments, the client device 110 communicates with the server device 120 to enable provisioning of services of the digital assistant 114 and the business components 125. The client device 110 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a tablet computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combination thereof, including accessories and peripherals of these devices, or any combination thereof. In some embodiments, the client device 110 can also support any type of interface to the user (such as "wearable" circuitry, etc.). The server device 120 can be various types of computing systems / servers capable of providing computing capabilities, including but not limited to mainframes, edge computing nodes, computing devices in a cloud environment, and the like.
[0042] It should be appreciated that the structure and functionality of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.
[0043] As mentioned previously, the user can accomplish a variety of operations through various interactions with the digital assistant. The client device can receive a question input by the user during the interaction with the digital assistant and provide the question to the server device. The server device can determine an answer to the question by the digital assistant and provide the question and answer to the client device. The client device can in turn provide the answer to the user.
[0044] In the interaction scenario with the digital assistant, it is also desirable to provide more diversified services, including point of interest (POI) related services. A point of interest corresponds to a geocoding system that uniquely identifies any point in geographic space as a coordinate according to various types of geographic or spatial information. According to an embodiment of the present disclosure, a question and answer interaction scheme involving POI services is provided. According to the scheme of the embodiment of the present disclosure, in response to receiving a question of a user in the interaction of the user with the digital assistant, it is determined whether the question is related to a point of interest. In response to determining that the question is related to a point of interest, location information involved in the question is determined. The location information is used to invoke a predetermined plug-in to obtain an execution result of the predetermined plug-in, the predetermined plug-in being configured to perform a point of interest query, the execution result indicating at least one point of interest. A response of the digital assistant to the question is generated based on the execution result to provide to the client device for presentation to the user. If the client device responds to receiving a trigger of a target point of interest in the at least one point of interest, a location of the point of interest is presented in a map interface.
[0045] In this way, the server device can only request to obtain the location information of the client device in the case where it is determined that the question of the user involves a point of interest, so as to determine the point of interest based on the location information. This can guarantee the privacy security of the user and improve the interaction experience of the user.
[0046] Some example embodiments of the present disclosure will be described below with continuous reference to the drawings.
[0047] FIG. 2 shows a flow diagram of a signaling flow 200 of a question and answer interaction according to some embodiments of the present disclosure. The signaling flow 200 involves a client device 110 and a server device 120. For ease of discussion, the architecture 200 will be described with reference to the environment 100 of FIG. 1. It is noted that the operations performed by the aforementioned client device 110 and the operations performed by the client device 110 described later can be performed by a relevant application (e.g., the application 112) installed on the client device 110. In some embodiments, the operations performed on the client device 110 can be completed with the assistance of the server device 120.
[0048] As shown in FIG. 2, the client device 110 sends (201) the question to the server device 120 in response to receiving the question of the user in the interaction of the user with the digital assistant. The client device 110 may, for example, present an interaction interface of the user with the digital assistant. The interaction interface may, for example, include an input control such as an input box. The client device 110 may, via the interaction interface, receive the question of the user input by the input box. The client device 110 may, for example, in response to receiving the question, send the question to the server device 120 through a communication connection between the client device 110 and the server device 120. In some embodiments, the client device 110 may, via a gateway between the client device 110 and the server device 120, send the question to the server device 120. The gateway may, for example, include a long link for enabling interconnection between different devices / networks.
[0049] The server device 120 may, in response to receiving the question of the user in the interaction of the user with the digital assistant, determine (202) whether the question is related to a point of interest. The point of interest may, for example, indicate a place that the user can be interested in, which can contain information of one or more aspects such as a name, a category, location information (e.g., coordinates), a classification, etc. The point of interest can also be referred to as a POI. The server device 120 may, for example, determine a user intent indicated by the question and determine whether the user intent is related to a point of interest. The server device 120 may, in any suitable manner, determine the user intent. For example, the server device 120 may, by means of a machine learning model, determine the user intent of the question.
[0050] The machine learning model may, for example, be based on any suitable model structure, including but not limited to a Transformer model, a convolutional neural network (CNN), a recurrent neural network (RNN), a deep neural network (DNN), etc. In some embodiments, the machine learning model may, for example, be based on a language model (LM). The language model may, by learning from a large amount of corpus, be capable of having a question and answer ability. The machine learning model may, for example, also be based on other suitable models. The server device 120 may, for example, also analyze the user intent in any suitable manner to determine whether the user intent is related to a point of interest.
[0051] In some embodiments, the server device 120 can also determine whether the question is related to the point of interest based on context information in the interaction between the user and the digital assistant. The context information may, for example, at least include historical dialogue information between the user and the digital assistant. The server device 120 may, for example, determine the user intent in combination with the context information and the question. In this way, the accuracy of the determined user intent can be improved. It is to be noted that, in some embodiments, in order to ensure the timeliness of the context information, the context information can be context information corresponding to a time length that does not reach a threshold time length between the time of receiving the question. The threshold time length can be a time length determined by the user in advance, or a time length determined by the server device 120 itself.
[0052] In some embodiments, the server device 120 can obtain configuration information of a predetermined plug-in, and determine whether the question is related to the point of interest based on at least the question and the configuration information of the predetermined plug-in. The predetermined plug-in may, for example, be configured to perform one or more plug-ins of point of interest queries. The predetermined plug-in may, for example, also be referred to as a point of interest plug-in. The configuration information of the predetermined plug-in may, for example, at least include the name of the predetermined plug-in and description information of the capabilities of the predetermined plug-in (which may, for example, be used to describe the functions of the predetermined plug-in).
[0053] The server device 120 may, for example, determine whether the question is related to the point of interest based on the matching of the user intent and the configuration information. The server device 120 may, for example, determine the matching of the user intent and the configuration information by means of a machine learning model. It is to be noted that the server device 120 can perform different operations by means of different machine learning models, or perform different operations by means of the same machine learning model. If the user intent indicates to query a certain point of interest, and the configuration information of the predetermined plug-in indicates that the predetermined plug-in has the function of point of interest query, the server device 120 can determine that the user intent matches the configuration information of the predetermined plug-in, and further determine that the question is related to the point of interest.
[0054] The server device 120 may, in response to determining that the question is related to the point of interest, determine (203) location information involved in the question. In some embodiments, the server device 120 can determine whether the question contains location information. The server device 120 may, for example, perform semantic analysis on the question to determine whether the question contains location information. The server device 120 may, in response to determining that the question contains location information, extract the location information from the question.
[0055] In some embodiments, the server device 120 can determine whether the question contains location information by means of a plug-in for determining location information. This plug-in can be the same plug-in as the predetermined plug-in, in which case the server device 120 can determine whether the question contains location information by means of the predetermined plug-in, and extract location information from the question by means of the predetermined plug-in if it is determined that the question contains location information. This plug-in can also be a different plug-in from the predetermined plug-in, for example, this plug-in can be referred to as a location recognition plug-in. The server device 120 can determine whether the question contains location information by means of the location recognition plug-in, and extract location information by means of the location recognition plug-in.
[0056] For example, if the question is the text "What is a good fruit store near XX Street, XX District?", the server device 120 can determine that the question is related to a point of interest, and can determine by means of a plug-in that the question itself contains location information (i.e. "XX Street, XX District"). If the question is the text "How to go to store A?" or "What is a good coffee store nearby?", the server device 120 can determine that the question is related to a point of interest, and can determine by means of a plug-in that the question itself does not contain location information.
[0057] The server device 120 can request location information from the client device 110 in response to determining that the question does not contain location information. In some embodiments, the server device 120 can also determine whether the context information contains location information. If the context information contains location information, the server device 120 can extract location information from the context information. In some embodiments, if the location information required for determining a point of interest cannot be extracted from the context information and the question itself, the server device 120 can request location information from the client device 110.
[0058] The server device 120 can request location information directly from the client device 110, for example. In some embodiments, in order to ensure the privacy and security of the user, the server device 120 can also send a location permission request to the client device 110, and receive a location permission request result from the client device 110. The location permission request result can include, for example, location information of the client device 110 obtained in the case of authorization.
[0059] For example, the client device 110 can determine user authorization for positioning permission in response to receiving the location permission request. If the client device 110 determines that it has previously had user authorization (which can also be referred to as historical user authorization for positioning permission), it can directly send a location permission request result including location information obtained in the case of authorization to the server device 120.
[0060] If the client device 110 determines that the user authorization is not owned (also referred to as the historical user authorization for the location permission does not exist), the client device 110 can request the authorization from the user. The client device 110 can present an authorization application interface to the user, for example, and present a location permission request to the user via the authorization application interface. The location permission request can include text for requesting to obtain the location permission, for example (e.g., the text "Allow to obtain the location permission?"). The client device 110 can receive an authorization result of the user for the location permission via the authorization application interface, the authorization result indicating whether the client device 110 can obtain the user authorization. Illustratively, the authorization application interface can include an acknowledge control and a reject control. The client device 110 can determine that an acknowledgement is received for the location permission request in response to receiving a trigger for the acknowledge control, and in turn determine that the user authorization for the location permission is obtained (i.e., determine that the user authorization is obtained). The client device 110 can determine that a rejection is received for the location permission request in response to receiving a trigger for the reject control, and in turn determine that the user authorization for the location permission is not obtained (i.e., determine that the user authorization is not obtained).
[0061] The server device 120 can send a location permission request result including the location information obtained in the authorized case to the server device 120, for example, in a case where it is determined that the user authorization is obtained. Alternatively or additionally, the client device 110 can send a location permission request result indicating that the location information is not obtained to the server device 120, in a case where it is determined that the user authorization is not owned and the user authorization is not obtained after requesting the authorization from the user.
[0062] The server device 120 can invoke the predetermined plug-in with the location information to obtain (204) an execution result of the predetermined plug-in. The invoked predetermined plug-in is configured to perform a point of interest query. Such a plug-in is also sometimes referred to as a point of interest (POI) plug-in. The execution result of the predetermined plug-in indicates at least one point of interest. Specifically, the server device 120 can invoke the predetermined plug-in with the location information as a parameter. The input parameter of the predetermined plug-in is defined to include at least the location information, including the longitude and latitude information of the location, and a point of interest category (e.g., a keyword for the point of interest query, etc.). The output parameter of the predetermined plug-in is defined to include at least a name of the point of interest and a location of the point of interest, etc.
[0063] The server device 120 can invoke the predetermined plug-in to find at least one point of interest matching the location information in a point of interest database based on the location information. The execution result of the predetermined plug-in is the at least one point of interest found.
[0064] The server device 120 can further generate (205) a response to the question by the digital assistant based on the execution result. In some embodiments, the server device 120 can generate the response directly based on the at least one point of interest indicated by the execution result. The server device 120 may, for example, directly provide the at least one point of interest as the response to the client device 110. In some embodiments, the server device 120 can also rank the points of interest according to the relevance between the points of interest returned by the plug-in and the user question, and return the response to the client device 110 based on the ranking result. In some embodiments, the server device 120 can also determine the style of the response. For example, the response message can be in a card style, each point of interest can correspond to a card message or multiple points of interest can be integrated in one card message, etc. The response style for presenting the points of interest can be configured according to actual application.
[0065] In some embodiments, in order to facilitate the user to view the points of interest via the client device 110, the server device 120 can provide a map access portal to the points of interest. The server device 120 can generate the response based on the location information of the at least one point of interest and the map access portal. The response generated in this way can indicate the location information of the at least one point of interest and the map access portal, and present the location of each point of interest in the map interface via the map access portal. In this way, at the client device 110, the map interface can be presented via the map access portal, and the location of each point of interest in the map interface can be determined based on the location information of each point of interest.
[0066] Referring to FIG. 3, FIG. 3 shows an example 300 according to some embodiments of the present disclosure. The interface 310 in the example 300 may, for example, show one example of the interaction interface between the user and the digital assistant. The client device 110 can present the interface 310 to the user and receive the user input question via the input box 301 in the interface 310. The client device 110 can respond to receiving the question 321, the question 331 and the question 341 (it can be understood that the time of receiving the three questions can be different and can be discontinuous). The client device 110 can provide the received questions to the server device 120 and receive the response to the questions from the server device 120.
[0067] For example, the server device 120 can determine, for the question 321, a response including the message 322 and a card 323, which can include description information (e.g., name, location, etc.) of the point of interest corresponding to the question 321 and a map access entry (e.g., the access entry with the name "GO" in the figure). The server device 120 can determine, for the question 331, a response including the card 332, the card 333, and the card 333, each of which can include description information of one point of interest corresponding to the question 331 and a map access entry corresponding to the point of interest. The server device 120 can determine, for the question 341, a response including the card 342, the card 343, and the card 343, each of which can include description information of one point of interest corresponding to the question 341 and a map access entry corresponding to the point of interest.
[0068] The client device 110 may, for example, present the map interface 320 in response to receiving a trigger for the map access entry. In a scenario where navigation is needed, the map interface 320 can be presented with an indication (e.g., the indication 351) of a location of the client device 110 in the map and an indication (e.g., the indication 352) of a location of the point of interest corresponding to the map access entry in the map. The map interface 320 may, for example, also include navigation information (e.g., the navigation information 353) indicating a navigation from the location of the client device 110 to the location of the point of interest. It can be appreciated that the map interface 320 presented by the client device 110 can include different content in response to triggers for different map access entries corresponding to different points of interest.
[0069] The server device 120 can send (206) the generated response to the client device 110 so that the client device 110 can obtain the response to the question. The server device 120 may, for example, also send the response to the client device 110 through the gateway. The client device 110 may, in response to receiving the response to the question from the server device 120, present (207) the response via the digital assistant, the response indicating at least one point of interest.
[0070] The client device 110 presents a map interface in response to receiving the trigger of the target interest point among the at least one interest point, and presents (208) the location of the interest point in the map interface. The client device 110 may, for example, determine at least one map application installed by itself in response to receiving the trigger of the target interest point. The client device 110 may, for example, present an application selection interface to the user, which can include at least one option corresponding to the at least one map application. The client device 110 may, in response to receiving the selection of the target option in the application selection interface, determine that the selection of the target map application corresponding to the target option is received, and in turn present a map interface corresponding to the target map application. It should be appreciated that the map interfaces corresponding to different map applications can be different or the same. The client device 110 can present the location of the target interest point in the map interface corresponding to the target map application.
[0071] An example of extracting location information with a plugin is described below with reference to FIG. 4. FIG. 4 illustrates an example diagram of a signaling flow 400 of a question-answer interaction, according to some embodiments of the present disclosure. The signaling flow 400 involves the client device 110, a gateway 401, the server device 120, a machine learning model 402, and a plugin service 403.
[0072] The client device 110 can present an interaction interface of the user with the digital assistant to the user, and obtain (411) a question from the user via the interaction interface. The client device 110 may, in response to obtaining the question from the user, send (412) the question to the gateway 401. The gateway 401 can send (413) the question to the server device 120. The server device 120 may, based on the question, send (414) a first request to the machine learning model 402 indicating the machine learning model 402 to determine whether the question is related to an interest point. The first request may, for example, also be a prompt input to the machine learning model 402. The machine learning model 402 may, based on the first request, determine whether the question is related to an interest point.
[0073] If it is determined that the question is related to a point of interest, the machine learning model 402 can determine whether at least one plugin managed by the plugin service 403 includes a plugin for determining and extracting location information from the question. The plugin service 403 can be used to manage at least one plugin that can be invoked to perform a task. If it is determined that such a plugin (e.g., a location recognition plugin) is included, the machine learning model 402 can send (415) a second request to the plugin service 403 instructing the plugin service 403 to determine location information involved by the question. Based on the second request, the plugin service 403 can invoke the location recognition plugin to determine whether the question contains location information. The location recognition plugin can extract the location information from the question if it is determined that the question contains location information. The machine learning model 402 can send (416) an execution result for the second request. If the question contains location information, the execution result can indicate the location information extracted from the question.
[0074] The machine learning model 402 can further send (417) a third request to the plugin service 403 instructing the plugin service 403 to query points of interest matching the location information based on the location information. At least one plugin managed by the plugin service 403 can include, for example, a point of interest plugin for performing point of interest queries. Based on the third request, the plugin service 403 can invoke the point of interest plugin to find at least one point of interest matching the location information from a point of interest database and send (418) the found at least one point of interest to the machine learning model 402 as an execution result for the third request. The machine learning model 403 can determine a response to the question based on the at least one point of interest, for example, and send (419) a model output to the server device 120. The server device 120 can generate a response to be provided to the client device 110 from the received model output, including determining content to be included in the response, a presentation form of the response, and the like. The server device 120 can send (420) the response to the gateway 401, which can send (421) the response to the client device 110. In this way, the client device 110 can provide the response to the question to the user (422). The client device 110 can also provide the response to the user via an interaction interface of the digital assistant with the user, for example.
[0075] An example in which location information is not extracted by a plugin is described below with reference to FIG. 5. FIG. 5 illustrates an example diagram of a signaling flow 500 of a question and answer interaction according to some other embodiments of the present disclosure. The signaling flow 500 involves the client device 110, the gateway 401, the server device 120, the machine learning model 402, and the plugin service 403.
[0076] The client device 110 can present an interaction interface for the user with the digital assistant to the user and acquire 501 a question from the user via the interaction interface. The client device 110 can send 502 the question to the gateway 401 in response to acquiring the question from the user. The gateway 401 can send 503 the question to the server device 120. The server device 120 can send 504, based on the question, a first request indicating the machine learning model 402 to determine whether the question is related to a point of interest to the machine learning model 402 to determine, based on the first request, whether the question is related to a point of interest.
[0077] If it is determined that the question is related to the point of interest and the machine learning model 402 can determine that the location recognition plug-in for determining and extracting location information from the question is not included in the at least one plug-in managed by the plug-in service 403, the machine learning model 402 can send 505 a fourth request indicating to acquire the location information from the client device 110 to the server device 120. If it is determined that the question is related to the point of interest and the machine learning model 402 can determine that the location recognition plug-in for determining and extracting location information from the question is included in the at least one plug-in managed by the plug-in service 403, the machine learning model 402 can send 506 a second request indicating the plug-in service 403 to determine the location information involved in the question to the plug-in service 403. The plug-in service 403 can invoke the location recognition plug-in to determine whether the question contains location information based on the second request. The location recognition plug-in can extract the location information from the question if it is determined that the question contains location information. If the location recognition plug-in determines that the question does not include location information or fails to extract the location information from the question, the plug-in service 403 can send 507 an execution result indicating that the extraction of the location information fails to the machine learning model 402. The machine learning model 402 can also send 508 the fourth request indicating to acquire the location information from the client device 110 to the server device 120 in response to receiving the execution result indicating that the extraction of the location information fails.
[0078] The server device 120 can send 509 a location permission request to the gateway 401 and wait 510 for receiving a result for the location permission request. The gateway 401 can send 511 the location permission request to the client device 110. The client device 110 can determine whether there is a historical user authorization for the location permission in response to receiving the location permission request. If it is determined that there is no historical user authorization, the client device 110 can present 512 the location permission request to the user and determine to acquire 513 a user authorization for the location permission (i.e., determine the user authorization for the location permission) in response to receiving a confirmation for the location permission request.
[0079] The client device 110 can send (514) a location permission request result to the gateway 401 in response to determining the user authorization to the location permission, the location permission request result including the location information of the client device 110 acquired in the authorized case. The gateway 401 sends (515) the location permission request result to the server device 120. The server device 120 can determine the location information based on the location permission request result, and provide (516) the location information to the machine learning model 402.
[0080] The machine learning model 402 can further send (517) a third request indicating the plug-in service 403 to query the points of interest matching the location information to the plug-in service 403 based on the location information. The at least one plug-in managed by the plug-in service 403 can include, for example, a point of interest plug-in for performing the point of interest query. The plug-in service 403 can invoke the point of interest plug-in to find at least one point of interest matching the location information from the point of interest database based on the third request, and send (518) the found at least one point of interest to the machine learning model 402 as an execution result for the third request. The machine learning model 403 can determine, for example, the answer to the question based on the at least one point of interest, and send (519) a model output to the server device 120. The server device 120 can generate the answer to be provided to the client device 110 from the received model output, including determining the content to be included in the answer, the presentation form of the answer, and the like. The server device 120 can send (520) the answer to the gateway 401, and the gateway 401 can send (521) the answer to the client device 110. In this way, the client device 110 can provide the answer to the question to the user (522). The client device 110 can also provide the answer to the user via the interaction interface of the user and the digital assistant, for example.
[0081] In summary, according to the embodiments of the present disclosure, the server device can request the location information from the client device only in the case that it is determined that the question of the user relates to the point of interest, so as to determine the point of interest based on the location information. This can guarantee the privacy security of the user and improve the interaction experience of the user.
[0082] FIG. 6 shows a flowchart of a method 600 for question and answer interaction according to some embodiments of the present disclosure. The method 600 can be implemented at the server device 120.
[0083] At block 610, the server device 120 determines whether the question relates to the point of interest in response to receiving the question of the user in the interaction of the user and the digital assistant.
[0084] At block 620, the server device 120 determines the location information related to the question in response to determining that the question relates to the point of interest.
[0085] At block 630, the service-side device 120 invokes the predetermined plug-in with the location information to obtain an execution result of the predetermined plug-in, the predetermined plug-in being configured to perform the point-of-interest query, the execution result indicating at least one point of interest.
[0086] At block 640, the service-side device 120 generates a response of the digital assistant to the question based on the execution result.
[0087] In some embodiments, determining whether the question is related to the point of interest comprises: determining, based at least on the question and the configuration information of the predetermined plug-in, whether the question is related to the point of interest.
[0088] In some embodiments, determining the location information involved by the question comprises: determining whether the question contains the location information; in response to determining that the question contains the location information, extracting the location information from the question; in response to determining that the question does not contain the location information, requesting the location information from the client device.
[0089] In some embodiments, requesting the location information from the client device comprises: sending a location permission request to the client device; and receiving a location permission request result from the client device, the location permission request result comprising the location information of the client device obtained in the case of authorization.
[0090] In some embodiments, generating the response of the digital assistant to the question based on the execution result comprises: generating the response to indicate the location information of the at least one point of interest and a map access portal, wherein the location of each point of interest in the map interface is presented via the map access portal.
[0091] FIG. 7 shows a flowchart of a method 700 for question and answer interaction, according to some other embodiments of the present disclosure. The method 700 can be implemented at the client device 110.
[0092] At block 710, the client device 110 sends a question to the service-side device in response to receiving the question of the user in the interaction of the user with the digital assistant.
[0093] At block 720, the client device 110 presents a response of the digital assistant via the digital assistant in response to receiving the response to the question from the service-side device, the response indicating at least one point of interest.
[0094] At block 730, the client device 110 presents the location of the point of interest in the map interface in response to receiving a trigger to a target point of interest in the at least one point of interest.
[0095] In some embodiments, the method 700 further includes receiving, from the server-side device, a location permission request; determining a user authorization for the location permission; and in response to determining the user authorization for the location permission, sending, to the server-side device, a location permission request result, the location permission request result including the location information of the client device obtained in the authorized case.
[0096] In some embodiments, determining the user authorization for the location permission includes: if it is determined that there is no historical user authorization for the location permission, presenting a location permission request; and in response to receiving a confirmation for the location permission request, determining the user authorization for the location permission.
[0097] In some embodiments, in response to receiving the trigger for the target interest point in the at least one interest point, presenting the location of the interest point in the map interface includes: in response to receiving the trigger for the target interest point in the at least one interest point, determining a map application to be used; and receiving a selection for the map application, presenting the location of the interest point in a map interface corresponding to the selected map application.
[0098] Embodiments of the present disclosure also provide a corresponding apparatus for implementing the above method or process.
[0099] FIG. 8 shows an exemplary structural block diagram of an apparatus 800 for question and answer interaction, according to some embodiments of the present disclosure. The apparatus 800 can be implemented as or included in the server-side device 120. Various modules / components in the apparatus 800 can be implemented by hardware, software, firmware, or any combination thereof.
[0100] As shown in FIG. 8, the apparatus 800 includes an interest point determination module 810 configured to, in response to receiving a question of a user in an interaction between the user and a digital assistant, determine whether the question is related to an interest point. The apparatus 800 further includes a location information determination module 820 configured to, in response to determining that the question is related to the interest point, determine location information involved in the question. The apparatus 800 further includes an execution result obtaining module 830 configured to invoke a predetermined plug-in using the location information to obtain an execution result of the predetermined plug-in, the predetermined plug-in being configured to perform an interest point query, the execution result indicating at least one interest point. The apparatus 800 further includes an answer generation module 840 configured to generate an answer of the digital assistant to the question based on the execution result.
[0101] In some embodiments, the interest point determination module 810 is further configured to determine whether the question is related to the interest point based at least on the question and configuration information of the predetermined plug-in.
[0102] In some embodiments, the location information determination module 820 includes a first determination module configured to determine whether the question contains location information, a location information extraction module configured to extract the location information from the question in response to determining that the question contains location information, and a location information request module configured to request the location information from the client device in response to determining that the question does not contain location information.
[0103] In some embodiments, the location information request module includes a request sending module configured to send a location permission request to the client device, and a request result receiving module configured to receive a location permission request result from the client device, the location permission request result including the location information of the client device obtained in the case of authorization.
[0104] In some embodiments, the answer generation module 840 is further configured to generate the answer to indicate the location information of the at least one point of interest and a map access portal, wherein the location of each point of interest in the map interface is presented via the map access portal.
[0105] FIG. 9 shows an exemplary structural block diagram of an apparatus 900 for question and answer interaction, according to some other embodiments of the present disclosure. The apparatus 900 can be implemented as or included in the client device 110. Various modules / components in the apparatus 900 can be implemented by hardware, software, firmware, or any combination thereof.
[0106] As shown in FIG. 9, the apparatus 900 includes a question sending module 910 configured to send a question to a server device in response to receiving a question of a user in an interaction of the user with a digital assistant. The apparatus 900 further includes an answer presenting module 920 configured to present an answer via the digital assistant in response to receiving the answer to the question from the server device, the answer indicating at least one point of interest. The apparatus 900 further includes a location presenting module 930 configured to present a location of the point of interest in a map interface in response to receiving a trigger of a target point of interest in the at least one point of interest.
[0107] In some embodiments, the apparatus 900 further includes a request receiving module configured to receive a location permission request from the server device, a user authorization determination module configured to determine a user authorization of the positioning permission, and a request result sending module configured to send a location permission request result to the server device in response to determining the user authorization of the positioning permission, the location permission request result including the location information of the client device obtained in the case of authorization.
[0108] In some embodiments, the user authorization determination module includes a request presentation module configured to present a location permission request if it is determined that there is no historical user authorization for the location permission, and an authorization determination module configured to determine user authorization for the location permission in response to receiving a confirmation of the location permission request.
[0109] In some embodiments, the location presentation module 930 includes an application determination module configured to determine a map application to use in response to receiving a trigger for a target point of interest among the at least one point of interest, and a first location presentation module configured to present a location of the point of interest in a map interface of the selected map application corresponding to the selected map application.
[0110] The units and / or modules included in the apparatus 800 and / or the apparatus 900 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, e.g., machine executable instructions stored on a storage medium. In addition to or alternatively, some or all of the units and / or modules in the apparatus 800 and / or the apparatus 900 can be implemented at least partially by one or more hardware logic components. As an example and not by way of limitation, example types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SOCs), complex programmable logic devices (CPLDs), etc.
[0111] It should be understood that one or more steps in the above methods can be performed by an appropriate electronic device or combination of electronic devices. Such an electronic device or combination of electronic devices may, for example, include the client device 110 and / or the server device 120 in FIG. 1.
[0112] FIG. 10 shows a block diagram of an electronic device 1000 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 1000 illustrated in FIG. 10 is merely an example and should not be construed to limit the functionality and scope of the embodiments described herein. The electronic device 1000 illustrated in FIG. 10 can be used to implement the client device 110 and / or the server device 120 of FIG. 1.
[0113] As shown in FIG. 10, electronic device 1000 is in the form of a general electronic device. Components of electronic device 1000 can include, but are not limited to, one or more processors 1010 or processing units, memory 1020, storage 1030, one or more communication units 1040, one or more input devices 1050, and one or more output devices 1060. Processor 1010 can be a real or virtual processor and is capable of executing various processing in accordance with programs stored in memory 1020. In a multi-processor system, multiple processors execute computer-executable instructions in parallel to improve parallel processing capability of electronic device 1000.
[0114] Electronic device 1000 typically includes a plurality of computer storage media. Such media can be any available media that is accessed by electronic device 1000 and includes both volatile and nonvolatile media, removable and non-removable media. Memory 1020 can be volatile (such as register, cache, or random access memory (RAM)), non-volatile (such as read-only memory (ROM), electrically erasable programmable read only memory (EEPROM), or flash memory), or some combination thereof. Storage 1030 can be removable or non-removable media and can include machine- readable media, such as a flash drive, magnetic disks, or any other medium that can be used to store information and / or data and that can be accessed by electronic device 1000.
[0115] Electronic device 1000 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 10, a disk drive or other computer-readable media drive can be provided for reading from or writing to a removable, non-removable, volatile, or non-volatile media slot (such as a "floppy disk"). In such cases, each drive can be connected to the bus (not shown) by one or more data media interfaces. Memory 1020 can include a computer program product 1025 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.
[0116] Communication unit 1040 enables communication with other electronic devices over communication media. Additionally, functionality of components of electronic device 1000 can be implemented in a single computing cluster or a plurality of computer machines that are capable of communicating over a communication connection. Thus, electronic device 1000 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes in a distributed computing environment.
[0117] The input device 1050 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 1060 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 1000 can also communicate with one or more external devices (not shown) such as storage devices, display devices, etc., one or more devices that enable a user to interact with the electronic device 1000, or any devices (e.g., a network card, a modem, etc.) that enable the electronic device 1000 to communicate with one or more other electronic devices, as desired via the communication unit 1040. Such communication can be carried out via an input / output (I / O) interface (not shown).
[0118] According to an example implementation of the present disclosure, there is provided a computer-readable storage medium having computer-executable instructions stored thereon, where the computer-executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, there is also provided a computer program product tangibly stored on a non-transitory computer-readable medium and comprising computer-executable instructions, where the computer-executable instructions are executed by a processor to implement the method described above.
[0119] Various aspects of the disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, and computer program products implemented according to the present disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.
[0120] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can comprise a non-transitory computer readable storage medium. The instructions stored in the computer readable storage medium, which can comprise a non-transitory computer readable storage medium, are used to program a computer, a programmable data processing apparatus, and / or other devices to produce a machine, such that the instructions, which run via the processor of the computer or other programmable data processing apparatus, implement a function / act specified in the flowchart and / or block diagram block or blocks.
[0121] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0122] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0123] The implementations of the disclosure have been described above with the intent to be illustrative rather than limiting. Although being shown and described in terms of certain implementations and overall functions, the implementations are not intended to exclude other implementations or technologies. Modifications and changes can be made in arrangement, operation, and details of the methods and apparatus described. Many modifications and variations of the described implementations are possible and will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. It is therefore intended that the description be considered in all respects as illustrative, rather than limiting, of the disclosed implementations. Changes are made to the descriptions that are intended to be protective of the applications claimed. It is therefore intended that the description be considered in all respects as illustrative, rather than limiting, of the disclosed implementations. Changes are made to the descriptions that are intended to be protective of the applications claimed.
Claims
1.A method of question and answer interaction, implemented at a server device, comprising: in response to receiving a question of a user in an interaction of the user with a digital assistant, determining whether the question is related to a point of interest; in response to determining that the question is related to a point of interest, determining location information involved in the question; invoking a predetermined plug-in with the location information to obtain an execution result of the predetermined plug-in, the predetermined plug-in being configured to perform a point of interest query, the execution result indicating at least one point of interest; and generating a response of the digital assistant to the question based on the execution result. 2.The method of claim 1, wherein determining whether the question is related to a point of interest comprises: determining whether the question is related to a point of interest based at least on the question and configuration information of the predetermined plug-in. 3.The method of claim 1, wherein determining location information involved in the question comprises: determining whether the question contains location information; in response to determining that the question contains location information, extracting the location information from the question; in response to determining that the question does not contain location information, requesting the location information from the client device. 4.The method of claim 3, wherein requesting the location information from the client device comprises: sending a location permission request to the client device; and receiving a location permission request result from the client device, the location permission request result including location information of the client device obtained in an authorized case. 5.The method of claim 1, wherein generating a response of the digital assistant to the question based on the execution result comprises: generating the response to indicate location information of the at least one point of interest and a map access entry, wherein a location of each point of interest in a map interface is presented via the map access entry. 6.A method of question and answer interaction, implemented at a client device, comprising: in response to receiving a question of a user in an interaction of the user with a digital assistant, sending the question to a server device; in response to receiving a response to the question from the server device, presenting the response via the digital assistant, the response indicating at least one point of interest; and in response to receiving a trigger to a target point of interest among the at least one point of interest, presenting a location of the point of interest in a map interface. 7.The method of claim 6, further comprising: receiving a location permission request from the server device; determining user authorization to a positioning permission; and in response to determining the user authorization to the positioning permission, sending a location permission request result to the server device, the location permission request result including location information of the client device obtained in an authorized case. 8.The method of claim 7, wherein determining user authorization to a positioning permission comprises: presenting a positioning permission request if it is determined that there is no historical user authorization to the positioning permission; and in response to receiving a confirmation to the positioning permission request, determining user authorization to the positioning permission. 9.The method of any of claims 6-8, wherein presenting the location of the interest point in a map interface in response to receiving a trigger for a target interest point of the at least one interest point comprises: determining a map application to use in response to receiving the trigger for the target interest point of the at least one interest point; and receiving a selection of the map application, presenting the location of the interest point in a map interface corresponding to the selected map application. 10.An apparatus for question and answer interaction implemented at a server device, comprising: an interest point determination module configured to determine whether a question received from a user in an interaction between the user and a digital assistant is related to an interest point in response to receiving the question; a location information determination module configured to determine location information involved in the question in response to determining that the question is related to an interest point; an execution result obtaining module configured to invoke a predetermined plug-in configured to perform an interest point query using the location information to obtain an execution result of the predetermined plug-in, the execution result indicating at least one interest point; and an answer generation module configured to generate an answer to the question by the digital assistant based on the execution result. 11.An apparatus for question and answer interaction implemented at a client device, comprising: a question sending module configured to send a question received from a user in an interaction between the user and a digital assistant to a server device; an answer presenting module configured to present an answer to the question received from the server device via the digital assistant in response to receiving the answer, the answer indicating at least one interest point; and a location presenting module configured to present a location of a target interest point of the at least one interest point in a map interface in response to receiving a trigger for the target interest point. 12.An electronic device, comprising: at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, cause the electronic device to perform the method of any one of claims 1-5 and / or the method of any one of claims 6-9. 13.A computer-readable storage medium having computer-executable instructions stored thereon that are executable by a processor to implement the method of any one of claims 1-5 and / or the method of any one of claims 6-9. 14.A computer program product comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method of any one of claims 1-5 and / or the method of any one of claims 6-9.
Citation Information
Patent Citations
Interfacing between digital assistant applications and navigation applications
CN110869706A
Digital assistant user interface and response mode
CN112099720A
Method, electronic equipment and system for sharing navigation information
CN116257196A
Method, device and equipment for arousing intelligent assistant, chip and storage medium
CN117453090A