Conversation method and device, electronic equipment, storage medium and product

Abstract

The invention relates to a dialogue method and device, electronic equipment, a storage medium and a product, and relates to the technical field of artificial intelligence. The dialogue method comprises the following steps: displaying a first dialogue between a first user and a second user at a client of the first user; calling one or more robots for the first user based on the information of the first dialogue; generating auxiliary dialogue information of the robot based on the first dialogue; and displaying the auxiliary dialogue information.

Description

Technical Field

[0001] The present disclosure relates to the field of artificial intelligence technology, and in particular to a dialogue method, device, electronic device, storage medium and product. Background Art

[0002] With the development of artificial intelligence and machine learning technologies, machine learning models can be used to implement intelligent conversational robots. For example, intelligent conversational robots can serve as intelligent customer service and virtual friends, receiving inquiries sent by users and providing feedback on answers to users. Summary of the invention

[0003] This summary is provided to introduce concepts in a brief form that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0004] According to some embodiments of the present disclosure, a conversation method is provided, including: displaying a first conversation between a first user and a second user on a client of the first user; calling one or more robots for the first user based on information of the first conversation; generating auxiliary conversation information of the robots based on the first conversation; and displaying the auxiliary conversation information.

[0005] According to some embodiments of the present disclosure, a conversation device is provided, including: a first display module, configured to display a first conversation between a first user and a second user on a client of the first user; a calling module, configured to call one or more robots for the first user based on information of the first conversation; a generating module, configured to generate auxiliary conversation information of the robot based on the first conversation; and a second display module, configured to display the auxiliary conversation information.

[0006] According to some embodiments of the present disclosure, an electronic device is provided, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute the conversation method of any embodiment described in the present disclosure based on instructions stored in the memory.

[0007] According to some embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the dialogue method of any embodiment described in the present disclosure is performed.

[0008] According to some embodiments of the present disclosure, a computer program product is provided. When the computer program product is executed on a computer, the computer is enabled to implement the dialogue method of any embodiment described in the present disclosure.

[0009] According to some embodiments of the present disclosure, a computer program is provided, comprising: instructions, which, when executed by a processor, cause the processor to execute the dialog method of any embodiment described in the present disclosure.

[0010] Other features, aspects and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The preferred embodiments of the present disclosure are described below with reference to the accompanying drawings. The drawings described herein are used to provide a further understanding of the present disclosure. Each of the drawings together with the following detailed description is included in this specification and forms a part of the specification, and is used to explain the present disclosure. It should be understood that the drawings described below only relate to some embodiments of the present disclosure and do not constitute a limitation on the present disclosure. In the drawings:

[0012] Figure 1 A flowchart of a conversation method according to some embodiments of the present disclosure is shown.

[0013] Figure 2 The calling method of the robot according to some embodiments of the present disclosure is shown

[0014] Figure 3 The invention shows a method for calling a robot according to some other embodiments of the present disclosure.

[0015] Figure 4 The invention shows a method for calling a robot according to some other embodiments of the present disclosure.

[0016] Figure 5A and 5B A schematic diagram of a dialogue interface according to some embodiments of the present disclosure is shown.

[0017] Figure 6 A schematic diagram of a conversation interface according to some embodiments of the present disclosure is shown.

[0018] Figure 7 A schematic diagram of the structure of a dialogue device according to some embodiments of the present disclosure is shown.

[0019] Figure 8 A schematic structural diagram of an electronic device according to some embodiments of the present disclosure is shown.

[0020] Fig. 9 A schematic diagram of the structure of a computer system according to some embodiments of the present disclosure is shown.

[0021] It should be understood that, for ease of description, the sizes of the various parts shown in the drawings are not necessarily drawn according to the actual proportional relationship. The same or similar reference numerals are used in the various drawings to represent the same or similar parts. Therefore, once an item is defined in one drawing, it may not be further discussed in subsequent drawings. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure, but it is obvious that the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. The following description of the embodiments is actually only illustrative and is by no means intended to limit the present disclosure and its application or use. It should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein.

[0023] It should be understood that the various steps recorded in the method embodiments of the present disclosure can be performed in different orders, and / or performed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown in the execution. The scope of the present disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement, numerical expressions and numerical values ​​of the parts and steps set forth in these embodiments should be interpreted as being merely exemplary and do not limit the scope of the present disclosure.

[0024] The term "include" and its variations used in the present disclosure mean an open term that includes at least the following elements / features but does not exclude other elements / features, that is, "including but not limited to". In addition, the term "include" and its variations used in the present disclosure mean an open term that includes at least the following elements / features but does not exclude other elements / features, that is, "including but not limited to". Therefore, include is synonymous with include. The term "based on" means "based at least in part on".

[0025] References throughout this specification to "one embodiment," "some embodiments," or "an embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. For example, the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments." Furthermore, the appearances of the phrases "in one embodiment," "in some embodiments," or "in an embodiment" in various places throughout this specification do not necessarily all refer to the same embodiment, but may do so.

[0026] It should be noted that the concepts of "first", "second", etc. mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units. Unless otherwise specified, the concepts of "first", "second", etc. are not intended to imply that the objects described in this way must be in a given order in time, space, ranking, or any other manner.

[0027] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0028] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0029] The embodiments of the present disclosure are described in detail below in conjunction with the accompanying drawings, but the present disclosure is not limited to these specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. In addition, in one or more embodiments, specific features, structures or characteristics can be combined in any suitable manner that will be clear from the present disclosure by a person of ordinary skill in the art.

[0030] It should be understood that the present disclosure does not limit how to obtain the image to be applied / processed. In one embodiment of the present disclosure, it can be obtained from a storage device, such as an internal memory or an external storage device. In another embodiment of the present disclosure, a photographic component can be mobilized to shoot. It should be noted that the acquired image can be a captured image or a frame of an image in a captured video, and is not particularly limited to this.

[0031] In the context of the present disclosure, an image may refer to any of a variety of images, such as a color image, a grayscale image, etc. It should be noted that in the context of the present specification, the type of image is not specifically limited. In addition, the image may be any appropriate image, such as an original image obtained by a camera device, or an image that has been subjected to specific processing, such as preliminary filtering, anti-aliasing, color adjustment, contrast adjustment, normalization, etc. It should be noted that the preprocessing operation may also include other types of preprocessing operations known in the art, which will not be described in detail here.

[0032] In the scenario of using intelligent conversation robots in the related art, the robot is mainly provided by the developer of the application and is used as a party to the conversation with the user, that is, the respondent to the message sent by the user. The robot can respond to the message sent by the user based on the user's input and its own knowledge base. That is, the application scenario is a scenario in which the user talks to the robot alone. The robot cannot be applied to the personalized network social scenario of each user.

[0033] An embodiment of the present disclosure provides a dialogue, which can call a robot for the first user to assist the first user in having a dialogue with the second user through information of the dialogue between the first user and the second user.

[0034] Figure 1 FIG. 1 is a flow chart showing a dialog method according to some embodiments of the present disclosure. Figure 1 As shown, the dialogue method of this embodiment includes steps S102 to S108.

[0035] In step S102, a first conversation between the first user and the second user is displayed on the client of the first user.

[0036] The client of the first user refers to a client that has logged into the account of the first user, or a client used by the first user. The client can provide the first user with a function of online chatting with other users, for example, it can be an application client based on social network or instant messaging, or other types of clients including an online chatting module.

[0037] The second user is a user who chats with the first user. The second user can be a real user, such as a contact of the first user, or other users in the application. Of course, the second user can also be a virtual user, such as an agent created by the first user or other users, or an agent provided by the application.

[0038] The first conversation between the first user and the second user may include messages sent by both the first user and the second user, or may include only messages sent by the second user because the first user did not check and reply to the messages in time, or may include only messages sent by the first user. In addition, messages sent by other users may be further included. That is, the embodiments of the present disclosure are applicable to the scenario where the first user chats with a single user, and are also applicable to the scenario where the first user chats with multiple users in a group.

[0039] In step S104, based on the information of the first conversation, one or more robots are called for the first user.

[0040] The information of the first conversation includes at least one of the content information and attribute information of the first conversation. The content information can be understood as the body of the conversation, that is, the text, voice, image, video, emoticon, link and other content sent by the user. The attribute information includes, for example, attribute information of the conversation content, such as sending time, text length, etc., and may also include attribute information of the sender of the conversation, such as sender information, relationship between senders, etc.

[0041] The robot can generate corresponding content based on the dialogue sent by other subjects in the dialogue scene (such as the first user, the second user, and other users or robots participating in the dialogue). It can be implemented in software, hardware, or a combination of software and hardware. The robot can also be called a virtual agent of a digital person or a machine learning model. The robot can be implemented based on a machine learning model, such as a large language model (LLM) or a foundation model. The machine learning model can be a generative model, which is used to output target content based on input information. The information input to the generative model includes the processing basis of the generative model in the generation process, such as which information is referenced to perform the generation process, the requirements of the output target content, etc. The generative model includes, for example, a model generated based on text, or a model generated based on an image, and the output of the generative model can include text, images, or a combination of the two. Of course, the input or output of the generative model can also be data of other modalities, such as audio, video, or a combination of multiple types of data. The generative model can be a single-modal model, such as a model that generates text from text (referred to as the "text-to-text model") or a model that generates images from images (referred to as the "image-to-image model"). Alternatively, the generative model can be a cross-modal model, that is, a model whose input and output belong to different modalities, such as a model that generates images from text (referred to as the "text-to-image model"). Alternatively, the input of the generative model can include multiple modalities, and the output can also include multiple modalities.

[0042] When calling a robot, one or more robots corresponding to the information of the first conversation may be selected from one or more candidate robots. The called robot may be created by the first user, created by other users, or provided by an application. The candidate robots may include robots of various types and purposes, and each robot may generate a response based on its pre-configured setting information, response strategy, etc.

[0043] The robot can directly participate in the conversation between the first user and the second user. The robot can also generate reference information for the first user for the conversation. For example, the robot can display the generated content only to the first user, and the first user can copy or edit the content and send it to the second user.

[0044] Robots can be divided into multiple types according to their types, applicable scenarios, and usage methods. For example, robots may include virtual avatar robots, which, as virtual avatars or digital avatars of the first user, can imitate some habits and characteristics of the first user, thereby participating in conversations on behalf of the first user in specific scenarios. For another example, robots can be divided into tool robots, knowledge robots, and emotional robots according to applicable scenarios. Tool robots can help users use other functions provided in the application, such as booking air tickets, booking hotels, and online shopping. Knowledge robots have a knowledge base and can provide users with factual information. Emotional robots can analyze the emotions in the user's conversation, provide emotional help to the user through the conversation, or liven up the chat atmosphere based on the relationship between the first user and other users.

[0045] After the robot to be called is determined, the calling process can be executed after obtaining the user's consent. Alternatively, the user can make a unified confirmation in advance, and after the user confirms, the robot can be automatically called according to its configured logic and strategy.

[0046] In step S106, auxiliary dialogue information of the robot is generated based on the first dialogue.

[0047] Auxiliary dialogue information refers to information used to assist the first user and the second user in conducting a dialogue, so that the dialogue between the first user and the second user proceeds more smoothly. The auxiliary dialogue information can be the message itself sent by the robot in the dialogue, or it can be reference information provided to the first user. Regardless of the aforementioned form, it can include at least one of reference information associated with the first dialogue, a summary of the first dialogue, and a reply to the second user.

[0048] The robot can generate auxiliary dialogue information using the machine learning model it relies on. For example, part or all of the content in the first dialogue can be input into the robot's machine learning model. The input information can also include some instruction information, such as requirements for the content, format, and style of the generated information. After obtaining the output of the model, the output information or the processed output information can be directly used as auxiliary dialogue information.

[0049] In step S108, auxiliary dialogue information is displayed.

[0050] The auxiliary dialogue information is displayed in the client of the first user. For example, it can be displayed in the dialogue interface between the first user and the second user. The auxiliary dialogue information can be visible to both the first user and the second user, or only to the first user. In some embodiments, when the auxiliary dialogue information is displayed, the robot's identifier (e.g., avatar, name, etc.) can also be displayed in association to indicate the source of the auxiliary dialogue information.

[0051] When a robot participates in a conversation, the robot can be displayed separately from the real user so that the second user knows that the robot is currently in the conversation. For example, adding labels such as "AI" or "robot" or marking the messages it sends in different styles.

[0052] In the above embodiment, during the conversation between the first user and the second user, the robot is automatically called to assist the first user in the conversation using the conversation information, so that the robot can be used to enrich the conversation content, thereby improving the richness and interest of the conversation between the first user and the second user.

[0053] The present disclosure provides the following two exemplary methods for the robot to assist the first user in conducting a conversation. Of course, those skilled in the art can use other methods as needed, and the present disclosure will not describe them one by one.

[0054] In an exemplary manner, the robot participates in a conversation between a first user and a second user. That is, the robot can be the subject in the conversation and send messages to the first user and the second user. Thus, a group chat is formed between the first user, the second user, and the robot, and the group chat may include more subjects as appropriate. In this embodiment, the auxiliary conversation information is the information sent by the robot during the process of the robot participating in the conversation between the first user and the second user. That is, after generating the auxiliary conversation information, the robot can send it as its own message, so that the auxiliary conversation information also becomes the conversation content between the first user, the second user, and the robot. Thus, the content in the conversation can be directly enriched.

[0055] In an exemplary manner, the robot does not directly participate in the conversation between the first user and the second user, but provides reference information to the first user. The reference information can be visible to both the first user and the second user, or only to the first user. In this embodiment, the auxiliary conversation information is information provided to the first user for reference. Thus, while assisting the first user, the impact on the nature of the conversation between the first user and the second user can be reduced, and the robot can be used as a behind-the-scenes guide for the first user without appearing in the conversation.

[0056] The above two methods can be selected manually by the user or automatically based on the conversation scenario. In some embodiments, based on the information of the first conversation, the conversation scenario between the first user and the second user is determined; in response to the conversation scenario belonging to the first type, one or more robots for participating in the conversation between the first user and the second user are called for the first user; in response to the conversation scenario belonging to the second type, one or more robots for providing reference information are called for the first user.

[0057] The conversation scenario is used to help determine whether the robot needs to directly participate in the conversation between the first user and the second user. In the first type of scenario, the robot needs to directly participate in the conversation, for example, the relationship between the first user and the second user is close, the relationship between the first user and the second user is not close and the importance is low (such as chatting with strangers), the topic of the first user and the second user is aimless, etc. In the second type of scenario, the robot may not need to directly participate in the conversation, for example, the relationship between the first user and the second user is not close and the importance is high, the chat content between the first user and the second user involves professional fields, etc. When determining the conversation scenario, the multiple dimensions included in the information of the first conversation can be input into the machine learning model, or matched with the pre-set conditions of each scenario, so as to obtain the classification result of the conversation scenario.

[0058] After describing the application scenarios of the robots provided by the embodiments of the present disclosure, the calling methods of the robots of some embodiments of the present disclosure are further described below.

[0059] Figure 2 The illustrated embodiment will describe the robot's calling method from a semantic perspective. Figure 2 FIG. 4 shows a method for calling a robot according to some embodiments of the present disclosure. In this embodiment, the information of the first dialogue includes semantic information. Figure 2 As shown, the calling method of this embodiment includes steps S202 to S204.

[0060] In step S202, based on the semantic information of the first dialogue, one or more robots corresponding to the first dialogue are determined.

[0061] The semantic information reflects the main content involved in the first conversation, which may include one or more of a summary, key content or theme of the conversation. In some embodiments, the semantic analysis model may be used to process all or part of the conversation in the first conversation to obtain the semantic information.

[0062] Several exemplary methods for determining the target dialogue in the first dialogue are provided below, so as to determine the semantic information of the first dialogue based on the target dialogue. Of course, those skilled in the art may also use other methods to determine the semantic information as needed.

[0063] In some embodiments, the last conversation of the first conversation with a specified number is taken as the target conversation, so as to determine the semantic information of the first conversation based on the target conversation. The specified number of conversations can be conversations of a specified length (i.e., a specified number of words), conversations including a specified number of messages, and conversations including a specified round (one or more messages sent continuously by the same user belong to the same round). Thus, by semantically analyzing the latest message with a certain amount of information, the semantic information in the current first conversation is obtained.

[0064] In some embodiments, the last conversation in the first conversation that occurred within a specified time period is used as the target conversation, so as to determine the semantic information of the first conversation based on the target conversation. This method also performs semantic analysis on the latest message, but determines the content worth referring to more from the time dimension, and determines the semantic information in the current first conversation based on the content.

[0065] In some embodiments, the conversations in the first conversation that belong to the same topic are taken as target conversations, so as to determine the semantic information of the first conversation based on the target conversation. This method uses topics to classify messages, so that the focus of the conversation can be used as the basis for extracting semantic information. If the first conversation involves multiple topics, the conversation under the topic with the largest amount of information can be determined as the target conversation. Since the chats between users are usually casual, they may occasionally change topics but quickly switch back to the original topic, so this method can extract the most important information in the first conversation.

[0066] The semantic information may reflect a summary of the first conversation, or may reflect key information in the first conversation. Alternatively, the semantic information may reflect both types of information at the same time. The specific type of information to be used may be determined based on the topic involved in the information in the first conversation.

[0067] In the case where the subject of the first conversation is relatively simple and clear, summary information can be generated to reflect the semantics of the first conversation. In some embodiments, the subject involved in one or more rounds of conversations in the first conversation is determined; in response to the number of subjects involved in one or more rounds of conversations being not greater than a specified value, the summary information of the first conversation is determined as the semantic information of the first conversation. Since the semantics expressed in a round of conversations are usually relatively continuous, this embodiment uses the conversation round as the minimum unit to count the subjects involved in one or more rounds of conversations. This round or more rounds of conversations may be the latest conversation in the first conversation. Of course, as needed, statistics can also be performed in other units, such as the number of words, the number of messages, etc., which will not be repeated here. In the case where the subject involved in one or more rounds of conversations is not greater than a specified value, it means that the subjects involved in these conversations are relatively clear, so by generating summary information, the semantics of the conversation can be reflected more simply, accurately and comprehensively.

[0068] In some embodiments, key information is extracted from the first conversation as semantic information of the first conversation. Key information is, for example, keywords and key sentences. Key information can be determined by matching a preset key information table, or by analyzing core words and core sentences in the conversation. Key information can be extracted from the first conversation as semantic information when the number of topics involved in one or more rounds of conversations is greater than a specified value. That is, when the topics involved in the conversation are scattered and unclear, key information is extracted to reflect the key content under each scattered topic. Of course, key information can also be extracted as semantic information when the number of topics involved in one or more rounds of conversations is not greater than a specified value.

[0069] Based on the semantic information, a robot that matches the first conversation can be determined. In some embodiments, the semantic information of the first conversation is matched with the attributes of one or more candidate robots, and one or more robots corresponding to the first conversation are determined based on the matching results. The attributes of the robot can be type, setting information, and description information. When matching the semantic information with the attributes of the robot, the degree of matching can be determined by calculating the similarity between the semantic information and the attributes, for example, a specified number of robots with the highest matching degree, or robots with a matching degree higher than a specified threshold are determined as matching robots. Thereby, the called robot can more accurately respond to the content currently discussed by the first user and the second user.

[0070] In some embodiments, it can be determined whether to select a robot corresponding to the semantic information of the first conversation based on the number of topics involved in the first conversation. For example, in response to the number of topics involved in the semantic information being not greater than a specified value, the semantic information of the first conversation is matched with the attributes of one or more candidate robots, and one or more robots corresponding to the first conversation are determined based on the matching results; in response to the number of topics involved in the semantic information being greater than a specified value, or the semantic information involved in the first conversation being unclear, the conversation guiding robot is determined as the robot corresponding to the first conversation. That is, when the number of topics involved in the first conversation is small (e.g., not greater than a specified value), it means that the topic of the first conversation is clear, and a robot that matches the semantics of the first conversation can be called based on the semantic information of the first conversation. In the case where the number of topics involved in the first conversation is large (e.g., greater than a specified value), or when the semantics are unclear such as the inability to extract a topic, it means that the current conversation between the first user and the second user does not have a clear topic, and a conversation guiding robot can be used to bring out a topic to liven up the chat atmosphere between the two.

[0071] The conversation guiding robot is used to induce further communication between the first user and the second user with content containing new topics. For example, when the conversation guiding robot is called, the association information of the semantic information can be generated based on the semantic information of the first conversation and the second conversation, and the information of the first user and the second user; based on the association information, the message sent by the conversation guiding robot is generated. The association information of the semantic information can be obtained by expanding the semantic information, or by determining the topic associated with the semantic information and obtaining the association information based on the associated topic. When generating the association information, the information of the first user and the second user, such as the attributes of the first user and the second user, or the relationship between the two, can be referred to at the same time. For example, the first user and the second user are chatting aimlessly, and the first conversation includes "Have you eaten?" "Eat." "Oh", "Hmm" and some expressions without clear meanings in sequence. At this time, the conversation guiding robot can be called to participate in the conversation. For example, the topic of eating was mentioned before, and the conversation guiding robot can send a message like "Who are you eating with, a female colleague?" to liven up the chat atmosphere. Alternatively, the conversation guidance robot can provide the first user with some conversation assistance information for reference, which is only visible to the first user, such as "Ask her if she has eaten," "We can go eat XXX together next time," etc., so that the first user can continue the conversation with the second user based on the revelation.

[0072] In step S204, one or more robots corresponding to the first conversation are called for the first user.

[0073] The above embodiment calls the robot based on the semantic information of the first conversation, so that the called conversation robot can match the content discussed by the first user and the second user, thereby improving the effect of the robot in assisting the first user in the conversation, thereby further improving the richness and interest of the conversation between the first user and the second user.

[0074] In some embodiments, it is further possible to determine whether the first conversation corresponds to a service intent based on semantic information. For example, some service functions are provided in the application, such as booking air tickets, booking hotels, online shopping, etc. If the subject or key information of the first conversation can match these service functions, it is considered that the first conversation has a service intent. In response to the first conversation corresponding to the service intent, auxiliary conversation information including at least one of a product card and a service subscription card is generated. Thus, the first user, or the first user and the second user, can quickly access the service function during the conversation, which can assist the user in improving the efficiency of using the service function.

[0075] Figure 3 The illustrated embodiment will describe the robot's calling method from the perspective of the second user's category. Figure 3FIG. 4 shows a method for calling a robot according to some other embodiments of the present disclosure. In this embodiment, the information of the first conversation includes the category of the second user. Figure 3 As shown, the calling method of this embodiment includes steps S302 to S304.

[0076] In step S302, the category of the second user is determined. The category of the second user can be determined based on whether the second user is a contact of the first user, or based on a category label or grouping set by the first user for the second user. Those skilled in the art may also use other methods to determine the category, which will not be described in detail here.

[0077] In step S304, in response to the second user's category being the designated category, a conversation guiding robot is called for the first user to participate in the conversation between the first user and the second user.

[0078] The designated category can be set by the user. For users of the designated category, the first user hopes to invite the dialogue guiding robot to participate in the chat to liven up the atmosphere when having a conversation with them. For example, when the first user is chatting with a close friend, the first user hopes that the dialogue guiding robot will participate to liven up the atmosphere so that the conversation can continue. In this case, the appearance condition of the dialogue guiding robot can be pre-configured to be a conversation between the first user and a second user of the designated category, so that when the first user and the second user of the designated category have a conversation, the robot automatically appears and participates in the conversation. The auxiliary dialogue information of the dialogue guiding robot is the message sent by the dialogue guiding robot during the process of participating in the conversation. The method of generating the auxiliary dialogue information can refer to the aforementioned embodiment and will not be repeated here.

[0079] The above embodiment calls the robot according to the type of the second user, so that the called robot can be automatically determined for the designated chat object of the first user, thereby improving the fun of the chat between the first user and the second user.

[0080] Figure 4 The illustrated embodiment will describe the robot's calling method from the perspective of the dialog state. Figure 4 FIG. 4 shows a method for calling a robot according to some other embodiments of the present disclosure. In this embodiment, the information of the first conversation includes the conversation time. Figure 4 As shown, the calling method of this embodiment includes steps S402 to S404.

[0081] In step S402, the sender and sending time of the last conversation in the first conversation are determined.

[0082] In step S404, in response to the last conversation in the first conversation being sent by the second user and the sending time of the last conversation exceeding the specified threshold from the current time, a robot that is the virtual avatar of the first user is called for the first user to reply to the second user.

[0083] If the sender of the last conversation is the first user, it means that the first user has replied to the message sent by the second user. If the sender of the last conversation is the second user, it means that the first user has not replied to the message sent by the second user, and if the last message has been sent for a while, it means that the first user may not have time to check the message or does not want to reply to the second user. In this case, a robot that can replace the first user can be called to reply to the second user, so that the second user can get a response in time, improving the smoothness of communication between the first user and the second user.

[0084] The first user's virtual avatar may be a robot created by the first user and used to communicate with other users on behalf of the first user. The properties of the virtual avatar may be configured by the first user, and some properties may be system defaults when created.

[0085] In some embodiments, the avatar of the virtual avatar robot can be generated based on a picture specified by the first user. The user can upload an image from a local or cloud gallery, or select from an image gallery provided by the application. After the user specifies the picture, the image can be processed to obtain a picture with added effects as the robot's avatar. For example, a real-life photo uploaded by a user can be processed into a picture with a comic effect. In the process of processing the image, a graph-generated graph model can be used for processing. For example, the user-specified picture and the processing instructions entered by the user (for example, "generate a comic effect image for me" and "make the eyes bigger") can be input into the model; alternatively, the style or filter template provided by the application can be used.

[0086] In some embodiments, the voice of the virtual avatar robot is generated according to the voice specified by the first user. The user can upload the voice from a local or cloud gallery, or select from a voice library provided by the application. Then, as needed, the voice can be changed or mixed with multiple tones according to the voice specified by the user to generate a richer sound effect.

[0087] The virtual avatar robot created in the above manner can create or edit the robot based on the attributes specified by the user, thereby improving the matching degree between the virtual avatar robot and the first user's conversation intention, so that the robot can play a better role in assisting the conversation.

[0088] After determining the robot to be called, the user can also be asked, and the robot can be called after confirmation by the user. In some embodiments, the first call control of the robot corresponding to the first conversation is displayed; in response to the trigger operation of the first user on the first call control, the auxiliary conversation information is triggered. Thus, the robot can be called after the first user confirms the robot recommended based on the conversation through the first call control. After calling the robot through the call control, it can provide at least one of the reference information associated with the first conversation, the summary of the first conversation, and the reply to the second user as auxiliary conversation information. Thus, the robot can provide various forms of responses as a conversation assistant to the user in response to the user's confirmation.

[0089] Figure 5A and 5B FIG. 2 shows a schematic diagram of a dialogue interface according to some embodiments of the present disclosure. Figure 5A As shown, the dialogue interface 51 of this embodiment is an interface for a dialogue between a first user AA and a second user BB. In the dialogue, the two users are discussing the topic of traveling to Jiuzhaigou.

[0090] In response to detecting the topic, the application can generate an automatic reply message, such as the content shown in 511, so that user AA can directly send the content after triggering the control where the automatic reply message is located to quickly reply. Control 511 can also include the identification of the robot that provides the auxiliary dialogue information. Control 511 is invisible to user BB.

[0091] In the dialogue interface 51, a first call control 512 may also be displayed. According to the dialogue between the two users, it can be determined that the corresponding robot is a "travel assistant". The first call control 512 may carry the identification of the travel assistant, such as a name or an avatar, so as to confirm with the user whether to call the robot. The first call control 512 is also invisible to the user BB.

[0092] In some embodiments, the call control includes instruction information for the robot generated based on the semantic information of the first dialogue. In response to the first user's triggering operation on the first call control, the auxiliary dialogue information is triggered to be generated based on the instruction information and the first dialogue. For example, in the dialogue interface 51, in addition to the name "travel assistant", the first call control 512 also includes the instruction information "provide me with a travel plan for Jiuzhaigou". Therefore, when the user triggers the first call control 512, the instruction information can be sent to the travel assistant robot so that the robot can generate an answer based on the previous dialogue and the instruction information.

[0093] As described in the above embodiments, the robot can participate in the conversation or only provide visible reference information to the first user. In some embodiments, the conversation interface between the first user and the second user displays auxiliary conversation information sent by the robot participating in the conversation between the first user and the second user. For example, the travel assistant can send messages as a participant in the conversation, such as Figure 5A As shown in the message control 513 in . For another example, the travel assistant can also display the generated information on the client of the first user. In some embodiments, the generated content can be directly filled into the message input control of the first user, for example Figure 5B In the input box 514 shown, the first user can then send the message directly, or send the message after editing.

[0094] After the first conversation, the first user may continue to send messages based on the auxiliary conversation information provided by the robot. In some embodiments, a second conversation sent by the first user is displayed, wherein the second conversation is determined based on the auxiliary conversation information, and the auxiliary conversation information is not visible to the second user. Figure 5B , the user can edit the content automatically filled into the input box 514 by the robot, for example, changing "I have compiled a guide, the first day... the second day..." to "How about this arrangement, the first day... the second day...", and send it. Thus, the message sent by user AA appears in the dialogue interface 51, as shown in the message control 515.

[0095] The above embodiments provide methods for automatically recommending a robot to a user or directly and automatically calling a robot. In some embodiments, the user can also manually control whether to use a robot to assist in the conversation.

[0096] Figure 6 Schematic diagram of a dialogue interface according to some embodiments of the present disclosure is shown. Figure 6 As shown, the dialogue interface 60 of this embodiment is a dialogue interface between a first user AA and a second user BB, wherein user BB sends a message 601 “What time will you be back in the evening?”.

[0097] Since user AA has not responded for a long time, in some embodiments, the virtual avatar robot aa of user AA can be automatically called according to the current conversation status, and the robot aa then sends a message to the conversation "He should be working overtime, he is very busy recently" 602. In some embodiments, in response to user BB and user AA being in a relationship, the conversation guiding robot "atmosphere group" can be automatically called, and the "atmosphere group" robot then sends a message "Are you with a female colleague?" 603 to tease in the conversation to liven up the conversation atmosphere.

[0098] Figure 6Some or all of the robots shown may also be manually called by the user. In some embodiments, in response to the operation of calling the robot by the first user, a robot determined based on the information of the first conversation or a robot specified by the operation is displayed. The robot can be displayed in the conversation (i.e., the robot is allowed to participate in the conversation) or displayed for the first user (i.e., the robot is instructed to provide reference information). For example, the call 604 of the robot aa and the call control 605 of the atmosphere group can be set in the interface 60. The first user can turn the robot on or off by triggering controls 604 and 605. The turned-on robot will participate in the conversation, and the turned-off robot will not participate in the conversation. Thus, in addition to the method of automatically calling the robot, the user can also manually call the robot as needed, which increases the user's freedom to use the robot. When the robot is turned on, the robot can decide whether to send a message and what content to send according to the content output by each subject in the current conversation.

[0099] In some embodiments, the robot may output a round of messages each time in response to a call operation by the first user. For example, a second call control corresponding to the candidate robot is displayed; in response to a trigger operation on the second call control, the candidate robot's reply to the first conversation is displayed. For example, one or more second call controls of candidate robots may be set in the conversation interface. For a candidate robot, each time the first user clicks its second call control, the robot participates in the conversation and outputs a message, after which the robot no longer sends messages and instructs the user to trigger its second call control again. Thus, the robot can be made to participate in the conversation in response to the needs of the user, and the degree of participation of the robot can be more strictly controlled.

[0100] The above is an introduction to the dialogue method of the embodiment of the present disclosure. The following describes the related devices of the embodiment of the present disclosure in conjunction with the accompanying drawings.

[0101] Figure 7 FIG. 2 shows a schematic diagram of the structure of a dialogue device according to some embodiments of the present disclosure. Figure 7 As shown, the dialogue device 70 of this embodiment includes: a first display module 701, configured to display a first dialogue between a first user and a second user on a client of the first user; a calling module 702, configured to call one or more robots for the first user based on information of the first dialogue; a generating module 703, configured to generate auxiliary dialogue information of the robot based on the first dialogue; and a display module 704, configured to display the auxiliary dialogue information.

[0102] In some embodiments, the auxiliary dialogue information is information sent by the robot during the robot's participation in a dialogue between a first user and a second user; or, the auxiliary dialogue information is information provided to the first user for reference.

[0103] In some embodiments, the calling module 702 is further configured to: determine a conversation scenario between the first user and the second user based on information of the first conversation; in response to the conversation scenario belonging to the first type, call one or more robots for the first user to participate in the conversation between the first user and the second user; in response to the conversation scenario belonging to the second type, call one or more robots for the first user to provide reference information.

[0104] In some embodiments, the information of the first conversation includes semantic information, and the calling module 702 is further configured to: determine one or more robots corresponding to the first conversation based on the semantic information of the first conversation; and call one or more robots corresponding to the first conversation for the first user.

[0105] In some embodiments, the dialogue device 70 further includes a determination module 705 .

[0106] In some embodiments, the determination module 705 is configured to: take the last specified number of conversations generated in the first conversation as the target conversation, or take the last conversation generated in the first conversation within a specified time period as the target conversation, or take the conversations belonging to the same topic in the first conversation as the target conversation; based on the target conversation, determine the semantic information of the first conversation.

[0107] In some embodiments, the determination module 705 is configured to: determine the topics involved in one or more rounds of conversation in the first conversation; in response to the number of topics involved in one or more rounds of conversation being not greater than a specified value, determine the summary information of the first conversation as the semantic information of the first conversation.

[0108] In some embodiments, the determination module 705 is configured to extract key information from the first conversation as semantic information of the first conversation.

[0109] In some embodiments, the calling module 702 is further configured to: in response to the number of topics involved in the semantic information being greater than a specified value, or the semantic information involved in the first conversation being unclear, determine the conversation guiding robot as the robot corresponding to the first conversation; in response to the number of topics involved in the semantic information being not greater than a specified value, match the semantic information of the first conversation with the attributes of one or more candidate robots, and determine one or more robots corresponding to the first conversation based on the matching results.

[0110] In some embodiments, the information of the first conversation includes the category of the second user, and the calling module 702 is further configured to: in response to the category of the second user being a specified category, call a conversation-guided robot for the first user to participate in the conversation between the first user and the second user.

[0111] In some embodiments, the auxiliary dialogue information is a message sent by the dialogue guiding robot during the process of participating in the dialogue, and the generation module 703 is further configured to: generate association information of the semantic information based on the semantic information of the first dialogue and the second dialogue, and the information of the first user and the second user; based on the association information, generate a message sent by the dialogue guiding robot.

[0112] In some embodiments, the information of the first conversation includes the conversation time, and the calling module 702 is further configured to: in response to the last conversation in the first conversation being sent by the second user, and the sending time of the last conversation being greater than a specified threshold from the current time, call a robot that is the virtual avatar of the first user to reply to the second user for the first user.

[0113] In some embodiments, the avatar of the virtual avatar robot is generated based on a picture specified by the first user, and the voice of the virtual avatar robot is generated based on a voice specified by the first user.

[0114] In some embodiments, the calling module 702 is further configured to: display a first calling control of the robot corresponding to the first dialogue; and trigger the generation of auxiliary dialogue information in response to a triggering operation of the first user on the first calling control.

[0115] In some embodiments, the calling control includes instruction information for the robot generated based on semantic information of the first conversation, and the calling module 702 is further configured to: in response to the first user's triggering operation on the first calling control, trigger the generation of auxiliary conversation information based on the instruction information and the first conversation.

[0116] In some embodiments, the auxiliary conversation information includes at least one of: reference information associated with the first conversation, a summary of the first conversation, and a reply to the second user.

[0117] In some embodiments, the display module 704 is further configured to: display a second conversation sent by the first user, wherein the second conversation is determined based on the auxiliary conversation information, and the auxiliary conversation information is not visible to the second user.

[0118] In some embodiments, the display module 704 is further configured to: display, on the dialogue interface between the first user and the second user, auxiliary dialogue information sent by the robot participating in the dialogue between the first user and the second user.

[0119] In some embodiments, the generation module 703 is further configured to: in response to the first conversation corresponding to the service intent, generate auxiliary conversation information including at least one of a product card and a service subscription card.

[0120] In some embodiments, the display module 704 is further configured to: in response to the first user's operation of calling the robot, display the robot determined based on the information of the first conversation, or operate the designated robot.

[0121] In some embodiments, the display module 704 is further configured to: display a second call control corresponding to the candidate robot; and display a reply of the candidate robot to the first conversation in response to a triggering operation on the second call control.

[0122] It should be noted that the above-mentioned units are only logical modules divided according to the specific functions implemented by them, and are not used to limit the specific implementation methods. For example, they can be implemented in software, hardware, or a combination of software and hardware. In actual implementation, the above-mentioned units can be implemented as independent physical entities, or can also be implemented by a single entity (for example, a processor (CPU or DSP, etc.), an integrated circuit, etc.). In addition, the above-mentioned units are shown with dotted lines in the drawings to indicate that these units may not actually exist, and the operations / functions implemented by them can be implemented by the processing circuit itself.

[0123] In addition, although not shown, the device may also include a memory, which may store various information generated by the device, various units contained in the device during operation, programs and data for operation, data to be sent by the communication unit, etc. The memory may be a volatile memory and / or a non-volatile memory. For example, the memory may include, but is not limited to, a random access memory (RAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a read-only memory (ROM), and a flash memory. Of course, the memory may also be located outside the device. Optionally, although not shown, the device may also include a communication unit, which may be used to communicate with other devices. In one example, the communication unit may be implemented in a suitable manner known in the art, such as including communication components such as an antenna array and / or a radio frequency link, various types of interfaces, communication units, etc. It will not be described in detail here. In addition, the device may also include other components not shown, such as a radio frequency link, a baseband processing unit, a network interface, a processor, a controller, etc. It will not be described in detail here.

[0124] Some embodiments of the present disclosure also provide an electronic device. Figure 8A schematic diagram of the structure of an electronic device according to some embodiments of the present disclosure is shown. For example, in some embodiments, the electronic device 8 can be various types of devices, for example, can include but are not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. For example, the electronic device 8 can include a display panel for displaying data and / or execution results used in the scheme according to the present disclosure. For example, the display panel can be in various shapes, such as a rectangular panel, an elliptical panel, or a polygonal panel, etc. In addition, the display panel can be not only a flat panel, but also a curved panel, or even a spherical panel.

[0125] like Figure 8 As shown, the electronic device 8 of this embodiment includes: a memory 81 and a processor 82 coupled to the memory 81. It should be noted that Figure 8 The components of the electronic device 8 shown are only exemplary and non-restrictive. The electronic device 8 may also have other components according to actual application requirements. The processor 82 may control other components in the electronic device 8 to perform desired functions.

[0126] In some embodiments, the memory 81 is used to store one or more computer-readable instructions. When the processor 82 is used to execute the computer-readable instructions, the computer-readable instructions are executed by the processor 82 to implement the method according to any of the above embodiments. For the specific implementation of each step of the method and the related explanation content, please refer to the above embodiments, and the repetition will not be repeated here.

[0127] For example, the processor 82 and the memory 81 may communicate with each other directly or indirectly. For example, the processor 82 and the memory 81 may communicate with each other through a network. The network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network. The processor 82 and the memory 81 may also communicate with each other through a system bus, which is not limited by the present disclosure.

[0128] For example, the processor 82 may be embodied as various appropriate processors, processing devices, etc., such as a central processing unit (CPU), a graphics processing unit (GPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The central processing unit (CPU) may be an X86 or ARM architecture, etc. For example, the memory 81 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The memory 81 may include, for example, a system memory, which may store, for example, an operating system, an application, a boot loader, a database, and other programs. Various applications and various data may also be stored in the storage medium.

[0129] In addition, according to some embodiments of the present disclosure, various operations / processes according to the present disclosure, when implemented by software and / or firmware, can be transmitted from a storage medium or a network to a computer system having a dedicated hardware structure, such as Fig. 9 The computer system 90 shown installs the programs constituting the software, and when the various programs are installed, the computer system can execute various functions, including the functions described above. Fig. 9 A schematic diagram of the structure of a computer system according to some embodiments of the present disclosure is shown.

[0130] exist Fig. 9 In the embodiment, a central processing unit (CPU) 901 performs various processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage section 908 to a random access memory (RAM) 903. In the RAM 903, data required when the CPU 901 performs various processes, etc., is also stored as needed. The central processing unit is merely exemplary, and it may also be other types of processors, such as the various processors described above. The ROM 902, the RAM 903, and the storage section 908 may be various forms of computer-readable storage media, as described below. It should be noted that although Fig. 9 ROM 902, RAM 903 and storage device 908 are shown separately in the figure, but one or more of them may be combined or located in the same or different memory or storage modules.

[0131] The CPU 901, the ROM 902, and the RAM 903 are connected to one another via a bus 904. An input / output interface 905 is also connected to the bus 904.

[0132] The following components are connected to the input / output interface 905: an input section 909, such as a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output section 907, including a display, such as a cathode ray tube (CRT), a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage section 908, including a hard disk, a magnetic tape, etc.; and a communication section 909, including a network interface card such as a LAN card, a modem, etc. The communication section 909 allows communication processing to be performed via a network such as the Internet. It is easy to understand that although Fig. 9 The various devices or modules in the computer system 90 are shown to communicate via a bus 904, but they may also communicate via a network or other means, wherein the network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network.

[0133] A drive 910 is also connected to the input / output interface 905 as needed. A removable medium 911 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like is mounted on the drive 910 as needed so that a computer program read therefrom is installed into the storage section 908 as needed.

[0134] In the case where the above-described series of processing is realized by software, a program constituting the software can be installed from a network such as the Internet or a storage medium such as the removable medium 911 .

[0135] According to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by the CPU 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0136] It should be noted that in the context of the present disclosure, a computer-readable medium may be a tangible medium that may contain or store a program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. A computer-readable storage medium may be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that may be used by an instruction execution system, device or device or used in combination with it. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0137] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0138] In some embodiments, a computer program is further provided, comprising: instructions, which, when executed by a processor, cause the processor to execute any of the methods of the above embodiments. For example, the instructions may be embodied as computer program codes.

[0139] In embodiments of the present disclosure, computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or combinations thereof, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In situations involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0140] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0141] The modules, components or units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the names of the modules, components or units do not, in some cases, limit the modules, components or units themselves.

[0142] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0143] The above descriptions are only some embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, a technical solution formed by replacing the above features with the technical features with similar functions disclosed in the present disclosure (but not limited to).

[0144] In the description provided herein, many specific details are set forth. However, it is understood that embodiments of the present invention can be implemented without these specific details. In other cases, well-known methods, structures, and techniques are not presented in detail in order not to obscure the understanding of the description.

[0145] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0146] Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It should be understood by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A conversation method, comprising: On a client of a first user, displaying a first conversation between the first user and a second user; Based on the information of the first conversation, calling one or more robots for the first user; Based on the first dialogue, generating auxiliary dialogue information of the robot; The auxiliary dialogue information is displayed.

2. The conversation method according to claim 1, wherein: The auxiliary dialogue information is information sent by the robot during the process of the robot participating in the dialogue between the first user and the second user; or The auxiliary dialogue information is information provided to the first user for reference.

3. The dialogue method according to claim 1 or 2, wherein: The calling one or more robots for the first user based on the information of the first conversation includes: Determining a conversation scenario between the first user and the second user based on the information of the first conversation; In response to the conversation scenario belonging to the first type, invoking one or more robots for the first user to participate in a conversation between the first user and a second user; In response to the dialogue scenario belonging to the second type, one or more robots for providing reference information are called for the first user.

4. The dialogue method according to any one of claims 1 to 3, wherein: The information of the first conversation includes semantic information, and calling one or more robots for the first user based on the information of the first conversation includes: Determining one or more robots corresponding to the first conversation based on the semantic information of the first conversation; One or more robots corresponding to the first conversation are called for the first user.

5. The conversation method according to claim 4, further comprising: The last conversations generated in the first conversation and the specified number of conversations are used as target conversations, or the last conversations generated in the first conversation and the specified time period are used as target conversations, or the conversations belonging to the same topic in the first conversation are used as target conversations; Based on the target dialog, semantic information of the first dialog is determined.

6. The dialogue method according to claim 4 or 5, further comprising: Determining a topic involved in one or more conversation rounds in the first conversation; In response to the number of topics involved in the one or more rounds of dialogue being not greater than a specified value, the summary information of the first dialogue is determined as the semantic information of the first dialogue.

7. The dialogue method according to any one of claims 4 to 6, wherein: Also includes: Key information is extracted from the first conversation as semantic information of the first conversation.

8. The dialogue method according to any one of claims 4 to 7, wherein: The determining, based on the semantic information of the first conversation, one or more robots corresponding to the first conversation comprises: In response to the number of topics involved in the semantic information being greater than a specified value, or the semantic information involved in the first dialogue being unclear, determining the dialogue guiding robot as a robot corresponding to the first dialogue; In response to the number of topics involved in the semantic information being no greater than the specified value, the semantic information of the first conversation is matched with attributes of one or more candidate robots, and one or more robots corresponding to the first conversation are determined based on the matching results.

9. The dialogue method according to any one of claims 1 to 8, wherein: The information of the first conversation includes a category of the second user, and calling one or more robots for the first user based on the information of the first conversation includes: In response to the second user's category being the designated category, a conversation guiding robot is called for the first user to participate in a conversation between the first user and the second user.

10. The dialogue method according to claim 8 or 9, wherein: The auxiliary dialogue information is a message sent by the dialogue guiding robot in the process of participating in the dialogue, and the generating of the auxiliary dialogue information of the robot includes: generating association information of the semantic information based on the semantic information of the first conversation and the second conversation, and the information of the first user and the second user; Based on the associated information, a message sent by the dialogue guiding robot is generated.

11. The dialogue method according to any one of claims 1 to 10, wherein: The information of the first conversation includes conversation time, and calling one or more robots for the first user based on the information of the first conversation includes: In response to the last conversation in the first conversation being sent by the second user and the sending time of the last conversation exceeding a specified threshold from the current time, calling a robot that is a virtual avatar of the first user to reply to the second user.

12. The dialogue method according to claim 11, wherein: The avatar of the virtual avatar robot is generated according to the picture specified by the first user, and the voice of the virtual avatar robot is generated according to the voice specified by the first user.

13. The dialogue method according to any one of claims 1 to 12, wherein: The calling one or more robots for the first user comprises: Displaying a first calling control of the robot corresponding to the first conversation; In response to the triggering operation of the first user on the first calling control, the auxiliary dialogue information is triggered to be generated.

14. The dialogue method according to claim 13, wherein: The calling control includes instruction information for the robot generated according to the semantic information of the first dialogue, and the triggering of generating the auxiliary dialogue information includes: In response to the triggering operation of the first user on the first calling control, the auxiliary dialogue information is generated according to the indication information and the first dialogue.

15. The dialogue method according to claim 13 or 14, wherein: The auxiliary dialogue information includes at least one of: reference information associated with the first dialogue, a summary of the first dialogue, and a reply to the second user.

16. The dialog method according to any one of claims 1 to 15, further comprising: A second conversation sent by the first user is displayed, wherein the second conversation is determined based on the auxiliary conversation information, and the auxiliary conversation information is not visible to the second user.

17. The dialogue method according to any one of claims 1 to 16, wherein: The displaying of the auxiliary dialogue information comprises: On the conversation interface between the first user and the second user, the auxiliary conversation information sent by the robot participating in the conversation between the first user and the second user is displayed.

18. The dialogue method according to any one of claims 1 to 17, wherein: The generating the auxiliary dialogue information of the robot based on the first dialogue comprises: In response to the first conversation corresponding to the service intention, the auxiliary conversation information including at least one of a product card and a service subscription card is generated.

19. The dialog method according to any one of claims 1 to 18, further comprising: In response to the first user's operation of calling a robot, a robot determined based on the information of the first conversation or a robot specified by the operation is displayed.

20. The dialog method according to any one of claims 1 to 19, further comprising: displaying a second call control corresponding to the candidate robot; In response to a triggering operation on the second call control, a reply of the candidate robot to the first dialogue is displayed.

21. A conversation device, comprising: A first display module is configured to display a first conversation between the first user and a second user on a client of the first user; a calling module, configured to call one or more robots for the first user based on information of the first conversation; A generating module, configured to generate auxiliary dialogue information of the one or more robots based on the first dialogue; The second display module is configured to display the auxiliary dialogue information.

22. An electronic device comprising: Memory; as well as A processor coupled to the memory, the processor being configured to execute the dialog method according to any one of claims 1 to 20 based on instructions stored in the memory.

23. A computer-readable storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the dialog method according to any one of claims 1 to 20 is implemented.

24. A computer program product, when the computer program product is run on a computer, enables the computer to implement the dialogue method according to any one of claims 1 to 20.

25. A computer program comprising: Instructions which, when executed by a processor, cause the processor to perform the dialog method according to any one of claims 1 to 20.

Images