Interaction method, intelligent terminal and storage medium

Abstract

The invention provides an interaction method, an intelligent terminal and a storage medium. The interaction method comprises the following steps: S11, in response to a preset event, determining a target role and / or response voice of a voice assistant; on the basis, the voice assistant can be triggered through the preset event to automatically switch roles in the interaction process, for example, along with different text contents of users or voices, the voice assistant can be switched to an adaptive target role, so that personalized interaction of voice interaction is improved, and the use experience of the users is improved.

Description

Technical Field

[0001] The present application relates to the field of speech recognition, and in particular to an interaction method, an intelligent terminal and a storage medium. Background Art

[0002] When a voice assistant interacts with a user, the same smart terminal or the same voice assistant performing the interaction usually has only one role, and this single-role interaction method tends to appear monotonous.

[0003] In the process of conceiving and implementing this application, the inventors found that there are at least the following problems: during the interaction process, users have the need to switch the role of the voice assistant. For example, different users have the interaction needs of corresponding roles. For example, even if the same user is in different dialogue scenarios, it is expected that the voice assistant can automatically switch to different roles according to the needs. However, the existing voice assistants will not switch roles according to the different users or the text content of the voice, resulting in a poor user experience. When the user expects the voice assistant to switch roles, the following two methods are mainly used: first, the user explicitly issues a command to switch roles to control the voice assistant to switch to the role selected by the user; second, the user's feature information is obtained to match the role of the voice assistant corresponding to this. However, these two methods only determine the role that needs to be switched before the interaction and make the voice assistant switch to the role. The role will not be automatically switched during the interaction, which limits the personalized interaction of voice interaction and affects the user experience.

[0004] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the invention

[0005] In response to the above technical problems, the present application provides an interaction method, an intelligent terminal and a storage medium, which can enable the voice assistant to automatically switch roles during the interaction process, improve the personalized interaction of voice interaction, and enhance the user experience.

[0006] The present application provides an interactive method, which is applied to a smart terminal and includes the following steps:

[0007] S11, in response to a preset event, determining a target role and / or a response voice of the voice assistant.

[0008] Optionally, the preset event includes at least one of the following:

[0009] The text content of the user's voice pauses;

[0010] The first user switches to the second user to issue a user voice;

[0011] Voice call events;

[0012] A target scene and / or target object having a preset association relationship with the user's voice.

[0013] Optionally, the preset association relationship includes at least one of the following:

[0014] Having a textual logical relationship with the text content of the user's speech;

[0015] A mapping relationship between the pre-set text content of the user's speech and the target scene;

[0016] A mapping relationship between the text content of the user's speech and the target object;

[0017] Pre-set mapping relationship between users and target scenarios;

[0018] A pre-defined mapping relationship between users and target objects.

[0019] Optionally, determining the target role of the voice assistant includes at least one of the following:

[0020] According to the text content of the user's voice, determine the character with the highest matching degree as the target character;

[0021] Determine the target role of the voice assistant based on user instructions;

[0022] Determine the target role of the voice assistant based on the current scene information and / or historical interaction information.

[0023] Optionally, the determining the response voice includes:

[0024] Determine characteristic information of the answering voice according to at least one of the working mode of the intelligent terminal, the user role, the historical interaction information and the preset characteristics of the user voice;

[0025] Determine the text content of the response;

[0026] A response voice is generated according to the feature information of the response voice and the text content.

[0027] Optionally, the text content of the determined response includes:

[0028] Obtain the industry colloquial particles of the target role through a preset AI model;

[0029] Generate text content of the response based on the industry colloquial particles.

[0030] Optionally, the text content of the response generated according to the industry colloquial particle includes at least one of the following:

[0031] Inserting the industry colloquial particle at a pause point in the text content of the response;

[0032] The preset AI model is used to learn the sentence interval when the text content of the response is converted into speech, and the industry spoken auxiliary words are inserted into the sentence interval exceeding the preset threshold.

[0033] Optionally, the method further includes:

[0034] The user is marked according to the text content of the user's voice and / or the historical interaction information between the user and the smart terminal.

[0035] Optionally, the method further includes:

[0036] The output result of the target character and / or the response voice, and the user voice are backed up and stored.

[0037] Optionally, the method further includes:

[0038] In response to schedule information being recognized from the output result of the target character and / or the response voice, and the user voice, a schedule is created.

[0039] The present application also provides an intelligent terminal, including a memory and a processor, wherein a message display program is stored in the memory, and when the message display program is executed by the processor, the steps of any of the above interaction methods are implemented.

[0040] The present application also provides a storage medium storing a computer program, wherein the computer program implements the steps of any of the above interaction methods when executed by a processor.

[0041] As described above, the technical solution of the present application includes: determining the target role and / or response voice of the voice assistant in response to a preset event. The present application can trigger the voice assistant to automatically switch roles during the interaction process through preset events. For example, as the user or the text content of the voice is different, the voice assistant will switch to an adapted target role, thereby improving the personalized interaction of the voice interaction and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments of the present application, and together with the specification, are used to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

[0043] Figure 1 A schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application;

[0044] Figure 2A communication network system architecture diagram provided for an embodiment of the present application;

[0045] Figure 3 A flowchart of an interaction method provided in the first embodiment of the present application;

[0046] FIG. 4( a ) and FIG. 4( b ) are schematic diagrams showing the display of voice assistants of two APPs on different smart terminals on the running interface of one of the APPs;

[0047] Figure 5a A schematic diagram of interaction based on a called event provided in the first embodiment of the present application;

[0048] Figure 5b Another interactive diagram based on a called event provided in the first embodiment of the present application;

[0049] Figure 6 A schematic diagram of a process for determining a response voice provided in the first embodiment of the present application;

[0050] Figure 7 A flowchart of an interaction method provided in the second embodiment of the present application;

[0051] Figure 8 A flowchart of another interactive method provided in the second embodiment of the present application;

[0052] FIG. 9( a ) and FIG. 9( b ) are schematic diagrams showing the display of two voice assistants of different smart terminals on the interface of one of the smart terminals.

[0053] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0054] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0055] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0056] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0057] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0058] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0059] It should be noted that in this article, step codes such as S22 and S23 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the sequence. When implementing the step, those skilled in the art may execute S23 first and then S22, etc., but these should all be within the scope of protection of this application.

[0060] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0061] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0062] The smart terminal may be implemented in various forms. For example, the smart terminal described in this application may include smart terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0063] The following description will be made by taking a mobile terminal as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to fixed-type terminals.

[0064] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application, the mobile terminal 100 may include: RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0065] Combine the following Figure 1 The following is a detailed introduction to the various components of the mobile terminal:

[0066] The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communications can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution), 5G and 6G, etc.

[0067] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the mobile terminal and can be omitted as needed without changing the essence of the invention.

[0068] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0069] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and other operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.

[0070] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0071] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0072] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1071 or near the touch panel 1071 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 110, and can receive and execute the command sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.

[0073] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the mobile terminal, which is not limited here.

[0074] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.

[0075] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0076] The processor 110 is the control center of the mobile terminal. It uses various interfaces and lines to connect various parts of the entire mobile terminal. It executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0077] The mobile terminal 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0078] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.

[0079] In order to facilitate understanding of the embodiments of the present application, the communication network system on which the mobile terminal of the present application is based is described below.

[0080] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.

[0081] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.

[0082] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 , etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 may provide UE 201 with access to EPC 203 .

[0083] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving Gate Way) 2034, PGW (PDN Gate Way) 2035 and PCRF (Policy and Charging Rules Function) 2036, etc. Optionally, MME 2031 is a control node that processes signaling between UE 201 and EPC 203, and provides bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and store some user-specific information such as service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide IP address allocation and other functions for UE 201, PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources, which selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0084] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem) or other IP services.

[0085] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation here.

[0086] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

[0087] First embodiment

[0088] Figure 3 An interaction method is provided for the first embodiment of the present application. The execution subject of the interaction method can be a smart terminal such as a mobile phone, a wearable device, and at least one of a voice assistant, a processor, a storage medium, etc. with a voice interaction function. The voice assistant includes but is not limited to the voice interaction programs that come with various smart terminals based on the operating system, such as Siri of Apple smart terminals, Xiaoai Voice of Android smart terminals, Xiaoyi Voice of Hongmeng smart terminals, Zebra Voice of various domestic car machines, etc., as well as the voice interaction programs of various APPs installed on the smart terminals.

[0089] Optionally, the voice assistant of each APP is only applicable to the interaction between the user and the APP; or, the voice interaction is linked with the voice assistants of other APPs according to the user settings. For example, the user sets the voice assistants of the first APP and the second APP to have a linkage relationship. Then, the user can directly send voice instructions to control the second APP through the voice assistant of the first APP (referred to as the "first voice assistant") to the voice assistant of the second APP (referred to as the "second voice assistant"). As shown in Figure 4(a) and Figure 4(b), the first APP can directly display the icon of the "second voice assistant", and the voice instructions sent by the user through the first APP are received by the "second voice assistant", and the icon of the "first voice assistant" can be displayed at the same time as the icon of the "second voice assistant" is displayed, or it can not be displayed, and / or the "first voice assistant" continues to monitor and recognize the voice instructions, or it can not monitor or recognize them. For example, when the first APP and the second APP are installed on two smart terminals respectively, the user can issue a voice command through only one of the smart terminals. As shown in Figure 4(b), the icons of "first voice assistant" and "second voice assistant" can be displayed simultaneously on the running interface of the first APP. The voice command includes content that needs to be executed by the first APP and also includes content that needs to be executed by the second APP. Then, the first APP of one of the smart terminals executes the corresponding operation, and the second APP of the other smart terminal executes the corresponding operation.

[0090] The user can set a preset relationship between the two smart terminals to thereby set a linkage relationship between the voice assistants of the two APPs. The preset relationship includes but is not limited to at least one of the following: a connection relationship established based on near-field communication technologies such as Bluetooth, a connection relationship established based on far-field communication technologies such as cellular networks, a connection relationship established based on authentication, a master-slave control or information sending and receiving relationship formed according to custom rules and located in the same local area network and the same Internet of Things group.

[0091] The voice command may be specifically manifested as a sound produced by a user's speech, or a sound in the form of an analog signal produced by a tool such as an electronic device, such as an artificially synthesized sound.

[0092] For ease of explanation and understanding, unless otherwise specified, the following description of this application takes the scenario of a user interacting with a voice assistant that comes with the operating system of a smart terminal as an example.

[0093] like Figure 3 As shown, the interaction method includes step S11.

[0094] S11: In response to a preset event, determining a target role and / or a response voice of the voice assistant.

[0095] In one example, the preset event can be expressed as one or more events, which can be a special event for implementing the present application, which is different from the existing event that triggers the smart terminal, so that at least any event can be avoided from conflicting with existing events that perform other functions (including personalized events set by the user). For example, step S11 can be performed only when entering the preset mode and / or turning on the preset function option, so as to avoid conflicts with existing events that perform other functions. For example, only when the preset mode is turned on in the setting interface, the preset event is deemed valid and the corresponding steps are triggered. In this regard, the user can also perform different functions by implementing the same event more conveniently and quickly, that is, multiplexing the events that perform other functions. For example, when entering the preset mode, an incoming call (i.e., a preset event) can trigger the execution of step S11, and when not entering the preset mode, the incoming call can only be performed in a traditional way, such as automatically hanging up if no one answers the call for a long time, and the function of the preset event cannot be realized.

[0096] For example, for scenarios applicable to smart terminals, this example is equivalent to adding a quick message viewing function to the smart terminal. The implementation of this function includes, but is not limited to: taking a smart phone as an example, pre-programming a script or application and installing it in the operating system of the smart phone, thereby adding a "quick message viewing" option in the setting interface of the operating system of the smart phone and / or the setting interface of the voice assistant; then, by sliding the slider to turn on or off the option, the function can be turned on or off accordingly. Alternatively, the smart terminal can set an APP on the main interface alone, through which the corresponding control function can be turned on and off, as well as the detailed setting of any one or more events including preset events. After turning on this function option, the smart terminal can allow the user to set an event on the display interface, so as to check whether the detected event is consistent with the set event in the subsequent process. If consistent, step S11 is triggered, and if inconsistent, step S11 is not triggered.

[0097] In another example, the preset event is not an existing event for executing other functions, but is only a special event for this application. Optionally, this application combines the preset event with the current interface to determine whether to trigger the execution of step S11. For example, if the current interface is an interface that the voice assistant has opened (referred to as the "running interface"), once the preset event is detected as an existing event for executing other functions, step S11 is triggered; if the current interface is not the running interface of the voice assistant, the preset event is detected as an existing event for executing other functions, and step S11 is not triggered, but other functions corresponding to the existing event are executed; and if the preset event is detected as a special event for this application, it is not considered whether the current interface is the running interface of the voice assistant, and step S11 is directly triggered.

[0098] The specific manifestation of any event including the preset event is not limited in this application. The following description is made by taking the preset event including at least one of events 1 to 4 as an example.

[0099] Event 1: The text content of the user's voice pauses.

[0100] The pause point can be understood as a sentence segmentation mark, and the present application can identify the pause point through natural language processing (NLP) technology. In actual scenarios, each detection of a pause point can indicate that the user has finished speaking a sentence, which can trigger the determination of the target role and / or response voice of the voice assistant.

[0101] Event 2: The first user switches to the second user and speaks a user voice.

[0102] The present application can determine whether the speaking user has changed by identifying the voiceprint feature information of the current sound. If so, the object of the user's voice has changed, which triggers the determination of the target role and / or response voice of the voice assistant.

[0103] Event 3: Voice call event.

[0104] The voice call event includes but is not limited to at least one of an incoming call event and a called event of a call or chat APP. Figure 5a and Figure 5b As shown, when a mobile phone calls, if the user does not answer within a preset time, the intelligent terminal automatically activates and runs the voice assistant, and triggers the determination of the target role and / or answering voice of the voice assistant. Optionally, after answering, the user voice (i.e., the caller's speech) and the text content of the answering voice will be displayed in the following manner according to the conversation sequence. Figure 5a and Figure 5bOn the interface of the smart terminal shown (i.e., the call interface); if the user actively answers the call within the preset time, the call can be conducted in a traditional way. Optionally, during the call, the voice assistant can also run and monitor the process in real time, and intervene according to user instructions. For example, the voice assistant queries other information such as schedule and broadcasts it.

[0105] This application can be run in offline mode. Through the voice assistant based on the offline large model, functions such as answering calls on behalf of others and automatic replying can be realized, which significantly improves call efficiency. At the same time, offline processing can ensure user privacy and security, avoid privacy issues that may be involved in real-time calls, and provide better practices for the terminal application of the offline large model voice assistant, ensuring the stability and scalability of the terminal system.

[0106] Event 4: a target scene and / or target object that has a preset association relationship with the user's voice.

[0107] The target scenario can be used to associate the voice assistant's interactions with different scenarios, and the target object can be used to associate the voice assistant's interactions with different users, thereby improving the accuracy of voice interaction.

[0108] For example, the text content of the user's voice is "xxx bought a house a few days ago and is now preparing to renovate it." Although the word "renovation" appears, it is difficult for the voice assistant to determine whether the user wants to ask questions about renovation. At this time, event 4 is used to introduce the target scene. For example, the smart terminal can automatically turn on the 3D radar scanning function of the rear camera to scan the current scene. If it is detected that the current location is indoors, it means that the user wants to ask questions about renovation, which triggers the voice assistant to determine the corresponding target role-renovation consultant.

[0109] For another example, when a sound is detected (the sound is the "user voice"), the voiceprint feature information of the sound can be detected to determine whether it is emitted by the target user (i.e., the "target object"); if so, the voice assistant is triggered to determine the target role and / or the response voice; if not, for example, if the sound is recognized to be emitted by the TV, or emitted by user A instead of the target user B, the sound is ignored. In this way, the accuracy and privacy security of voice interaction can be improved.

[0110] Optionally, the preset association relationship includes at least one of the following:

[0111] Relationship 1: has a textual logical relationship with the text content of the user's voice.

[0112] For example, the text content of the user's voice is "How do I plan to renovate a house?" The word "renovation" has a textual logical relationship with the house scene. The smart terminal can automatically turn on the 3D radar scanning function of the rear camera to scan the current scene. If it detects that the user is currently indoors, it means that the user wants to ask questions about renovation. The voice assistant then determines the corresponding target role - renovation consultant.

[0113] Different from the relationship 1 which is a relationship automatically determined based on natural speech processing technology, the following relationships 2 to 5 may be relationships preset manually.

[0114] Relationship 2: A mapping relationship between the pre-set text content of the user's speech and the target scene.

[0115] Relationship 3: A mapping relationship between the pre-set text content of the user's speech and the target object.

[0116] For example, the text content of the user's voice is "Are you going home for dinner on Saturday?" At this time, the voice assistant detects that the person making the user's voice is "father", and there is a preset mapping relationship between father and home. The voice assistant then determines the target role and / or the response voice.

[0117] Relationship 4: A pre-set mapping relationship between a user and a scene and / or a user and an object.

[0118] Relationship 5: A pre-set mapping relationship between a user and a target object.

[0119] For example, when a user voice is detected, the user who makes the user voice is the target object (i.e., it meets the pre-set mapping relationship between the user and the target object), and / or the 3D radar scan of the rear camera shows that the current scene is the house where the user who makes the user voice lives (i.e., it meets the pre-set mapping relationship between the user and the scene), then the voice assistant is automatically triggered and run, and the target role and / or response voice is determined.

[0120] It should be noted that the embodiments of the present application include multiple situations and multiple feasible implementation methods for a certain technical feature. Unless otherwise specified, it means that the corresponding technical feature can be implemented by combining any part of the methods. For example, the above relationship 1 can be combined with any one of relationships 2 to 5. Through the combination scheme, the corresponding technical feature can be implemented more accurately and / or intelligently, thereby improving the accuracy of the implementation of the technical feature and the user experience.

[0121] It should be understood that the preset event does not necessarily include user voice, that is, the target role and / or response voice of the voice assistant does not necessarily have to be determined based on the detected user voice. For example, in the scenario where the preset event is the above-mentioned called event, once the called event is detected, the voice assistant can determine the target role and / or answering voice according to the caller of the called event. Taking the call from the takeaway as an example, the voice assistant can automatically answer the call and determine the target role as the user of the smart terminal according to the historical interaction information (i.e., the previously identified call voice of the user of the smart terminal, the identification of the caller number, etc.), which can of course also be a common smart robot. Note that at this time, the takeaway does not need to issue any "user voice" to indicate the identity, and the voice assistant can automatically reply "Hello, please put it in the express cabinet in Building 1"; taking the father's call as an example, when the call is not answered after the preset time, the voice assistant can automatically answer the call and determine the target role as the user of the smart terminal according to the historical interaction information (i.e., the previously identified call voice of the user of the smart terminal), and make a personalized reply according to the calling habits, timbre, and communication tone habits of the user of the smart terminal with the caller (i.e., the father). This personalized reply can refer to the more mature dialogue technology in the field of voice interaction, which will not be repeated here.

[0122] Each role of the voice assistant has professional skills and knowledge corresponding to the role, and can provide operations and dialogues that match the role. The voice assistant can be an AI (Artificial Intelligence) assistant, and the roles it contains can include existing professional roles. For example, traditional decoration consultants, decoration designers, intellectual property lawyers, etc., can also include user-defined roles, such as the user of the smart terminal, love experts, fairy tale masters, etc. synthesized by the voice assistant imitating learning. In step S11, the method of determining the target role of the voice assistant may include at least one of the following:

[0123] Method 1: According to the text content of the user's voice, determine the character with the highest matching degree as the target character.

[0124] The user's voice is analyzed through natural language processing technology to obtain text content, which is mainly used to determine the user's intention. Therefore, keywords in the text content are extracted to determine the corresponding role according to the keywords as a candidate role.

[0125] When only one candidate role is determined, the candidate role is directly used as the target role.

[0126] When there are multiple candidate roles, for example, the text content is "The house that needs to be renovated has three bedrooms and one living room, and I like to watch movies and play games at home", based on the keywords "renovation", "watching movies", and "playing games", three candidate roles are determined - decoration consultant, movie master, and e-sports consultant. Then, the preset rules can be used to determine which one has the highest matching degree. The preset rules can be the degree of correlation between the context of the user's voice. For example, if the previous sentence between the user and the voice assistant contains "renovation", it is determined that "watching movies" and "playing games" are only for the convenience of leisure and entertainment needs that need to be preferred during renovation. At this time, the decoration consultant has the highest matching degree, that is, it is used as the target role.

[0127] In other examples, when multiple candidate roles are determined, they can be used as the target roles of the voice assistant in order of high to low matching degree; optionally, these target roles can play response voices in order of high to low matching degree. Taking the three roles mentioned above as an example, after the decoration consultant finishes speaking, the movie master can give feedback "xxx movie was recently released, do you need to watch it?", and then the e-sports consultant can give feedback "Which game do you need to open to relax?" During the playback of these three roles, once the user's voice is detected, the voice assistant will no longer play the response voices of the remaining roles.

[0128] Method 2: Determine the target role of the voice assistant based on user instructions.

[0129] When multiple candidate roles are determined, the user selects at least one as the target role.

[0130] Method 3: Determine the target role of the voice assistant based on the current scene information and / or historical interaction information.

[0131] For example, when the candidate roles determined are decoration consultant and decoration designer, the smart terminal can automatically turn on the 3D radar scanning function of the rear camera. If the current indoor layout information can be scanned, "decoration designer" is selected as the target role of the voice assistant; if the current indoor layout information is not scanned, "decoration consultant" is selected as the target role of the voice assistant.

[0132] For another example, when a delivery man calls, the target role of the voice assistant can be determined based on historical interaction information (such as the tone of voice during the most recent conversation with the delivery man). For another example, if the historical interaction information shows that the most recent conversation with the delivery man was through an intelligent robot, then the target role this time is the intelligent robot; if the most recent conversation was with the current intelligent terminal user, then the target role this time is still the current intelligent terminal user.

[0133] Based on the above, the present application can trigger the voice assistant to automatically switch roles during the interaction process through preset events, thereby improving the personalized interaction of voice interaction and enhancing the user experience.

[0134] In one scenario, the smart terminal turns on the default assistant: "I am your assistant, how can I help you?" The user voice is "I want to renovate a house, how do I plan it?"; at this time, the target role is determined to be a decoration assistant, and the response voice is "I am a decoration consultant. How big is the house? Can you describe your daily life arrangements?" The user voice is "Wait a minute, it's noon. Please help me order a braised chicken to the company." At this time, the target role is determined to be a gourmet assistant, and the gourmet assistant executes the takeaway and feeds back to the user with the response voice "The takeaway has been ordered"; then, the user voice is "The house has three bedrooms and a living room, and I like to watch movies and play games at home." At this time, the target role is determined to be a decoration consultant, and the response voice is "xxxx."

[0135] In another scenario, the smart terminal turns on the default assistant: "I am your assistant, how can I help you?", and the user voice is "I had a conflict with my girlfriend today"; at this time, it can be determined that two voice assistants are obtained, one of the target roles is determined to be a love expert, and the response voice is "I suggest you calm down first, and then look for a solution", and the other target role is determined to be a story generation assistant, and the response voice is "Do you want me to tell you a happy little story?", followed by "Tell you a story", and the response voice of the target role "Story Generation Assistant" is "xxxxx".

[0136] Users do not need to manually select roles or provide detailed switching instructions. The voice assistant of this application can automatically switch roles and perform corresponding operations and dialogues to provide users with a more personalized and efficient experience and provide more appropriate services. In addition, users can easily talk and chat with multiple target roles, further improving the personalization and efficiency of interaction, and increasing user satisfaction.

[0137] In addition, unlike the traditional method of only needing to determine the text content and then generating a response voice with fixed voice feature information (i.e., the so-called speaking speed, intonation, emotion, etc.), in step S11, the feature information of the response voice is adaptively changed.

[0138] In one example, if Figure 6 As shown, the method of determining the answer voice includes:

[0139] S111: Determine feature information of the answering voice according to at least one of the working mode of the intelligent terminal, the user role, the historical interaction information, and the preset features of the user voice;

[0140] S112: Determine the text content of the response; and,

[0141] S113: Generate a response voice according to the feature information and text content of the response voice.

[0142] In step S111, the preset characteristic information may include at least one factor of the user's voice text content, voiceprint characteristic information, speech speed, intonation, emotional characteristic information, etc. The user's voice is analyzed by natural language processing technology to extract the preset characteristic information and determine the characteristic information of the answering voice.

[0143] The working mode of the smart terminal may include but is not limited to at least one of the conference mode, do not disturb mode, outdoor mode, etc. Taking the conference mode as an example, when an incoming call is detected, the smart terminal can automatically answer the call, and the voice assistant determines the target role of "smart robot of predetermined gender", and uses the voice feature information corresponding to the smart robot as the feature information of the answering voice. The predetermined gender can be confirmed from the historical interaction information (i.e., the gender of the user of the smart terminal learned in advance).

[0144] The user role may be the role of the user who issues the user voice, such as the role of the user of the smart terminal. For example, when an incoming call from "father" is detected, the user role is determined to be "son", thereby determining that the characteristic information of the answering voice tends to be respectful, playful, etc.

[0145] The preset features of the user's voice include but are not limited to at least one factor of the user's voice, such as text content, voiceprint feature information, speaking speed, intonation, and emotional feature information.

[0146] In one example, step S111 may obtain the industry colloquial particles of the target role through a preset AI model, and generate the text content of the response according to the industry colloquial particles.

[0147] Taking the preset feature as speech speed as an example, the intelligent terminal can detect the current speech speed of the user's voice, and analyze the difference between the current speech speed and the speech speed of the AI ​​voice assistant (i.e., the target role) in real time, and compare the difference with the corresponding preset threshold; if the difference exceeds the first preset threshold, it means that the speech speed of the AI ​​voice assistant is too slow, then the speech speed of the AI ​​voice assistant is increased; if the difference is less than the second preset threshold, and the second preset threshold is less than the first preset threshold, it means that the speech speed of the AI ​​voice assistant is too fast, then the speech speed of the AI ​​voice assistant can be reduced, or the AI ​​voice assistant inserts common colloquial particles in the conversation to reduce the speech speed of the AI ​​voice assistant, thereby forming the text content of the answer determined in step S112. The industry colloquial particles include but are not limited to the common colloquial particles in the industry where the target role is located, which can be learned by the AI ​​model from the daily communication between multiple industry personnel and consumer groups, for example, "boss", "beautiful girl", "tastes great".

[0148] The method of generating the text content of the response according to the industry colloquial particles may include at least one of the following:

[0149] Method 1: Insert industry colloquial particles at pause points in the text content of the response.

[0150] For example, the AI ​​voice assistant can first identify the pause points of the text content of the response, and insert the industry colloquial particle into the corresponding pause points. The AI ​​voice assistant can determine the pause points by identifying the punctuation marks in the text content, such as inserting the industry colloquial particle after the period or exclamation mark when a period or exclamation mark is identified; or, by learning the pauses or sentence intervals when the text content of the response is converted into speech through a preset AI model, to determine the pause points.

[0151] Method 2: The preset AI model is used to learn the sentence interval when the text content of the response is converted into speech, and the industry colloquial particle is inserted in the sentence interval exceeding the preset threshold.

[0152] The characteristic information of the response voice of this application will change adaptively. For example, as the working mode of the smart terminal, user role, historical interaction information and / or user voice are different, the voice assistant will respond with an adaptive tone and emotion, thereby improving the personalized interaction of the voice interaction and enhancing the user experience.

[0153] Second embodiment

[0154] Combination Figure 7 As shown, the interaction method of the second embodiment includes the following steps:

[0155] S21: In response to a preset event, determining a target role and / or a response voice of the voice assistant;

[0156] S22: backing up and storing the output result of the target character and / or the response voice, and the user voice;

[0157] S23: Labeling the user according to the text content of the user's voice and / or the historical interaction information between the user and the smart terminal.

[0158] The step S21 may correspond to the step S11 of the above embodiment, so the same features of this embodiment and the above embodiment can be referred to above and will not be repeated here. In addition, only one of the steps S22 and S23 may be executed, and when both are executed, the order may also be interchanged.

[0159] In step S23, combined Figure 5a and Figure 5b As shown, the output results of the voice assistant can be set with corresponding AI tags. For example, after the user finishes the meeting, the missed call records stored in backup can be viewed through the AI ​​tags. The user clicks to read the backup storage to achieve the purpose of playing the call recording of the corresponding person.

[0160] In step S23, taking an incoming call from an unknown number as an example, according to the call content of the caller (i.e., the text content of the user's voice) "You won 5 million yuan, I hope you can come to xxx to claim it", the unknown number is automatically marked as suspected fraud; taking an incoming call from a fixed number (for example, not stored in the smart terminal but a regular official phone number) as an example, the call content of the caller (i.e., the text content of the user's voice) is "We have a children's insurance product, if you need it, I can introduce it to you", and the historical interaction information between the user and the smart terminal is "By learning the user's user habits, it was found that the user purchased insurance not long ago", the fixed number and this voice interaction event are marked as harassment; if the historical interaction information between the user and the smart terminal is "By learning the user's user habits, it was found that the user recently studied related insurance products", the fixed number and this voice interaction event are not marked, or are marked as normal.

[0161] By identifying harassing calls and the latest fraud scenarios, this application can build a zero-harassment, anti-fraud call environment, which is conducive to improving the user's terminal usage privacy.

[0162] After step S22, Figure 8 As shown, it may also include S24: creating a schedule. That is, the intelligent terminal recognizes text information that can create a schedule from the backup storage results through natural language processing technology, and can automatically extract and create a schedule. For example, "xx asks you to go home at 12 o'clock to eat noodles" in the backup storage can be extracted as key information, and "xx" can be an associated party of the schedule.

[0163] Through backup storage, this application can provide users with a full-scenario intelligent experience, including risk identification, summary generation, and further derived personalized services.

[0164] In other examples, the schedule may be created directly in response to the output results of the target role and / or the response voice and the user voice recognition of the schedule information without the need for backup storage. For example, when the working mode of the smart terminal is the meeting mode, the voice assistant automatically answers the call from the father and replies "Dad, I'm in a meeting, what's the matter?" The father says "Don't forget the dinner at 'Harvest Day' on Sunday night", and the voice assistant automatically replies "OK"; optionally, after hanging up the phone, the voice assistant will display "The schedule for the Sunday dinner has been created" on the preset interface of the smart terminal (such as the current call interface), or play the response voice "The schedule for the Sunday dinner has been created".

[0165] Third embodiment

[0166] Based on the description of any of the above embodiments, the difference is that the preset event of the third embodiment includes receiving a control instruction of an associated device and / or a user voice. For ease of description, the associated device is referred to as the second smart terminal, and the smart terminal is referred to as the first smart terminal.

[0167] The user can set a preset relationship between the two smart terminals to thereby set a linkage relationship between the voice assistants of the two. The preset relationship includes but is not limited to at least one of the following: a connection relationship established based on near-field communication technologies such as Bluetooth, a connection relationship established based on far-field communication technologies such as cellular networks, a connection relationship established based on authentication, a master-slave control or information sending and receiving relationship formed according to custom rules and located in the same local area network and the same Internet of Things group.

[0168] In one example, after completing the setting of the linkage relationship, the user can send the user voice through the voice assistant of the first smart terminal (referred to as the "first voice assistant"), and the user voice is also received by the voice assistant of the second smart terminal (referred to as the "second voice assistant") at this time. As shown in Figure 9 (a) and Figure 9 (b), the first smart terminal can directly display the icon of the "second voice assistant", and the voice command sent by the user through the first smart terminal is received by the "second voice assistant", and the icon of the "first voice assistant" can be displayed at the same time as the icon of the "second voice assistant", or it can not be displayed, and / or, the "first voice assistant" continues to monitor and recognize the voice command, or it can not monitor or recognize it. For example, the user can only issue the user voice through the first smart terminal, as shown in Figure 9 (b), the icons of the "first voice assistant" and the "second voice assistant" can be displayed on the operation interface of the first smart terminal at the same time, and the user voice contains the content that needs to be executed by the first smart terminal and the content that needs to be executed by the second smart terminal, then the first smart terminal and the second smart terminal respectively perform corresponding operations. Here, the target role of the second voice assistant finally determined is the same as that of the first voice assistant, the text content of the response voice is different, but the feature information of the response voice can be the same.

[0169] An embodiment of the present application further provides an intelligent terminal, including a memory and a processor, wherein an interactive program is stored in the memory, and when the interactive program is executed by the processor, the steps of the interactive method in any of the above embodiments are implemented.

[0170] An embodiment of the present application further provides a storage medium having an interactive program stored thereon. When the interactive program is executed by a processor, the steps of the interactive method in any of the above embodiments are implemented.

[0171] In the embodiments of the smart terminal and storage medium provided in the present application, all technical features of any of the above-mentioned interaction method embodiments may be included, and therefore have corresponding beneficial effects. The expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods and will not be repeated here.

[0172] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the methods in the various possible implementation modes described above.

[0173] An embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store computer programs, and the processor is used to call and run the computer programs from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.

[0174] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0175] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0176] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0177] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0178] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.

[0179] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0180] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0181] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.

[0182] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. Computer instructions can be stored in a storage medium, or transmitted from one storage medium to another storage medium. For example, computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. Available media can be magnetic media, (e.g., floppy disk, storage disk, tape), optical media (e.g., DVD), or semiconductor media (e.g., solid-state storage disk Solid State Disk (SSD)), etc.

[0183] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. An interactive method, applied to an intelligent terminal, characterized in that: Includes steps: S11, in response to a preset event, determining a target role and / or a response voice of the voice assistant.

2. The method according to claim 1, characterized in that The preset event includes at least one of the following: The text content of the user's voice pauses; Switching from the first user to the second user to issue a user voice; Voice call events; A target scene and / or target object having a preset association relationship with the user's voice.

3. The method according to claim 2, characterized in that The preset association relationship includes at least one of the following: Having a textual logical relationship with the text content of the user's speech; A mapping relationship between the pre-set text content of the user's speech and the target scene; A mapping relationship between the text content of the user's speech and the target object; Pre-set mapping relationship between users and target scenarios; A pre-defined mapping relationship between users and target objects.

4. The method according to claim 1, characterized in that Determining the target role of the voice assistant includes at least one of the following: According to the text content of the user's voice, determine the character with the highest matching degree as the target character; Determine the target role of the voice assistant based on user instructions; Determine the target role of the voice assistant based on the current scene information and / or historical interaction information.

5. The method according to any one of claims 1 to 4, characterized in that The step of determining the response voice comprises: Determine characteristic information of the answering voice according to at least one of the working mode of the intelligent terminal, the user role, the historical interaction information and the preset characteristics of the user voice; Determine the text content of the response; A response voice is generated according to the feature information of the response voice and the text content.

6. The method according to claim 5, characterized in that The text content of the determination response includes: Acquire the industry colloquial particles of the target role through sampling of a preset AI model; Generate text content of the response based on the industry colloquial particles.

7. The method according to claim 6, characterized in that The text content of the response generated according to the industry colloquial particle includes at least one of the following: Inserting the industry colloquial particle at a pause point in the text content of the response; The preset AI model is used to learn the sentence interval when the text content of the response is converted into speech, and the industry spoken auxiliary words are inserted into the sentence interval exceeding the preset threshold.

8. The method according to any one of claims 1 to 4, characterized in that Also includes: The user is marked according to the text content of the user's voice and / or the historical interaction information between the user and the smart terminal.

9. An intelligent terminal, characterized in that: include: A memory and a processor, wherein a message display program is stored in the memory, and when the message display program is executed by the processor, the steps of the interaction method as described in any one of claims 1 to 8 are implemented.

10. A storage medium, characterized in that: The storage medium stores a computer program, which, when executed by a processor, implements the steps of the interaction method according to any one of claims 1 to 8.

Images