A method, device, electronic device and storage medium for voice interaction

Abstract

The present application discloses a method, device, electronic device and storage medium for voice interaction, and relates to the field of intelligent voice interaction. The specific implementation scheme is: the received voice information is recognized to obtain a recognition result. According to the recognition result, the target application is determined from the candidate applications that match the recognition result. A control instruction for the target application is generated according to the recognition result. The control instruction is sent to the target application so that the target application executes the control instruction. Through the above scheme, the target application can be automatically selected and opened according to the voice information to realize the control of the target application. The page of the opened target application meets the user's psychological expectations, thereby improving the accuracy of voice interaction.

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence, and in particular to the field of intelligent voice interaction. Background Art

[0002] Smart voice interaction devices with screens have appeared in more and more homes, and existing technologies only support relatively simple voice interactions, such as checking the weather and time, etc. When users have more complex needs such as shopping or searching, existing smart voice interaction devices with screens often have poor expressiveness. Summary of the invention

[0003] The embodiments of the present application provide a method, device, electronic device and storage medium for voice interaction to solve one or more technical problems in the prior art.

[0004] In a first aspect, the present application provides a method for voice interaction, comprising the following steps:

[0005] The received voice information is recognized to obtain a recognition result.

[0006] According to the recognition result, a target application is determined among candidate applications matching the recognition result.

[0007] Generate control instructions for the target application based on the recognition results.

[0008] The control instruction is sent to the target application so that the target application executes the control instruction.

[0009] Through the above solution, the target application can be automatically selected and opened according to the voice information, and the target application can be controlled, so that the page of the opened target application meets the user's psychological expectations and the accuracy of voice interaction is improved.

[0010] In a second aspect, the present application provides a voice interaction device, comprising the following components:

[0011] The voice information recognition module is used to recognize the received voice information and obtain the recognition result.

[0012] The target application determination module is used to determine the target application from the candidate applications matching the recognition result according to the recognition result.

[0013] The control instruction generation module is used to generate control instructions for the target application program according to the recognition result.

[0014] The control instruction sending module is used to send the control instruction to the target application so that the target application executes the control instruction.

[0015] In a third aspect, an embodiment of the present application provides an electronic device, including:

[0016] at least one processor; and

[0017] a memory communicatively connected to at least one processor; wherein,

[0018] The memory stores instructions that can be executed by at least one processor, and the instructions are executed by at least one processor so that the at least one processor can execute the method provided by any embodiment of the present application.

[0019] In a fourth aspect, an embodiment of the present application provides a non-transitory computer-readable storage medium storing computer instructions, where the computer instructions are used to enable a computer to execute a method provided by any embodiment of the present application.

[0020] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program / instructions, which, when executed by a processor, implement the method described in any embodiment of the present application.

[0021] Other effects of the above optional manner will be described below in conjunction with specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present application.

[0023] Figure 1 is a flow chart of a method for voice interaction according to an embodiment of the present application;

[0024] Figure 2 is a schematic diagram of an interactive interface presented after a target application is started according to an embodiment of the present application;

[0025] Figure 3 is a flow chart of a method for determining user usage habits according to an embodiment of the present application;

[0026] Figure 4 is a schematic diagram of a voice interaction device according to an embodiment of the present application;

[0027] Figure 5 is a schematic diagram of a target application determination module according to an embodiment of the present application;

[0028] Figure 6 It is a block diagram of an electronic device used to implement the voice interaction method of an embodiment of the present application. DETAILED DESCRIPTION

[0029] The following is a description of exemplary embodiments of the present application in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0030] like Figure 1 As shown, in one embodiment, a method for voice interaction is provided, comprising the following steps:

[0031] S101: Recognize the received voice information to obtain a recognition result.

[0032] S102: According to the recognition result, determine a target application from candidate applications matching the recognition result.

[0033] S103: Generate control instructions for the target application according to the recognition result.

[0034] S104: Send the control instruction to the target application so that the target application executes the control instruction.

[0035] The above method of the present application can be executed by the intelligent voice interaction device with screen or by the cloud server. Taking the execution of the cloud server as an example, when the intelligent voice interaction device with screen receives the voice information, it sends it to the cloud server. The cloud server recognizes it and obtains the recognition result. The recognition result may include relevant information of the user and / or the user's intention, etc.

[0036] The user-related information may include the user's identity, usage habits or preferences for candidate applications, etc.

[0037] The user's intention may include wake-up intention, query intention, etc.

[0038] For example, the voice information may be "Xiaodu, Xiaodu", in which case it can be determined that it is a wake-up intention, and the voice interaction mode can be entered.

[0039] For another example, the voice information may be "I want to buy rice". In this case, although the wake-up word is not included, it can be determined through intent recognition that the voice information is a voice interaction command issued by the user. Then, a shopping application matching the command can be controlled to open a rice query in response to the command.

[0040] In addition, the recognition result of the voice information may also be noise, such as environmental background sound or the user's phone voice, etc. In this case, no corresponding operation is performed.

[0041] The case where the recognition result is noise or wake-up intention is not described in detail in this embodiment.

[0042] According to the recognition result of the voice information, the candidate applications that match the recognition result can be determined, and the target application can be determined from the candidate applications. For example, the voice information can be "play songs from XXX's new album", and the corresponding recognition result is playing songs. Based on this, the music playing application can be determined as the candidate application. For another example, the voice information can be "I want to buy rice", and the corresponding recognition result is shopping. Based on this, the shopping application can be determined as the candidate application.

[0043] When multiple candidate applications matching the recognition result are pre-installed in the intelligent voice interaction device with a screen, one of them can be randomly selected as the determined target application.

[0044] In addition, the target application can be determined based on the usage habits of the current user. The usage habits can be candidate applications that the current user frequently opens, or objects that are frequently queried using candidate applications. For example, the current user frequently uses the first music playback candidate application to query and play songs by singer XXX, etc. For another example, the current user frequently uses the second shopping candidate application to query and purchase rice of brand X, etc. The above usage habits can be obtained through the operation records in the intelligent voice interaction device with a screen, or through the background server of the candidate application.

[0045] Taking shopping applications as candidate applications as an example, for example, when a plurality of shopping applications are pre-installed in the intelligent voice interaction device with a screen, the candidate applications frequently used by the current user can be used as target applications.

[0046] In addition, the target application may also be determined based on the characteristics of the candidate applications.

[0047] The characteristics of the candidate application may be limited-time free trials, shopping discounts and other activities launched by the candidate application.

[0048] Taking the candidate applications of music playback as an example, the first candidate application can be obtained by using web crawlers and other technologies for a limited-time free trial, and the first candidate application can be used as the target application. Alternatively, taking the candidate applications of shopping as an example, the promotional activities of each (shopping) candidate application can be obtained by using web crawlers and other technologies. For example, the promotional activity of the first candidate application is "40 off for rice over 200", and the promotional activity of the second candidate application is "10% off for rice". By comparison, the candidate application with strong promotion can be selected as the target application.

[0049] In addition, the target application may be determined based on the current user's usage habits and the characteristics of the candidate applications.

[0050] For example, the first scores of the two candidate applications are calculated based on the usage habits of the current user in the past month. The second scores of the two candidate applications are calculated based on the characteristics of the candidate applications. Furthermore, weights can be set for the user's usage habits and the characteristics of the candidate applications. Finally, the scores calculated using the weights are added together as the final scores of the two candidate applications. The candidate application with the higher final score is used as the target application.

[0051] When the target application is determined, the recognition result may be converted into an instruction recognizable by the target application, and the converted instruction may be sent to the target application.

[0052] For example, based on the user's voice information "I want to buy rice", it is confirmed that the user's query intention is to enter the page for buying rice. An instruction to control the target application to enter the page for buying rice can be directly generated.

[0053] Alternatively, a control instruction for controlling the target application program that meets the current user's purchasing habits may be generated based on the current user's frequent purchase of brand X rice. After receiving the control instruction that meets the current user's purchasing habits, the target application program may directly enter a page for purchasing rice, and place brand X rice in a prominent position on the page for purchasing rice, or display it in a highlighted manner.

[0054] Enter as Figure 2 After viewing the page for purchasing rice, you can also make a statement, such as "We found the following products for you, come and buy them."

[0055] Through the above solution, the target application can be automatically selected and opened according to the voice information, and the target application can be controlled, so that the page of the opened target application meets the user's psychological expectations and the accuracy of voice interaction is improved.

[0056] In one implementation, step S102 includes:

[0057] In the case where the recognition result includes the query intent and the user's usage habits, a target application matching the query intent is determined from the candidate applications according to the user's usage habits.

[0058] According to the voice information, the query intention and user usage habits of the current user can be obtained. For example, when the identity of the current user is determined according to the voice information, the operation record of the current user can be obtained. According to the operation record, the user's usage habits can be determined, so that the candidate application that meets the user's usage habits can be determined as the target application.

[0059] Take the query intent of shopping as an example. If multiple shopping applications are pre-installed in the intelligent voice interaction device with a screen, then all of the multiple shopping applications can be candidate applications. For example, if it is determined through the operation record that the user prefers to place an order from the first candidate application, the first candidate application can be determined as the target application.

[0060] Through the above solution, the target application can be determined in combination with the user's usage habits, so that the determined target application is more in line with the user's psychological expectations.

[0061] like Figure 3 As shown, in one embodiment, the method for determining the user's usage habits includes the following steps:

[0062] S301: Identify the current user based on voice information.

[0063] S302: Determine the user usage habits according to the time the current user browses the candidate application and / or according to the frequency with which the current user opens the candidate application.

[0064] A matching relationship between a user and a voiceprint can be established in advance. By performing voiceprint recognition on the voice information, the current user can be determined.

[0065] The current user's usage habits can be determined based on the current user's operation records. For example, the current user's usage habits can be determined based on the time the current user browses the candidate applications, the frequency with which the current user opens the candidate applications, etc. That is, the candidate applications that the user prefers can be determined.

[0066] Through the above solution, the target application can be determined more accurately in combination with the user's usage habits, so that the determined target application is more in line with the user's psychological expectations.

[0067] In one implementation, step S103 includes the following steps:

[0068] S1031: When the recognition result includes the query intent, generate a control instruction for the target application according to the query intent.

[0069] For example, based on the user's voice message "I want to buy rice", it can be confirmed that the user's query intention is to query the page for shopping rice. Then, an instruction to query the page for purchasing rice can be directly generated. The instruction can directly control the target application to perform corresponding operations.

[0070] In the traditional touch operation mode, the user needs to open the target application first, and then manually input "rice" so that the target application finally presents the page for purchasing rice. Alternatively, in the existing voice interaction mode, the user needs to use multiple rounds of interactions such as "open XXX application", "enter the non-staple food page", "view rice" to finally query the rice purchase page.

[0071] By adopting the above solution of the present application, not only can the target application be started, but also control instructions for the target application can be directly generated, thus simplifying the process of voice interaction and thus improving the user experience.

[0072] In one implementation, step S1031 further includes:

[0073] In the case where the recognition result includes the query intention and the user's usage habits, a control instruction for the target application that matches the user's usage habits is generated according to the intention.

[0074] For example, based on the user's voice message "I want to buy rice", it is confirmed that the user's query intention is to search for a page for shopping rice.

[0075] By recognizing the voice information, the current user can be identified. Then, by querying the operation record of the current user, the usage habits of the current user can be determined. Usage habits may include browsing history, shopping preferences, etc. For example, the current user has browsed or purchased brand A rice many times before, the current user has browsed or purchased rice produced in Northeast China many times, the current user has browsed or purchased rice with a price range of X1 yuan to X2 yuan many times, etc.

[0076] According to the user's usage habits, corresponding control instructions can be generated. For example, a purchase page for querying brand A rice, a purchase page for querying rice produced in Northeast China, or a purchase page for querying rice with a price range of X1 yuan to X2 yuan can be directly generated.

[0077] Through the above solution, control instructions for the target application can be generated according to the current user's usage habits, making the generated control instructions more intelligent and closer to the current user's real intention.

[0078] In one implementation, the target application is a shopping application.

[0079] Through the above solution, when the recognition result includes shopping intention, the target application that meets the shopping intention can be directly recommended to the user without the user performing other operations. The shopping needs of users on the intelligent voice interaction device with screen can be met more intelligently.

[0080] In addition, the received voice information may be continuously recognized, and when the recognition result is to adjust the display state of the target application, an instruction corresponding to the recognition result is sent to the target application.

[0081] Adjusting the display state of the target application may include entering the next page, returning to the previous page, returning to the home page, exiting the target application, etc. The above recognition results are converted into control instructions for the target application and sent to the target application. Thus, direct voice control of the target application can be achieved.

[0082] Through the above solution, the target application can be directly controlled by voice information. In particular, in the face of a target application that does not support voice information control, the above technical solution can also be used to upgrade it to an application that can respond to voice information control.

[0083] like Figure 4 As shown, in one embodiment, a voice interaction device is provided, comprising the following components:

[0084] The voice information recognition module 401 is used to recognize the received voice information and obtain a recognition result.

[0085] The target application determining module 402 is used to determine the target application from the candidate applications matching the recognition result according to the recognition result.

[0086] The control instruction generation module 403 is used to generate a control instruction for the target application according to the recognition result.

[0087] The control instruction sending module 404 is used to send the control instruction to the target application so that the target application executes the control instruction.

[0088] In one implementation, the target application determination module 402 is specifically used to: when the recognition result includes the query intent and the user's usage habits, determine the target application that matches the query intent from the candidate applications according to the user's usage habits.

[0089] like Figure 5 As shown, in one embodiment, the target application determination module 402 includes:

[0090] The current user identification submodule 4021 is used to identify the current user according to the voice information.

[0091] The user usage habit determination submodule 4022 is used to determine the user usage habit according to the time when the current user browses the candidate application and / or according to the frequency of the current user opening the candidate application.

[0092] In one implementation, the control instruction generation module 403 is specifically used to: when the recognition result includes the query intent, generate a control instruction for the target application according to the query intent.

[0093] In one implementation, the control instruction generation module 403 is specifically used to: when the recognition result includes the query intention and the user's usage habits, generate a control instruction for the target application that matches the user's usage habits according to the intention.

[0094] In one implementation, the target application is a shopping application.

[0095] The functions of each module in each device in the embodiments of the present application can be found in the corresponding description in the above method, and will not be repeated here.

[0096] According to an embodiment of the present application, the present application also provides an electronic device, a readable storage medium and a computer program product.

[0097] In the technical solution of this application, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0098] like Figure 6 , is a block diagram of an electronic device according to a method of voice interaction of an embodiment of the present application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0099] like Figure 6As shown, the electronic device includes: one or more processors 610, a memory 620, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input / output device (such as a display device coupled to the interface). In other embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 6 A processor 610 is taken as an example.

[0100] The memory 620 is a non-transient computer-readable storage medium provided in the present application. The memory stores instructions executable by at least one processor to enable the at least one processor to perform the voice interaction method provided in the present application. The non-transient computer-readable storage medium of the present application stores computer instructions, which are used to enable a computer to perform the voice interaction method provided in the present application.

[0101] The memory 620 is a non-transient computer-readable storage medium that can be used to store non-transient software programs, non-transient computer executable programs and modules, such as program instructions / modules corresponding to the voice interaction method in the embodiment of the present application (for example, the attached Figure 4 The processor 610 executes various functional applications and data processing of the server by running the non-transient software programs, instructions and modules stored in the memory 620, that is, the voice interaction method in the above method embodiment is implemented.

[0102] The memory 620 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device for voice interaction, etc. In addition, the memory 620 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory 620 may optionally include a memory remotely arranged relative to the processor 610, and these remote memories may be connected to the electronic device for voice interaction via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0103] The electronic device of the voice interaction method may further include: an input device 630 and an output device 640. The processor 610, the memory 620, the input device 630 and the output device 640 may be connected via a bus or other means. Figure 6 The example of connecting through bus is taken in the following.

[0104] The input device 630 can receive input digital or character information, and generate key signal input related to user settings and function control of the electronic device for voice interaction, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator bar, one or more mouse buttons, a trackball, a joystick and other input devices. The output device 640 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display and a plasma display. In some embodiments, the display device may be a touch screen.

[0105] Various implementations of the systems and techniques described herein can be realized in digital electronic circuit systems, integrated circuit systems, dedicated ASICs (application specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0106] These computer programs (also referred to as programs, software, software applications, or code) include machine instructions for programmable processors and can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, device, and / or means (e.g., disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.

[0107] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0108] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0109] A computer system may include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other.

[0110] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the expected results of the technical solution disclosed in this application can be achieved, and this document is not limited here.

[0111] The above specific implementations do not constitute a limitation on the protection scope of this application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of this application should be included in the protection scope of this application.

Claims

1. A voice interaction method, characterized in that: include: Recognize the received voice information and obtain a recognition result; In the case where the recognition result includes the query intention and the user's usage habits, determining the target application according to the user's usage habits and the characteristics of the candidate application matching the recognition result, wherein the target application is a shopping application and the characteristics are promotional activities of the candidate application; generating a control instruction for the target application that matches the user's usage habits according to the query intention, wherein the query intention is to purchase an item, and the control instruction is an instruction to control the target application to enter a page for purchasing the item; Sending the control instruction to the target application so that the target application executes the control instruction; The method further comprises: The received voice information is continuously recognized, and when the recognition result is to adjust the display status of the target application, a corresponding adjustment instruction is sent to the target application, wherein the display status includes at least one of the following: entering the next page, returning to the previous page, returning to the home page, or exiting the target application.

2. The method according to claim 1, characterized in that Methods for determining the user's usage habits include: Identifying the current user according to the voice information; The user usage habits are determined according to the time when the current user browses the candidate application programs and / or according to the frequency with which the current user opens the candidate application programs.

3. The method according to claim 1 or 2, characterized in that: The target application is a shopping application.

4. A voice interaction device, characterized in that: include: The voice information recognition module is used to recognize the received voice information and obtain the recognition result; a target application determination module, configured to determine the target application according to the user usage habits and the characteristics of the candidate application matching the recognition result when the recognition result includes the query intention and the user usage habits, wherein the target application is a shopping application and the characteristics are promotional activities of the candidate application; A control instruction generation module, used to generate a control instruction for the target application that matches the user's usage habits according to the query intention, wherein the query intention is to purchase an item, and the control instruction is an instruction to control the target application to enter a page for purchasing the item; A control instruction sending module, used for sending the control instruction to the target application so that the target application executes the control instruction; The device also includes: The display status adjustment instruction sending module is used to continuously recognize the received voice information, and when the recognition result is to adjust the display status of the target application, the corresponding adjustment instruction is sent to the target application, wherein the display status includes at least one of the following: entering the next page, returning to the previous page, returning to the home page or exiting the target application.

5. The device according to claim 4, characterized in that The target application determination module includes: A current user identification submodule, used to identify the current user according to the voice information; The user usage habit determination submodule is used to determine the user usage habit according to the time when the current user browses the candidate application and / or according to the frequency of the current user opening the candidate application.

6. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 3.

7. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to any one of claims 1 to 3.

8. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the method according to any one of claims 1 to 3 is implemented.

Images