Voice interaction method and device, equipment, storage medium and program product

Abstract

The invention relates to a voice interaction method and device, equipment, a storage medium and a program product. The method is applied to the electronic equipment and comprises the steps that a voice operation instruction of a first application program is received through a voice assistant, and the first application program is an application program running in the background of the electronic equipment; responding to the voice operation instruction through the voice assistant in the background of the electronic equipment, and displaying response information when the voice assistant responds to the voice operation instruction in a user interface of a second application program according to a preset display mode, the second application program is an application program running in the foreground of the electronic equipment. By adopting the method, the operation flexibility of the application program can be improved.

Description

Technical Field

[0001] The present application relates to the field of voice interaction technology, and in particular to a voice interaction method, device, equipment, storage medium and program product. Background Art

[0002] With the development of electronic technology, more and more applications (Application, APP) can be used on electronic devices. Multiple applications can be run simultaneously in an electronic device. When a user needs to process a transaction of a certain application across applications, the electronic device needs to switch the screen to the interface of the application for the user to process the transaction.

[0003] However, the above method has the problem of poor operational flexibility of the application program. Summary of the invention

[0004] Based on this, it is necessary to provide a voice interaction method, device, equipment, storage medium and program product that can improve the operational flexibility of the application program in response to the above technical problems.

[0005] In a first aspect, the present application provides a voice interaction method, applied to an electronic device, the method comprising:

[0006] receiving, through a voice assistant, a voice operation instruction of a first application, where the first application is an application running in the background of the electronic device;

[0007] The voice operation instruction is responded to through the voice assistant in the background of the electronic device, and the response information of the voice assistant when responding to the voice operation instruction is displayed in the user interface of the second application according to a preset display mode. The second application is the application running in the foreground of the electronic device.

[0008] In a second aspect, the present application further provides a voice interaction device, applied to an electronic device, the device comprising:

[0009] A receiving module, configured to receive a voice operation instruction of a first application through a voice assistant, wherein the first application is an application running in the background of the electronic device;

[0010] An execution module is used to respond to the voice operation instruction through the voice assistant in the background of the electronic device, and display the response information of the voice assistant when responding to the voice operation instruction in the user interface of a second application according to a preset display mode, and the second application is an application running in the foreground of the electronic device.

[0011] In a third aspect, the present application further provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps described in the first aspect when executing the computer program.

[0012] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps described in the first aspect above.

[0013] In a fifth aspect, the present application further provides a computer program product, comprising a computer program, which implements the steps described in the first aspect when executed by a processor.

[0014] In the above-mentioned voice interaction method, apparatus, device, storage medium and program product, an electronic device receives a voice operation instruction of a first application through a voice assistant, and the first application is an application running in the background of the electronic device. Then, the voice operation instruction is responded to through the voice assistant in the background of the electronic device, and the response information of the voice assistant when responding to the voice operation instruction is displayed in the user interface of a second application according to a preset display mode. The second application is an application running in the foreground of the electronic device. In this way, when the second application runs in the foreground of the electronic device and the first application runs in the background of the electronic device, if the user needs to operate the first application, the electronic device does not need to switch the screen from the user interface of the second application to the user interface of the first application for the user to operate, but the voice assistant responds to the voice operation instruction of the first application in the background of the electronic device to replace the user operation, thereby improving the convenience of operation of the first application and making the operation of the first application more flexible. In addition, the present application also displays the response information of the voice assistant to the user, so that the user can know which operations the voice assistant is performing on behalf of the user, thereby improving the operational flexibility of the first application. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0016] Figure 1 is a flowchart of a voice interaction method in one embodiment;

[0017] Figure 2 is a schematic diagram of a user interface of a game application in one embodiment;

[0018] Figure 3 A schematic diagram of a flow chart of receiving a voice operation instruction through a voice assistant in one embodiment;

[0019] Figure 4 is a schematic diagram of a user interface of a game application in one embodiment;

[0020] Figure 5 A flowchart of responding to a voice operation instruction through a voice assistant in one embodiment;

[0021] Figure 6 is a schematic diagram of an exemplary dialog box in one embodiment;

[0022] Figure 7 is a flowchart of a voice interaction method in one embodiment;

[0023] Figure 8 is a schematic diagram of an exemplary dialog box in one embodiment;

[0024] Fig. 9 is a structural block diagram of a voice interaction device in one embodiment;

[0025] Fig.10 FIG. 4 is a diagram showing the internal structure of an electronic device in one embodiment. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0027] With the development of electronic technology, more and more applications (Application, APP) can be used on electronic devices. Multiple applications can be run simultaneously in an electronic device. When a user needs to process a transaction of a certain application across applications, the electronic device needs to switch the screen to the interface of the application for the user to process the transaction.

[0028] For example, in a game scenario, an electronic device runs a game application in the foreground. After the electronic device receives a message that needs to be replied, the user clicks the notification information bar in the game interface, and the electronic device switches the screen to the corresponding application for the user to reply to the message, and then slides the navigation bar left and right to switch back to the game interface, or the user can reply to the message through a small window in the game interface. However, these current ways of replying to messages in immersive scenarios require switching the game interface or blocking a large area of ​​the game interface, affecting the gaming experience, and the user may not be able to reply to the message in time during the game, which has a greater impact on the timeliness of the reply.

[0029] Therefore, there is currently a problem that the operational flexibility of the application program is poor.

[0030] In view of this, the embodiments of the present application provide a voice interaction method, apparatus, device, storage medium and program product. In the voice interaction method, an electronic device receives a voice operation instruction of a first application through a voice assistant, and the first application is an application running in the background of the electronic device. Then, the voice operation instruction is responded to through the voice assistant in the background of the electronic device, and the response information of the voice assistant when responding to the voice operation instruction is displayed in the user interface of a second application according to a preset display mode. The second application is an application running in the foreground of the electronic device. In this way, when the second application runs in the foreground of the electronic device and the first application runs in the background of the electronic device, if the user needs to operate the first application, the electronic device does not need to switch the screen from the user interface of the second application to the user interface of the first application for the user to operate. Instead, the voice assistant responds to the voice operation instruction of the first application in the background of the electronic device to replace the user operation, thereby improving the convenience of operation of the first application and making the operation of the first application more flexible. In addition, the present application also displays the response information of the voice assistant to the user, so that the user can know which operations the voice assistant is performing on behalf of the user, thereby improving the flexibility of operation of the first application.

[0031] In an exemplary embodiment, Figure 1 As shown, a voice interaction method is provided, and the method is applied to an electronic device as an example for explanation, wherein the electronic device may be a laptop, a smart phone, a tablet computer, an Internet of Things device, and a portable wearable device, etc., wherein the Internet of Things device may be a smart speaker, a smart TV, a smart air conditioner, a smart car device, a projection device, etc., and the portable wearable device may be a smart watch, a smart bracelet, a head-mounted device, etc., and the head-mounted device may be a virtual reality (VR) device, an augmented reality (AR) device, smart glasses, etc. Figure 1 As shown, the voice interaction method may include the following steps:

[0032] Step 101: Receive a voice operation instruction of a first application through a voice assistant.

[0033] In an embodiment of the present application, a voice assistant is installed in the electronic device. The voice assistant can be an intelligent application. The user can interact with the voice assistant intelligently. For example, the user can have an intelligent conversation and instant question and answer with the voice assistant. The voice assistant can help the user solve some problems or operate the electronic device on behalf of the user.

[0034] The electronic device receives the voice assistant wake-up instruction, responds to the voice assistant wake-up instruction, and wakes up the voice assistant, so that the electronic device is in the voice assistant function. The voice assistant wake-up instruction can be an agreed wake-up voice, such as "Xiao Bu Xiao Bu"; the voice assistant wake-up instruction can also be an agreed wake-up operation, such as a preset tapping action for the electronic device, a preset key action, etc.

[0035] Under the voice assistant function, the electronic device receives a voice operation instruction for a first application input by a user, where the first application is an application running in the background of the electronic device.

[0036] For example, the electronic device runs the second application for the user in the foreground and runs the first application in the background. If the user needs to operate the first application, the user first wakes up the voice assistant and then voice inputs voice operation instructions for the first application. In this way, the electronic device can detect the voice operation instructions under the voice assistant function.

[0037] In an embodiment of the present application, the first application may be any application that can interact with a user and can run in the background of an electronic device. The first application may be, for example, an instant messaging application, a shopping application, a life service application, a food delivery application, and the like. The second application may be any application that can run in the foreground of an electronic device. Optionally, the second application may be an application with an immersive scene, for example, a game application, an audio and video media application, and the like.

[0038] Taking the first application as an instant messaging application and the second application as a game application as an example, when the user plays a game in the game interface, he can wake up the voice assistant and input voice operation instructions. The voice operation instructions can be automatic reply instructions, for example, the automatic reply instruction is "I am playing games now, please reply to those who are looking for me first and wait a moment"; the voice operation instruction can also be a quick direct instruction, for example, the electronic device receives an instant messaging message and displays the instant messaging message in the game interface. After the user sees the instant messaging message, he can input voice operation instructions for the instant messaging message, for example, the voice operation instruction is "Please reply for me and wait 15 minutes. I am busy."

[0039] Taking the example of the first application being a food delivery application and the second application being a game application, when the user is playing a game in the game interface, if he needs to order food delivery, he can wake up the voice assistant and enter a voice operation instruction. The voice operation instruction can be an automatic food delivery ordering instruction. For example, the voice operation instruction is "I'm playing a game now, please order me a portion of XXX food from XXX store". The voice operation instruction can also include a delivery address. Optionally, if the voice operation instruction does not include a delivery address, the voice assistant can select a delivery address that matches the location of the electronic device from the delivery address of the first application, and so on.

[0040] Taking the first application as a shopping application and the second application as a game application as an example, when the user is playing a game in the game interface, if he needs to purchase a product, he can wake up the voice assistant and enter a voice operation instruction. The voice operation instruction can be an automatic purchase product instruction. For example, the voice operation instruction is "I am playing a game now, please help me buy a XXX product from XXX store". The voice operation instruction may also include a delivery address. Optionally, if the voice operation instruction does not include a delivery address, the voice assistant can select a delivery address that matches the location in the delivery address of the first application based on the location of the electronic device, and so on.

[0041] Step 102: Respond to the voice operation instruction through the voice assistant in the background of the electronic device, and display the response information of the voice assistant when responding to the voice operation instruction in the user interface of the second application according to a preset display mode.

[0042] After the electronic device receives the above-mentioned voice operation instruction through the voice assistant, the electronic device responds to the voice operation instruction through the voice assistant, that is, the electronic device executes the operation task corresponding to the voice operation instruction through the voice assistant.

[0043] For example, taking the voice operation instruction as the above-mentioned automatic takeout ordering instruction as an example, the electronic device simulates the user's click operation in the background of the electronic device through the voice assistant: open the takeout application - determine the merchant corresponding to the automatic takeout ordering instruction - determine the food corresponding to the automatic takeout ordering instruction - complete the order, thereby realizing the response to the automatic takeout ordering instruction.

[0044] In this way, when the first application is running in the background of the electronic device, if the user needs to operate the first application, the electronic device does not have to switch the screen to the user interface of the first application for the user to operate. Instead, the voice assistant responds to the voice operation instructions of the first application in the background of the electronic device to replace the user operation, thereby improving the operating convenience of the first application and making the operation of the first application more flexible.

[0045] In an embodiment of the present application, when the electronic device responds to a voice operation instruction through a voice assistant, the response information of the voice assistant in response to the voice operation instruction can also be displayed in the user interface of the second application according to a preset display mode. As described above, the second application is an application running in the foreground of the electronic device.

[0046] The response information includes at least one operation step when responding to the voice operation instruction through the voice assistant, and / or the response information includes a response result obtained by the voice assistant responding to the voice operation instruction.

[0047] Exemplarily, when the electronic device responds to a voice operation instruction through a voice assistant in the background, it will simulate the operation steps clicked by the user through the voice assistant, that is, the electronic device executes the various operation steps corresponding to the voice operation instruction through the voice assistant. For example, in the example above, the voice operation instruction is an automatic takeout ordering instruction, and the various operation steps executed by the electronic device through the voice assistant may include: opening a takeout application - determining the merchant corresponding to the automatic takeout ordering instruction - determining the food corresponding to the automatic takeout ordering instruction - completing the order. The electronic device may display some or all of these operation steps as response information in the user interface of the second application.

[0048] Optionally, when the electronic device displays multiple operation steps when responding to the voice operation instruction through the voice assistant in the user interface of the second application, the operation steps being performed by the electronic device through the voice assistant can be displayed in sequence according to the execution order of each operation step. For example, the electronic device is performing the operation step of "opening a takeaway application" through the voice assistant, and the electronic device displays the operation step being performed by the voice assistant in the user interface of the second application. After the operation step is completed, the electronic device performs the operation step of "determining the merchant corresponding to the automatic takeaway ordering instruction" through the voice assistant, and the electronic device displays the operation step being performed by the voice assistant in the user interface of the second application, and so on.

[0049] The electronic device can also obtain a response result by responding to the voice operation instruction through the voice assistant in the background. The response result can indicate whether the electronic device responds to the voice operation instruction successfully or fails through the voice assistant. The electronic device can display the response result as response information in the user interface of the second application.

[0050] That is, when the electronic device responds to a voice operation instruction through a voice assistant in the background, at least one operation step when responding to the voice operation instruction through the voice assistant can be displayed in the user interface of the second application, or at least one operation step and the response result when responding to the voice operation instruction through the voice assistant can be displayed in the user interface of the second application, or the response result when responding to the voice operation instruction through the voice assistant can be displayed in the user interface of the second application. In this way, it is convenient for users to know which operations the voice assistant is performing on behalf of the user, thereby improving the operational flexibility of the first application.

[0051] In an embodiment of the present application, the preset display mode includes at least one of a bubble display mode, a capsule display mode and a card display mode.

[0052] The bubble display mode may refer to the electronic device generating a bubble-shaped display frame in the user interface of the second application and displaying the above response information in the bubble-shaped display frame.

[0053] The capsule display mode may mean that the electronic device generates a capsule-shaped display frame in the user interface of the second application and displays the response information in the capsule-shaped display frame.

[0054] The card display mode may mean that the electronic device generates a card-shaped display frame in the user interface of the second application and displays the above response information in the card-shaped display frame.

[0055] As an implementation manner, the display frame may include other contents in addition to the response information, for example, a reminder icon, which may be a dynamic icon or a static icon.

[0056] Optionally, when the content of the response information is large and cannot be displayed entirely in the display frame, the electronic device may scroll the response information in the display frame according to the chronological order of the characters in the response information; the scrolling display may be an up and down scrolling display, a left and right scrolling display, and so on.

[0057] The above display frame can be displayed in a partial area of ​​the user interface of the second application. For example, the display frame is displayed in the top area, bottom area or side area of ​​the user interface of the second application to avoid blocking the user interface of the second application.

[0058] In the following, the capsule display mode is described by taking the case where the first application is an instant messaging application and the second application is a game application as an example.

[0059] See also Figure 2 , Figure 2 A schematic diagram of a user interface of an exemplary gaming application.

[0060] When the user plays a game in the game interface, he wakes up the voice assistant and enters a voice operation instruction, which is an automatic reply instruction, such as "I am playing a game now, please reply to those who are looking for me and wait a moment", and the electronic device responds to the voice operation instruction through the voice assistant in the background, that is, after receiving the instant messaging information corresponding to the first application, the electronic device will automatically reply to the instant messaging information in the background through the voice assistant, such as replying "Busy, please wait a moment, contact you later", and display the response information of the voice assistant in response to the voice operation instruction in a capsule-shaped display box in the game interface. Optionally, the display box also includes a reminder icon.

[0061] Figure 2 In the illustrated embodiment, the electronic device scrolls and displays the response information from left to right in the display frame.

[0062] In this way, when playing games, users can input voice operation instructions through voice, and let the voice assistant automatically reply to instant messaging messages in the background on behalf of the user. The voice assistant can perform some tasks that are inconvenient for users to operate with both hands, thereby improving the timeliness, convenience and flexibility of information replies. In addition, the response information of the voice assistant in response to voice operation instructions is displayed in the game interface, and important information when the voice assistant responds to voice operation instructions is presented in a relatively low-key manner, which can facilitate users to know what operations the voice assistant is performing on behalf of the user without excessively disturbing the user.

[0063] Please refer to Figure 3 In an optional embodiment of the present application, an optional technical process for receiving a voice operation instruction of a first application through a voice assistant is provided, such as Figure 3 As shown, the technical process includes the following steps:

[0064] Step 301: wake up the voice assistant in response to the received voice assistant wake-up instruction.

[0065] The electronic device receives a voice assistant wake-up instruction and wakes up the voice assistant in response to the voice assistant wake-up instruction.

[0066] The voice assistant wake-up instruction may be an agreed wake-up voice, such as "Xiaobu Xiaobu"; the voice assistant wake-up instruction may also be an agreed wake-up operation, such as a preset tapping action, a preset key action, and the like for the electronic device.

[0067] Step 302: Receive a voice operation instruction through a voice assistant, and display the voice assistant wake-up instruction and text information corresponding to the voice operation instruction in a target display box in the user interface.

[0068] Under the voice assistant function, the electronic device receives a voice operation instruction for a first application input by a user.

[0069] In the embodiment of the present application, the electronic device can also display the text information corresponding to the voice assistant wake-up instruction and the voice operation instruction in the target display box in the user interface. For example, the electronic device can perform voice recognition on the voice assistant wake-up instruction and the voice operation instruction respectively, recognize the text information, and then display the text information in the target display box in the user interface to improve the interactive experience.

[0070] For example, the electronic device obtains the text information "Xiaobu Xiaobu" through voice recognition of the voice assistant wake-up command, and obtains the text information "Xiaobu Xiaobu, I am playing games now, please reply to anyone who wants to contact me and ask them to wait a moment" through voice recognition of the voice operation command. Then, the electronic device displays the text information "Xiaobu Xiaobu, I am playing games now, please reply to anyone who wants to contact me and ask them to wait a moment" in the target display box in the user interface of the second application.

[0071] In an embodiment of the present application, the target display box is displayed in a partial area of ​​the user interface of the second application. For example, the display box is displayed in the top area, bottom area or side area of ​​the user interface of the second application to avoid obstructing the user interface of the second application.

[0072] As an implementation manner, the target display frame also includes at least one of a keyboard input switching control and a multi-modal input switching control.

[0073] Among them, the keyboard input switching control is used to switch the keyboard input page; the multimodal input switching control is used to switch at least one of the image input page, the shooting input page and the document input page; the keyboard input page, the image input page, the shooting input page and the document input page are respectively used to at least obtain application operation instructions.

[0074] Taking the keyboard input switching control as an example, after the electronic device detects a trigger operation for the keyboard input switching control, it can display a keyboard input page in the user interface of the second application. The keyboard input page includes a virtual keyboard. The user can enter application operation instructions for any background application by clicking on the virtual keyboard. After the electronic device detects the application operation instructions based on the virtual keyboard, it responds to the application operation instructions through a voice assistant in the background of the electronic device.

[0075] Taking the multimodal input switching control as an example, after the electronic device detects a trigger operation for the multimodal input switching control, it can display an input method selection page in the user interface of the second application. The input method selection page is used for the user to select an image input method, a shooting input method, or a document input method. If the electronic device detects the input method selected by the user in the input method selection page, it displays the corresponding input page in the user interface of the second application: an image input page, a shooting input page, or a document input page. In this way, the user can operate in the displayed input page to input application operation instructions for any background application. After the electronic device detects the application operation instruction, it responds to the application operation instruction through a voice assistant in the background of the electronic device.

[0076] In the following, the target display frame is described by taking the case where the first application is an instant messaging application and the second application is a game application as an example.

[0077] See also Figure 4 , Figure 4 A schematic diagram of a user interface of an exemplary gaming application.

[0078] When the user plays a game in the game interface, he inputs the voice assistant wake-up command "Xiaobu Xiaobu". After the electronic device receives the voice assistant wake-up command, it wakes up the voice assistant. The user inputs the voice operation command "I'm playing games now, please reply to anyone who wants me to wait a moment", and the electronic device receives the voice operation command through the voice assistant. The electronic device responds to the voice assistant wake-up command and the text information corresponding to the voice operation command "Xiaobu Xiaobu, I'm playing games now, please reply to anyone who wants me to wait a moment" is displayed in the target display box in the game interface. The target display box also includes a keyboard input switching control and a multimodal input switching control.

[0079] In this way, after the user wakes up the voice assistant and enters a voice operation instruction, he can intuitively see the operation instruction he entered in the current user interface, thereby improving the user's interactive experience. After the user sees the text information displayed in the target display box, if the voice operation instruction is incorrect, the user can re-enter it to correct the voice operation instruction, thereby improving the operation accuracy of the voice assistant.

[0080] Please refer to Figure 5 In an optional embodiment of the present application, an optional technical process is provided for responding to voice operation instructions through a voice assistant in the background of an electronic device when the first application is an instant messaging application, such as Figure 5 As shown, the technical process includes the following steps:

[0081] Step 501: Receive instant messaging information corresponding to a first application program through a voice assistant.

[0082] As an implementation mode, the electronic device receives a voice operation instruction of a first application through a voice assistant, and the voice operation instruction is an automatic reply instruction for the first application. The automatic reply instruction is used to instruct the electronic device to automatically reply to the instant messaging message corresponding to the first application through the voice assistant after receiving the instant messaging message.

[0083] Step 502: Determine the default reply information corresponding to the automatic reply instruction through the voice assistant, and respond to the instant messaging message according to the default reply information in the background of the electronic device.

[0084] Exemplarily, the automatic reply instruction may include a reply keyword. For instance, as in the example above, the automatic reply instruction is "I'm playing games now. Please reply to everyone who contacts me and ask them to wait a moment." The reply keyword included in the automatic reply instruction is "wait a moment." After the electronic device extracts the reply keyword from the automatic reply instruction through the voice assistant, it uses the reply keyword as the default reply information.

[0085] Optionally, after the electronic device extracts the reply keyword from the automatic reply instruction through the voice assistant, it can also expand the reply keyword according to the automatic reply instruction to obtain the default reply information. For example, the semantic feature "busy" can be extracted from the automatic reply instruction, and the extracted semantic feature can be spliced ​​with the reply keyword to obtain the default reply information "wait a moment, busy"; for example, detailed information can also be added to the default reply information, for example, adding a wait time, such as 15 minutes, etc., and the way in which the electronic device determines the default reply information corresponding to the automatic reply instruction through the voice assistant is not specifically limited.

[0086] The electronic device responds to the instant messaging message according to the default reply information in the background of the electronic device through the voice assistant, that is, the default reply information is published in the dialog box corresponding to the instant messaging message through the voice assistant.

[0087] The electronic device also displays the response information of the voice assistant in response to the voice operation instruction in the user interface of the second application according to a preset display mode.

[0088] The following is an example to illustrate the implementation of this optional embodiment.

[0089] Continuing with the example of the second application being a game application, Figure 2 and Figure 4 The embodiment shown,

[0090] When the user plays a game in the game interface, he inputs the voice assistant wake-up command "Xiaobu Xiaobu". After the electronic device receives the voice assistant wake-up command, it wakes up the voice assistant. The electronic device receives the voice operation command "I am playing a game now, please reply to anyone who is looking for me, please wait a moment" through the voice assistant. Optionally, the electronic device displays the text information "Xiaobu Xiaobu, I am playing a game now, please reply to anyone who is looking for me, please wait a moment" corresponding to the voice assistant wake-up command and the voice operation command in the target display box of the game interface, such as Figure 4 shown.

[0091] After the electronic device receives the instant messaging information corresponding to the first application, the electronic device publishes the default reply information corresponding to the automatic reply instruction to the dialog box corresponding to the instant messaging information through the voice assistant in the background.

[0092] For example, see Figure 6 , Figure 6 is a schematic diagram of an exemplary dialog box. Figure 6 The instant messaging message is sent by the user "Xiaobao" as "What are you doing? I have an appointment with a friend to go to Futian in the afternoon. Do you want to come with me?" The electronic device uses the voice assistant in the background to post the default reply message "Wait a moment, I will get back to you in 15 minutes" to the dialog box corresponding to the instant messaging message.

[0093] In the foreground of the electronic device, the game interface is still displayed. Optionally, the electronic device displays the response information of the voice assistant in response to the voice operation instruction in a capsule-shaped display box in the game interface, such as Figure 2 As shown, the response information is, for example: Automatically reply to Xiaobao: Wait a moment, I will get back to you after being busy for 15 minutes.

[0094] In the above-mentioned implementation mode, after the electronic device receives the automatic reply instruction of the first application through the voice assistant, and after receiving the instant messaging information corresponding to the first application, it directly responds to the instant messaging information based on the default reply information through the voice assistant in the background, that is, the reply text extracted from the automatic reply instruction is brought into the dialog box of the first application and completes the output. The electronic device does not need to jump to the dialog box during the entire process, which improves the timeliness of the information reply, improves the operating convenience and flexibility of the first application, and avoids the switching of the user interface affecting the user experience of the second application. In addition, the response information of the voice assistant is displayed to the user, so that the user can know which operations the voice assistant is performing on behalf of the user, thereby further improving the operating flexibility of the first application.

[0095] Please refer to Figure 7In an optional embodiment of the present application, an optional technical process is provided for responding to voice operation instructions through a voice assistant in the background of an electronic device when the first application is an instant messaging application, such as Figure 7 As shown, before step 101, it also includes Figure 7 Step 701 and step 702 are shown:

[0096] Step 701: Receive instant messaging information corresponding to a first application.

[0097] Step 702: Display the instant messaging information in the user interface of the second application.

[0098] The electronic device runs a second application in the foreground, and the user interface of the second application is displayed on the screen of the electronic device. After the electronic device receives the instant messaging information corresponding to the first application running in the background, the electronic device displays the instant messaging information in the user interface of the second application.

[0099] Exemplarily, the electronic device may display the instant messaging information in the user interface of the second application via a banner message.

[0100] After the user sees the instant messaging message, he can wake up the voice assistant and input voice operation instructions. After the electronic device wakes up the voice assistant, it receives the voice operation instructions under the voice assistant function.

[0101] Please continue to see Figure 7 , step 102 includes Figure 7 Step 703 and step 704 are shown:

[0102] Step 703: extract target reply information from the voice operation instruction through the voice assistant, and respond to the instant messaging message according to the target reply information in the background of the electronic device.

[0103] Exemplarily, the voice operation instruction may include reply keywords. For example, the voice operation instruction is "Please reply for 15 minutes, we are busy", and the reply keyword included in the voice operation instruction is "Please wait for 15 minutes, we are busy". After the electronic device extracts the reply keyword from the voice operation instruction through the voice assistant, it uses the reply keyword as the target reply information. Optionally, detailed information may be added to the target reply information, such as adding the honorific "Please wait for 15 minutes, we are busy".

[0104] Optionally, after the electronic device extracts the reply keywords from the voice operation instruction through the voice assistant, it can also expand the reply keywords according to the voice operation instruction to obtain the target reply information. For example, the voice operation instruction is "Please reply to me and wait for 15 minutes", and the reply keyword included in the voice operation instruction is "Wait for 15 minutes", and the semantic feature "Busy" can be extracted from the voice operation instruction, and the extracted semantic feature is spliced ​​with the reply keyword to obtain the target reply information "Wait for 15 minutes, busy", etc., and the way in which the electronic device determines the target reply information corresponding to the voice operation instruction through the voice assistant is not specifically limited.

[0105] The electronic device responds to the instant messaging message according to the target reply information in the background of the electronic device through the voice assistant, that is, the target reply information is published in the dialog box corresponding to the instant messaging message through the voice assistant.

[0106] Step 704: Display the response information of the voice assistant in response to the voice operation instruction in the user interface of the second application according to the preset display mode.

[0107] The electronic device also displays the response information of the voice assistant in response to the voice operation instruction in the user interface of the second application according to a preset display mode.

[0108] The following is an example to illustrate the implementation of this optional embodiment.

[0109] Continuing with the example that the second application is a game application, when the user plays a game in the game interface, the game interface is displayed on the screen of the electronic device. After the electronic device receives the instant messaging information corresponding to the instant messaging application running in the background, the electronic device displays the instant messaging information in the game interface via a banner message.

[0110] After the user sees the instant messaging message, he inputs the voice assistant wake-up command "Xiaobu Xiaobu", and the electronic device wakes up the voice assistant after receiving the voice assistant wake-up command. The user inputs the voice operation command "Please reply for me in 15 minutes, I am busy", and after the electronic device wakes up the voice assistant, it receives the voice operation command under the voice assistant function.

[0111] Optionally, the electronic device displays the text information "Xiaobu Xiaobu, please help me wait 15 minutes, I'm busy" corresponding to the voice assistant wake-up instruction and the voice operation instruction in the target display box in the game interface.

[0112] The electronic device publishes the target reply information corresponding to the voice operation instruction to the dialog box corresponding to the instant messaging information through the voice assistant in the background.

[0113] For example, see Figure 8 , Figure 8 is a schematic diagram of an exemplary dialog box. Figure 8 The instant messaging message is sent by the user "Xiaobao" as "What are you doing? I have an appointment with a friend to go to Futian in the afternoon. Do you want to come with me?" The electronic device uses the voice assistant in the background to publish the target reply message "Wait 15 minutes, busy" to the dialog box corresponding to the instant messaging message.

[0114] Optionally, on the foreground of the electronic device, the electronic device displays the response information of the voice assistant when responding to the voice operation instruction in a capsule-shaped display box in the game interface.

[0115] In the above-mentioned implementation mode, when the electronic device runs the second application in the foreground and receives the instant messaging information corresponding to the first application, the instant messaging information is displayed in the user interface of the second application. After the user sees the instant messaging information, the voice assistant is woken up and voice operation instructions are input. The electronic device responds to the instant messaging information based on the target reply information through the voice assistant in the background, that is, the reply text extracted from the voice operation instruction is brought into the dialog box of the first application and the output is completed. The electronic device does not need to jump to the dialog box during the whole process, which improves the timeliness of information reply, improves the operational convenience and flexibility of the first application, and avoids the switching of the user interface affecting the user experience of the second application. In addition, the response information of the voice assistant is displayed to the user, so that the user can know which operations the voice assistant is performing on behalf of the user, thereby further improving the operational flexibility of the first application.

[0116] In one embodiment, a voice interaction method is provided, which is applied to an electronic device, and the method includes:

[0117] 1) The electronic device runs the second application in the foreground and runs the instant messaging application in the background.

[0118] 2) The electronic device wakes up the voice assistant in response to the voice assistant wake-up instruction.

[0119] 3) The electronic device receives the voice operation instruction of the instant messaging application through the voice assistant (the voice operation instruction is an automatic reply instruction), and displays the voice assistant wake-up instruction and the text information corresponding to the voice operation instruction in the target display box in the user interface of the second application.

[0120] 4) The electronic device receives the instant messaging information corresponding to the instant messaging application through the voice assistant.

[0121] 5) The electronic device determines the default reply information corresponding to the automatic reply instruction through the voice assistant, and responds to the instant messaging message according to the default reply information in the background of the electronic device.

[0122] 6) The electronic device displays the response information of the voice assistant in response to the voice operation instruction in the user interface of the second application according to the preset display mode.

[0123] The preset display mode includes at least one of a bubble display mode, a capsule display mode and a card display mode; the response information includes at least one operation step when responding to a voice operation instruction through a voice assistant, and / or the response information includes a response result obtained by responding to the voice operation instruction through the voice assistant.

[0124] In one embodiment, a voice interaction method is provided, which is applied to an electronic device, and the method includes:

[0125] 1) The electronic device runs the second application in the foreground and runs the instant messaging application in the background.

[0126] 2) The electronic device receives the instant messaging information corresponding to the first application.

[0127] 3) The electronic device displays the instant messaging information in the user interface of the second application.

[0128] 4) The electronic device wakes up the voice assistant in response to the voice assistant wake-up instruction.

[0129] 5) The electronic device receives the voice operation instruction of the instant messaging application through the voice assistant, and displays the voice assistant wake-up instruction and the text information corresponding to the voice operation instruction in the target display box in the user interface of the second application.

[0130] 6) The electronic device extracts target reply information from the voice operation instruction through the voice assistant, and responds to the instant messaging message according to the target reply information in the background of the electronic device.

[0131] 7) The electronic device displays the response information of the voice assistant in response to the voice operation instruction in the user interface of the second application according to the preset display mode.

[0132] The preset display mode includes at least one of a bubble display mode, a capsule display mode and a card display mode; the response information includes at least one operation step when responding to a voice operation instruction through a voice assistant, and / or the response information includes a response result obtained by responding to the voice operation instruction through the voice assistant.

[0133] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0134] Based on the same inventive concept, the embodiment of the present application also provides a voice interaction device for implementing the voice interaction method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more voice interaction device embodiments provided below can refer to the limitations on the voice interaction method above, and will not be repeated here.

[0135] In an exemplary embodiment, Fig. 9 As shown, a voice interaction device 900 is provided, including: a receiving module 901 and an execution module 902.

[0136] Among them, the receiving module 901 is used to receive the voice operation instructions of the first application through the voice assistant, and the first application is an application running in the background of the electronic device; the execution module 902 is used to respond to the voice operation instructions through the voice assistant in the background of the electronic device, and display the response information of the voice assistant when responding to the voice operation instructions in the user interface of the second application according to the preset display mode, and the second application is an application running in the foreground of the electronic device.

[0137] In an optional embodiment of the present application, the preset display mode includes at least one of a bubble display mode, a capsule display mode and a card display mode.

[0138] In an optional embodiment of the present application, the response information includes at least one operation step when responding to a voice operation instruction through a voice assistant, and / or the response information includes a response result obtained by the voice assistant responding to the voice operation instruction.

[0139] In an optional embodiment of the present application, the receiving module 901 is specifically used to: wake up the voice assistant in response to a received voice assistant wake-up instruction; receive voice operation instructions through the voice assistant, and display the voice assistant wake-up instruction and the text information corresponding to the voice operation instruction in the target display box in the user interface.

[0140] In an optional embodiment of the present application, the target display box also includes at least one of a keyboard input switching control and a multimodal input switching control; wherein the keyboard input switching control is used to switch the keyboard input page; the multimodal input switching control is used to switch at least one of an image input page, a shooting input page, and a document input page; the keyboard input page, the image input page, the shooting input page, and the document input page are respectively used at least to obtain application operation instructions.

[0141] In an optional embodiment of the present application, the first application is an instant messaging application.

[0142] In an optional embodiment of the present application, the voice operation instruction is an automatic reply instruction, and the execution module 902 is specifically used to: receive the instant messaging information corresponding to the first application through the voice assistant; determine the default reply information corresponding to the automatic reply instruction through the voice assistant, and respond to the instant messaging information according to the default reply information in the background of the electronic device.

[0143] In an optional embodiment of the present application, the receiving module 901 is further used to: before receiving the voice operation instruction of the first application through the voice assistant, receive the instant messaging information corresponding to the first application;

[0144] The device also includes a display module, which is used to display instant messaging information in the user interface;

[0145] The execution module 902 is specifically used to extract target reply information from the voice operation instruction through the voice assistant, and respond to the instant messaging information according to the target reply information in the background of the electronic device.

[0146] Each module in the above-mentioned voice interaction device can be implemented in whole or in part by software, hardware or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the electronic device in the form of hardware, or can be stored in the memory in the electronic device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0147] In an exemplary embodiment, an electronic device is provided, the internal structure of which can be as shown in FIG. Fig.10As shown. The electronic device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. The processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the electronic device is used to exchange information between the processor and an external device. The communication interface of the electronic device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (Near Field Communication, NFC) or other technologies. When the computer program is executed by the processor, a voice interaction method is implemented. The display unit of the electronic device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the electronic device casing, or an external keyboard, touchpad or mouse.

[0148] Those skilled in the art will understand that Fig.10 The structure shown in the figure is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the electronic device to which the scheme of the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0149] In an exemplary embodiment, an electronic device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0150] A voice operation instruction of a first application is received through a voice assistant, and the first application is an application running in the background of the electronic device; the voice operation instruction is responded to through the voice assistant in the background of the electronic device, and the response information of the voice assistant when responding to the voice operation instruction is displayed in the user interface of a second application according to a preset display mode, and the second application is an application running in the foreground of the electronic device.

[0151] In one embodiment, the preset display mode includes at least one of a bubble display mode, a capsule display mode, and a card display mode.

[0152] In one embodiment, the response information includes at least one operation step when responding to the voice operation instruction through the voice assistant, and / or the response information includes a response result obtained by the voice assistant responding to the voice operation instruction.

[0153] In one embodiment, when the processor executes the computer program, the following steps are specifically implemented: waking up the voice assistant in response to a received voice assistant wake-up instruction; receiving a voice operation instruction through the voice assistant, and displaying the voice assistant wake-up instruction and the text information corresponding to the voice operation instruction in a target display box in the user interface.

[0154] In one embodiment, the target display box also includes at least one of a keyboard input switching control and a multimodal input switching control; wherein the keyboard input switching control is used to switch the keyboard input page; the multimodal input switching control is used to switch at least one of an image input page, a shooting input page, and a document input page; the keyboard input page, the image input page, the shooting input page, and the document input page are respectively used at least to obtain application operation instructions.

[0155] In one embodiment, the first application is an instant messaging application.

[0156] In one embodiment, the voice operation instruction is an automatic reply instruction, and the processor specifically implements the following steps when executing the computer program: receiving instant messaging information corresponding to the first application through the voice assistant; determining the default reply information corresponding to the automatic reply instruction through the voice assistant, and responding to the instant messaging information according to the default reply information in the background of the electronic device.

[0157] In one embodiment, when the processor executes the computer program, the following steps are further implemented: receiving instant messaging information corresponding to the first application; displaying the instant messaging information in the user interface;

[0158] When the processor executes the computer program, the following steps are specifically implemented: extracting target reply information from the voice operation instruction through the voice assistant, and responding to the instant messaging message according to the target reply information in the background of the electronic device.

[0159] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0160] A voice operation instruction of a first application is received through a voice assistant, and the first application is an application running in the background of the electronic device; the voice operation instruction is responded to through the voice assistant in the background of the electronic device, and the response information of the voice assistant when responding to the voice operation instruction is displayed in the user interface of a second application according to a preset display mode, and the second application is an application running in the foreground of the electronic device.

[0161] In one embodiment, the preset display mode includes at least one of a bubble display mode, a capsule display mode, and a card display mode.

[0162] In one embodiment, the response information includes at least one operation step when responding to the voice operation instruction through the voice assistant, and / or the response information includes a response result obtained by the voice assistant responding to the voice operation instruction.

[0163] In one embodiment, when the computer program is executed by a processor, the following steps are specifically implemented: waking up the voice assistant in response to a received voice assistant wake-up instruction; receiving a voice operation instruction through the voice assistant, and displaying the voice assistant wake-up instruction and the text information corresponding to the voice operation instruction in a target display box in the user interface.

[0164] In one embodiment, the target display box also includes at least one of a keyboard input switching control and a multimodal input switching control; wherein the keyboard input switching control is used to switch the keyboard input page; the multimodal input switching control is used to switch at least one of an image input page, a shooting input page, and a document input page; the keyboard input page, the image input page, the shooting input page, and the document input page are respectively used at least to obtain application operation instructions.

[0165] In one embodiment, the first application is an instant messaging application.

[0166] In one embodiment, the voice operation instruction is an automatic reply instruction, and when the computer program is executed by the processor, the following steps are specifically implemented: receiving the instant messaging information corresponding to the first application through the voice assistant; determining the default reply information corresponding to the automatic reply instruction through the voice assistant, and responding to the instant messaging information according to the default reply information in the background of the electronic device.

[0167] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: receiving instant messaging information corresponding to the first application; displaying the instant messaging information in the user interface;

[0168] When the computer program is executed by the processor, the following steps are specifically implemented: extracting target reply information from the voice operation instruction through the voice assistant, and responding to the instant messaging message according to the target reply information in the background of the electronic device.

[0169] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0170] A voice operation instruction of a first application is received through a voice assistant, and the first application is an application running in the background of the electronic device; the voice operation instruction is responded to through the voice assistant in the background of the electronic device, and the response information of the voice assistant when responding to the voice operation instruction is displayed in the user interface of a second application according to a preset display mode, and the second application is an application running in the foreground of the electronic device.

[0171] In one embodiment, the preset display mode includes at least one of a bubble display mode, a capsule display mode, and a card display mode.

[0172] In one embodiment, the response information includes at least one operation step when responding to the voice operation instruction through the voice assistant, and / or the response information includes a response result obtained by the voice assistant responding to the voice operation instruction.

[0173] In one embodiment, when the computer program is executed by a processor, the following steps are specifically implemented: waking up the voice assistant in response to a received voice assistant wake-up instruction; receiving a voice operation instruction through the voice assistant, and displaying the voice assistant wake-up instruction and the text information corresponding to the voice operation instruction in a target display box in the user interface.

[0174] In one embodiment, the target display box also includes at least one of a keyboard input switching control and a multimodal input switching control; wherein the keyboard input switching control is used to switch the keyboard input page; the multimodal input switching control is used to switch at least one of an image input page, a shooting input page, and a document input page; the keyboard input page, the image input page, the shooting input page, and the document input page are respectively used at least to obtain application operation instructions.

[0175] In one embodiment, the first application is an instant messaging application.

[0176] In one embodiment, the voice operation instruction is an automatic reply instruction, and when the computer program is executed by the processor, the following steps are specifically implemented: receiving the instant messaging information corresponding to the first application through the voice assistant; determining the default reply information corresponding to the automatic reply instruction through the voice assistant, and responding to the instant messaging information according to the default reply information in the background of the electronic device.

[0177] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: receiving instant messaging information corresponding to the first application; displaying the instant messaging information in the user interface;

[0178] When the computer program is executed by the processor, the following steps are specifically implemented: extracting target reply information from the voice operation instruction through the voice assistant, and responding to the instant messaging message according to the target reply information in the background of the electronic device.

[0179] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0180] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0181] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A voice interaction method, characterized in that: Applied to electronic equipment, the method comprises: receiving, through a voice assistant, a voice operation instruction of a first application, where the first application is an application running in the background of the electronic device; The voice operation instruction is responded to through the voice assistant in the background of the electronic device, and the response information of the voice assistant when responding to the voice operation instruction is displayed in the user interface of the second application according to a preset display mode. The second application is the application running in the foreground of the electronic device.

2. The method according to claim 1, characterized in that The preset display mode includes at least one of a bubble display mode, a capsule display mode and a card display mode.

3. The method according to claim 1, characterized in that The response information includes at least one operation step when the voice assistant responds to the voice operation instruction, and / or the response information includes a response result obtained by the voice assistant responding to the voice operation instruction.

4. The method according to claim 1, characterized in that: The step of receiving the voice operation instruction of the first application program through the voice assistant includes: In response to the received voice assistant wake-up instruction, waking up the voice assistant; The voice operation instruction is received through the voice assistant, and the voice assistant wake-up instruction and the text information corresponding to the voice operation instruction are displayed in the target display box in the user interface.

5. The method according to claim 4, characterized in that The target display frame also includes at least one of a keyboard input switching control and a multi-modal input switching control; wherein, The keyboard input switching control is used to switch the keyboard input page; The multimodal input switching control is used to switch at least one of an image input page, a shooting input page, and a document input page; the keyboard input page, the image input page, the shooting input page, and the document input page are respectively used to at least obtain application operation instructions.

6. The method according to claim 1, characterized in that The first application is an instant messaging application.

7. The method according to claim 6, characterized in that The voice operation instruction is an automatic reply instruction, and the backstage of the electronic device responds to the voice operation instruction through the voice assistant, including: Receiving instant messaging information corresponding to the first application through the voice assistant; The default reply information corresponding to the automatic reply instruction is determined by the voice assistant, and the instant messaging message is responded to according to the default reply information in the background of the electronic device.

8. The method according to claim 6, characterized in that Before receiving the voice operation instruction of the first application through the voice assistant, the method further includes: Receiving instant messaging information corresponding to the first application; Displaying the instant messaging information in the user interface; The step of responding to the voice operation instruction through the voice assistant in the background of the electronic device includes: The target reply information is extracted from the voice operation instruction by the voice assistant, and the instant messaging information is responded to according to the target reply information in the background of the electronic device.

9. A voice interaction device, characterized in that: Applied to electronic equipment, the device comprises: A receiving module, configured to receive a voice operation instruction of a first application through a voice assistant, wherein the first application is an application running in the background of the electronic device; An execution module is used to respond to the voice operation instruction through the voice assistant in the background of the electronic device, and display the response information of the voice assistant when responding to the voice operation instruction in the user interface of a second application according to a preset display mode, and the second application is an application running in the foreground of the electronic device.

10. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 8 are implemented.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

Images