Voice control method and device, electronic equipment, vehicle and storage medium

By receiving voice commands and identifying the target application, and controlling the execution of voice commands based on the priority of the display screen and candidate applications, the problem of multiple display screen applications responding simultaneously is solved, thus improving the user experience.

CN115440212BActive Publication Date: 2025-12-05BEIJING CO WHEELS TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202210773076.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-30
Publication Date
2025-12-05
Estimated Expiration
2042-06-30

AI Technical Summary

Technical Problem

In existing technologies, voice control of multiple display screens in a vehicle causes multiple applications that intend to respond to voice commands to respond simultaneously, affecting the user experience.

Method used

By receiving voice commands, the target application is identified, and the target application is controlled to execute the voice commands based on the priority of the display screen and candidate applications.

Benefits of technology

This avoids multiple applications responding to voice commands simultaneously, ensuring that voice commands are executed correctly and improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115440212B_ABST
    Figure CN115440212B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a voice control method, device, electronic device, vehicle and storage medium. The method comprises: receiving a voice instruction indicating a control requirement; determining a target application matching the control requirement according to at least one of a display screen corresponding to the voice instruction and a priority of each candidate application; and controlling the target application to execute the voice instruction. The method can avoid response abnormalities caused by at least two applications executing the voice instruction, so that the voice instruction can be normally executed, thereby improving user experience.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of voice control, and in particular, to a voice control method and device, an electronic device, a vehicle, and a storage medium. BACKGROUND

[0002] With the development of vehicles, users have higher and higher requirements for the driving experience and entertainment experience of vehicles. Multi-display screen vehicles have appeared, so that passengers in the vehicle can experience entertainment through different display screens. Each display screen can include at least two applications, such as audio applications, video applications, karaoke applications, etc. Based on different applications, users can experience different entertainment projects.

[0003] However, when a voice instruction issued by a user hits a user intent, the user intent corresponds to at least two applications in at least two display screens, resulting in at least two applications responding to the voice instruction, which causes abnormal voice instruction response and affects user experience. SUMMARY

[0004] The present disclosure provides a voice control method and device, an electronic device, a vehicle, and a storage medium, which can avoid at least two applications responding to a voice instruction, so that the voice instruction can be normally executed, thereby improving user experience.

[0005] In a first aspect, the present disclosure provides a voice control method, comprising:

[0006] receiving a voice instruction indicating a control requirement;

[0007] determining a target application matching the control requirement according to at least one of a display screen corresponding to the voice instruction and a priority of each candidate application;

[0008] controlling the target application to execute the voice instruction.

[0009] Optionally, the determining a target application matching the control requirement according to at least one of a display screen corresponding to the voice instruction and a priority of each candidate application comprises:

[0010] selecting a target display screen corresponding to the voice instruction;

[0011] if the candidate applications are at least two, determining the candidate application with the highest priority as the target application according to the priorities of the at least two candidate applications in the target display screen;

[0012] if the candidate applications are one, determining the candidate application as the target application.

[0013] Optionally, the selecting the target display screen corresponding to the voice instruction comprises:

[0014] if the voice instruction corresponds to a display screen including a specified display screen, determining the specified display screen as the target display screen;

[0015] if the voice instruction corresponds to a display screen not including a specified display screen, determining the display screen where the voice virtual image is located as the target display screen.

[0016] Optionally, the determining the display screen where the voice virtual image is located as the target display screen comprises:

[0017] if the type of the voice instruction is a first type, determining the display screen where the voice virtual image is located as the target display screen, the first type including an on-demand type, an interface opening type and an interface closing type;

[0018] if the type of the voice instruction is a second type and the display screen where the voice virtual image is located is in a headphone playing state, determining the display screen where the voice virtual image is located as the target display screen, the second type including a resume type and a control type.

[0019] Optionally, the method further comprises:

[0020] when the target display screen is not selected, determining the candidate application with the highest priority as the target application according to the priority of each candidate application of the voice instruction.

[0021] Optionally, the determining the candidate application with the highest priority as the target application according to the priority of each candidate application corresponding to the type of the voice instruction comprises:

[0022] if the type of the voice instruction is a control type, determining the candidate application in a power amplifier playing state as the target application;

[0023] if the type of the voice instruction is a resume type, determining the candidate application with the highest priority as the target application according to the priority of each candidate application corresponding to the connection state between the display screen where the voice virtual image is located and the headphone.

[0024] Optionally, the determining the candidate application with the highest priority as the target application according to the priority of each candidate application corresponding to the connection state between the display screen where the voice virtual image is located and the headphone comprises:

[0025] if the connection state is not connected, determining the candidate application with the most recent power amplifier playing record as the target application;

[0026] if the connection state is connected and the candidate application in the power amplifier playback exists, determining the candidate application in the power amplifier playback as the target application;

[0027] if the connection state is connected and the candidate application in the power amplifier playback does not exist, determining the candidate application with the most recent playback record in the display screen where the voice virtual image is located as the target application.

[0028] Optionally, the determining the target application matching the control demand according to the priority of each candidate application comprises:

[0029] obtaining state information of each candidate application;

[0030] determining the target application with the highest priority of state information according to the state information and priority information, wherein the priority information comprises at least two preset state information and respective corresponding priority.

[0031] Optionally, before the determining the target application with the highest priority of state information according to the state information and priority information, the method further comprises:

[0032] querying and determining the instruction type corresponding to the voice instruction according to the voice instruction and instruction corresponding rule, wherein the instruction corresponding rule comprises at least two preset voice instructions and respective corresponding preset instruction types;

[0033] querying and determining the priority information corresponding to the instruction type according to the instruction type and preset priority corresponding relationship, wherein the preset priority corresponding relationship comprises at least two preset instruction types and respective corresponding preset priority information.

[0034] Optionally, the determining the target application with the highest priority of state information according to the state information and priority information comprises:

[0035] selecting target state information from the priority information in order of priority from high to low, and querying whether the target state information exists in the state information for each target state information;

[0036] determining the candidate application corresponding to the first target state information found in the state information as the target application.

[0037] Optionally, the method further comprises:

[0038] when the preset state information matching the state information does not exist in the priority information, determining a pre-set default application in each candidate application as the target application.

[0039] In a second aspect, the present disclosure provides a voice control device, comprising:

[0040] a receiving module configured to receive a voice instruction indicating a control requirement;

[0041] a determining module configured to determine a target application matching the control requirement according to at least one of a display screen corresponding to the voice instruction and a priority of each candidate application;

[0042] a control module configured to control the target application to execute the voice instruction.

[0043] In a third aspect, the present disclosure provides an electronic device, comprising: a processor configured to execute a computer program stored in a memory, the computer program being executed by the processor to implement the steps of any method provided in the first aspect.

[0044] In a fourth aspect, the present disclosure provides a computer readable storage medium having a computer program stored thereon, the computer program being executed by a processor to implement the steps of any method provided in the first aspect.

[0045] In a fifth aspect, the present disclosure provides a vehicle, comprising: the voice control device provided in the second aspect; or the electronic device provided in the third aspect; or the computer readable storage medium provided in the fourth aspect.

[0046] In the technical solutions provided by the present disclosure, by receiving a voice instruction indicating a control requirement, determining a target application matching the control requirement according to at least one of a display screen corresponding to the voice instruction and a priority of each candidate application, and controlling the target application to execute the voice instruction, one target application can be determined from at least two applications that can execute the voice instruction, so that the target application executes the voice instruction, avoiding response abnormalities caused by the at least two applications executing the voice instruction, so that the voice instruction can be normally executed, thereby improving user experience. BRIEF DESCRIPTION OF DRAWINGS

[0047] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and serve to explain the principles of the present disclosure, together with the description.

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced as follows. Obviously, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

[0049] Figure 1A schematic diagram of an application scenario provided by the present disclosure;

[0050] Figure 2 A flowchart of a voice control method provided by the present disclosure;

[0051] Figure 3 A flowchart of another voice control method provided by the present disclosure;

[0052] Figure 4 A flowchart of another voice control method provided by the present disclosure;

[0053] Figure 5 A flowchart of another voice control method provided by the present disclosure;

[0054] Figure 6 A flowchart of another voice control method provided by the present disclosure;

[0055] Figure 7 A flowchart of another voice control method provided by the present disclosure;

[0056] Figure 8 A flowchart of another voice control method provided by the present disclosure;

[0057] Figure 9 A flowchart of another voice control method provided by the present disclosure;

[0058] Figure 10 A flowchart of another voice control method provided by the present disclosure

[0059] Figure 11 A structural schematic diagram of a voice control device provided by the present disclosure;

[0060] Figure 12 A structural schematic diagram of an electronic device provided by the present disclosure. DETAILED DESCRIPTION

[0061] In order to enable a person skilled in the art to more clearly understand the above-mentioned purposes, features and advantages of the present disclosure, the schemes of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0062] In the following description, many specific details are set forth in order to fully understand the present disclosure, but the present disclosure can also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some of the embodiments of the present disclosure, not all the embodiments.

[0063] Figure 1 A schematic diagram of an application scenario provided by the present disclosure, as Figure 1As shown, the application scenario includes at least two display screens, for example, the display screens can be the central control display screen 111, the first vehicle display screen 112, the second vehicle display screen 113, and the third vehicle display screen 114, wherein the central control display screen 111 can provide an entertainment experience to the driver, the first vehicle display screen 112 is located near the co-pilot seat and can provide an entertainment experience to the user on the co-pilot seat, the second vehicle display screen 113 is located near the left rear seat and can provide an entertainment experience to the user on the left rear seat, and the third vehicle display screen 114 is located near the right rear seat and can provide an entertainment experience to the user on the right rear seat. In addition, the display screen in the present disclosure can also be a smart phone, a palm computer, a tablet computer, a wearable device with a display screen, a desktop computer, a notebook computer, an all-in-one machine, a smart home device, etc.

[0064] It should be noted that, Figure 1 The application scenario is exemplarily described by taking four display screens as an example, in actual application, the display screens can be two or three, or more than four, and the number of display screens in the application scenario is not limited in the embodiment. It should be further noted that, Figure 1 The application scenario is exemplarily described by taking a vehicle with two rows and five seats as an example, but it is not limited to the number and arrangement of seats in the vehicle.

[0065] The application scenario of the present disclosure also includes a sound collecting device, for example, a microphone, as shown in Figure 1 As shown, the sound collecting device in the application scenario can include four microphones, which are the first microphone 121 located near the driver's seat, the second microphone 122 located near the co-pilot seat, the third microphone 123 located near the left rear seat, and the fourth microphone 124 located near the right rear seat. Among them, the first microphone 121 can collect the sound signal of the driver, the second microphone 122 can collect the sound signal of the user on the co-pilot seat, the third microphone 123 can collect the sound signal of the user on the left rear seat, and the fourth microphone 124 can collect the sound signal of the user on the right rear seat. Based on the sound signal collected by the microphone, the voice instruction triggered by the user can be obtained, for example, the voice instruction can be "co-pilot pause playing", "continue playing", "play XXX", etc.

[0066] The voice instruction triggered by the user is parsed to obtain a user intent hit by the voice instruction. For example, the voice instruction triggered by the user is “play song XXX”, and the voice instruction “play song XXX” is parsed to obtain the user intent “play audio”. For the user intent of the voice instruction, the application that can execute the voice instruction is an application of the same type. For example, based on the above embodiment, for the user intent “play audio”, the application that can execute the voice instruction is an audio application.

[0067] In some embodiments, the application that can execute the voice instruction is an application with the same application name, and the application with the same application name is arranged in at least two display screens. Therefore, at least two applications can execute the voice instruction. For example, the voice instruction is “play song XXX”, and the application with the application name A1 can execute the voice instruction. The application with the application name A1 is arranged in the display screen P1 and the display screen P2. Therefore, at least two applications that can execute the voice instruction are the application with the application name A1 in the display screen P1 and the display screen P2. In some embodiments, the application that can execute the voice instruction is an application with at least two application names, and the application with at least two application names can be arranged in at least one display screen. Therefore, at least two applications can execute the voice instruction. For example, the voice instruction is “play song XXX”, and the application with the application name A1 and the application with the application name A2 can execute the voice instruction. The application with the application name A1 is arranged in the display screen P1, and the application with the application name A2 is arranged in the display screen P1 and the display screen P2. Therefore, at least two applications that can execute the voice instruction are the application with the application name A1 and the application with the application name A2 in the display screen P1, and the application with the application name A1 in the display screen P2. In this way, in the application scenario provided by the present disclosure, at least two applications can execute the voice instruction, which easily causes abnormal internal data processing of the display screen, that is, abnormal response of the display screen to the voice instruction.

[0068] To solve the above problem, in the present disclosure, a voice instruction indicating a control requirement is received, a target application matching the control requirement is determined according to at least one of a display screen corresponding to the voice instruction and a priority of each candidate application, and the target application is controlled to execute the voice instruction. One target application can be determined from at least two applications that can execute the voice instruction, so that the target application executes the voice instruction, avoids abnormal response caused by at least two applications executing the voice instruction, enables the voice instruction to be normally executed, and thus improves user experience.

[0069] The technical solutions of the present disclosure are described in detail below with reference to several specific embodiments.

[0070] Figure 2 A flowchart of a voice control method provided by the present disclosure is shown in FIG. 1, which includes the following steps. Figure 2 ​

[0071] S101, receive a voice instruction indicating a control requirement.

[0072] For example, a user issues a corresponding voice instruction based on his own control requirement, and the voice instruction triggered by the user can be acquired based on a sound acquisition device, so that the voice instruction triggered by the user can be received. The voice instruction can be divided into five instruction types, namely, a play-continuing type, a control type, a play-on-demand type, an interface opening type, and an interface closing type. Correspondingly, the voice instruction can be divided into a play-continuing type voice instruction, a control type voice instruction, a play-on-demand type voice instruction, an interface opening type voice instruction, and an interface closing type voice instruction. The play-continuing type voice instruction can include “play”, “continue to play”, “previous”, and “next”, the control type voice instruction can include “pause playing”, “favorite”, “unfavorite”, “fast forward”, and “fast backward”, the play-on-demand type voice instruction can include “search XXX” and “play XXX”, the interface opening type voice instruction can be “open XXX”, and the interface closing type voice instruction can be “close XXX”.

[0073] S102, determine a target application matching the control requirement according to at least one of a display screen corresponding to the voice instruction and a priority of each candidate application.

[0074] For example, the display screen corresponding to the voice instruction can be a display screen specified by the user and / or a display screen where a voice virtual image is located, and can also be all display screens in an application scenario. Based on the type of the voice instruction, a priority of a state corresponding to the voice instruction can be obtained, the state including at least one of playing, running in the foreground, and having a recent playing record. The state of each candidate application that can execute the voice instruction is obtained, and based on the state of each candidate application of the voice instruction and the priority of the state corresponding to the voice instruction, the priority of each candidate application of the voice instruction can be obtained.

[0075] In some embodiments, the target application matching the control requirement can be determined according to the display screen corresponding to the voice instruction and the priority of each candidate application. If a target display screen executing the voice instruction can be selected from the display screen corresponding to the voice instruction, the candidate application with the highest priority can be determined as the target application executing the voice instruction according to the priority of each candidate application of the voice instruction in the target display screen. If the target display screen executing the voice instruction cannot be selected from the display screen corresponding to the voice instruction, the candidate application with the highest priority can be determined as the target application executing the voice instruction based on the priority of each candidate application of the voice instruction, and the display screen where the target application is located is the target display screen executing the voice instruction.

[0076] In some embodiments, the target application matching the control requirement can be determined according to the display screen corresponding to the voice instruction. If a target display screen for executing the voice instruction can be selected from the display screen corresponding to the voice instruction, a candidate application corresponding to the voice instruction can be obtained based on the type of the voice instruction, and the candidate application is determined as the target application for executing the voice instruction. For example, the target display screen is selected as a specified display screen, if the voice instruction is a continuous playing type, the candidate application corresponding to the continuous playing type voice instruction is an application with a recent playing record, and the application with the recent playing record in the specified display screen is determined as the target application; if the voice instruction is a control type, the candidate application corresponding to the control type voice instruction is an application in playing, and the application in playing in the specified display screen is determined as the target application.

[0077] In some embodiments, the target application matching the control requirement can also be determined from the candidate applications according to the priority of each candidate application, that is, the candidate application with the highest priority is the target application for executing the voice instruction.

[0078] S103, controlling the target application to execute the voice instruction.

[0079] Based on the above embodiments, a target application for executing the voice instruction can be determined, so that the application interface of the target application can be called, and the voice instruction can be transmitted to the target application through the application interface of the target application. When the target application supports the voice instruction, the target application can execute the voice instruction, and when the target application does not support the voice instruction, a prompt information that the voice instruction is not supported can be returned.

[0080] In the embodiment, the voice instruction indicating the control requirement is received, the target application matching the control requirement is determined according to at least one of the display screen corresponding to the voice instruction and the priority of each candidate application, and the target application is controlled to execute the voice instruction. The target application can be determined from at least two applications that can execute the voice instruction, so that the target application executes the voice instruction, the response abnormality caused by the at least two applications executing the voice instruction is avoided, the voice instruction can be normally executed, and the user experience can be improved.

[0081] Figure 3 A flowchart of another voice control method provided by the present disclosure is shown in FIG. 8, Figure 3 As shown in FIG. 8, Figure 2 The specific description of one possible implementation manner of S102 executed on the basis of the embodiment shown in FIG. 7 is as follows:

[0082] S1021, selecting a target display screen corresponding to the voice instruction.

[0083] For example, according to the voice instruction, a target display screen for executing the voice instruction is selected from the display screen corresponding to the voice instruction, and the target display screen can be a specified display screen or a display screen where the voice virtual image is located.

[0084] As a specific description of one possible implementation manner when S1021 is executed, as shown in the following table: Figure 4

[0085] S201, determining whether the specified display screen is included in the display screen corresponding to the voice instruction.

[0086] If yes, S202 is executed; if no, S203 is executed.

[0087] For example, the priority of the specified display screen is higher than that of the display screen where the voice virtual image is located, so that the target display screen is determined to be the specified display screen or the display screen where the voice virtual image is located based on whether the specified display screen is included in the display screen corresponding to the voice instruction.

[0088] S202, determining that the specified display screen is the target display screen.

[0089] If the user-specified display screen is included in the voice instruction, that is, the specified display screen is included in the display screen corresponding to the voice instruction, the specified display screen can be determined as the target display screen. For example, the voice instruction is “co-driver plays song XXX”, and the specified display screen is the display screen near the co-driver, so that the display screen near the co-driver can be determined as the target display screen for executing the voice instruction.

[0090] If the specified display screen is in a closed state, the specified display screen will display a prompt message to the user to prompt the display screen to be closed, for example, the prompt message can be “the screen has not been opened, and cannot be controlled in this way”. If the specified display screen is in an open state, a target application for executing the voice instruction can be further determined from the candidate applications of the specified display screen.

[0091] S203, determining that the display screen where the voice virtual image is located is the target display screen.

[0092] ​If the specified display screen is not included in the display screen corresponding to the voice instruction, the display screen where the voice virtual image is located is determined as the target display screen. For example, if the type of the voice instruction is the first type, and the first type is the on-demand type, the interface opening type, and the interface closing type, the display screen where the voice virtual image is located is determined as the target display screen. If the type of the voice instruction is the second type, and the second type is the continuous playing type and the control type, when the display screen where the voice virtual image is located is currently in the earphone playing mode, the display screen where the voice virtual image is located is determined as the target display screen.

[0093] In S1022, it is determined whether the candidate application is one.

[0094] If yes, S1023 is performed; if no, S1024 is performed.

[0095] For example, when the target display screen is determined, at least one candidate application that can execute the voice instruction is determined in the target display screen. When the voice instruction is of the second type, the candidate application corresponding to the voice instruction is one. For example, if the target display screen is the specified display screen, the candidate application corresponding to the continuous playing type voice instruction is the application with the recent playing record, and the candidate application corresponding to the control type voice instruction is the application in the playing mode. If the target display screen is the display screen where the voice virtual image is located, the candidate application of the second type voice instruction is the application in the earphone playing mode. When the voice instruction is of the first type, the candidate application of the voice instruction can be one or at least two. For example, if the specified application is included in the voice instruction, the specified application is the candidate application, and thus the candidate application of the voice instruction is one. If the specified application is not included in the voice instruction, the candidate application of the voice instruction is at least two, and each candidate application corresponds to one priority. Thus, it can be determined whether the candidate application that can execute the voice instruction is one.

[0096] In S1023, it is determined that the candidate application is the target application.

[0097] In some embodiments, when the voice instruction is of the second type, it can be determined that the candidate application that can execute the voice instruction is one, and the candidate application is the target application that executes the voice instruction. For example, based on the above embodiments, when the target display screen is the specified display screen, if the voice instruction is of the continuous playing type, the target application is the application with the recent playing record in the specified display screen, and if the voice instruction is of the control type, the target application is the application in the playing mode in the specified display screen. When the target display screen is the display screen where the voice virtual image is located, the target application of the second type voice instruction is the application in the earphone playing mode in the display screen where the voice virtual image is located.

[0098] In some embodiments, the voice instruction is of the first type and the voice instruction includes a specified application, it can be determined that there is one candidate application that can execute the voice instruction, and the candidate application is the target application of the voice instruction. For example, based on the above embodiment, the specified application in the second type of voice instruction is an application named A1, that is, the candidate application of the second type of voice instruction is the application named A1, and the target application of the second type of voice instruction is the application named A1 in the target display screen.

[0099] In S1024, according to the priority of the at least two candidate applications in the target display screen, the candidate application with the highest priority is determined as the target application.

[0100] If the voice instruction is of the first type and the voice instruction does not include a specified application, it can be determined that there are at least two candidate applications that can execute the voice instruction, and according to the priority of the at least two candidate applications in the target display screen, the candidate application with the highest priority in the target display screen is determined as the target application. For example, the three candidate applications corresponding to the on-demand type voice instruction and the interface opening type voice instruction are the application running in the foreground, the application playing in the background, and the application with the latest playing record, respectively, wherein the application running in the foreground has the highest priority, and the application running in the foreground in the target display screen is the target application. The three candidate applications corresponding to the interface closing type voice instruction are the application running in the foreground, the application playing in the background, and the application with the latest playing record, respectively, wherein the application playing in the background has the highest priority, and the application playing in the background in the target display screen is the target application.

[0101] Figure 5 A flowchart of another voice control method provided by the present disclosure is shown in FIG. 6, Figure 5 For Figure 3 Based on the above-mentioned embodiments, the method further includes:

[0102] In S301, it is determined whether the target display screen is selected.

[0103] If not, S302 is performed.

[0104] In S302, according to the priority of the candidate applications of the voice instruction, the candidate application with the highest priority is determined as the target application.

[0105] For example, if the target display screen for executing the voice instruction is not selected from the display screen corresponding to the voice instruction according to the voice instruction, the priority of the state corresponding to the type of the voice instruction is obtained, the state including at least one of playing, foreground running, and having a recent playing record. Based on the voice instruction, each candidate application that can execute the voice instruction is obtained, the state of each candidate application is obtained, and according to the state of each candidate application of the voice instruction and the priority of the state corresponding to the type of the voice instruction, the priority of each candidate application of the voice instruction is obtained. In this way, based on the priority of each candidate application of the voice instruction, the candidate application with the highest priority is determined as the target application for executing the voice instruction, and the display screen where the target application is located is the target display screen for executing the voice instruction.

[0106] Figure 6 A flowchart of another voice control method provided by the present disclosure is shown in FIG. 6, Figure 6 For Figure 5 Based on the embodiment shown in FIG. 6, a specific description of one possible implementation of S302 is as follows:

[0107] S3021, if the type of the voice instruction is a control type, the candidate application in the power amplifier playing state is determined as the target application.

[0108] For example, the voice instruction is a control type voice instruction, if the candidate application of the control type voice instruction includes an application in the power amplifier playing state, the candidate application in the power amplifier playing state is determined as the target application. If the candidate application of the control type voice instruction does not include an application in the power amplifier playing state, the display screen shows a prompt information to the user, for example, the prompt information is "You have no playing content, please manually operate first".

[0109] S3022, if the type of the voice instruction is a control type, the candidate application in the power amplifier playing state is determined as the target application.

[0110] For example, if the connection state of the display screen where the voice virtual image is located and the earphone is not connected, the corresponding state is the application with the most recently played record of the power amplifier, that is, the candidate application corresponding to the display screen where the voice virtual image is located and the earphone is not connected is the application with the most recently played record of the power amplifier. If the connection state of the display screen where the voice virtual image is located and the earphone is connected, the corresponding state is that the power amplifier is playing and the display screen where the voice virtual image is located has the most recently played record, and the priority of the power amplifier playing is higher than that of the display screen where the voice virtual image is located having the most recently played record, that is, the candidate application corresponding to the display screen where the voice virtual image is located and the earphone is connected is the application in the power amplifier playing and the application in the display screen where the voice virtual image is located having the most recently played record.

[0111] Based on the priority of each candidate application corresponding to the connection state of the display screen where the voice virtual image is located and the earphone, the candidate application with the highest priority is determined as the target application. For example, based on the above embodiment, when the connection state of the display screen where the voice virtual image is located and the earphone is not connected, if the candidate application of the voice instruction includes the application with the most recently played record of the power amplifier, the candidate application with the most recently played record of the power amplifier is determined as the target application, and if the candidate application of the voice instruction does not include the application with the most recently played record of the power amplifier, the display screen shows the user a prompt information, for example, the prompt information is "You have not played content, first manually operate".

[0112] When the connection state of the display screen where the voice virtual image is located and the earphone is connected, if the candidate application of the voice instruction includes the application in the power amplifier playing, the candidate application in the power amplifier playing is determined as the target application; if the candidate application of the voice instruction does not include the application in the power amplifier playing, it is determined whether the candidate application of the voice instruction includes the application in the display screen where the voice virtual image is located having the most recently played record. If the candidate application of the voice instruction includes the application in the display screen where the voice virtual image is located having the most recently played record, the candidate application in the display screen where the voice virtual image is located having the most recently played record is determined as the target application; if the candidate application of the voice instruction does not include the application in the display screen where the voice virtual image is located having the most recently played record, the display screen shows the user a prompt information, for example, the prompt information is "You have not played content, first manually operate".

[0113] Figure 7 A flowchart of another voice control method provided by the present disclosure is shown in FIG. 10, Figure 7 For Figure 2 Based on the embodiment shown in the figure, the specific description of another possible implementation manner when S102 is executed is as follows:

[0114] S401, obtaining state information of the candidate applications.

[0115] For example, the preset voice instruction corresponding relationship is traversed, the preset voice instruction corresponding relationship includes at least two preset voice instructions and a preset application corresponding to each preset voice instruction, and it is determined whether there is a preset voice instruction matching the voice instruction in the voice instruction corresponding relationship. Here, matching can be understood as identical or similar. If there is a preset voice instruction identical to the voice instruction in all preset voice instructions, and / or if there is a preset voice instruction similar to the voice instruction in all preset voice instructions, it can be determined that there is a preset voice instruction matching the voice instruction in the voice instruction corresponding relationship. As a possible implementation manner of determining whether there is a preset voice instruction similar to the voice instruction in the voice instruction corresponding relationship: based on whether the verb of the voice instruction and the verb of each preset voice instruction in all preset voice instructions are identical, it is determined whether there is a preset voice instruction similar to the voice instruction in the voice instruction corresponding relationship. For example, the voice instruction is "play song XXX", there is a preset voice instruction "play" in the voice instruction corresponding relationship, the voice instruction "play song XXX" and the preset voice instruction "play" are identical verbs, and it is determined that there is a preset voice instruction matching the voice instruction in the voice instruction corresponding relationship. After obtaining the preset voice instruction matching the voice instruction in the voice instruction corresponding relationship, it can be determined that the preset application corresponding to the preset voice instruction matching the voice instruction is each candidate application that can execute the voice instruction.

[0116] The state information can include at least one of a running state, a playing state, and a recent playing record state, wherein the running state can be foreground running, running, background running, or not running, the playing state can be earphone playing, power amplifier playing, playing, or not playing, and the recent playing record state information can be having a recent playing record, having an earphone recent playing record, having a power amplifier recent playing record, or having no recent playing record. After obtaining each candidate application that can execute the voice instruction, the current state information of each candidate application is obtained.

[0117] S403, determining the target application with the highest priority according to the state information and the priority information.

[0118] The priority information includes at least two preset state information and respective priorities corresponding to the preset state information.

[0119] Exemplarily, all preset voice instructions can be divided into at least two types, each type corresponds to a preset priority information, the type of the voice instruction is one of the at least two types, and thus the priority information corresponding to the type of the voice instruction can be determined. The priority information includes at least two preset state information, for example, the priority information includes three preset state information, which are foreground running, playing and having recent playing record respectively. Each preset state information in the priority information corresponds to a priority, for example, based on the above embodiment, the priority of playing is higher than that of foreground running, and the priority of foreground running is higher than that of having recent playing record.

[0120] In other embodiments, the priority information includes two preset state information, which are earphone playing and power amplifier playing respectively, wherein the priority of earphone playing is higher than that of power amplifier playing; or the two preset state information are having earphone recent playing record and having power amplifier recent playing record respectively, wherein the priority of having earphone recent playing record is higher than that of having power amplifier recent playing record.

[0121] It should be noted that the embodiment only takes the priority information including three or two preset state information as an example to exemplarily illustrate the number of preset state information in the priority information, and does not limit the number of preset state information in the priority information. The embodiment only exemplarily illustrates the preset state information as playing, foreground running and having recent playing record, and does not limit the preset state information. The embodiment only exemplarily illustrates the priority of playing is higher than that of foreground running, and the priority of foreground running is higher than that of having recent playing record, and the priority of the preset state information can be flexibly set in actual application.

[0122] Figure 8 A flowchart of another voice control method provided by the present disclosure is shown in FIG. 6, Figure 8 Based on the embodiment shown in FIG. 6, before S403 is executed, the method further includes: Figure 7 Based on the embodiment shown in FIG. 6, before S403 is executed, the method further includes:

[0123] S4021, according to the voice instruction and the instruction corresponding rule, the instruction type corresponding to the voice instruction is determined.

[0124] The instruction corresponding rule includes at least two preset voice instructions and their respective corresponding preset instruction types.

[0125] For example, the instruction corresponding rule is pre-set, the instruction corresponding rule includes at least two preset voice instructions, and the preset voice instructions in the instruction corresponding rule are the same as the preset voice instructions in the voice instruction corresponding relationship. The instruction corresponding rule also includes at least two preset instruction types, each preset instruction type corresponds to at least one preset voice instruction, for example, the instruction corresponding rule includes five preset instruction types, which are respectively a play-again type, a control type, a on-demand type, an interface opening type and an interface closing type, wherein the preset voice instructions corresponding to the play-again type can be "play", "continue to play", "previous" and "next", the preset voice instructions corresponding to the control type can be "pause playing", "favorite", "cancel favorite", "fast forward" and "fast backward", the preset voice instructions corresponding to the on-demand type can be "search XXX" and "play XXX", the preset voice instructions corresponding to the interface opening type can be "open XXX", and the preset voice instructions corresponding to the interface closing type can be "close XXX".

[0126] The instruction corresponding rule is traversed to query whether the instruction corresponding rule includes a preset voice instruction matching the voice instruction, and in the case where the instruction corresponding rule includes a preset voice instruction matching the voice instruction, the preset instruction type corresponding to the preset voice instruction matching the voice instruction in the instruction corresponding rule is determined as the instruction type corresponding to the voice instruction. For example, based on the above embodiment, if the voice instruction is "previous", the instruction type of the voice instruction is queried as the play-again type by traversing the instruction corresponding rule; if the voice instruction is "fast forward", the instruction type of the voice instruction is queried as the control type by traversing the instruction corresponding rule; and if the voice instruction is "play AAA", the instruction type of the voice instruction is queried as the on-demand type by traversing the instruction corresponding rule.

[0127] S4022, according to the instruction type and the preset priority corresponding relationship, the priority information corresponding to the instruction type is queried and determined.

[0128] The preset priority corresponding relationship includes at least two preset instruction types and their respective corresponding preset priority information.

[0129] For example, the preset priority corresponding relationship includes at least two preset instruction types, and the preset instruction types in the preset priority corresponding relationship are the same as the preset instruction types in the instruction corresponding rule. The preset priority corresponding relationship also includes at least two preset priority information, and the preset instruction types can correspond to the preset priority information one by one, for example, the play-again type corresponds to preset priority information M1, the control type corresponds to preset priority information M2, the on-demand type corresponds to preset priority information M3, the interface opening type corresponds to preset priority information M4, and the interface closing type corresponds to preset priority information M5. In other embodiments, at least two preset instruction types can correspond to one preset priority information.

[0130] After the instruction type of the acquired voice instruction, the preset priority correspondence relationship is traversed, the preset priority information corresponding to the instruction type in the preset priority correspondence relationship is queried, and the preset priority information corresponding to the instruction type is determined as the priority information.

[0131] In some embodiments, the instruction corresponding rule and the preset priority correspondence relationship can be combined, and the priority information corresponding to the voice instruction can be obtained by querying only once, thereby improving the efficiency of voice instruction control.

[0132] In the embodiment, the instruction type corresponding to the voice instruction is determined by querying the voice instruction and the instruction corresponding rule, the instruction corresponding rule including at least two preset voice instructions and preset instruction types corresponding to the voice instructions respectively; the priority information corresponding to the instruction type is determined by querying the instruction type and the preset priority correspondence relationship, the preset priority correspondence relationship including at least two preset instruction types and preset priority information corresponding to the instruction types respectively, so that different priority information is set for different types of voice instructions, thereby improving the diversity of voice control.

[0133] Figure 9 A flowchart of another voice control method provided by the present disclosure is shown in FIG. 6. Figure 9 As shown in FIG. 6, the voice control method includes the following steps. Figure 7 Based on the embodiment shown in FIG. 6, a specific description of one possible implementation manner of step S403 is as follows.

[0134] S4031, the target state information is selected from the priority information in order of high to low priority, and for each target state information, it is queried whether the target state information exists in the state information.

[0135] For example, based on the order of high to low priority of at least two preset state information in the priority information, the target state information is selected in order, for example, the voice instruction is a on-demand voice instruction or an interface opening instruction, the priority information includes foreground running, playing and having recent playing record, wherein the priority of the foreground running is higher than that of the playing, the priority of the playing is higher than that of the having recent playing record, and the target state information selected in order of high to low priority is: foreground running- playing- having recent playing record.

[0136] In some embodiments, the voice instruction is a interface closing type voice instruction, and the priority information can include two preset state information, which are playing and foreground running respectively, wherein the priority of the playing is higher than that of the foreground running. In some embodiments, the voice instruction is a continuous playing type voice instruction, and the priority information can include four preset state information, which are earphone playing, power amplifier playing, earphone recent playing record and power amplifier recent playing record respectively, wherein the priority of the earphone playing is higher than that of the power amplifier playing, the priority of the power amplifier playing is higher than that of the earphone recent playing record, the priority of the earphone recent playing record is higher than that of the power amplifier recent playing record. In some embodiments, the voice instruction is a control type voice instruction, and the priority information can include two preset state information, which are earphone playing and power amplifier playing respectively, wherein the priority of the earphone playing is higher than that of the power amplifier playing.

[0137] Based on the first target state information, the state information of each candidate application is traversed to determine whether the first target state information can be queried in the state information of each candidate application. If the first target state information can be queried in the state information of each candidate application, the first target state information is the state information first queried in the state information of each candidate application. If the first target state information is not queried in the state information of each candidate application, a second target state information is selected, and the state information of each candidate application is traversed based on the second target state information to determine whether the second target state information can be queried in the state information of each candidate application. If the second target state information can be queried in the state information of each candidate application, the second target state information is the state information first queried in the state information of each candidate application. In this way, the target state information is selected in turn until the last target state information, and the state information first queried in the state information of each candidate application can be determined.

[0138] For example, the voice instruction is a play-on-demand voice instruction or an interface opening instruction. Based on the above embodiment, the first target state information is foreground running. Based on the state information of each candidate application in the play-on-demand state, it is queried whether the foreground running is included in the state information of each candidate application. If the foreground running is included in the state information of each candidate application, the first queried target state information is the foreground running. If the foreground running is not included in the state information of each candidate application, the second selected target state information is the play-on-demand. Based on the foreground running, the state information of each candidate application is traversed, and it is queried whether the play-on-demand is included in the state information of each candidate application. If the play-on-demand is included in the state information of each candidate application, the first queried target state information is the play-on-demand. If the play-on-demand is not included in the state information of each candidate application, the last selected target state information is the recent play record. Based on the recent play record, the state information of each candidate application is traversed, and it is queried whether the recent play record is included in the state information of each candidate application. If the recent play record is included in the state information of each candidate application, the first queried target state information is the recent play record.

[0139] S4032, the candidate application corresponding to the first queried target state information in the state information is determined as the target application.

[0140] For example, based on the above embodiment, if the first queried target state information is the foreground running, the candidate application in the foreground running among the candidate applications is determined as the target application. If the first queried target state information is the play-on-demand, the candidate application in the play-on-demand among the candidate applications is determined as the target application. If the first queried target state information is the recent play record, the candidate application with the recent play record among the candidate applications is determined as the target application.

[0141] Figure 10 A flowchart of another voice control method provided by the present disclosure is shown in FIG. 6. Figure 10 For example, the voice instruction is a play-on-demand voice instruction or an interface opening instruction. Based on the above embodiment, the first target state information is foreground running. Based on the state information of each candidate application in the play-on-demand state, it is queried whether the foreground running is included in the state information of each candidate application. If the foreground running is included in the state information of each candidate application, the first queried target state information is the foreground running. If the foreground running is not included in the state information of each candidate application, the second selected target state information is the play-on-demand. Based on the foreground running, the state information of each candidate application is traversed, and it is queried whether the play-on-demand is included in the state information of each candidate application. If the play-on-demand is included in the state information of each candidate application, the first queried target state information is the play-on-demand. If the play-on-demand is not included in the state information of each candidate application, the last selected target state information is the recent play record. Based on the recent play record, the state information of each candidate application is traversed, and it is queried whether the recent play record is included in the state information of each candidate application. If the recent play record is included in the state information of each candidate application, the first queried target state information is the recent play record. Figure 7 The above-mentioned embodiments are based on the following.

[0142] S403', when the priority information does not include the preset state information matched with the state information, the default application of the candidate applications is determined as the target application.

[0143] For example, based on the above embodiment, if the first queried target state information is the foreground running, the candidate application in the foreground running among the candidate applications is determined as the target application. If the first queried target state information is the play-on-demand, the candidate application in the play-on-demand among the candidate applications is determined as the target application. If the first queried target state information is the recent play record, the candidate application with the recent play record among the candidate applications is determined as the target application.

[0144] In some embodiments, the first type of voice instruction includes a specified application, for example, the voice instruction "application Al plays XXX", where "application Al" is the application name of the specified application. If the system application in the target display screen for executing the voice instruction includes the specified application, the specified application is determined as the target application for executing the voice instruction; if the system application in the target display screen for executing the voice instruction does not include the specified application, it is determined whether the application store of the target display screen for executing the voice instruction includes the specified application. If the application store of the target display screen for executing the voice instruction does not include the specified application, a prompt information is returned to the target display screen for executing the voice instruction, which is used to prompt the user that the specified application is not found, for example, based on the above embodiment, the prompt information is "application A is not found"; if the application store of the target display screen for executing the voice instruction includes the specified application, it is determined whether the specified application has been downloaded to the target display screen for executing the voice instruction. If the specified application has been downloaded to the target display screen for executing the voice instruction, the specified application is determined as the target application for executing the voice instruction; if the specified application has not been downloaded to the target display screen for executing the voice instruction, it is determined whether the specified application is being installed to the target display screen for executing the voice instruction. If the specified application is being installed to the target display screen for executing the voice instruction, a prompt information is returned to the target display screen for executing the voice instruction, which is used to prompt the user that the specified application is being downloaded, for example, based on the above embodiment, the prompt information is "application A is being downloaded, please wait later"; if the specified application is not being installed to the target display screen for executing the voice instruction, an application information card of the specified application is returned to the target display screen for executing the voice instruction, and based on the target display screen for executing the voice instruction, a multi-round question is initiated to the user whether to download the specified application, for example, based on the above embodiment, the prompt information of the application information card can be "you have not installed application A, do you need to install it for you".

[0145] In some embodiments, the first type of voice instruction does not include a specified application, for example, the voice instruction "play XXX".

[0146] If there is no application in the target display screen for executing the voice instruction that matches the voice instruction, it is determined whether there is an application in the application store of the target display screen for executing the voice instruction that matches the voice instruction and is being downloaded. If there is an application in the application store of the target display screen for executing the voice instruction that matches the voice instruction and is being downloaded, a prompt information is returned to the target display screen for executing the voice instruction, which is used to prompt the user that the specified application is being downloaded, for example, the application that matches the voice instruction and is being downloaded is B, and the prompt information is "application B is being downloaded, please wait later".

[0147] If there is no application matching the voice instruction and being downloaded in the application store of the target display screen executing the voice instruction, an application information card of the specified application is returned to the target display screen executing the voice instruction, and based on the target display screen executing the voice instruction, a multi-round query is initiated to the user as to whether to download the specified application, for example, based on the above embodiment, the prompt information of the application information card can be "You have not installed application A, do you need to install it for you".

[0148] In some embodiments, when the specified display screen is in a closed state, voice control is not supported, and prompt information prompting the user that the screen is in a closed state is returned to the specified display screen, for example, when the specified display screen C is in a closed state, the prompt information is "Display screen C has not been turned on, you cannot control it this way". In some embodiments, when the specified display screen is in a doze mode, video applications and singing applications do not support voice control, and information prompting the user that voice control is not supported is returned to the specified display screen, for example, the prompt information is "In the current state, this control is not supported". Applications other than video applications and singing applications support voice control. In some embodiments, when the specified display screen is in a screen-off state, in response to the voice instruction, the specified display screen exits the screen-off mode and then executes the voice instruction.

[0149] The present disclosure also provides a voice control device, Figure 11 A structural schematic diagram of a voice control device provided by the present disclosure is shown in Figure 11 As shown, the voice control device includes:

[0150] The receiving module 210 is configured to receive a voice instruction indicating a control requirement.

[0151] The determining module 220 is configured to determine a target application matching the control requirement according to at least one of a display screen corresponding to the voice instruction and a priority of each candidate application.

[0152] The control module 230 is configured to control the target application to execute the voice instruction.

[0153] Optionally, the determining module 220 is further configured to select a target display screen corresponding to the voice instruction according to the voice instruction.

[0154] If the candidate applications are at least two, the candidate application with the highest priority is determined as the target application according to the priorities of the at least two candidate applications in the target display screen; if the candidate applications are one, the candidate application is determined as the target application.

[0155] Optionally, the determining module 220 is further configured to determine the display screen where the voice virtual image is located as the target display screen if the display screen corresponding to the voice instruction includes a specified display screen; and determine the display screen where the voice virtual image is located as the target display screen if the display screen corresponding to the voice instruction does not include a specified display screen.

[0156] Optionally, the determining module 220 is further configured to determine the display screen where the voice virtual image is located as the target display screen if the type of the voice instruction is a first type, the first type including an on-demand type, an interface opening type and an interface closing type; and determine the display screen where the voice virtual image is located as the target display screen if the type of the voice instruction is a second type and the display screen where the voice virtual image is located is in a headphone playing state, the second type including a continuous playing type and a control type.

[0157] Optionally, the determining module 220 is further configured to determine the candidate application with the highest priority as the target application according to the priority of each candidate application of the voice instruction when the target display screen is not selected.

[0158] Optionally, the determining module 220 is further configured to determine the candidate application in a power amplifier playing state as the target application if the type of the voice instruction is a control type; and determine the candidate application with the highest priority according to the priority of each candidate application corresponding to the connection state between the display screen where the voice virtual image is located and the headphone as the target application if the type of the voice instruction is a continuous playing type.

[0159] Optionally, the determining module 220 is further configured to determine the candidate application with the most recent power amplifier playing record as the target application if the connection state is not connected; determine the candidate application in the power amplifier playing state as the target application if the connection state is connected and the candidate application in the power amplifier playing state exists; and determine the candidate application with the most recent playing record in the display screen where the voice virtual image is located as the target application if the connection state is connected and the candidate application in the power amplifier playing state does not exist.

[0160] Optionally, the determining module 220 is further configured to acquire state information of each candidate application; and determine the target application with the highest priority of the state information according to the state information and priority information, the priority information including at least two preset state information and respective priorities corresponding to the at least two preset state information.

[0161] Optionally, the determining module 220 is further configured to query the instruction type corresponding to the voice instruction according to the voice instruction and an instruction corresponding rule, the instruction corresponding rule including at least two preset voice instructions and respective preset instruction types corresponding to the at least two preset voice instructions; query the priority information corresponding to the instruction type according to a preset priority corresponding relationship, the preset priority corresponding relationship including at least two preset instruction types and respective preset priority information corresponding to the at least two preset instruction types.

[0162] Optionally, the determining module 220 is further configured to select target state information from the priority information in order of priority from high to low, and for each target state information, query whether the target state information exists in the state information; determine the candidate application corresponding to the first target state information found in the state information as the target application.

[0163] Optionally, the determining module 220 is further configured to determine a default application previously set in the candidate applications as the target application when the preset state information matching the state information does not exist in the priority information.

[0164] The apparatus provided in the embodiment can execute the method provided in any embodiment of the present disclosure, has the corresponding function modules and beneficial effects of executing the method, which will not be described here.

[0165] The present disclosure also provides an electronic device, comprising: a processor, the processor is used for executing the computer program stored in the memory, the computer program is executed by the processor to realize the steps of the above method embodiment.

[0166] Figure 12 A structural schematic diagram of an electronic device provided by the present disclosure, Figure 12 A block diagram of an exemplary electronic device suitable for implementing an embodiment of the present disclosure is shown. Figure 12 The electronic device shown is merely an example and should not impose any limitation on the function and use range of the embodiment of the present disclosure.

[0167] As Figure 12 shown, the electronic device 12 is in the form of a general-purpose computing device. The components of the electronic device 12 can include, but are not limited to, one or at least two processors 16, system memory 28, and bus 18 connecting different system components, including system memory 28 and processor 16.

[0168] Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration bus, a processor or local bus using any of a variety of bus architectures. By way of example, these architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

[0169] Electronic device 12 typically includes a variety of computer system readable media. These media can be any available media that is located either internally or externally to electronic device 12, including both volatile and nonvolatile media, removable and non-removable media.

[0170] System memory 28 can include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Electronic device 12 can further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 can be provided for reading from and writing to non-removable, non-volatile magnetic media (typically called a "hard drive"). A magnetic disk drive can also be provided for reading from and writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive can be provided for reading from or writing to a removable, non-volatile optical disk (such as a CD-ROM, DVD-ROM or other optical media). In these instances, each can be connected to bus 18 by one or more data media interfaces. As will be further depicted and described below, memory can include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the application.

[0171] Program / utility 40, having a set (at least one) of program modules 42, can be stored in, for example, system memory 28 by way of example, such programs can include an operating system, one or more application programs, other program modules, and program data, each or a combination thereof, used by the processes of embodiments of the application. Program modules 42 generally carry out the functions and / or methodologies of embodiments of the application as described herein.

[0172] Processor 16 performs a variety of functions as described herein including providing information to, from, or for the benefit of one or more other components of electronic device 12 by executing one or more of the program modules stored in system memory 28.

[0173] The present disclosure also provides a computer readable storage medium having stored thereon a computer program, which, when executed by a processor, implements the steps of the method embodiments described above.

[0174] Any combination of one or at least two computer readable medium can be employed. The computer readable medium can be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium include an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium can be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

[0175] A computer readable signal medium can include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal can take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium can be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

[0176] Program code embodied on a computer readable medium can be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0177] Computer program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider). These implementations can provide for a great deal of flexibility, portability, and adaptability as well as the convenience

[0178] The present disclosure also provides a vehicle, comprising the voice control device, the electronic device or the computer readable storage medium provided in the above embodiments.

[0179] The present disclosure also provides a computer program product, which, when running on a computer, causes the computer to perform the steps of the above method embodiments.

[0180] It should be noted that, in this document, the terms such as "first" and "second" are merely used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations. Moreover, the terms "include", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including a" does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0181] The above description is merely a specific implementation of the present disclosure, enabling those skilled in the art to understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to these embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A voice control method, characterized by, The method comprises: receiving a voice instruction indicating a control requirement; if the voice instruction does not correspond to a specified display screen in a display screen corresponding to the voice instruction, and the type of the voice instruction is a first type, determining a display screen where a voice virtual image is located as a target display screen; if the voice instruction does not correspond to a specified display screen in a display screen corresponding to the voice instruction, and the type of the voice instruction is a second type and the display screen where the voice virtual image is located is in earphone playback, determining the display screen where the voice virtual image is located as the target display screen; controlling a target application to execute the voice instruction, the target application being an application in the target display screen matching the control requirement; wherein the first type includes on-demand, interface opening and interface closing; the second type includes continuous playing and control of an audio / video in playback.

2. The method of claim 1, wherein, The method of controlling the target application to execute the voice instruction comprises: if there are at least two candidate applications in the target display screen, determining the candidate application with the highest priority as the target application according to the priority of the at least two candidate applications in the target display screen; if there is only one candidate application, determining the candidate application as the target application; controlling the target application to execute the voice instruction.

3. The method of claim 1, wherein, Before the method of controlling the target application to execute the voice instruction, the method further comprises: if the voice instruction corresponds to a specified display screen in a display screen corresponding to the voice instruction, determining the specified display screen as the target display screen.

4. The method according to any one of claims 1 to 3, characterized in that, The method further comprises: when the target display screen is not selected, determining the candidate application with the highest priority as the target application according to the priority of each candidate application corresponding to the type of the voice instruction.

5. The method of claim 4, wherein, The method of determining the candidate application with the highest priority as the target application according to the priority of each candidate application corresponding to the type of the voice instruction comprises: if the type of the voice instruction is control, determining the candidate application in power amplifier playback as the target application; if the type of the voice instruction is continuous playing, determining the candidate application with the highest priority as the target application according to the priority of each candidate application corresponding to the connection state of the display screen where the voice virtual image is located and the earphone.

6. The method of claim 5, wherein, The method of determining the candidate application with the highest priority as the target application according to the priority of each candidate application corresponding to the connection state of the display screen where the voice virtual image is located and the earphone comprises: if the connection state is not connected, determining the candidate application with the most recent power amplifier playback record as the target application; if the connection state is connected and there is a candidate application in power amplifier playback, determining the candidate application in power amplifier playback as the target application; if the connection state is connected and there is no candidate application in power amplifier playback, determining the candidate application with the most recent playback record in the display screen where the voice virtual image is located as the target application.

7. The method of claim 2, wherein, If there are at least two candidate applications in the target display screen, determining the candidate application with the highest priority as the target application based on the priority of the at least two candidate applications in the target display screen includes: Obtain the status information of each candidate application; Based on the status information and priority information, the target application with the highest priority of the status information is determined. The priority information includes at least two preset status information and their respective priorities.

8. The method of claim 7, wherein, Before determining the target application with the highest priority based on the status information and priority information, the method further includes: Based on the voice command and command correspondence rules, the command type corresponding to the voice command is determined by querying. The command correspondence rules include at least two preset voice commands and their respective preset command types. Based on the instruction type and the preset priority correspondence, the priority information corresponding to the instruction type is queried and determined. The preset priority correspondence includes at least two preset instruction types and their respective preset priority information.

9. The method of claim 7, wherein, The step of determining the target application with the highest priority based on the status information and priority information includes: In descending order of priority, target state information is selected sequentially from the priority information. For each target state information, it is queried whether the target state information exists in the state information. The candidate application corresponding to the first queried target status information in the status information is determined as the target application.

10. The method according to any one of claims 7-9, characterized in that, The method further includes: When the priority information does not contain the preset status information that matches the status information, the preset default application among the candidate applications is determined as the target application.

11. A voice control device, characterized in that include: The receiving module is used to receive voice commands indicating control requirements; The determination module is used to determine the display screen where the voice virtual image is located as the target display screen if the display screen corresponding to the voice command does not include the specified display screen and the type of the voice command is a first type; and to determine the display screen where the voice virtual image is located as the target display screen if the display screen corresponding to the voice command does not include the specified display screen, the type of the voice command is a second type and the display screen where the voice virtual image is located is playing through headphones. The control module is used to control the target application to execute the voice command, wherein the target application is an application on the target display screen that matches the control requirements; The first type includes on-demand type, interface open type, and interface close type; The second type includes resume playback classes and control classes for audio and video that are currently playing.

12. An electronic device, comprising: include: A processor for executing a computer program stored in a memory, wherein the computer program, when executed by the processor, implements the steps of the method according to any one of claims 1-10.

13. A computer readable storage medium having stored thereon a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1-10.

14. A vehicle characterized by comprising: include: The voice control device as described in claim 11; Or, the electronic device as described in claim 12; or a computer readable storage medium as claimed in claim 13.

Citation Information

Patent Citations

  • Voice control method and device and mobile device

    CN104916287A

  • Terminal control method and device, intelligent terminal and computer readable storage medium

    CN111933135A

  • Display content control method and device, computer device and readable storage medium

    CN112786032A