Voice control method and device of application program, storage medium and electronic device

Abstract

This invention provides a voice control method, apparatus, computer-readable storage medium, and electronic device for an application. The method includes: recognizing an acquired voice command based on a voice control program to determine a semantic recognition result corresponding to the voice command; determining a target application based on the semantic recognition result; determining a communication execution mode between the voice control program and the target application based on voice service registration information and a preset configuration table corresponding to the target application; and controlling the target application to execute the operation corresponding to the voice command based on the communication execution mode. The technical solution provided by this invention enables voice control of downloaded target applications, facilitating user operation.

Description

Technical Field

[0001] This invention relates to the field of voice control technology, and more specifically, to voice control methods, devices, storage media, and electronic devices for applications. Background Technology

[0002] With the continuous advancement of human-computer interaction technology, voice control functions on smart terminals have become increasingly common. Currently, voice control functions on smart terminals are usually factory-tested. However, in daily life, users often download and install various applications from the app store on their smart terminals according to their needs. Since smart terminals cannot perform voice control on newly downloaded applications, determining a voice control method for an application is of great significance. Summary of the Invention

[0003] This invention provides a voice control method, apparatus, computer-readable storage medium, and electronic device for applications, to solve the technical problem that existing smart terminals cannot perform voice control on applications newly downloaded from the application market.

[0004] Firstly, a voice control method for an application is provided, which specifically includes the following steps:

[0005] The acquired voice commands are recognized based on the voice control program, and the semantic recognition result corresponding to the voice commands is determined.

[0006] Based on the semantic recognition results, the target application is determined;

[0007] Based on the voice service registration information and preset configuration table corresponding to the target application, the communication execution method between the voice control program and the target application is determined.

[0008] Based on the communication execution method, the target application is controlled to perform the operation corresponding to the voice command.

[0009] Secondly, a voice control device for an application is provided, specifically including the following modules:

[0010] The recognition processing module is used to recognize the acquired voice commands based on the voice control program and determine the semantic recognition result corresponding to the voice commands.

[0011] The program determination module is used to determine the target application based on the semantic recognition results;

[0012] The method determination module is used to determine the communication execution method between the voice control program and the target application based on the voice service registration information and the preset configuration table corresponding to the target application;

[0013] An operation processing module is used to control the target application to perform the operation corresponding to the voice command based on the communication execution method.

[0014] Thirdly, a computer-readable storage medium is provided, the storage medium storing a computer program for executing the voice control method of the above-described application.

[0015] Fourthly, an electronic device is provided, the electronic device comprising:

[0016] processor;

[0017] Memory used to store the processor's executable instructions;

[0018] The processor is configured to read the executable instructions from the memory and execute the instructions to implement the voice control method of the application described above.

[0019] Compared with the prior art, the voice control method, device, computer-readable storage medium, and electronic device for applications provided by the present invention have at least the following beneficial effects:

[0020] The technical solution provided by this invention, after a user issues a voice command, uses a voice control program within the system that supports voice functionality to recognize the acquired voice command, determine the semantic recognition result corresponding to the voice command, and, based on the semantic recognition result, identify the target application that the user intends to control via the voice command. Further, it determines the voice service registration information corresponding to the target application. The existence of voice service registration information indicates that the target application has registered with the voice control program, meaning the target application has the permission to support voice services. In other words, the technical solution provided by this invention allows downloaded applications to register for voice services, thus providing a prerequisite for voice control of downloaded applications. Because there are many applications on the market, to achieve information interaction between the voice control program and various downloaded applications, different communication execution methods are determined for different downloaded applications. Therefore, when the target application has corresponding voice service registration information, combined with a pre-acquired preset configuration table, the communication execution method between the voice control program and the target application is determined. That is, the voice control program and the target application can interact through the determined communication execution method, allowing the target application to obtain information related to the voice command, enabling the target application to execute the operation corresponding to the voice command, realizing user voice control of the target application, and facilitating user operation. Attached Figure Description

[0021] To more clearly illustrate the technical solution of the present invention, the accompanying drawings used in the description of the present invention will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 This is a flowchart illustrating a voice control method for an application provided in an exemplary embodiment of the present invention. Figure 1 ;

[0023] Figure 2 This is a flowchart illustrating a voice control method for an application provided in an exemplary embodiment of the present invention. Figure 2 ;

[0024] Figure 3 This is a flowchart illustrating a voice control method for an application provided in an exemplary embodiment of the present invention. Figure 3 ;

[0025] Figure 4 This is a flowchart illustrating a voice control method for an application provided in an exemplary embodiment of the present invention. Figure 4 ;

[0026] Figure 5 This is a flowchart illustrating a voice control method for an application provided in an exemplary embodiment of the present invention. Figure 5 ;

[0027] Figure 6 This is a schematic diagram of the structure of a voice control device for an application provided in an exemplary embodiment of the present invention;

[0028] Figure 7 This is a structural diagram of an electronic device provided in an exemplary embodiment of the present invention. Detailed Implementation

[0029] The technical solutions of this invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art without creative effort based on the embodiments of this invention are within the scope of protection of this invention.

[0030] Exemplary methods

[0031] Figure 1 This is a flowchart illustrating a voice control method for an application provided in an exemplary embodiment of the present invention, specifically including the following steps:

[0032] Step 10: Based on the voice control program, the acquired voice commands are recognized to determine the semantic recognition result corresponding to the voice commands.

[0033] In one embodiment, the voice control program is a voice control program that supports voice functions and is already installed in a smart terminal system. The smart terminal includes, but is not limited to, mobile phones, computers, tablets, and in-vehicle infotainment systems. Specifically, if voice control program A is installed in the in-vehicle infotainment system, after the user issues a voice command, the voice acquisition device acquires the voice command and transmits it to voice control program A. Voice control program A recognizes the received voice command and determines the semantic recognition result corresponding to the voice command.

[0034] Step 20: Based on the semantic recognition results, determine the target application.

[0035] In one embodiment, the target application refers to a program object that the user intends to control via voice commands. For example, if the determined semantic recognition result is "application B" or "play a song," then the target application is identified as application B. Of course, when the user issues a voice command, application B may not be explicitly mentioned. For example, if the voice command is "open news C," then "news C" is extracted from the semantic recognition result. If news C is the content corresponding to application D, then application D is the target application.

[0036] Step 30: Based on the voice service registration information and preset configuration table corresponding to the target application, determine the communication execution method between the voice control program and the target application.

[0037] In one embodiment, after determining the target application, the corresponding voice service registration information is determined. If the target application has registered its voice service with the voice control program, then the target application has corresponding voice service registration information. If the target application has not registered its voice service with the voice control program, then the target application does not have corresponding voice service registration information. In other words, the technical solution provided by this invention allows downloaded applications to register their voice services, thus providing a prerequisite for voice control of downloaded applications. Furthermore, because there are many applications on the market, in order to achieve information interaction between the voice control program and various downloaded applications, different communication execution methods are determined for different downloaded applications. After the target application has corresponding voice service registration information, the communication execution method between the voice control program and the target application can be determined according to a preset configuration table. The communication execution methods include, but are not limited to, invocation methods and virtual click methods.

[0038] Specifically, it determines whether the target application has corresponding voice service registration information. If it does, it determines the communication execution method between the voice control program and the target application based on the preset configuration table. If it does not exist, it stops the current process, meaning that the target application cannot be controlled by voice.

[0039] Step 40: Based on the communication execution method, control the target application to execute the operation corresponding to the voice command.

[0040] In one embodiment, by determining the communication execution method, information interaction between the voice control program and the target application can be realized, so that the target application can obtain information related to the voice command, enabling the target application to execute the operation corresponding to the voice command.

[0041] In the above embodiments, after the user issues a voice command, the voice control program within the system that supports voice functionality recognizes the acquired voice command, determines the semantic recognition result corresponding to the voice command, and, based on the semantic recognition result, determines the target application that the user intends to control via the voice command. Further, the voice service registration information corresponding to the target application is determined. The existence of voice service registration information indicates that the target application has registered with the voice control program for voice services, meaning the target application has the permission to have the voice service supported by the voice control program. In other words, the technical solution provided in this embodiment allows downloaded applications to register for voice services, thus providing a prerequisite for voice control of downloaded applications. Because there are many applications on the market, to achieve information interaction between the voice control program and various downloaded applications, different communication execution methods are determined for different downloaded applications. Therefore, when the target application has corresponding voice service registration information, combined with a pre-acquired preset configuration table, the communication execution method between the voice control program and the target application is determined. That is, the voice control program and the target application can interact through the determined communication execution method, allowing the target application to obtain information related to the voice command, enabling the target application to execute the operation corresponding to the voice command, realizing the user's voice control of the target application, and facilitating user operation.

[0042] like Figure 2 As shown above, in the above Figure 1 Based on the illustrated embodiment, in an exemplary embodiment of the present invention, step 30 determines the communication execution method between the voice control program and the target application based on the voice service registration information and preset configuration table corresponding to the target application. Specifically, this may include the following steps:

[0043] Step 301: If the target application has voice service registration information, then the calling relationship between the voice control program and the target application is determined based on the preset configuration table.

[0044] Step 302: Determine the communication execution method based on the aforementioned call relationship.

[0045] In the above embodiments, the preset configuration table records configuration-related information of the applications. Based on the preset configuration table, the calling relationship between the voice control program and various applications can be determined—that is, whether the voice control program actively calls the downloaded applications, or the downloaded applications actively call the voice control program. Different calling methods correspond to different communication execution methods. Therefore, when the target application has voice service registration information, the calling relationship between the voice control program and the target application is further determined according to the preset configuration table, thereby determining the communication execution method. With the increase in applications on the market, some downloaded applications can actively call the voice control program, while some downloaded applications are incompatible with the protocol of the smart terminal system. Therefore, the voice control program needs to actively call these applications. This embodiment considers both possible calling relationships, providing conditions for realizing voice control of various applications.

[0046] like Figure 3 As shown above, in the above Figure 2 Based on the illustrated embodiment, in an exemplary embodiment of the present invention, step 302 determines the communication execution mode based on the calling relationship, including: step 3021, if the calling relationship is that the voice control program calls the target application, the communication execution mode is determined to be middleware communication.

[0047] In one embodiment, when the protocol of a downloaded application is incompatible with the protocol of the smart terminal system, in order to meet the user's need for voice control of that part of the application, the developers need to adapt it according to the external verification SDK of that part of the application and configure middleware so that the voice control program can call that part of the application through the middleware. Therefore, when the calling relationship is that the voice control program calls the target application, the communication execution method is middleware communication. Specifically, for commonly used applications in the download app market, such as the top 100 downloaded applications in the download app market, if there are any applications that are incompatible with the protocol of the smart terminal system, the developers can perform adaptation work. After the developers perform the adaptation, the package name corresponding to the application is added to a preset configuration table, so that the list of applications that the voice control program can actively call can be obtained from the preset configuration table.

[0048] Step 40, controlling the target application to execute the operation corresponding to the voice command based on the communication execution method, includes:

[0049] Step 401: If the communication execution mode is middleware communication, then the target configuration information in the middleware is determined based on the semantic recognition result.

[0050] Step 402: Based on the target configuration information, call the target interface of the target application so that the target application can perform the operation corresponding to the voice command.

[0051] In the above embodiments, different applications will have different configuration information. Therefore, after determining that the communication execution method is middleware communication, the target configuration information in the middleware is further determined based on the semantic recognition results. Based on the target configuration information, the target interface of the target application can be called, and the operation action corresponding to the voice command can be implemented through the target interface. In this embodiment, by using middleware communication, communication between the voice control program and the target application can be effectively realized, providing the conditions for voice control of commonly downloaded applications, so that users can control more downloaded applications by voice.

[0052] For example, the developers adapted application E and configured information in the middleware so that application E could be called through the middleware to implement the control functions in application E's SDK. The package name corresponding to application E was added to a preset configuration table, which determines when the voice control program actively calls application E. When the user's voice command is "Play music with application E," the target application is identified as application E. The system checks if application E has voice service registration information. If it does, it further checks if application E is in the preset configuration table. If it is, the calling relationship between application E and the voice control program is determined. If the calling relationship is determined to be the voice control program calling the target application, the communication method is middleware communication. Based on the identified target application (application E) and the target action (play), the target configuration information is determined. Based on the target configuration information, the target interface implementing the playback function in the target application is called, causing the target interface to execute the playback action, thus achieving voice control of the downloaded target application.

[0053] When the voice control program actively calls the application, the application's voice service registration with the voice control program is also completed through middleware. In one possible implementation: A first application is obtained; if, based on a preset configuration table, it is determined that the voice control program calls the first application, a first voice service registration request sent by the middleware is received; based on the first voice service registration request, the voice service registration information corresponding to the first application is determined. The first application can be obtained by downloading it. After downloading the first application, if, based on the preset configuration table, it is determined that the voice control program calls the first application, the middleware can be controlled to send the first voice service registration request to the voice control program, thereby enabling the voice control program to determine the voice service permissions of the first application based on the first voice service registration request. Alternatively, after downloading the first application, the system will broadcast the newly downloaded application; the middleware, based on this broadcast, will send the first voice service registration request to the voice control program, thus promptly registering the voice service for the first application after download. The first application can be obtained through user selection. That is, for a first application that has already been downloaded and installed, when the user wants to enable voice control of the first application, they can actively select it on the voice function registration interface to obtain the first application, thereby realizing the registration of the voice service of the already downloaded first application.

[0054] like Figure 4 As shown above, in the above Figure 2 Based on the illustrated embodiment, in an exemplary embodiment of the present invention, step 302, based on the calling relationship, determines the communication execution mode, including: step 3022, if the calling relationship is that the target application calls the voice control program, the communication execution mode is determined to be direct call communication.

[0055] In one embodiment, if the calling relationship is that the target application calls the voice control program, i.e., the target application initiates the call, information interaction can be achieved directly through the target application calling the voice control program without the need for middleware. Specifically, some applications, in order to promote their use, will configure their own applications according to the external verification SDK of the voice control program, thereby making the application's protocol compatible with the protocol of the smart terminal system. That is, after downloading the application, the application can call the voice control program. These applications are also recorded in a preset configuration table. Therefore, the calling relationship of the target application calling the voice control program can be determined through the preset configuration table.

[0056] Step 40, controlling the target application to execute the operation corresponding to the voice command based on the communication execution method, includes:

[0057] Step 403: If the communication execution method is direct call communication, then receive the call request from the target application;

[0058] Step 404: The logical result determined based on the call request is returned to the target application so that the target application executes the operation corresponding to the voice command.

[0059] In the above embodiments, if the communication execution method is direct invocation communication, the voice control program will directly receive the invocation request from the target application, perform the invocation according to the target application's invocation request, and return the logical result determined according to the invocation request to the target application, thereby enabling the target application to execute the operation corresponding to the voice command. In one possible implementation, after the voice control program recognizes the target application, it transmits notification information to the target application, and the target application transmits an invocation request based on the notification information. In this embodiment, interaction can be achieved through the target application actively invoking the voice control program, thereby realizing voice control of the target application and enabling users to control more downloaded applications via voice.

[0060] When the call relationship between the voice control program and the application is such that the application actively calls the voice control program, the application is responsible for registering its voice service with the voice control program. In one possible implementation: A second application is acquired; if, based on a preset configuration table, it is determined that the second application calls the voice control program, a second voice service registration request from the second application is received; based on the second voice service registration request, the voice service registration information of the second application is determined. The second application can be acquired through downloading. After downloading the second application, if, based on the preset configuration table, it is determined that the second application calls the voice control program, then upon installation, the second application directly transmits the second voice service registration request to the voice control program, allowing the voice control program to determine the voice service permissions of the second application based on the second voice service registration request. In other words, the voice service is registered for the second application promptly after downloading. Alternatively, the second application can be acquired through user selection. For a second application that has already been downloaded and installed, when the user wants to control it via voice, they actively select it in the voice function registration interface to acquire the second application and thus register its voice service.

[0061] like Figure 5 As shown above, in the above Figure 1Based on the illustrated embodiment, in an exemplary embodiment of the present invention, step 30 determines the communication execution method between the voice control program and the target application based on the voice service registration information and preset configuration table corresponding to the target application. Specifically, this may include the following steps:

[0062] Step 303: If the target application has voice service registration information and the target application is not in the preset configuration table, then the communication execution method between the voice control program and the target application is determined to be virtual click.

[0063] Step 40, controlling the target application to execute the operation corresponding to the voice command based on the communication execution method, includes:

[0064] Step 405: If the communication execution method is virtual click, then determine the target button corresponding to the semantic recognition result in the target application;

[0065] Step 406: Trigger the target button to cause the target application to execute the operation corresponding to the voice command.

[0066] In the above embodiments, if the target application has voice service registration information but is not in the preset configuration table, the target application and the voice control program cannot call each other due to interface differences. To meet the voice control needs of such applications, this embodiment adopts a virtual click communication execution method. Specifically, the system can obtain the displayed text of the application and register the displayed text as the corresponding voice. When a certain displayed text exists in the semantic recognition result, the system can determine the target button in the target application based on the registration content. By triggering the target button, the target application executes the operation corresponding to the voice command. Since there are many applications on the market, some applications may not be in the preset configuration table. In this embodiment, virtual clicks can be used to voice control such applications, meeting the user's need to control more applications.

[0067] When there is no calling relationship between the voice control program and the application, the application can register its voice service in the following ways: Obtain a third application; if the third application is not in a preset configuration table, determine the association between the displayed text and the buttons, and extract the displayed text of the third application for voice service registration. Obtaining the third application can be done by downloading it. If the third application is not in the preset configuration table, obtain its displayed text and determine the corresponding buttons for each displayed text, thus establishing the association between the displayed text and the buttons. Then, register the displayed text for voice service in the voice control program. This allows the voice control program to determine the voice service registration information of the third application based on the voice service registration of the displayed text, confirm the voice service permissions of the third application, and promptly register the voice service for the third application. Alternatively, the third application can be obtained through user selection. For a third application that has already been downloaded and installed, when the user wants to control it, they can actively select it in the voice function registration interface to obtain the third application and thus register its voice service.

[0068] In an exemplary embodiment of the present invention, the step of extracting the displayed text of the third application for voice service registration includes: extracting the displayed text of the third application; determining the display position of the displayed text; and registering the voice service based on the displayed text and the display position.

[0069] In the above embodiments, the displayed text of the third application is extracted, and the display position corresponding to the displayed text is further determined. Therefore, when registering the voice service, both the specific content and the display position of the displayed text are considered. When the same displayed text exists in different locations within the application, if voice service registration is based solely on the displayed text, accurate voice control may not be possible. Therefore, to achieve more accurate voice control, both the displayed text and the display position are considered during voice service registration, so that the target button can be accurately determined based on the content and position of the displayed text.

[0070] In an exemplary embodiment of the present invention, the method further includes: updating the preset configuration table based on the received configuration information. In the above embodiment, as applications are updated in the market, developers work to adapt their applications, and applications are promoted, the content of the preset configuration table needs to be updated. Therefore, the preset configuration table can be managed using configuration information, making the information in the preset configuration table real-time, so that users can use voice control to control the latest and most popular downloaded applications, providing greater convenience.

[0071] Exemplary device

[0072] Based on the same concept as the embodiments of the method of the present invention, such as Figure 6 As shown, this embodiment of the invention also provides a voice control device for an application, specifically including the following modules:

[0073] The recognition processing module 61 is used to recognize the acquired voice commands based on the voice control program and determine the semantic recognition result corresponding to the voice commands.

[0074] The program determination module 62 is used to determine the target application based on the semantic recognition result;

[0075] The method determination module 63 is used to determine the communication execution method between the voice control program and the target application based on the voice service registration information and the preset configuration table corresponding to the target application;

[0076] The operation processing module 64 is used to control the target application to perform the operation corresponding to the voice command based on the communication execution method.

[0077] In an exemplary embodiment of the present invention, the method determination module includes...

[0078] The relationship determination unit is used to determine the calling relationship between the voice control program and the target application based on a preset configuration table if the target application has voice service registration information.

[0079] The method determination unit is used to determine the communication execution method based on the calling relationship.

[0080] In an exemplary embodiment of the present invention, the mode determination unit is configured to determine that the communication execution mode is middleware communication if the calling relationship is that the voice control program calls the target application.

[0081] The operation processing module includes:

[0082] An information determination unit is used to determine the target configuration information in the middleware based on the semantic recognition result if the communication execution mode is middleware communication.

[0083] The first operation unit is used to call the target interface of the target application based on the target configuration information, so that the target application can perform the operation corresponding to the voice command.

[0084] In an exemplary embodiment of the present invention, the apparatus further includes:

[0085] The first acquisition module is used to acquire the first application. If it is determined based on the preset configuration table that the voice control program calls the first application, then the module receives the first voice service registration request sent by the middleware.

[0086] The first registration module is used to determine the voice service registration information corresponding to the first application based on the first voice service registration request.

[0087] In an exemplary embodiment of the present invention, the mode determination unit is configured to determine that the communication execution mode is direct call communication if the calling relationship is that the target application calls the voice control program.

[0088] The operation processing module includes:

[0089] The call processing unit is configured to receive the call request from the target application if the communication execution method is direct call communication;

[0090] The second operation unit is used to return the logical result determined based on the call request to the target application, so that the target application can execute the operation corresponding to the voice command.

[0091] In an exemplary embodiment of the present invention, the apparatus further includes:

[0092] The second acquisition module is used to acquire the second application. If it is determined based on the preset configuration table that the second application calls the voice control program, then the module receives the second voice service registration request of the second application.

[0093] The second registration module is used to determine the voice service registration information of the second application based on the second voice service registration request.

[0094] In an exemplary embodiment of the present invention, the method determining module includes:

[0095] A virtual processing unit is configured to determine that the communication execution mode between the voice control program and the target application is virtual click if the target application has voice service registration information and the target application is not in a preset configuration table.

[0096] The operation processing module includes:

[0097] A button determination unit is used to determine the target button in the target application corresponding to the semantic recognition result if the communication execution method is virtual click;

[0098] The third operation unit is used to trigger the target button, causing the target application to execute the operation corresponding to the voice command.

[0099] In an exemplary embodiment of the present invention, the apparatus further includes:

[0100] The third registration module is used to obtain a third application. If the third application is not in the preset configuration table, the module determines the association between the displayed text and the button, and extracts the displayed text of the third application for voice service registration.

[0101] In an exemplary embodiment of the present invention, the third registration module is used to obtain a third application; if the third application is not in a preset configuration table, it determines the association between the displayed text and the button, and extracts the displayed text of the third application; determines the display position of the displayed text; and registers voice service based on the displayed text and the display position.

[0102] In an exemplary embodiment of the present invention, the apparatus further includes:

[0103] An update processing module is used to update the preset configuration table based on the received configuration information.

[0104] Exemplary electronic devices

[0105] Figure 7 A block diagram of an electronic device according to an embodiment of the present invention is shown.

[0106] like Figure 7 As shown, the electronic device 100 includes one or more processors 101 and memory 102.

[0107] The processor 101 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 100 to perform desired functions.

[0108] The memory 102 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 101 may execute the program instructions to implement the voice control methods of the application programs of the various embodiments of the present invention described above, and / or other desired functions.

[0109] In one example, the electronic device 100 may also include an input device 103 and an output device 104, which are interconnected via a bus system and / or other forms of connection mechanism (not shown).

[0110] Of course, for the sake of simplicity, Figure 7 Only some of the components of the electronic device 100 relevant to the present invention are shown, omitting components such as buses, input / output interfaces, etc. In addition, the electronic device 100 may include any other suitable components depending on the specific application.

[0111] Exemplary computer program products and computer-readable storage media

[0112] In addition to the methods and devices described above, embodiments of the present invention may also be computer program products, which include computer program instructions that, when executed by a processor, cause the processor to perform the steps in the voice control methods of the application programs according to various embodiments of the present invention as described in the "Exemplary Methods" section of this specification.

[0113] The computer program product can be written in any combination of one or more programming languages ​​to perform the operations of the embodiments of the present invention. The programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0114] Furthermore, embodiments of the present invention may also be computer-readable storage media storing computer program instructions thereon, which, when executed by a processor, cause the processor to perform the steps in the voice control method of the application program according to various embodiments of the present invention described in the "Exemplary Methods" section above.

[0115] The computer-readable storage medium may be any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may, for example, include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0116] The basic principles of the present invention have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in the present invention are merely examples and not limitations, and should not be considered as essential features of each embodiment of the present invention. Furthermore, the specific details of the invention described above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the present invention to the necessity of employing the specific details described above.

[0117] The block diagrams of devices, apparatuses, devices, and systems involved in this invention are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0118] It should also be noted that in the apparatus, device, and method of the present invention, the components or steps can be disassembled and / or recombined. These disassemblies and / or recombinations should be considered as equivalent solutions of the present invention.

[0119] The above description of aspects of the invention is provided to enable any person skilled in the art to make or use the invention. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein can be applied to other aspects without departing from the scope of the invention. Therefore, the invention is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features of the invention herein.

[0120] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of the invention to the forms described herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations therein.

Claims

1. A voice control method for an application, characterized in that, Specifically, the steps include the following: The acquired voice commands are recognized based on the voice control program, and the semantic recognition result corresponding to the voice commands is determined. Based on the semantic recognition results, the target application is determined; Based on the voice service registration information and preset configuration table corresponding to the target application, the communication execution method between the voice control program and the target application is determined. Based on the communication execution method, the target application is controlled to perform the operation corresponding to the voice command; The step of determining the communication execution method between the voice control program and the target application based on the voice service registration information and preset configuration table corresponding to the target application includes: If the target application has voice service registration information, the calling relationship between the voice control program and the target application is determined based on the preset configuration table; Based on the aforementioned call relationship, the communication execution method is determined; The step of determining the communication execution method based on the invocation relationship includes: If the calling relationship is that the voice control program calls the target application, the communication execution method is determined to be middleware communication; If the calling relationship is that the target application calls the voice control program, the communication execution method is determined to be direct call communication.

2. The method according to claim 1, wherein controlling the target application to execute the operation corresponding to the voice command based on the communication execution mode includes: If the communication execution method is middleware communication, then the target configuration information in the middleware is determined based on the semantic recognition result; Based on the target configuration information, the target interface of the target application is invoked so that the target application executes the operation corresponding to the voice command.

3. The method according to claim 2, further comprising: Obtain the first application; if it is determined, based on the preset configuration table, that the voice control program calls the first application, then receive the first voice service registration request sent by the middleware. Based on the first voice service registration request, the voice service registration information corresponding to the first application is determined.

4. The method according to claim 1, wherein controlling the target application to execute the operation corresponding to the voice command based on the communication execution mode includes: If the communication execution method is direct call communication, then the call request from the target application is received; The logical result determined based on the call request is returned to the target application so that the target application can execute the operation corresponding to the voice command.

5. The method according to claim 4, further comprising: Obtain the second application; if, based on the preset configuration table, it is determined that the second application calls the voice control program, then receive the second voice service registration request of the second application. Based on the second voice service registration request, the voice service registration information of the second application is determined.

6. The method according to claim 1, wherein determining the communication execution mode between the voice control program and the target application based on the voice service registration information and preset configuration table corresponding to the target application includes: If the target application has voice service registration information and the target application is not in the preset configuration table, then the communication execution method between the voice control program and the target application is determined to be virtual click; The step of controlling the target application to execute the operation corresponding to the voice command based on the communication execution method includes: If the communication execution method is virtual click, then the target button corresponding to the semantic recognition result in the target application is determined; Triggering the target button causes the target application to execute the operation corresponding to the voice command.

7. The method according to claim 6, further comprising: Obtain a third application. If the third application is not in the preset configuration table, determine the association between the displayed text and the key, and extract the displayed text of the third application for voice service registration.

8. The method according to claim 7, wherein extracting the displayed text of the third application for voice service registration includes: Extract the displayed text of the third application; Determine the display position of the text; Voice service registration is performed based on the displayed text and display location.

9. The method according to any one of claims 1-8, further comprising: The preset configuration table is updated based on the received configuration information.

10. A voice control device for an application, characterized in that, Specifically, it includes the following modules: The recognition processing module is used to recognize the acquired voice commands based on the voice control program and determine the semantic recognition result corresponding to the voice commands. The program determination module is used to determine the target application based on the semantic recognition results; The method determination module is used to determine the communication execution method between the voice control program and the target application based on the voice service registration information and the preset configuration table corresponding to the target application; An operation processing module is used to control the target application to perform the operation corresponding to the voice command based on the communication execution method. The method for determining the module includes: The relationship determination unit is used to determine the calling relationship between the voice control program and the target application based on a preset configuration table if the target application has voice service registration information. The method determination unit is used to determine the communication execution method based on the calling relationship; The method determination unit is used to determine that if the calling relationship is that the voice control program calls the target application, the communication execution method is middleware communication; The method determination unit is used to determine that if the calling relationship is that the target application calls the voice control program, the communication execution method is direct call communication.

11. A computer-readable storage medium storing a computer program for executing a voice control method of the application program according to any one of claims 1-9.

12. An electronic device, the electronic device comprising: processor; Memory used to store the processor's executable instructions; The processor is configured to read the executable instructions from the memory and execute the instructions to implement the voice control method of the application according to any one of claims 1-9.

Images