Method and computing system for operating a voice assistant activation system

By using a single microphone and a decomposition module in kitchen appliances to decompose voice input into multiple virtual microphone signals, the problem of integrating multiple voice assistant modules is solved, enabling parallel processing and resource optimization of multiple voice assistant modules.

CN113593550BActive Publication Date: 2026-11-17QINGDAO HAIER SMART TECH R & D CO LTD +2
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110731604.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-11-13
Filing Date
2021-06-29
Publication Date
2026-11-17
Estimated Expiration
2041-06-29

AI Technical Summary

Technical Problem

In existing kitchen appliances, multiple voice assistant modules require multiple microphones, resulting in wasted resources and increased costs. Furthermore, only one voice assistant module can access the microphone, making it impossible to integrate multiple voice assistant modules.

Method used

By using a single microphone and a decomposition module, the voice input is decomposed into multiple virtual microphone signals, which are then sent to different voice assistant modules. Each voice assistant module is activated using different keywords.

Benefits of technology

It enables simultaneous activation and operation of multiple voice assistant modules, reducing hardware costs, improving resource utilization efficiency, and supporting parallel processing of multiple voice assistant modules.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113593550B_ABST
    Figure CN113593550B_ABST
Patent Text Reader

Abstract

A method for operating a voice assistant activation system, the voice assistant activation system including a microphone, a first voice assistant module, and a second voice assistant module. The method includes receiving voice input through the microphone; sending the voice input to the first voice assistant module through a first virtual microphone; sending the voice input to the second voice assistant module through a second virtual microphone; activating the first voice assistant module when the voice input includes a first keyword; and activating the second voice assistant module when the voice input includes a second keyword.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This topic generally relates to a network-connected kitchen hub, and more specifically to the voice assistant module of the kitchen hub. Background Technology

[0002] Generally speaking, kitchen appliances are appliances that perform related operations (e.g., refrigerators, ovens, microwave ovens, etc.). Recently, the interconnection between kitchen appliances and the internet has become increasingly close, both internally between appliances and externally. One feature that kitchen appliances may offer is a voice-activated assistant function. Specifically, users can activate the voice assistant module using specific keywords, and then the module can receive and execute voice requests or commands from the user.

[0003] However, in order to focus on receiving keywords, the voice assistant module must always have access to the microphone. Accordingly, for some appliances with only one microphone, only one voice assistant module can access that microphone at a time. Therefore, if a user wants to integrate multiple voice assistant modules into one appliance, an additional microphone needs to be installed for each voice assistant module.

[0004] Therefore, it would be beneficial for a kitchen hub or appliance to include features that eliminate one or more of these drawbacks. More specifically, a method of sending a single microphone input to multiple voice assistant modules would be particularly advantageous. Summary of the Invention

[0005] Various aspects and advantages of the present invention will be set forth in the following description, or will be obvious from the description, or may be learned by practicing the invention.

[0006] According to one aspect of the present disclosure, a method for operating a voice assistant activation system is provided. The voice assistant activation system may include a microphone, a first voice assistant module, and a second voice assistant module. The method may include: receiving voice input through the microphone; sending the voice input to the first voice assistant module through a first virtual microphone; sending the voice input to the second voice assistant module through a second virtual microphone; activating the first voice assistant module when the voice input includes a first keyword; and activating the second voice assistant module when the voice input includes a second keyword.

[0007] According to another aspect of the present disclosure, a computing system is disclosed. The computing system may include at least one processor, a microphone communicating with the at least one processor, a first voice assistant module connected to the at least one processor, a second voice assistant module connected to the at least one processor, and at least one tangible, non-transitory computer-readable medium for storing instructions, wherein the at least one processor, when executing the instructions, causes the at least one processor to perform an operation. The operation may include: receiving voice input through the microphone; sending the voice input to the first voice assistant module through a first virtual microphone; sending the voice input to the second voice assistant module through a second virtual microphone; activating the first voice assistant module when the voice input includes a first keyword; and activating the second voice assistant module when the voice input includes a second keyword.

[0008] These and other features, aspects, and advantages of the invention will be better understood by referring to the following description and appended claims. Embodiments of the invention are illustrated in conjunction with the accompanying drawings, which form a part of this description, and together with the description serve to explain the principles of the invention. Attached Figure Description

[0009] For those skilled in the art, the complete and feasible disclosure of the present invention is set forth in the specification, which includes the preferred mode thereof and is referenced in the accompanying drawings.

[0010] Figure 1 A front view of a system including microwave appliances according to an embodiment of the present disclosure is provided.

[0011] Figure 2 Provided Figure 1 A side view of an exemplary system.

[0012] Figure 3 A schematic diagram of possible connection methods for an exemplary system according to exemplary embodiments of the present disclosure is provided.

[0013] Figure 4 A flowchart is provided for a method of operating a voice activation system according to an exemplary embodiment of the present disclosure. Detailed Implementation

[0014] Referring now to embodiments of the invention, one or more examples are illustrated in the accompanying drawings. Each embodiment provided is intended to explain the invention and not to limit it. In fact, it will be apparent to those skilled in the art that various modifications and variations can be made to the invention without departing from its scope. For example, features shown or described as part of one embodiment may be used with another embodiment to produce yet another embodiment. Therefore, the invention includes the aforementioned modifications and variations within the scope of the following appended claims and their equivalents.

[0015] As used herein, the terms “includes” and “including” are intended to be included in a manner similar to the term “comprising.” Similarly, the term “or” is generally intended to be included (i.e., “A or B” is intended to mean “A or B or both”). As used throughout the specification and claims herein, approximate language is used to modify any quantitative representation that may allow for variation without altering the essential function associated with it. Therefore, a value modified by one or more terms such as “about,” “approximate,” and “substantially” is not limited to the specified exact value. In at least some cases, approximate language may correspond to the precision of the instrument used to measure the value. For example, approximate language may refer to a range of 10%.

[0016] Figure 1 and Figure 2 Various views of a system 100 according to embodiments of the present disclosure are provided. The system 100 may be a kitchen hub including an over-range (OTR) microwave appliance 102 that can be positioned or mounted above a cooktop appliance 104. Each of these microwave appliances 102 and cooktop appliances 104 within the system 100 will be described below independently and collectively. However, it should be understood that the subject matter is not limited to the specific appliances disclosed, and the configuration of specific appliances is not intended to limit the scope of the subject matter in any way.

[0017] like Figure 1 and Figure 2 As shown, system 100 defines a vertical direction V, a lateral direction L, and a transverse direction T. The vertical, lateral, and transverse directions are perpendicular to each other and form an orthogonal direction system. As used herein, this coordinate system is equally applicable to microwave appliance 102 and cooktop appliance 104, and therefore can be used interchangeably to describe these two appliances and their positions relative to each other.

[0018] The cooktop appliance 104 may include a chassis or cabinet 110 extending vertically V between a top 112 and a bottom 114; extending laterally L between a left and right side portion; and extending laterally T between a front and a rear portion. The cooktop appliance 104 includes a cooktop surface 116 having one or more heating elements 118 used, for example, in heating or cooking operations. In an exemplary embodiment, the cooktop surface 116 is made of microcrystalline glass. However, in other embodiments, the cooktop surface 116 may contain another suitable material, such as a metallic material (e.g., steel) or another suitable non-metallic material. The heating elements 118 may be of various sizes and may employ any suitable method to heat or cook objects, such as cooking utensils (not shown) and their contents. In some embodiments, for example, the heating element 118 uses a heat transfer method such as an electromagnetic coil or a gas burner to heat the cooking utensils. However, in other embodiments, the heating element 118 uses an induction heating method to directly heat the cooking utensils. Conversely, the heating element 118 may comprise a gas burner element, a resistance heating element, a radiant heating element, an induction element, or another suitable heating element.

[0019] In some embodiments, cooktop appliance 104 includes an insulated cabinet 110 defining a cooking chamber 120, which is selectively covered by a door 122. One or more heating elements 124 (e.g., a top grilling element or a bottom baking element) may be enclosed within the cabinet 110 to heat the cooking chamber 120. The heating elements 124 within the cooking chamber 120 may be any suitable element capable of cooking the contents of the cooking chamber 120, such as resistance heating elements, gas burners, microwave elements, halogen elements, etc. Thus, cooktop appliance 104 may relate to the range of oven appliances. As will be understood by those skilled in the art, cooktop appliance 104 is provided by way of example only, and the subject matter can be used within the range of any suitable cooking appliances, such as dual oven appliance ranges or standalone cooktops (e.g., integrally mounted with a kitchen sink surface). Unless otherwise indicated, the exemplary embodiments shown in the drawings are not intended to limit the subject matter to any particular cooking chamber or heating element configuration.

[0020] As shown, a user interface panel 126 may be provided on the cooktop appliance 104. Although shown at the front of the cooktop appliance 104, in alternative embodiments, another suitable location or structure (e.g., a back panel) may be provided to support the user interface panel 126. In some embodiments, the user interface panel 126 includes input components or controls 128, such as one or more of various electrical, mechanical, or electromechanical input devices. Controls 128 may include, for example, dials, knobs, buttons, and touchpads. A controller 130 communicates with the user interface panel 126 and controls 128, through which a user can select various operating characteristics and modes and monitor the progress of the cooktop appliance 104. In additional or alternative embodiments, the user interface panel 126 includes a display component 132, such as a digital or analog display that communicates with the controller 130 and is configured to provide operational feedback to the user. In some embodiments, the user interface panel 126 represents a general-purpose I / O (“GPIO”) device or functional module.

[0021] System 100 may include microphone 134. Microphone 134 may be used to monitor sound waves, noise, or other vibrations generated when a user is near system 100. For example, microphone 134 may be one or more microphones, acoustic detection devices, vibration sensors, or any other suitable acoustic transducers disposed in or around system 100. For example, according to an exemplary embodiment, microphone 134 may be installed within microwave appliance 102 or cooktop appliance 104 to detect any sound within the audible range of system 100. Alternatively or additionally, microphone 134 may be placed elsewhere in the room or residence where system 100 is located. In this respect, any suitable microphone 134 acoustically coupled to system 100 may be used to monitor sound. Microphone 134 may be communicatively coupled (i.e., in a communicative manner) to controller 130.

[0022] As shown in the figure, the controller 130 is communicatively coupled to the user interface panel 126, controls 128, and display 132. The controller 130 can also be communicatively coupled to various operating components of the cooktop appliance 104, such as heating elements (e.g., 118, 124), sensors, etc. Input / output (“I / O”) signals can flow between the controller 130 and the various operating components of the cooktop appliance 104. Thus, the controller 130 can selectively activate and operate these various components. The various components of the cooktop appliance 104 are communicatively coupled to the controller 130 via one or more communication lines, such as conductive signal lines, shared communication buses, or wireless communication strips.

[0023] In some embodiments, controller 130 includes one or more memory devices and one or more processors. The processor can be any combination of a general-purpose or special-purpose processor, a CPU, a processor capable of executing programming instructions or control code related to the operation of the cooktop appliance 104, etc. The memory device (i.e., memory) can represent random access memory such as DRAM or read-only memory such as ROM or FLASH. In one embodiment, the processor executes programming instructions stored in the memory. The memory can be a component separate from the processor or can be onboard within the processor. Alternatively, controller 130 can be constructed without a processor, for example, using a combination of discrete analog or digital logic circuits (such as switches, amplifiers, integrators, comparators, flip-flops, AND gates, etc.) to perform control functions instead of relying on software.

[0024] In some embodiments, controller 130 includes a network interface, enabling controller 130 to connect and communicate with one or more network nodes via one or more networks. Controller 130 may also include one or more transmitting, receiving, or transceiver components for sending / receiving communication signals to other devices communicatively coupled to cooktop appliance 104. Additionally or optionally, one or more transmitting, receiving, or transceiver components may be located outside the onboard controller 130. Typically, controller 130 may be located at any suitable location throughout cooktop appliance 104. For example, controller 130 may be located near user interface panel 126, facing the front of cooktop appliance 104. In alternative embodiments, controller 130 is operatively communicated with controller 130 of microwave appliance 102 (described below) (e.g., via one or more wired or wireless channels). Additionally or optionally, controller 130 may include at least one processor capable of executing instructions. For example, the memory of controller 130 may include at least one tangible, non-transitory computer-readable medium storing instructions that cause the processor to perform certain operations.

[0025] As described above, the microwave appliance 102 can be positioned or mounted above the cooktop appliance 104 (e.g., as an OTR microwave oven). Specifically, the heat-insulated cabinet 150 of the microwave appliance 102 can be positioned above the cooktop appliance 104 along a vertical direction V. As shown, the cabinet 150 of the microwave appliance 102 includes multiple outer walls, and when assembled, the microwave appliance 102 generally extends along the vertical direction V between the top end 152 and the bottom end 154; extends along the lateral direction L between the first side end 156 and the second side end 158; and extends along the transverse direction T between the front end 160 and the rear end 162. In some embodiments, the cabinet 150 is spaced apart from the cooktop surface 116 along the vertical direction V. Thus, an open area 164 can be defined along the vertical direction V between the cooktop surface 116 and the bottom end 154 of the cabinet 150. Although a generally rectangular shape is shown, any suitable shape or style can be adapted to form the structure of the cabinet 150. Inside cabinet 150, the lining of cabinet 150 defines a cooking chamber 166 for receiving food to be cooked.

[0026] Microwave appliance 102 is typically configured to use electromagnetic radiation to heat items (e.g., food or beverages) within cooking chamber 166. As generally understood, microwave appliance 102 may include various components that generate electromagnetic radiation by operation. For example, as understood, microwave appliance 102 may include a heating assembly 168 having a magnetron (e.g., a cavity magnetron), a high-voltage transformer, a high-voltage capacitor, and a high-voltage diode. The transformer can supply energy from a suitable energy source (such as a power outlet) to the magnetron. The magnetron can convert the energy into electromagnetic radiation, particularly microwave radiation. The capacitor typically connects the magnetron and transformer to a chassis via a high-voltage diode. The microwave radiation generated by the magnetron can be transmitted to cooking chamber 166 via a waveguide.

[0027] The structure and intended function of a microwave oven or appliance are generally understood by those skilled in the art and will not be described in detail here. According to an alternative embodiment, the microwave appliance 102 may include one or more heating elements, such as resistance heating elements, gas burners, other microwave heating elements, halogen heating elements, or suitable combinations of the above elements, disposed within a cooking chamber 166 to heat the cooking chamber 166 and food placed therein.

[0028] Reference Figure 3This diagram illustrates a voice activation system according to an exemplary embodiment. System 100 may include a voice assistant activation system 180. The voice assistant activation system 180 may be installed in a controller 130. In some embodiments, the voice assistant activation system 180 is located on or within an external storage unit that communicates with the controller 130 via a network. The voice assistant activation system 180 can combine and operate two or more voice assistant modules within system 100 simultaneously using a single microphone. Advantageously, the voice assistant activation system 180 allows multiple voice assistant modules to perform multiple pipelined operations, which can reduce operating and hardware costs.

[0029] Specifically, the voice assistant activation system 180 includes a microphone 134. The voice assistant activation system 180 may further include a decomposition module (or signal processing module) 182. The decomposition module 182 can receive voice input or signals from the microphone 134 and decompose the voice input or signals into two identical signals. Each signal may contain the same information (i.e., the voice input or signal is copied). Specifically, the decomposition module 182 can perform sound processing on the received voice input or signals to produce two identical signals. In some embodiments, the decomposition module 182 decomposes the voice input or signals into three or more identical signals. Therefore, the decomposition module 182 can produce any suitable number of identical signals.

[0030] The decomposition module 182 can send the generated identical signal to the virtual microphone. For example, the voice activation system 180 may include a first virtual microphone 184 and a second virtual microphone 186. In some embodiments, the first virtual microphone 184 and the second virtual microphone 186 are integrated with the decomposition module 182. Additionally or optionally, the first virtual microphone 184 and the second virtual microphone 186 may be separate entities from the decomposition module 182. In other words, the first virtual microphone 184 and the second virtual microphone 186 may be separate from the decomposition module 182 and configured independently or combined with it (e.g., in the controller 130). Specifically, the first virtual microphone 184 and the second virtual microphone 186 may simulate or emulate a microphone interface, thereby allowing another software program to communicate with the microphone. Advantageously, this allows more than one software program to connect to, communicate with, and receive signals from a single microphone (e.g., microphone 134).

[0031] The first virtual microphone 184 may be a first interface communicatively coupled to microphone 134 and also communicatively coupled to either the first voice assistant module 190 or the second voice assistant module 192, as will be described below. For example, the first virtual microphone 184 may receive a signal corresponding to the voice input received by microphone 134. In some embodiments, the first virtual microphone 184 is a first virtual interface that receives and distributes a mirrored or copied output of microphone 134. In other words, the first virtual microphone 184 may be a separate and distinct output from the decomposition module 182. The first virtual microphone 184 can then transmit signals to either the first voice assistant module 190 or the second voice assistant module 192. Therefore, the first voice assistant module 190 can continuously access the first virtual microphone 184, thereby continuously accessing microphone 134.

[0032] The second virtual microphone 186 may be a second interface communicatively coupled to microphone 134 and communicatively coupled to either the first voice assistant module 190 or the second voice assistant module 192, as will be described below. For example, the second virtual microphone 186 may receive a signal corresponding to the voice input received by microphone 134. In some embodiments, the second virtual microphone 186 is a second virtual interface that receives and distributes a mirrored or duplicated output of microphone 134. In other words, the second virtual microphone 186 may be a separate and distinct output from decomposition module 182. The second virtual microphone 186 may then transmit the signal to either the first voice assistant module 190 or the second voice assistant module 192. Therefore, the second voice assistant module 192 may continuously access the second virtual microphone 184, thereby continuously accessing microphone 134. Advantageously, each of the first voice assistant module 190 and the second voice assistant module 192 may continuously access microphone 134, thereby allowing each of the first voice assistant module 190 and the second voice assistant module 192 to receive and analyze the signal corresponding to the voice input from microphone 134.

[0033] Although the decomposition module 182 is described as sending a signal to the virtual microphone, it should be understood that the decomposition module 182 can provide the decomposed signal to the voice assistant module in any other suitable manner. In this regard, for example, virtual microphones 184, 186 could be simply output nodes or connections where the voice assistant module can be coupled to "hear" the copied signal. This paragraph may employ some cleanup and explanation, but it is necessary to ensure that we have a general description of the operation of these "virtual microphones".

[0034] The first voice assistant module 190 and the second voice assistant module 192 can be artificial intelligence (AI) software components that provide voice activation assistance to users. For example, both the first voice assistant module 190 and the second voice assistant module 192 can be network connectivity algorithms capable of communicating with multiple network-connected appliances in the home. Therefore, the first voice assistant module 190 and the second voice assistant module 192 can be software programs executed by a controller (e.g., controller 130). Additionally or optionally, both the first voice assistant module 190 and the second voice assistant module 192 can be connected to the Internet to retrieve and present information and / or multimedia (e.g., music, videos, etc.). Both the first voice assistant module 190 and the second voice assistant module 192 can utilize speaker-related artificial intelligence, neural networks, machine learning, or deep learning algorithms. Therefore, the first voice assistant module 190 and the second voice assistant module 192 can be trained to recognize keywords (e.g., a first keyword for the first voice assistant module 190 and a second keyword for the second voice assistant module 192) and initiate activation and interaction upon keyword recognition. Therefore, the first voice assistant module 190 and the second voice assistant module 192 can be different from each other (i.e., different encoding, different software design, etc.).

[0035] Figure 4 This is a flowchart illustrating a method for activating a system using an operating voice assistant according to an exemplary embodiment. The method 200 for activating a system using an operating voice assistant can be implemented in the system described above. It should be noted that method 200 can be implemented in any suitable electrical appliance, particularly in kitchen appliances such as refrigerators, microwave ovens, ovens, dishwashers, washing machines, etc. Therefore, the implementation of method 200 is not limited to the system described above.

[0036] In step 201, the method may include receiving voice input via a microphone (e.g., microphone 134). For example, the microphone may be located in an appliance such as system 100. The microphone may be in a continuous standby state so that sound is permanently received by the microphone. For example, the microphone may communicate with a controller via a microphone input. Additionally or optionally, the microphone may communicate with a decomposition module (e.g., decomposition module 182). Thus, voice input can be sent to the controller (or the decomposition module). The microphone input may be a module that allows a voice assistant module to communicate with the microphone. Specifically, the voice assistant module receives a voice input signal received via a microphone input connected to the microphone.

[0037] In step 202, the method may include sending voice input to a first voice assistant module via a first virtual microphone. Specifically, the microphone input may include a first virtual microphone and a second virtual microphone (e.g., a first virtual microphone 184 and a second virtual microphone 186). Both the first and second virtual microphones may be replicated virtual interfaces designed to allow more than one module (e.g., a first voice assistant module 190 and a second voice assistant module 192) to communicate with the microphone simultaneously (i.e., receive repeated signals from the microphone). Therefore, the controller can send voice input or signals to one or more voice assistant modules.

[0038] In step 203, the method may include sending voice input to a second voice assistant module via a second virtual microphone. As described above, the microphone input may include a first virtual microphone and a second virtual microphone. Each of the first and second virtual microphones may be a replicated virtual interface designed to allow more than one module (e.g., first voice assistant module 190 and second voice assistant module 192) to communicate with the microphone simultaneously (i.e., receive repeated signals from the microphone). Therefore, the controller can send voice input or signals to one or more voice assistant modules. Furthermore, by utilizing the first and second virtual microphones (or any suitable number of virtual microphones), the first and second voice assistant modules can simultaneously receive voice input from the microphones. For example, the voice input may be converted into a signal (e.g., a digital signal) by a decomposition module. The signal can then be replicated and sent to each virtual microphone.

[0039] In some embodiments, the first and second virtual microphones are combined as part of a decomposition module (e.g., decomposition module 182) that communicates between the microphones and each of the first and second voice assistant modules. In this case, voice input is sent from the microphones to the decomposition module. The decomposition module then distributes the voice input (i.e., as a signal) to each voice assistant module via each of the first and second virtual microphones. Thus, the voice input (and the corresponding signal) can be received by each voice assistant module that communicates with the decomposition module via the virtual microphones.

[0040] In step 204, the method may include activating a first voice assistant module when a voice input containing a first keyword is detected. After sending the voice input, each of the first and second voice assistant modules may analyze the voice input (or the corresponding signal) and extract the keyword. Each of the first and second voice assistant modules can be activated by a different unique keyword. The first voice assistant module can be activated when the user speaks the first keyword and the first voice assistant module receives and recognizes the voice input containing the first keyword. In other words, the first voice assistant module can have full control of the microphone and continue to listen for subsequent voice input from the user. Specifically, the decomposition module may stop any voice input received by the microphone from being distributed to the second voice assistant module. Such subsequent voice input may contain commands or requests (e.g., requests for detailed weather information or reservations stored in a user-connected device, commands to activate connected appliances or programs, etc.). Additionally or optionally, when the second voice assistant module is not activated, the first voice assistant module may receive commands or requests and perform actions on them. Thus, only the first voice assistant module will receive subsequent voice input until the command or request is fulfilled.

[0041] In step 205, the method may include activating the second voice assistant module when the detected voice input includes the second keyword. As described above, after sending voice input, each of the first and second voice assistant modules can analyze the voice input (or the corresponding signal) and extract or confirm the keyword. Each of the first and second voice assistant modules can be activated by a different unique keyword. The second voice assistant module can be activated when the user speaks the second keyword and the second voice assistant module receives and recognizes the voice input containing the second keyword. In other words, the second voice assistant module can have full control of the microphone and continue to listen to subsequent voice input from the user. Such subsequent voice input may contain commands or requests (e.g., requests for detailed weather information or reservations stored in the user's connected device, commands to activate connected appliances or programs, etc.).

[0042] According to at least one embodiment, when the first voice assistant module receives and recognizes a first keyword and subsequently accepts microphone control, the second voice assistant module is deactivated. For example, the controller can recognize that the first voice assistant module has recognized the first keyword and restrict or prohibit the second voice assistant module from accessing the microphone. Thus, the first voice assistant module can assume complete control of the microphone, while the second voice assistant module is restricted from further receiving input from either the microphone or a virtual microphone. Specifically, the decomposition module can stop any voice input received by the microphone from being distributed to the second voice assistant module. Additionally or optionally, when the second voice assistant module is not activated, the first voice assistant module can receive commands or requests and perform actions thereon. Similarly, when the second voice assistant module receives and recognizes a second keyword and subsequently accepts microphone control, the first voice assistant module is deactivated. For example, the controller can recognize that the second voice assistant module has recognized the second keyword and restrict the first voice assistant module from accessing the microphone. Thus, the second voice assistant module can assume complete control of the microphone, while the first voice assistant module is restricted from further receiving input from either the microphone or a virtual microphone. Specifically, the decomposition module can stop any voice input received by the microphone from being distributed to the first voice assistant module. Additionally or optionally, when the first voice assistant module is not activated, the second voice assistant module can receive commands or requests and perform actions on them.

[0043] Additionally or optionally, after a command or request is executed by the activated voice assistant module, the controller may reactivate a deactivated voice assistant module (e.g., the first voice assistant module or the second voice assistant module). For example, when the first voice assistant module recognizes a first keyword, the controller activates the first voice assistant module and deactivates the second voice assistant module. The first voice assistant module then listens to, analyzes, and executes the command or request from the user. After the first voice assistant module completes the execution or implementation of the command or request, the controller reactivates the second voice assistant module and allows the second voice assistant module to access the microphone through the first or second virtual microphone.

[0044] The draft specification uses examples to disclose the invention, includes the best mode, and also enables any person skilled in the art to practice the invention, including making and using any device or system and performing any combination of methods. The patentable scope of the invention is defined by the claims, but may include other examples that would occur to a person skilled in the art. Such other examples are intended to be included within the scope of the claims if they contain structural elements that do not differ from the literal language of the claims, or if they contain equivalent structural elements that do not substantially differ from the literal language of the claims.

Claims

1. A method for operating a voice assistant activation system, characterized in that, The voice assistant activation system includes a microphone, a decomposition module, a first voice assistant module, and a second voice assistant module; the method includes: Voice input is received via the microphone; The decomposition module decomposes the voice input into two identical signals. One of the same signals is sent to the first voice assistant module via a first virtual microphone; the first virtual microphone is a first virtual interface communicatively coupled to the microphone and the first voice assistant module, the first virtual interface receiving and allocating repeated outputs from the microphone, such that the first voice assistant module continuously accesses the microphone to receive and analyze voice input from the microphone; The second virtual microphone sends another path of the same signal to the second voice assistant module; the second virtual microphone is a second virtual interface communicatively coupled to the microphone and the second voice assistant module, the second virtual interface receiving and allocating repeated outputs from the microphone, so that the second voice assistant module continuously accesses the microphone to receive and analyze voice input from the microphone; When the voice input includes a first keyword, the first voice assistant module is activated, and the second voice assistant module is deactivated; and When the voice input includes the second keyword, the second voice assistant module is activated and the first voice assistant module is deactivated.

2. The method according to claim 1, characterized in that, The first voice assistant module and the second voice assistant module are software programs implemented by the controller of the appliance; the first virtual microphone and the second virtual microphone are configured to receive voice input from the microphone and send the voice input to the software programs of the first voice assistant module and the second voice assistant module, respectively.

3. The method according to claim 1, characterized in that, The first voice assistant module is different from the second voice assistant module.

4. The method according to claim 1, characterized in that, The microphone sends the voice input to both the first virtual microphone and the second virtual microphone simultaneously.

5. The method according to claim 1, characterized in that, The first keyword is different from the second keyword.

6. The method according to claim 1, characterized in that, The computer-implemented voice assistant activation system is installed in home appliances.

7. A computing system, characterized in that, include: At least one processor; A microphone that communicates with the at least one processor; Decomposition module; A first voice assistant module connected to the at least one processor; A second voice assistant module connected to the at least one processor; as well as At least one tangible, non-transitory computer-readable medium for storing instructions, wherein when the at least one processor executes the instructions, the at least one processor performs an operation; the operation includes: Voice input is received via the microphone; The decomposition module decomposes the voice input into two identical signals. One of the same signals is sent to the first voice assistant module via a first virtual microphone; the first virtual microphone is a first virtual interface communicatively coupled to the microphone and the first voice assistant module, the first virtual interface receiving and allocating repeated outputs from the microphone, such that the first voice assistant module continuously accesses the microphone to receive and analyze voice input from the microphone; The second virtual microphone sends another path of the same signal to the second voice assistant module; the second virtual microphone is a second virtual interface communicatively coupled to the microphone and the second voice assistant module, the second virtual interface receiving and allocating repeated outputs from the microphone, so that the second voice assistant module continuously accesses the microphone to receive and analyze voice input from the microphone; When the voice input includes a first keyword, the first voice assistant module is activated, and the second voice assistant module is deactivated; and When the voice input includes the second keyword, the second voice assistant module is activated and the first voice assistant module is deactivated.

8. The computing system according to claim 7, characterized in that, The first voice assistant module and the second voice assistant module are software programs implemented by the controller of the appliance; the first virtual microphone and the second virtual microphone are configured to receive voice input from the microphone and send the voice input to the software programs of the first voice assistant module and the second voice assistant module, respectively.

9. The computing system according to claim 7, characterized in that, The first voice assistant module is different from the second voice assistant module.

10. The computing system according to claim 7, characterized in that, The microphone sends the voice input to both the first virtual microphone and the second virtual microphone simultaneously.

11. The computing system according to claim 7, characterized in that, The first keyword is different from the second keyword.

Citation Information

Patent Citations

  • Method, device and terminal for voice input

    CN102799409A

  • Control method and apparatus of multiple voice assistants, and computer readable storage medium

    CN107919123A