Vehicle and method for controlling task allocation and hot word detection functions based on speech recognition

Abstract

A method for voice recognition (VR) based task allocation and hot word detection function control, for use in a wireless network having a hands-free (HF) node (e.g., a motor vehicle or its telematics unit) and an audio gateway (AG) node (e.g., a wireless device), the method comprising detecting a second wireless chipset of the AG node via a first wireless chipset of the HF node. The wireless chipset includes a corresponding VR engine responsive to a corresponding hot word. The method includes establishing a Bluetooth or other wireless connection between the wireless chipsets in response to detecting the second wireless chipset. The method may include automatically transmitting a deactivation command signal to the second wireless chipset via the first wireless chipset to thereby deactivate the hot word detection function of the second wireless chipset. The method may be recorded on a computer readable medium as instructions executable by a processor.

Description

Technical Field

[0001] In a wireless communication network, a device ("wireless device") equipped with a wireless communication chipset (e.g., a mobile / cellular phone, a laptop computer, or a tablet computer) or a wearable device (e.g., a wireless headset / earphone) can be paired with and connected to a router and other devices equipped with a wireless chipset on the wireless communication network. The wireless chipsets may each be implemented as a respective system on a chip (SoC), including one or more processing cores, memory devices, modems, antennas, transceivers, input / output circuitry, and other hardware components. Background Art

[0002] On modern motor vehicles, a vehicle telematics unit (VTU) with a resident wireless communication chipset interfaces with the Controller Area Network (CAN) bus in the vehicle and a backend cloud server to provide Internet access and in-vehicle access to a wide range of information and system control functions. When a compatible wireless device is discoverable, such as using Bluetooth, WiFi, or another suitable wireless communication protocol, the VTU automatically pairs with and connects to the detected wireless device. Thereafter, the VTU is able to control the operation of the paired wireless device, such as by transmitting or receiving an incoming phone call or text message, accessing an application ("app") resident on the paired device, or projecting / displaying content from the paired wireless device via a display screen of an infotainment system, etc. Such "hands-free" functionality allows vehicle occupants to focus more closely on the task of driving while still enabling limited use of the paired device within the vehicle.

[0003] VR detection functionality is common in modern smartphones, other types of mobile / cellular phones and other wireless devices, VTUs, and VR-enabled devices (e.g., streaming media players and televisions). In a typical exchange, a user speaks a platform-specific phrase or "hot word". In response, the VR-enabled device wakes up the resident VR engine and thereafter prepares itself to receive verbal commands ("utterances"), with the intent that the utterances be derived through translation and / or direct speech recognition. Because devices equipped with wireless chipsets utilize operating systems and VR assistants that are programmed to respond to specific hot words, processing and priority conflicts may result in an operating environment in which multiple wireless devices share the same hot word and / or are capable of performing the same requested functions, at least to some extent. Summary of the invention

[0004] Disclosed herein are methods and systems for selectively disabling / enabling local hotword detection functionality of a device ("wireless device") equipped with a wireless communication chipset within a wireless network and for automatic inter-network allocation of tasks based on voice recognition (VR). Within a wireless network, in some embodiments, the wireless device is referred to herein as an audio gateway (AG) node. In an exemplary motor vehicle embodiment, a vehicle telematics unit (VTU) of the motor vehicle may function as a hands-free (HF) node, wherein the abbreviations AG and HF have well-known meanings in the art. In some cases, the respective AG and HF nodes may respond to the same hotword when waking up their respective VR engines. Therefore, it may sometimes be unclear whether, after detecting a hotword, the wireless device / AG node or the VTU / HF node should process and act according to the user's intent.

[0005] Although various illustrative examples are provided herein in which HF nodes are implemented as VTUs, it will be appreciated by those of ordinary skill in the art that other systems using wireless networks may benefit from the present teachings. Therefore, the present disclosure is not limited to vehicle applications in general, or motor vehicle applications in particular. Likewise, the present teachings may be extended to forward-looking chipset architectures and wireless communication standards, and therefore unless otherwise noted, references herein to Bluetooth, near field communications (NFC), etc. are non-limiting and exemplary.

[0006] Disclosed herein is an exemplary embodiment of a method for VR-based task allocation and hot word detection function control, for use in a wireless network with separate HF and AG nodes, as mentioned above. The method may include detecting a second wireless chipset of the AG node. The first wireless chipset and the second wireless chipset include corresponding VR engines responsive to corresponding hot words. In this embodiment, the method also includes: in response to detecting the second wireless chipset, establishing a wireless connection between the first wireless chipset and the second wireless chipset. In response to a predetermined condition, the method includes automatically transmitting a deactivation command signal from the first wireless chipset of the HF node to the second wireless chipset of the AG node to temporarily deactivate the hot word detection function of the second wireless chipset.

[0007] In some embodiments, the method includes: in response to the deactivation command signal, receiving a confirmation signal via the first wireless chipset of the HF node, the confirmation signal indicating successful deactivation of the hot word detection function of the second wireless chipset, and then in response to the confirmation signal, processing a VR request of a user of the wireless network using the first wireless chipset of the HF node. Processing the VR request may optionally include selectively routing the VR request to the second wireless chipset for processing by the second wireless chipset.

[0008] Embodiments of the method may include receiving, via a first wireless chipset of the HF node, an error message signal indicating an unsuccessful deactivation of a hotword detection function of a second wireless chipset, and then performing a control action via the first wireless chipset in response to the error message signal.

[0009] When the connection is a Bluetooth connection, the method may include automatically transmitting a deactivation command signal to the second wireless chipset, including transmitting a modified Bluetooth VR Activation / Enhanced VR Activation Attention (AT+BVRA) command to the second wireless chipset.

[0010] The HF node may include a display screen, and wherein the predetermined condition is a requested projection of an application of the AG node onto the display screen of the HF node. In an embodiment of the HF node comprising a vehicle telematics unit (VTU) coupled to the display screen, the first wireless chipset of the HF node may be a hardware component of the VTU.

[0011] The method may also include receiving a termination signal via the first wireless chipset, the termination signal indicating a predetermined termination event. In response to receiving the termination signal, the method may further include transmitting an enable command signal to the first wireless chipset of the AG node via the second wireless chipset of the HF node to thereby automatically re-enable the hot word detection function of the second wireless chipset.

[0012] Also disclosed herein is a motor vehicle having a road wheel connected to a vehicle body and a VTU having a first wireless chipset. The VTU is configured to: detect a second wireless chipset of a wireless device within a wireless network via the first wireless chipset of the VTU, the first wireless chipset and the second wireless chipset including respective VR engines responsive to corresponding hot words; and establish a wireless connection between the first wireless chipset and the second wireless chipset in response to detecting the second wireless chipset. In response to a predetermined condition, the VTU is configured to automatically transmit a deactivation command signal to the second wireless chipset to thereby temporarily deactivate a hot word detection function of the wireless device.

[0013] This document also discloses a computer-readable medium embodiment, wherein the instructions recorded thereon can be executed by a processor of a VTU. The VTU can be a component of a motor vehicle. Execution of the instructions by the processor of the VTU causes the VTU to perform the method described above.

[0014] This article also discloses the following technical solutions.

[0015] 1. A method for task allocation and hot word detection function control based on speech recognition (VR), for use in a wireless network having a hands-free (HF) node and an audio gateway (AG) node, the method comprising:

[0016] detecting, via a first wireless chipset of a HF node, a second wireless chipset of an AG node, the first wireless chipset and the second wireless chipset comprising respective VR engines responsive to corresponding hot words;

[0017] In response to detecting the second wireless chipset, establishing a wireless connection between the first wireless chipset and the second wireless chipset; and

[0018] In response to a predetermined condition, a deactivation command signal is automatically transmitted from the first wireless chipset of the HF node to the second wireless chipset of the AG node to thereby temporarily deactivate a hotword detection function of the second wireless chipset.

[0019] 2. The method according to technical solution 1 further comprises:

[0020] receiving, in response to the deactivation command signal, a confirmation signal via the first wireless chipset of the HF node, the confirmation signal indicating successful deactivation of the hotword detection function of the second wireless chipset; and

[0021] In response to the confirmation signal, a VR request of a user of the wireless network is processed using the first wireless chipset of the HF node.

[0022] 3. The method according to technical solution 2, wherein processing the VR request includes selectively routing the VR request to the second wireless chipset for processing by the second wireless chipset.

[0023] 4. The method according to technical solution 1 further comprises:

[0024] receiving, via the first wireless chipset of the HF node, an error message signal indicating an unsuccessful deactivation of the hotword detection function of the second wireless chipset; and

[0025] In response to the error message signal, a control action is performed via the first wireless chipset.

[0026] 5. The method according to technical solution 1, wherein the wireless connection is a Bluetooth connection.

[0027] 6. The method according to technical solution 5, wherein automatically transmitting the deactivation command signal to the second wireless chipset includes transmitting a modified Bluetooth VR activation / enhanced VR activation attention (AT+BVRA) command to the second wireless chipset.

[0028] 7. The method according to technical solution 1, wherein the HF node includes a display screen, and wherein the predetermined condition is a requested projection of the AG node onto the display screen of the HF node.

[0029] 8. A method according to technical solution 7, wherein the HF node includes a vehicle telematics unit (VTU) connected to the display screen, and wherein the first wireless chipset of the HF node is a hardware component of the VTU.

[0030] 9. The method according to technical solution 1, wherein the predetermined condition is the establishment of the wireless connection.

[0031] 10. The method according to technical solution 1 further comprises:

[0032] receiving, via the first wireless chipset, a termination signal, the termination signal indicating a predetermined termination event; and

[0033] In response to receiving the termination signal, transmitting an enable command signal via the second wireless chipset of the HF node to the first wireless chipset of the AG node to thereby automatically re-enable the hotword detection function of the second wireless chipset.

[0034] 11. Motor vehicles, including:

[0035] The main body of the vehicle;

[0036] road wheels connected to the vehicle body; and

[0037] A vehicle telematics unit (VTU) having a first wireless chipset, wherein the VTU is configured to:

[0038] detecting, via the first wireless chipset of the VTU, a second wireless chipset of a wireless device within the wireless network, the first wireless chipset and the second wireless chipset comprising respective voice recognition (VR) engines responsive to corresponding hotwords;

[0039] In response to detecting the second wireless chipset, establishing a wireless connection between the first wireless chipset and the second wireless chipset; and

[0040] In response to a predetermined condition, a deactivation command signal is automatically transmitted to the second wireless chipset to thereby temporarily deactivate a hotword detection function of the wireless device.

[0041] 12. The motor vehicle according to technical solution 11, wherein the VTU is further configured to:

[0042] receiving, via the first wireless chipset, a confirmation signal in response to the deactivation command signal, the confirmation signal indicating successful deactivation of the hotword detection function of the wireless device; and

[0043] In response to the confirmation signal, a VR request of a user of the wireless network is processed using the first wireless chipset.

[0044] 13. A motor vehicle according to technical solution 12, wherein the VTU is configured to process the VR request by selectively routing the VR request to the second wireless chipset for processing by the second wireless chipset.

[0045] 14. A motor vehicle according to technical solution 11, wherein the VTU is configured to receive an error message signal from the wireless device via the first wireless chipset, the error message signal indicating an unsuccessful deactivation of the hotword detection function of the second wireless chipset; and

[0046] A control action is performed in response to the error message signal.

[0047] 15. A motor vehicle according to technical solution 11, wherein the wireless connection is a Bluetooth connection, and the VTU is configured to automatically transmit the deactivation command signal to the second wireless chipset as a modified Bluetooth VR activation / enhanced VR activation attention (AT+BVRA) command.

[0048] 16. A motor vehicle according to technical solution 11, wherein the VTU is connected to or includes a display screen, and wherein the predetermined condition is the requested projection of the application of the wireless device onto the display screen.

[0049] 17. A motor vehicle according to technical solution 11, wherein the predetermined condition is the establishment of the wireless connection.

[0050] 18. The motor vehicle according to technical solution 11, wherein the VTU is further configured to:

[0051] In response to a predetermined termination event, an enable command signal is transmitted to the second wireless chipset to thereby re-enable the hotword detection function of the wireless device.

[0052] 19. A computer readable medium having recorded thereon instructions executable by a processor of a vehicle telematics unit (VTU) of a motor vehicle, the VTU having a first wireless chipset, wherein execution of the instructions by the processor causes the VTU to:

[0053] detecting, via the first wireless chipset, a second wireless chipset of a wireless device within the motor vehicle, the first wireless chipset and the second wireless chipset comprising respective voice recognition (VR) engines responsive to corresponding hot words;

[0054] In response to detecting the second wireless chipset, establishing a Bluetooth connection between the first wireless chipset of the VTU and the second wireless chipset of the wireless device;

[0055] automatically transmitting a deactivation command signal via the first wireless chipset of the VTU to the second wireless chipset of the wireless device in response to a predetermined condition to thereby deactivate a hotword detection function of the wireless device, wherein the predetermined condition is a requested projection of the Bluetooth connection or an application of the wireless device onto a display screen of the VTU, and wherein the deactivation command signal is a modified Bluetooth VR Activation / Enhanced VR Activation Attention (AT+BVRA) signal;

[0056] receiving a confirmation signal from the wireless device, the confirmation signal indicating successful deactivation of the hotword detection function; and

[0057] In response to the confirmation signal, a VR request of the VTU and a user of the wireless device is processed using the first wireless chipset of the VTU instead of the second wireless chipset of the wireless device.

[0058] 20. A computer-readable medium according to technical solution 19, wherein execution of the instructions by the processor causes the VTU to process the VR request via the first wireless chipset by selectively routing the VR request to the second wireless chipset of the wireless device.

[0059] The above mentioned and other features and advantages of the present disclosure will be readily apparent from the following detailed description of the embodiments and the best mode for carrying out the disclosure when taken in conjunction with the accompanying drawings and the appended claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] Figure 1 is a schematic illustration of a representative wireless network configured to operate in accordance with the present method.

[0061] Figure 2 and Figure 3 is a schematic logic flow diagram that describes the operation of the method in an exemplary operating environment implementing Bluetooth.

[0062] Figure 4 is a flow chart describing an embodiment of a method for selectively disabling a hotword detection function of a wireless device within a wireless network according to the present disclosure.

[0063] The present disclosure is susceptible to various modifications and alternative forms, and some representative embodiments have been shown in the drawings by way of example and will be described in detail herein. However, it should be understood that the novel aspects of the present disclosure are not limited to the specific forms shown in the attached drawings. On the contrary, the present disclosure should cover modifications, equivalents, combinations and alternatives that fall within the scope and spirit of the present disclosure as defined by the appended claims. DETAILED DESCRIPTION

[0064] For the purposes of this description, unless specifically disclaimed, the use of the singular includes the plural, and vice versa, the terms "and" and "or" shall be both conjunctions and disjunctions, both "any" and "all" shall mean "any and all," and the words "include," "comprising," "including," "having," and the like shall mean "including but not limited to." In addition, approximate words (e.g., "about," "almost," "substantially," "generally," "approximately," and the like) may be used herein in the sense of "at, approximately, or nearly at," or "within 0-5% of ...," or "within acceptable manufacturing tolerances," or their logical combinations thereof.

[0065] Referring to the drawings, wherein like reference numerals refer to like parts, as shown Figure 1 1 , the wireless network 10 includes an exemplary motor vehicle 12 having a vehicle body 14 coupled to a set of road wheels 16. The road wheels 16 are in rolling contact with a road surface 18 such that when the motor vehicle 12 is propelled, torque generated by a propulsion system (not shown) causes the road wheels 16 to rotate. The motor vehicle 12 also includes a resident vehicle telematics unit (VTU) 20 configured to execute instructions implementing the method 100, hereinafter referred to as Figure 4 An exemplary embodiment of the method 100 is described.

[0066] The VTU 20 includes a first wireless chipset 25A having or coupled to a first speech recognition engine (VRE) 24, wherein the first VRE 24 is responsive to a first predetermined hotword. As understood in the art, as used herein, a hotword is a predetermined phrase or wake-up word, the detection of which causes the VRE 24 to wake up and prepare itself for subsequent spoken commands. Execution of the method 100 by one or more resident processors (P) of the VTU 20 allows the first wireless chipset 25A to selectively disable or enable the hotword functionality of a wireless device 30 implementing VR that is paired and connected to the VTU 20, wherein "connected to" is via a wireless connection / pairing or a direct connection, for example, using a USB cable. Thus, using established terminology, the VTU 20 and its resident first wireless chipset 25A act as a hands-free (HF) node within an embodiment of the wireless network 10, while the wireless device 30 and the resident second wireless chipset 25B act as an audio gateway (AG) node within such an embodiment.

[0067] To perform the assigned processes or functions according to the method 100, the VTU 20 and the wireless device 30 may be equipped with a respective display screen 28 or 38, a respective microphone 22 or 32, one or more processors (P), and sufficient computer-readable media indicated as memory (M), such as volatile and non-volatile storage devices in the form of read-only memory (ROM), random access memory (RAM), non-failure memory (KAM), flash memory, and / or other suitable electrical, magnetic or optical memory, or combinations thereof. Other components that are not depicted but are considered to be part of the VTU 20 or coupled thereto include speakers, buttons and / or input controls, display screens, and the like.

[0068] For simplicity of explanation, Figure 1 The first and second wireless chipsets 25A and 25B are abstracted in FIG. However, it will be understood by those skilled in the art that the hardware components of the first and second wireless chipsets 25A and 25B may also include a radio frequency (RF) transceiver circuit system, a local oscillator, a signal amplifier, a mixer, a filter, a digital-to-analog converter and / or an analog-to-digital converter, etc. In some embodiments, the hardware components of the wireless device 30 may be integrated into a system on a chip (SOC) 30-1.

[0069] The wireless device 30 may also be configured with various wireless communication capabilities suitable for the application. For example, the wireless device 30 may be configured to establish a wireless connection with the VTU 20 via a suitable short-range communication protocol (e.g., Bluetooth, near field communication (NFC), etc.). Other embodiments using WiFi, etc. are contemplated. The wireless device 30 may utilize other types of wireless connections and operate on other channels (e.g., those corresponding to cellular connections (e.g., LTE, 5G, 4G, etc.), WiFi connections, etc.).

[0070] Although in Figure 1 , but other embodiments of the wireless device 30 are possible within the scope of the present disclosure, including but not limited to tablet computers, laptop computers, wearable devices (e.g., smart watches), Internet of Things (IoT) devices, etc., or in other embodiments of the wireless network 10, fixed devices, such as desktop terminals. Similarly, optionally, the first wireless chipset 25A can be configured as part of a smart phone, a headset, headphones, or another device capable of acting as an HF node in a HF-AG node arrangement. However, for consistency of description, the HF node of the wireless network 10 will be described below in the context of the VTU 20 (when hosted by the motor vehicle 12), and the AG node will be described in the context of a wireless device 30 in the form of a user's mobile phone or smart phone (when wirelessly paired with the VTU 20 in a typical driving scenario).

[0071] Below is Figure 2 and Figure 3 The operation of the method 100 is described with respect to an exemplary Bluetooth embodiment, wherein a first wireless chipset 25A of a VTU 20 (i.e., an HF node within a wireless network 10) pairs with / connects to a second wireless chipset 25B of a wireless device 30 (acting as an AG node) over an established Bluetooth connection. In some cases, the HF node and the AG node may use the same hotword to wake up their respective VREs 24 and 34. This may occur when the same VR assistant is running on the same operating system, for example, when the VTU 20 is running ANDROID ® When the wireless device 30 is running the GOOGLE Automotive Operating System (AAOS), an ANDROID-AUTO (AA) session is also running on the wireless device 30. The AA application running on the wireless device 30 can be projected / projected via the AA application running on the VTU 20 via the display screen 28. In this case, the wireless device 30 and / or the VTU 20 can run the GOOGLE ® VR assistant application. When this occurs, it may not be clear which of the corresponding first or second wireless chipsets 25A or 25B should handle the user's intent as expressed by a spoken phrase or utterance. Outside of this exemplary conflict situation, there are scenarios where the first and second wireless chipsets 25A and 25B are triggered by different hot words. In such cases, method 100 may still be beneficial when managing the specific nodes that will be responsible for acting on a given utterance.

[0072] For example, the method enables the VTU 20 and its resident first wireless chipset 25A to automatically transmit a deactivation command signal ( ) to the second wireless chipset 25B of the wireless device 30 in response to a predetermined condition. Figure 1Arrow DD), for example, similarly in Figure 1 . When acted upon by the second wireless chipset 25B of the wireless device 30, the deactivation command signal (arrow DD) has the effect of temporarily deactivating or preventing execution of the resident hotword detection function of the second wireless chipset 25B. In situations where the HF node and the AG node share the same hotword, this control action can in turn help avoid situations where hotword detection and subsequent VR activation are repeated. Similarly, even when different hotwords are employed, this control action can help avoid conflicts between assistants when assigning a given user utterance to a HF node or an AG node for processing. When the hotword detection function is re-enabled in response to a predetermined enabling condition (e.g., when the user ends their projection session within the motor vehicle 12), an enablement command signal (arrow EE) can likewise be transmitted to the wireless device 30.

[0073] Figure 2 and Figure 3 A non-limiting embodiment is used in which the above-described deactivation command to the second wireless chipset is a modified Bluetooth VR Activation / Enhanced VR Activation Attention (AT+BVRA) command (arrow 40). As will be appreciated by one of ordinary skill in the art, the AT+BRVA command is defined in §4.25 and §4.35.1 of Bluetooth Hands-Free Profile (HFP) version 1.8. The enhanced BRVA that extends the BRVA with additional fields allows the AG node to communicate with the HF node (e.g., Figure 1 More granularity in the VR communication flow between the wireless device 30 and the VTU 20 within the representative wireless network 10.

[0074] As will be appreciated by one of ordinary skill in the art, a typical AG+BRVA syntax includes integer values ​​0, 1, or 2, where an integer value of 2 allows certain extended functionality. An integer value of 1 is used to trigger the VRE 34 of the wireless device 30 to begin speech recognition using its own microphone 32 by bypassing the need for hotword detection by the wireless device 30. An integer value of 0 has the opposite effect of telling the wireless device 30 (i.e., the AG node) to stop speech recognition processing. In a real-world example, in a motor vehicle equipped with a hands-free function (e.g., Figure 1 In a motor vehicle 12), a prolonged press of a button on the steering wheel will have the effect of AG + BRVA = 1, thereby allowing the user to speak a command without having to first articulate the hot word, e.g., "Hey, ALEXA ® !", "Hey, SIRI ® ! ” or “Hey, GOOGLE ® !" This method can use another integer value (for example, 3) to pass the actions of VTU20 and Figure 1The deactivation command signal (arrow DD) described above requests the AG node (e.g., Figure 1 If the AG node / wireless device 30 does not support the new AV+BVRA value, i.e., AT+BVRA=3,1 (arrow 40), the AG node / wireless device 30 may respond with an error message signal (arrow 44) instead of sending a positive confirmation signal (e.g., OK (arrow 42)) back to the first wireless chipset 25A.

[0075] In this illustrative example, the hands-free protocol may be modified to extend the AT+BRVA command in a manner that allows a HF node (e.g., Figure 1 20 and the resident first wireless chipset 25A) selectively disable or later re-enable the hotword detection function resident on the wireless device 30 by transmitting the command AT+BRVA=<3,0> (arrow 46). In turn, this capability allows the first wireless chipset 25A to process the VR request and selectively forward the VR request to the wireless device 30 for action as needed. In this way, the VTU 20 is operable to determine the VR request among multiple competing VR assistants within the wireless network 10, for example, by selecting the first wireless chipset 25A of the HF node or the second wireless chipset 25B of the AG node for action according to the intention of the VR request.

[0076] In particular, Figure 2 The method is schematically shown, wherein a HF node (e.g. Figure 1The HF node / VTU 20 is wirelessly paired with an AG node (e.g., wireless device 30) and connected to it. In order to selectively deactivate the hot word detection function of the AG node / wireless device 30, the HF node / VTU 20 may transmit an AT+BRVA signal (arrow 40) of <3, 1>. The integer value 1 has the effect of deactivating the local hot word detection function of the AG node / wireless device 30, wherein the new integer value 3 has the effect mentioned herein. Such effects include causing the AG node / wireless device 30 to respond with a confirmation that the hot word detection function has been successfully deactivated when the present function is supported ("OK", i.e., arrow 42) or in an optional example with an error message signal ("ERROR", i.e., arrow 44) when such function is not supported. In order to re-enable the hot word detection function, the HF node / VTU 20 may respond to the termination signal by automatically re-enabling the hot word detection function of the AG node / wireless device 30 (e.g., by transmitting the signal AT+BRVA = <3, 0> (arrow 46)). When the wireless link between the first and second wireless chipsets 25A and 25B is disconnected, hotword detection by the VRE 34 of the wireless device 30 is typically re-enabled automatically by the wireless device 30 itself, without action by the VTU 20 .

[0077] refer to Figure 3 , the intent processing operation of method 100 may be understood with reference to a simplified example, wherein: Figure 1 The user 15 of the AG node / radio device 30 interacts with the HF node / VTU 20. For example, if Figure 2 After deactivating the local hotword function of the wireless device 30, the user 15 may speak the phrase "What's the weather like in Montreal" or "Raise the temperature by 5 degrees", as represented by arrow 52, ​​and in response, the VRE 24 of the HF node / VTU 20 may locally process the requested intent ("local consumption of intent").

[0078] The HF node / VTU 20 may also selectively route a given VR request to a second wireless chipset 25B of the AG node / wireless device 30 for processing. Here, for text that is recognized by the VRE 24 of the HF node / motor vehicle 12 but is more appropriately processed by the AG node / wireless device 30 in the HF node's discretion, another AT+BRVA integer value, e.g., 4, may be used to facilitate sending a pre-processed text string or "intent" to the AG node / wireless device 30.

[0079] An example syntax may include AT+BVRA= <vrec> ，[ <textualrepresentation>],in,<textual representation> : <textid> ， <texttype> ， <textoperation> ， <string>Here, <texttype>is a new text type with integer value 4, which is "text recognized by the HF node." Thus, in an exemplary embodiment, where user 15 speaks the phrase "Navigate to 101 McNab Street in Markham, ON," arrow 54, HF node 12 may automatically generate an exemplary AT+BRVA message 4, 12AB, 4, 1, "Navigate to 101 McNab Street in Markham, ON," arrow 56, where <vrec>= 4, and<textual representation> = 12AB, 4, 1, utterance as a string. The modified AT+BRVA message is then transmitted to the AG node / wireless device 30 for processing the intent by the AG node and its resident VRE 34 and second wireless chipset 25B. The AG node / wireless device 30 then acknowledges back to the HF node / VTU 20, for example via a message "OK" (arrow 58).

[0080] refer to Figure 4 , depicts an exemplary embodiment of a method 100 for use on a motor vehicle 12, which itself is a non-limiting representation of a system equipped with a first wireless chipset 25A. The first wireless chipset 25A includes a first VRE 24 responsive to a first predetermined hotword, the identity of which depends on the particular operating system and the particular VR assistant employed thereby.

[0081] Starting from box B102, method 100 includes detecting a second wireless chipset 25B via a first wireless chipset 25A of a HF node, wherein, in this embodiment, the wireless device 30 acts as an AG node. When implementing box B102, Bluetooth, NFC, or other suitable short-range RF detection processes and protocols may be used. As described in detail above, the second VRE 34 of the second wireless chipset 25B responds to a hot word, which may be a first predetermined hot word (when the same operating system and VR assistant are used by the HF node and the AG node), or a different second predetermined hot word in other embodiments. When the second wireless chipset 25B has been detected, method 100 proceeds to box B104.

[0082] At block B104, the method 100 includes wireless pairing of the first wireless chipset 25A with the second wireless chipset 25B. As will be appreciated by one of ordinary skill in the art, a discoverable device (e.g., Figure 1 The method 100 may be used to verify the successful point-to-point pairing of the second wireless chipset 25B within the exemplary wireless device 30 of the present invention. In other embodiments, other short-range pairings besides Bluetooth may be used. When the HF node and the AG node are successfully paired, block B104 is completed, and the method 100 proceeds to block B106.

[0083] Figure 4 Block B106 of includes determining whether a predetermined condition is satisfied or true. For example, the predetermined condition may be a requested projection of an application of the wireless device 30 onto a display screen, for example, ANDROID AUTO ® . Optionally, the predetermined condition of block B106 may be the establishment of a wireless pairing in block B104, such that method 100 occurs whenever a potential wireless device 30 is present and paired with a HF node. Other predetermined conditions are contemplated within the scope of the present disclosure, including but not limited to user-enabled settings on the wireless device 30 and / or the HF node. When the predetermined condition is met, method 100 proceeds to block B108, and in an optional example, when the predetermined condition is not met, method 100 proceeds to block B110.

[0084] At block B108, method 100 includes: Figure 1 The first wireless chipset 25A automatically transmits a deactivation command to the second wireless chipset 25B ( Figure 1 DD) to thereby request deactivation of the hotword detection function of the second wireless chipset 25B. As a subset of block B108, some embodiments of method 100 may distinguish between an operating system and a VR assistant running on the wireless device 30, wherein the transmission of the deactivation command (arrow DD) is conditional on matching. Such methods will help avoid duplicate hotword detection and VR activation within the motor vehicle 12 or other systems. Other embodiments may be performed by deactivating the hotword detection function of the wireless device 30, regardless of whether the wireless device 30 uses the same hotword as the HF node (e.g., VTU 20).

[0085] The deactivation command (arrow DD) transmitted to the second wireless chipset 25B may be the same as that mentioned above. Figure 2 The modified Bluetooth AT+BVRA command described, for example, is an integer value of 3 in a scenario where the underlying protocol has been revised to allow such an exchange. In non-Bluetooth embodiments, similar methods may be used in other protocols, possibly including platform-specific protocols used within the range of the motor vehicle 12. The method 100 then proceeds to block B112.

[0086] At block B110, both the wireless chipsets 25A and 25B remain enabled and are therefore ready to receive VR commands within the motor vehicle 12 if the predetermined condition is not met at the previous block B106. Blocks B106 and B110 may be executed in a loop until the predetermined condition is detected. A timeout or other event-driven criteria (e.g., a ignition-off event in a vehicle embodiment of the motor vehicle 12) may be used to terminate the method 100, wherein, in such embodiments, the method 100 restarts from block B102.

[0087] Block B110 may also include performing a control action via the first wireless chipset 25A of the HF node / VTU 20 when block B112 (described below) returns an error message signal. For example, when the wireless device 30 does not respond to the deactivation command signal ( Figure 1 DD), the HF node / VTU 20 may continue to allow the AG node / wireless device 30 to operate in accordance with its local hotword detection function, and may even route appropriate VR commands or utterances to the wireless device 30 for action by the second wireless chipset 25B, similar to box B120, as described below.

[0088] Block B112 includes the result of a detection command (arrow DD) to determine whether the deactivation command signal (arrow DD) from the VTU 20 has successfully deactivated the local hotword function of the wireless device 30. For example, and as Figure 2 As shown in , when configured to operate in the context of method 100, the wireless device 30 will respond in one of two ways: (a) with a confirmation signal, for example, a predetermined bit or bit string value indicating a deactivation of the hotword function; or (b) with an error message signal indicating a failed deactivation attempt or incompatibility of the wireless device 30 with the deactivation command (arrow DD).

[0089] After a predetermined duration, the lack of a return signal from the wireless device 30 to the HF node may result in such an error message signal being automatically generated by the HF node / VTU 20. Thus, block B112 may include receiving an error message signal via the first wireless chipset 25A indicating that the second wireless chipset 25B is not responsive to the deactivation command in some manner. When deactivation of the hotword detection function of the wireless device 30 is unsuccessful, the method 100 proceeds to block B110, and when the hotword detection function is deactivated, the method 100 proceeds to block B114.

[0090] Box B114 requires Figure 1 The microphone 22 shown in FIG. Figure 3 The hot words and utterances or spoken phrases of the user 15. Block B114 includes converting the speech to text using a suitable speech-to-text converter (e.g., programmed into the memory (M) of the VTU 20 in the vehicle embodiment of the HF node) or via communication with a separate speech-to-text converter application. The method 100 then proceeds to block B116.

[0091] At block B116, the HF node determines the intent of the utterance collected at block B114. As used herein, "intent" means a specific function that the user 15 is attempting to control or a specific result that the user 15 wishes to achieve. For a given utterance, various functions or results may be desired. Non-limiting examples include requests for weather or traffic updates, requests to adjust the temperature, fan settings, playlists, radio station / other infotainment settings, or navigation requests, e.g., Figure 1 Turn-by-turn driving directions in a vehicle embodiment of the motor vehicle 12.

[0092] In terms of resident capabilities to act upon request, each utterance may correspond to an AG node or an HF node, or both an AG node and an HF node may be able to satisfy the request. Thus, block B116 may include discerning the intent of the utterance via the first wireless chipset 25A of the HF node to determine whether the utterance will be best executed by the first wireless chipset 25A. If so, the method 100 proceeds to block B118. Otherwise, when the intent is more suitable for execution by the second wireless chipset 25B, the method 100 proceeds to block B120.

[0093] At block B118, the method 100 includes processing the intent via the first wireless chipset 25A. Thus, when the second wireless chipset 25B responds to the deactivation command ( Figure 1 DD), if the intent matches the capabilities of the first wireless chipset 25A, as determined at block B116, the end result may be processing the VR request / utterance of the user 15 via the first wireless chipset 25A at block B118. After processing the intent, the method 100 proceeds to block B122.

[0094] At block B120, the method 100 includes relaying the intent to the second wireless chipset 25B. In this way, the first wireless chipset 25A can determine the VR request of the user 15 by selecting the second wireless chipset 25B for processing the VR request or speech detected at block B114. In other embodiments, the first wireless chipset 25A may not send the pre-processed intent to the second wireless chipset 25B, but may forward the audio itself to the microphone 32 of the wireless device 30. Such an option can be enabled by the existing extended Bluetooth VR command AT+BVRA=2. Then, the second wireless chipset 25B executes the intent, for example, by displaying a playlist or using another application resident on the wireless device 30 or other AG node. Therefore, processing the VR request or speech from block B114 after deactivating the hot word detection function of the VG node may include selectively routing the VR request to the second wireless chipset 25B for processing on the wireless device 30 / AG node. Then, the method 100 proceeds to block B122.

[0095] Block B122 needs to determine whether the paired device from block B104 has ended, i.e. Figure 1 In the illustrated vehicle embodiment of , whether the AG node / wireless device 30 has been disconnected from the HF node / VTU 20. Block B122 may include receiving a termination signal via the first wireless chipset 25A, the termination signal indicating a disconnected connection / terminated pairing, wherein the termination signal may be implemented in various ways, such as as a bit / bit stream or the lack thereof, when the wireless device 30 is no longer detected. For example, Figure 3 The user 15 may turn off the motor vehicle 12 and walk away, for example, after parking. When the devices are no longer paired, the method 100 proceeds to block B124, or when the AG node and the HF node remain paired, in the alternative, block B114 is repeated.

[0096] At block B124, the method 100 includes automatically re-enabling the hotword detection function of the second wireless chipset 25B via the first wireless chipset 25A in response to the termination signal mentioned above. In this case, the first wireless chipset 25A may transmit a hotword detection enable command (arrow EE) to the second wireless chipset 25B using a Bluetooth pairing example (i.e., AT+BVRA=3,0), as shown in FIG. Figure 2 . Other methods may be used within the scope of the present disclosure to achieve the same or similar effects. In a possible method, in the absence of receiving an enable command (arrow EE) from the HF node, the AG node may wait for a predetermined duration after pairing has ended, and then automatically restore its resident hotword detection function, or the user 15 may do so via a corresponding setting on the wireless device 30. The method 100 is completed after block B124 and restarts from block B102.

[0097] The detailed description and the accompanying drawings or diagrams are supportive and descriptive for the present teaching, but the scope of the present teaching is limited only by the claims. Although some best modes and other embodiments for carrying out the present teaching have been described in detail, there are various optional designs and embodiments for practicing the present teaching defined in the appended claims. In addition, the present disclosure explicitly includes combinations and sub-combinations of the elements and features presented above and below.< / vrec> < / texttype> < / string> < / textoperation> < / texttype> < / textid> < / textualrepresentation> < / vrec>

Claims

1. A method for task allocation based on speech recognition and hot word detection function control for use in a wireless network having a hands-free node and an audio gateway node, the method comprising: detecting, via a first wireless chipset of a hands-free node, a second wireless chipset of an audio gateway node, the first wireless chipset and the second wireless chipset comprising respective speech recognition engines responsive to corresponding hotwords; In response to detecting the second wireless chipset, establishing a wireless connection between the first wireless chipset and the second wireless chipset; as well as In response to a predetermined condition, a deactivation command signal is automatically transmitted from the first wireless chipset of the hands-free node to the second wireless chipset of the audio gateway node to thereby temporarily deactivate a hotword detection function of the second wireless chipset.

2. The method according to claim 1, further comprising: receiving, via the first wireless chipset of the hands-free node, a confirmation signal in response to the deactivation command signal, the confirmation signal indicating successful deactivation of the hotword detection function of the second wireless chipset; as well as In response to the confirmation signal, a speech recognition request of a user of the wireless network is processed using the first wireless chipset of the hands-free node.

3. The method according to claim 2, wherein: Processing the speech recognition request includes selectively routing the speech recognition request to the second wireless chipset for processing by the second wireless chipset.

4. The method according to claim 1, further comprising: receiving, via the first wireless chipset of the hands-free node, an error message signal indicating an unsuccessful deactivation of the hotword detection function of the second wireless chipset; as well as In response to the error message signal, a control action is performed via the first wireless chipset.

5. The method according to claim 1, wherein: The wireless connection is a Bluetooth connection.

6. The method according to claim 5, wherein: Automatically transmitting the deactivation command signal to the second wireless chipset includes transmitting a modified Bluetooth voice recognition activation / enhanced voice recognition activation attention command to the second wireless chipset.

7. The method according to claim 1, wherein: The hands-free node comprises a display screen, and wherein the predetermined condition is a requested projection of an application of the audio gateway node onto the display screen of the hands-free node.

8. The method according to claim 7, wherein: The hands-free node includes a vehicle telematics unit coupled to the display screen, and wherein the first wireless chipset of the hands-free node is a hardware component of the vehicle telematics unit.

9. The method according to claim 1, wherein: The predetermined condition is the establishment of the wireless connection.

10. The method according to claim 1, further comprising: receiving, via the first wireless chipset, a termination signal, the termination signal indicating a predetermined termination event; as well as In response to receiving the termination signal, transmitting an enable command signal via the first wireless chipset of the hands-free node to the second wireless chipset of the audio gateway node to thereby automatically re-enable the hotword detection function of the second wireless chipset.

11. Motor vehicles, including: The main body of the vehicle; road wheels connected to the vehicle body; as well as A vehicle telematics unit having a first wireless chipset, wherein the vehicle telematics unit is configured to: detecting, via the first wireless chipset of the vehicle telematics unit, a second wireless chipset of a wireless device within the wireless network, the first wireless chipset and the second wireless chipset including respective speech recognition engines responsive to corresponding hot words; In response to detecting the second wireless chipset, establishing a wireless connection between the first wireless chipset and the second wireless chipset; and In response to a predetermined condition, a deactivation command signal is automatically transmitted to the second wireless chipset to thereby temporarily deactivate a hotword detection function of the wireless device.

12. A motor vehicle according to claim 11, wherein: The vehicle telematics unit is further configured to: receiving, via the first wireless chipset, a confirmation signal in response to the deactivation command signal, the confirmation signal indicating successful deactivation of the hotword detection function of the wireless device; as well as In response to the confirmation signal, a speech recognition request of a user of the wireless network is processed using the first wireless chipset.

13. A motor vehicle according to claim 12, wherein: The vehicle telematics unit is configured to process the voice recognition request by selectively routing the voice recognition request to the second wireless chipset for processing by the second wireless chipset.

14. The motor vehicle of claim 11, wherein: the vehicle telematics unit being configured to receive an error message signal from the wireless device via the first wireless chipset, the error message signal indicating an unsuccessful deactivation of the hotword detection function of the second wireless chipset; as well as A control action is performed in response to the error message signal.

15. The motor vehicle of claim 11, wherein: The wireless connection is a Bluetooth connection, and the vehicle telematics unit is configured to automatically transmit the deactivation command signal to the second wireless chipset as a modified Bluetooth voice recognition activation / enhanced voice recognition activation attention command.

16. The motor vehicle of claim 11, wherein: The vehicle telematics unit is coupled to or includes a display screen, and wherein the predetermined condition is a requested projection of an application of the wireless device onto the display screen.

17. The motor vehicle of claim 11, wherein: The predetermined condition is the establishment of the wireless connection.

18. The motor vehicle of claim 11, wherein: The vehicle telematics unit is further configured to: In response to a predetermined termination event, an enable command signal is transmitted to the second wireless chipset to thereby re-enable the hotword detection function of the wireless device.

19. A computer readable medium having recorded thereon instructions executable by a processor of a vehicle telematics unit of a motor vehicle, the vehicle telematics unit having a first wireless chipset, wherein: Execution of the instructions by the processor causes the vehicle telematics unit to: detecting, via the first wireless chipset, a second wireless chipset of a wireless device within the motor vehicle, the first wireless chipset and the second wireless chipset including respective speech recognition engines responsive to corresponding hot words; in response to detecting the second wireless chipset, establishing a Bluetooth connection between the first wireless chipset of the vehicle telematics unit and the second wireless chipset of the wireless device; automatically transmitting a deactivation command signal via the first wireless chipset of the vehicle telematics unit to the second wireless chipset of the wireless device to thereby deactivate a hotword detection function of the wireless device in response to a predetermined condition, wherein the predetermined condition is a requested projection of the Bluetooth connection or an application of the wireless device onto a display screen of the vehicle telematics unit, and wherein the deactivation command signal is a modified Bluetooth voice recognition activation / enhanced voice recognition activation attention signal; receiving a confirmation signal from the wireless device, the confirmation signal indicating successful deactivation of the hotword detection function; and In response to the confirmation signal, a voice recognition request by a user of the vehicle telematics unit and the wireless device is processed using the first wireless chipset of the vehicle telematics unit instead of the second wireless chipset of the wireless device.

20. The computer-readable medium of claim 19, wherein: Execution of the instructions by the processor causes the vehicle telematics unit to process the voice recognition request via the second wireless chipset of the wireless device by selectively routing the voice recognition request to the second wireless chipset.

Images