Voice device response methods, devices, electronic equipment, storage media and chips
By generating and sending wake-up data packets and determining the device's response conditions based on the sound source energy value, the problem of slow response in collaborative wake-up is solved, achieving fast response and improved user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-10-31
- Publication Date
- 2026-03-13
AI Technical Summary
When waking up multiple voice devices in a coordinated manner, there is a problem of large differences in wake-up latency, resulting in slow device response and poor user experience.
By acquiring the sound source energy value from the voice wake-up command, a wake-up data packet is generated and sent. The device is judged to meet the response conditions according to the preset response conditions, and if no response is received from other devices within a predetermined time, it directly responds to avoid waiting for other devices to wake it up.
It improves the response speed and user experience of voice devices and reduces the response latency of collaborative wake-up.
Smart Images

Figure CN116074933B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of terminal technology, and in particular to a voice device response method, apparatus, electronic device, storage medium, and chip. Background Technology
[0002] With the continuous development of IoT technology, users can more easily issue commands to devices. For example, users can wake up electronic devices by saying a "wake word," thereby enabling interaction between users and electronic devices.
[0003] Currently, with the continuous increase in smart devices, collaborative wake-up functionality has emerged to ensure that users can interact normally with as many devices as possible. However, when collaboratively waking up devices, if there are significant differences in wake-up latency, some devices may have low wake-up latency, but they still need to wait for other devices to wake up before receiving the wake-up data packet, resulting in slower device response and a reduced user experience. Summary of the Invention
[0004] To overcome the problems existing in related technologies, this disclosure provides a device response method, apparatus, electronic device, storage medium, and chip.
[0005] According to a first aspect of the present disclosure, a device response method is provided, applied to a first voice device, the method comprising:
[0006] Get the user's voice wake-up command;
[0007] After detecting that the voice wake-up command contains a preset wake-up word, a first energy value is generated according to a preset sound source energy algorithm, wherein the first energy value represents the sound energy of the voice wake-up command when it propagates from the sound source to the first voice device;
[0008] Send a first wake-up data packet to at least one second voice device, the first wake-up data packet including the first energy value;
[0009] After receiving pre-wake-up data packets sent by all second voice devices, it is determined whether the first voice device meets the preset response conditions based on the pre-wake-up data packets and preset response conditions. The pre-wake-up data packets include a second energy value, which represents the sound energy when the voice wake-up command is transmitted from the sound source to the second voice device.
[0010] If the first voice device does not meet the preset response conditions and does not receive a second wake-up data packet from any of the second voice devices within a predetermined time, then the first voice device responds to the voice wake-up command, and the second wake-up data packet includes the second energy value.
[0011] Optionally, the second wake-up data packet is sent by the second voice device after detecting that the voice wake-up command contains a preset wake-up word.
[0012] Optionally, the method further includes: if the first voice device meets the preset response conditions, then the first voice device responds to the voice wake-up command.
[0013] Optionally, the first wake-up data packet further includes: device information of the first voice device, wake-up time detected by the first voice device, and transmission initiation time for the first wake-up data packet;
[0014] The second wake-up data packet further includes: device information of the second voice device, wake-up time detected by the second voice device, and transmission initiation time for the second wake-up data packet.
[0015] Optionally, the first voice device and the at least one second voice device are connected to a local area network and are in the same preset network group.
[0016] According to a second aspect of the present disclosure, a voice device response method is provided, applied to a second voice device, the method comprising:
[0017] Upon receiving a first wake-up data packet sent by a first voice device, a second energy value is generated according to a preset sound source energy algorithm. The second energy value represents the sound energy of the voice wake-up command issued by the user when it propagates from the sound source to the second voice device. The first wake-up data packet includes the first energy value, which represents the sound energy of the voice wake-up command when it propagates from the sound source to the first voice device.
[0018] Send a pre-wake-up data packet to the first voice device. The pre-wake-up data packet includes the second energy value. The pre-wake-up data packet is used by the first voice device to determine whether the first voice device meets the preset response conditions based on the pre-wake-up data packet and the preset response conditions. If the first voice device meets the preset response conditions, it responds to the voice wake-up command.
[0019] After detecting that the voice wake-up command contains a preset wake-up word, a second wake-up data packet is sent to the first voice device. The second wake-up data packet includes the second energy value. The second wake-up data packet is used by the first voice device to respond to the voice wake-up command if the preset response conditions are not met and no second wake-up data packet is received from any of the second voice devices within a predetermined time.
[0020] Optionally, the first voice device and the at least one second voice device are connected to a local area network and are in the same preset network group.
[0021] According to a third aspect of the present disclosure, a voice device response method is provided, applied to a first voice device and a second voice device, the method comprising:
[0022] The first voice device acquires the voice wake-up command issued by the user;
[0023] After detecting that the voice wake-up command contains a preset wake-up word, the first voice device generates a first energy value according to a preset sound source energy algorithm, wherein the first energy value represents the sound energy of the voice wake-up command when it propagates from the sound source to the first voice device;
[0024] The first voice device sends a first wake-up data packet to at least one second voice device, the first wake-up data packet including the first energy value;
[0025] After receiving the first wake-up data packet, the second voice device generates a second energy value according to a preset sound source energy algorithm, wherein the second energy value represents the sound energy when the voice wake-up command is transmitted from the sound source to the second voice device;
[0026] The second voice device sends a pre-wake-up data packet to the first voice device, the pre-wake-up data packet including the second energy value;
[0027] After detecting that the voice wake-up command contains a preset wake-up word, the second voice device sends a second wake-up data packet to the first voice device, wherein the second wake-up data packet includes the second energy value;
[0028] After receiving the pre-wake-up data packets sent by all the second voice devices, the first voice device determines whether the first voice device meets the preset response conditions based on the pre-wake-up data packets and the preset response conditions.
[0029] If the first voice device meets the preset response conditions, then the first voice device responds to the voice wake-up command;
[0030] If the first voice device does not meet the preset response conditions and does not receive a second wake-up data packet from any of the second voice devices within a predetermined time, then the first voice device responds to the voice wake-up command.
[0031] According to a fourth aspect of the present disclosure, a voice device response apparatus is provided, applied to a first voice device, the apparatus comprising:
[0032] The voice wake-up command acquisition module is configured to acquire the voice wake-up command issued by the user.
[0033] The first energy value generation module is configured to generate a first energy value according to a preset sound source energy algorithm after detecting that the voice wake-up command contains a preset wake-up word. The first energy value represents the sound energy of the voice wake-up command when it propagates from the sound source to the first voice device.
[0034] The first wake-up data packet sending module is configured to send a first wake-up data packet to at least one second voice device, the first wake-up data packet including the first energy value;
[0035] The response determination module is configured to, after receiving pre-wake-up data packets sent by all second voice devices, determine whether the first voice device meets the preset response conditions based on the pre-wake-up data packets and preset response conditions, wherein the pre-wake-up data packets include a second energy value, the second energy value representing the sound energy when the voice wake-up command propagates from the sound source to the second voice device;
[0036] The response module is configured to respond to the voice wake-up command if the first voice device does not meet the preset response conditions and does not receive a second wake-up data packet from any of the second voice devices within a predetermined time. The second wake-up data packet includes the second energy value.
[0037] According to a fifth aspect of the present disclosure, a voice device response apparatus is provided, applied to a second voice device, the apparatus comprising:
[0038] The second energy value generation module is configured to generate a second energy value according to a preset sound source energy algorithm when receiving a first wake-up data packet sent by the first voice device. The second energy value represents the sound energy when the voice wake-up command issued by the user propagates from the sound source to the second voice device. The first wake-up data packet includes the first energy value, which represents the sound energy when the voice wake-up command propagates from the sound source to the first voice device.
[0039] A pre-wake-up data packet sending module is configured to send a pre-wake-up data packet to the first voice device. The pre-wake-up data packet includes the second energy value. The pre-wake-up data packet is used by the first voice device to determine whether the first voice device meets the preset response conditions based on the pre-wake-up data packet and preset response conditions, and to respond to the voice wake-up command if the first voice device meets the preset response conditions.
[0040] The second wake-up data packet sending module is configured to send a second wake-up data packet to the first voice device after detecting that the voice wake-up command contains a preset wake-up word. The second wake-up data packet includes the second energy value. The second wake-up data packet is used by the first voice device to respond to the voice wake-up command if the preset response conditions are not met and no second wake-up data packet is received from any of the second voice devices within a predetermined time.
[0041] According to a sixth aspect of the present disclosure, an electronic device is provided, comprising:
[0042] processor;
[0043] Memory used to store processor-executable instructions;
[0044] The processor is configured to implement the steps of the method described in the first or second aspect.
[0045] According to a seventh aspect of the present disclosure, a computer-readable storage medium is provided that stores computer program instructions thereon, which, when executed by a processor, implement the steps of the method described in the first or second aspect.
[0046] According to an eighth aspect of the present disclosure, a chip is provided, including a processor and an interface; the processor is configured to read instructions to execute the method described in the first or second aspect.
[0047] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects: acquiring a voice wake-up command issued by a user through a first voice device; after detecting that the voice wake-up command contains a preset wake-up word, generating a first energy value according to a preset sound source energy algorithm, wherein the first energy value represents the sound energy of the voice wake-up command when it propagates from the sound source to the first voice device; sending a first wake-up data packet to at least one second voice device, the first wake-up data packet including the first energy value; after receiving pre-wake-up data packets sent by all second voice devices, determining whether the first voice device meets the preset response conditions according to the pre-wake-up data packets and preset response conditions, wherein the pre-wake-up data packets include a second energy value, the second energy value representing the sound energy of the voice wake-up command when it propagates from the sound source to the second voice device; if the first voice device does not meet the preset response conditions and does not receive a second wake-up data packet sent by any of the second voice devices within a predetermined time, then the first voice device responds to the voice wake-up command, the second wake-up data packet including the second energy value. Thus, during the collaborative wake-up process of the first voice device and the second voice device, before the second voice device is woken up, the second voice device sends a pre-wake-up data packet in advance, enabling the first voice device to make a response decision in advance based on the pre-wake-up data packet, so as to respond quickly, instead of having the first voice device wait until the second voice device is woken up before making a response decision, thereby improving the response speed and user experience.
[0048] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0049] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0050] Figure 1 This is a flowchart illustrating a device response method according to an exemplary embodiment.
[0051] Figure 2 It is based on Figure 1 The embodiment shows a schematic diagram of the device network structure.
[0052] Figure 3 This is a flowchart illustrating a device response method according to another exemplary embodiment.
[0053] Figure 4 This is a timing diagram illustrating a device response method according to yet another exemplary embodiment.
[0054] Figure 5 yes Figure 4 An implementation flowchart of a device response method is shown in the embodiment.
[0055] Figure 6 This is a block diagram illustrating a device response apparatus according to an exemplary embodiment.
[0056] Figure 7 This is a block diagram illustrating a device response apparatus according to another exemplary embodiment.
[0057] Figure 8 This is a block diagram illustrating an electronic device according to an exemplary embodiment. Detailed Implementation
[0058] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0059] It should be noted that all actions involving the acquisition of signals, information, or data in this application are carried out in compliance with the relevant data protection laws and policies of the country where the application is located, and with the authorization granted by the owner of the relevant device.
[0060] In related technologies, when a user coordinates the wake-up of multiple voice devices in the same network, if one voice device is woken up, it must wait until it receives wake-up data packets from other voice devices in the group or if a timeout occurs before it can make a decision and determine whether to respond. This results in a relatively long wait time after each wake-up when there are remote voice devices, such as when a remote device is not woken up during each wake-up attempt, or when there are devices with high wake-up latency, before deciding whether to respond. This leads to a slow response time for the voice device and a poor user experience.
[0061] To address the aforementioned issues, this embodiment provides a method, apparatus, electronic device, storage medium, and chip for responding to voice device responses, which can effectively improve the response speed of voice devices.
[0062] Figure 1 This is a flowchart illustrating a voice device response method according to an exemplary embodiment, such as... Figure 1 As shown, the voice device response method can be applied to a first voice device. The method may include the following steps:
[0063] In step S11, the user's voice wake-up command is obtained.
[0064] For example, such as Figure 2 As shown, the first voice device can be located in a preset network group 100. This preset network group 100 can be formed by multiple voice devices accessing the same local area network (LAN). The multiple voice devices within the group can communicate with each other. The multiple voice devices may include the first voice device 110 and at least one second voice device 120. Optionally, the multiple voice devices include, but are not limited to: mobile terminals (such as smartphones, personal computers, etc.), smart TVs, smart speakers, smart clothes racks, smart refrigerators, smart wearable devices, etc. Optionally, the multiple devices in the preset network group 100 can be located in the same space or in different spaces, for example, one at home and another at the office; this is not limited here.
[0065] In some implementations, one voice device in the preset network can be arbitrarily selected as the first voice device, and other voice devices in the preset network besides the first voice device can be selected as the second voice devices. The first voice device can monitor in real time whether it receives a voice wake-up command from the user. When the first voice device receives a voice wake-up command, it can wake up. It can be understood that waking up the device can be regarded as starting the device; when the device is woken up, it indicates that the device has completed the startup process.
[0066] Specifically, when the voice wake-up command contains a preset wake-up word, and the voice device detects the preset wake-up word, the voice device can be triggered to wake up.
[0067] In step S12, after detecting that the voice wake-up command contains a preset wake-up word, a first energy value is generated according to a preset sound source energy algorithm, wherein the first energy value represents the sound energy when the voice wake-up command propagates from the sound source to the first voice device.
[0068] For example, if the first voice device detects that a user's voice command contains a preset wake-up word "XX classmate", then the voice device can trigger a wake-up action and generate a first energy value according to a preset sound source energy algorithm. In other words, the first voice device can determine whether it is awake by detecting whether the voice wake-up command contains a preset wake-up word.
[0069] Understandably, since the first energy value represents the sound energy when the voice wake-up command travels from the sound source to the first voice device, and the amount of sound energy received by the first voice device is related to the distance between the sound source and the first voice device, this first energy value can be used to determine the distance between the sound source and the first voice device. For example, the larger the first energy value, the closer the sound source is to the first voice device; the smaller the first energy value, the farther the sound source is from the first voice device. Here, the sound source is the user.
[0070] Optionally, a preset sound source energy algorithm can be pre-stored in the first voice device.
[0071] In step S13, a first wake-up data packet is sent to at least one second voice device, the first wake-up data packet including a first energy value.
[0072] In some implementations, the first voice device may generate a first wake-up data packet based on a first energy value and send the first wake-up data packet to the second voice device.
[0073] In some implementations, the first wake-up data packet may include, in addition to the first energy value, device information of the first voice device, the wake-up time detected by the first voice device, and the transmission initiation time for the first wake-up data packet. Optionally, the device information may be encrypted and may include, but is not limited to, device type information, device identifier (deviceId), and product serial number (SN). Optionally, the aforementioned wake-up time may specifically be a recorded wake-up timestamp, and the aforementioned transmission initiation time may also be a transmission initiation timestamp.
[0074] In step S14, after receiving the pre-wake-up data packets sent by all the second voice devices, it is determined whether the first voice device meets the preset response conditions based on the pre-wake-up data packets and the preset response conditions. The pre-wake-up data packets include a second energy value, which represents the sound energy when the voice wake-up command is transmitted from the sound source to the second voice device.
[0075] In some implementations, the first wake-up data packet can be used by the second voice device to send a pre-wake-up data packet back to the first voice device when the second voice device receives the first wake-up data packet. For example, when the second voice device receives the first wake-up data packet, it can detect whether it has been woken up. If it has not been woken up, it indicates that the second voice device may not have received the user's voice wake-up command for various reasons. In this case, the second voice device can send a pre-wake-up data packet back to the first voice device in advance.
[0076] The implementation method for the second voice device to detect whether it has been woken up can refer to the method of the first voice device detecting a preset wake-up word, so it will not be described in detail here.
[0077] After receiving the pre-wake-up data packets sent by all the second voice devices, the first voice device can determine whether the first voice device meets the preset response conditions based on the pre-wake-up data packets and the preset response conditions.
[0078] Optionally, the preset response condition can be to determine whether the second energy value in the pre-wake-up data packet is within a specified range. If it is, the preset response condition is met; if it is not, the preset response condition is not met.
[0079] In other embodiments, the pre-wake data packet may also include wake-up object information. When the first voice device receives the pre-wake data packet sent by the second voice device, it can determine whether the first voice device is the device that the user needs to respond to based on the wake-up object information in the pre-wake data packet. If so, it can determine whether the first voice device meets the preset response conditions. As an example, the first voice device can compare the device ID in the voice wake-up command with its own ID. If the two IDs match, it can determine whether the first voice device meets the preset response conditions.
[0080] In step S15, if the first voice device does not meet the preset response conditions and does not receive a second wake-up data packet from any of the second voice devices within a predetermined time, the first voice device responds to the voice wake-up command, and the second wake-up data packet includes a second energy value.
[0081] Optionally, the second wake-up data packet is sent by the second voice device after detecting that the voice wake-up command contains a preset wake-up word.
[0082] The second wake-up data packet and the pre-wake-up data packet can contain the same data. The difference between the two is that the data packets are different types. The second wake-up data packet is sent after the second voice device is woken up, while the pre-wake-up data packet is sent after receiving the first wake-up data packet, without waiting for the second voice device to be woken up.
[0083] As an example, if the first voice device does not receive the second wake-up data packet sent by the second voice device within a preset time period, it indicates that the first voice device is unsure whether any device in the preset network responds to the user's voice wake-up command. To avoid any device in the preset network failing to respond to the user's voice wake-up command, the first voice device can respond to the voice wake-up command to inform the user of the device's response status. For example, if the user issues the voice wake-up command "XX, turn on the second voice device," the first voice device, after receiving the voice wake-up command first, sends the first wake-up data packet to the second voice device. However, if it does not receive the second wake-up data packet within the preset time period, it can directly respond to the user "No second voice device detected."
[0084] In some implementations, the method may further include: if the first voice device meets preset response conditions, then the first voice device responds to the voice wake-up command.
[0085] In some implementations, the method may further include:
[0086] If a second wake-up data packet sent by the second voice device is received within a preset time period, then the detection of whether the second wake-up data packet sent by the second voice device has been received is stopped.
[0087] For example, if the first voice device receives the second wake-up data packet sent by the second voice device within a preset time period, it indicates that the first voice device already knows whether the second voice device has responded and does not need to make a response decision itself. Therefore, it can stop detecting whether the second wake-up data packet has been received, thereby reducing power consumption.
[0088] As can be seen, in this embodiment, the user's voice wake-up command is obtained through a first voice device; after detecting that the voice wake-up command contains a preset wake-up word, a first energy value is generated according to a preset sound source energy algorithm, wherein the first energy value represents the sound energy of the voice wake-up command when it propagates from the sound source to the first voice device; a first wake-up data packet is sent to at least one second voice device, the first wake-up data packet including the first energy value; after receiving pre-wakeup data packets sent by all second voice devices, it is determined whether the first voice device meets the preset response conditions according to the pre-wakeup data packets and preset response conditions, wherein the pre-wakeup data packets include a second energy value, the second energy value representing the sound energy of the voice wake-up command when it propagates from the sound source to the second voice device; if the first voice device does not meet the preset response conditions and does not receive a second wake-up data packet sent by any second voice device within a predetermined time, then the first voice device responds to the voice wake-up command, the second wake-up data packet including the second energy value. Thus, during the collaborative wake-up process of the first voice device and the second voice device, before the second voice device is woken up, the second voice device sends a pre-wake-up data packet in advance, enabling the first voice device to make a response decision in advance based on the pre-wake-up data packet, so as to respond quickly, instead of having the first voice device wait until the second voice device is woken up before making a response decision, thereby improving the response speed and user experience.
[0089] Figure 3 This is a flowchart illustrating a voice device response method according to another exemplary embodiment, such as... Figure 3 As shown, the voice device response method is used for a second voice device. At least one second voice device and the first voice device are connected to a local area network and are in the same preset network group. The method may include the following steps:
[0090] In step S21, upon receiving the first wake-up data packet sent by the first voice device, a second energy value is generated according to a preset sound source energy algorithm. The second energy value represents the sound energy of the voice wake-up command issued by the user when it propagates from the sound source to the second voice device. The first wake-up data packet includes the first energy value, which represents the sound energy of the voice wake-up command when it propagates from the sound source to the first voice device.
[0091] In step S22, a pre-wake-up data packet is sent to the first voice device. The pre-wake-up data packet includes a second energy value. The pre-wake-up data packet is used by the first voice device to determine whether the first voice device meets the preset response conditions based on the pre-wake-up data packet and the preset response conditions, and to respond to the voice wake-up command if the first voice device meets the preset response conditions.
[0092] In step S23, after detecting that the voice wake-up command contains a preset wake-up word, a second wake-up data packet is sent to the first voice device. The second wake-up data packet includes a second energy value. The second wake-up data packet is used by the first voice device to respond to the voice wake-up command if the preset response conditions are not met and no second wake-up data packet is received from any second voice device within a predetermined time.
[0093] For example, a user can issue a voice wake-up command to a device in a preset network. The first voice device can respond to the received voice wake-up command, wake up, and then send a first wake-up data packet to the second voice device. When the second voice device receives the first wake-up data packet, it can detect whether it has been woken up. If it has not been woken up, it indicates that the second voice device may not have received the user's voice wake-up command, or that the time of receiving the voice wake-up command is later than that of the first voice device due to network latency.
[0094] Following the example above, under normal circumstances, the first voice device needs to receive the wake-up data packet fed back by the second voice device after it is woken up in order to make a response decision. Here, in order not to hinder the first voice device, which is woken up first, from making a wake-up decision, a pre-wake-up data packet can be sent to the first voice device in advance before the second voice device is woken up, so that the first voice device can make a response decision in advance.
[0095] More specific implementations of steps S21 to S23 can be found in steps S11 to S15 of the above embodiments, and will not be repeated here.
[0096] Figure 4 This is a timing diagram illustrating a voice device response method according to an exemplary embodiment, such as... Figure 4 As shown, the voice device response method can be applied to a preset network, which may include a first voice device and at least one second voice device. The method may include:
[0097] In step S31, the first voice device acquires the voice wake-up command issued by the user.
[0098] In step S32, after detecting that the voice wake-up command contains a preset wake-up word, the first voice device generates a first energy value according to a preset sound source energy algorithm, wherein the first energy value represents the sound energy when the voice wake-up command propagates from the sound source to the first voice device.
[0099] In step S33, the first voice device sends a first wake-up data packet to at least one second voice device, the first wake-up data packet including a first energy value.
[0100] In step S34, after receiving the first wake-up data packet, the second voice device generates a second energy value according to a preset sound source energy algorithm, wherein the second energy value represents the sound energy when the voice wake-up command is transmitted from the sound source to the second voice device.
[0101] In step S35, the second voice device sends a pre-wake-up data packet to the first voice device, the pre-wake-up data packet including a second energy value.
[0102] In step S36, after detecting that the voice wake-up command contains a preset wake-up word, the second voice device sends a second wake-up data packet to the first voice device, wherein the second wake-up data packet includes a second energy value.
[0103] In step S37, after receiving all the pre-wake-up data packets sent by the second voice devices, the first voice device determines whether the first voice device meets the preset response conditions based on the pre-wake-up data packets and the preset response conditions.
[0104] In step S38, if the first voice device meets the preset response conditions, the first voice device responds to the voice wake-up command.
[0105] In step S39, if the first voice device does not meet the preset response conditions and does not receive a second wake-up data packet sent by any of the second voice devices within a predetermined time, then the first voice device responds to the voice wake-up command.
[0106] The specific implementation of steps S31 to S39 in this embodiment can be referred to steps S11 to S15 and steps S21 to S23 in the above embodiment, so they will not be repeated here.
[0107] For example, such as Figure 6 As shown, in practical applications, the specific implementation process of the device response method in this embodiment can be as follows:
[0108] At time T0, the user issues a voice wake-up command.
[0109] At time T1, the first voice device is woken up and sends a first wake-up data packet to the second voice device, wherein the first wake-up data packet contains a first energy value.
[0110] At time Ta, the second voice device receives the first wake-up data packet, then obtains the second energy value obtained at time Ta, and replies with a pre-wake-up data packet to the first voice device based on the second energy value.
[0111] At time T2, the second voice device is woken up and sends a second wake-up data packet to the first voice device. The second wake-up data packet also includes a second energy value.
[0112] At time Tb, the first voice device receives the pre-wake-up data packet and makes a decision based on the pre-wake-up data packet.
[0113] If the decision is for the first voice device to respond, then the first voice device will respond immediately.
[0114] If the decision is for the second voice device to respond, then continue waiting for the second wake-up data packet from the second voice device. If the second wake-up data packet is received at time Tc, then the first voice device does not respond. If the second wake-up data packet is not received after time Tc, then the first voice device responds.
[0115] As can be seen, by using pre-wake packets, when the first voice device wakes up with a fast wake-up engine, the first voice device can make decisions in advance based on the pre-wake data packets fed back by the second voice device. Therefore, when the device front-end response latency is large, the response latency of collaborative wake-up can be reduced. Specifically, the advance time ΔT = diff_t2 - diff_t1 is approximately increased. This effectively improves the device's response speed and provides users with a better user experience.
[0116] Figure 6 This is a block diagram illustrating a voice device response apparatus according to an exemplary embodiment. (Refer to...) Figure 6 The device 50 is applied to a first voice device in a preset network, and the network further includes at least one second voice device. The device 50 includes:
[0117] The voice wake-up command acquisition module 51 is configured to acquire the voice wake-up command issued by the user.
[0118] The first energy value generation module 52 is configured to generate a first energy value according to a preset sound source energy algorithm after detecting that the voice wake-up command contains a preset wake-up word. The first energy value represents the sound energy of the voice wake-up command when it is transmitted from the sound source to the first voice device.
[0119] The first wake-up data packet sending module 53 is configured to send a first wake-up data packet to at least one second voice device, the first wake-up data packet including a first energy value.
[0120] The response judgment module 54 is configured to determine whether the first voice device meets the preset response conditions based on the pre-wake data packets and preset response conditions after receiving the pre-wake data packets from all the second voice devices. The pre-wake data packets include a second energy value, which represents the sound energy when the voice wake-up command is transmitted from the sound source to the second voice device.
[0121] The response module 55 is configured to respond to the voice wake-up command if the first voice device does not meet the preset response conditions and does not receive a second wake-up data packet from any second voice device within a predetermined time. The second wake-up data packet includes a second energy value.
[0122] In some implementations, the first voice device and at least one second voice device are connected to a local area network and are in the same preset network group.
[0123] In some implementations, the first wake-up data packet further includes: device information of the first voice device, wake-up time detected by the first voice device, and transmission initiation time for the first wake-up data packet; the second wake-up data packet further includes: device information of the second voice device, wake-up time detected by the second voice device, and transmission initiation time for the second wake-up data packet.
[0124] In some implementations, the response module 55 is further configured to respond to the voice wake-up command if the first voice device meets the preset response conditions.
[0125] In some implementations, the second wake-up data packet is sent by the second voice device after detecting that the voice wake-up command contains a preset wake-up word.
[0126] Figure 7 This is a block diagram illustrating a voice device response apparatus according to another exemplary embodiment. (Refer to...) Figure 7 The device 60 is applied to a second voice device in a pre-defined network, the network also including a first voice device, and the device 60 includes:
[0127] The second energy value generation module 61 is configured to generate a second energy value according to a preset sound source energy algorithm when receiving a first wake-up data packet sent by the first voice device. The second energy value represents the sound energy when the voice wake-up command issued by the user propagates from the sound source to the second voice device. The first wake-up data packet includes the first energy value, which represents the sound energy when the voice wake-up command propagates from the sound source to the first voice device.
[0128] The pre-wake data packet sending module 62 is configured to send a pre-wake data packet to the first voice device. The pre-wake data packet includes a second energy value. The pre-wake data packet is used by the first voice device to determine whether the first voice device meets the preset response conditions based on the pre-wake data packet and the preset response conditions, and to respond to the voice wake-up command if the first voice device meets the preset response conditions.
[0129] The second wake-up data packet sending module 63 is configured to send a second wake-up data packet to the first voice device after detecting that the voice wake-up command contains a preset wake-up word. The second wake-up data packet includes a second energy value. The second wake-up data packet is used by the first voice device to respond to the voice wake-up command if the preset response conditions are not met and no second wake-up data packet is received from any second voice device within a predetermined time.
[0130] In some implementations, the first voice device and at least one second voice device are connected to a local area network and are in the same preset network group.
[0131] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0132] This disclosure also provides a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, implement the steps of the device response method provided in this disclosure.
[0133] Figure 8 This is a block diagram illustrating an electronic device 800 for a voice device response method according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.
[0134] Reference Figure 8 The electronic device 800 may include one or more of the following components: processing component 802, memory 804, power supply component 806, multimedia component 808, audio component 810, input / output interface 812, sensor component 814, and communication component 816.
[0135] Processing component 802 typically controls the overall operation of electronic device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.
[0136] Memory 804 is configured to store various types of data to support the operation of electronic device 800. Examples of this data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.
[0137] Power supply component 806 provides power to various components of electronic device 800. Power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800.
[0138] Multimedia component 808 includes a screen that provides an output interface between the aforementioned electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
[0139] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when electronic device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
[0140] Input / output interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.
[0141] Sensor assembly 814 includes one or more sensors for providing state assessments of various aspects of electronic device 800. For example, sensor assembly 814 can detect the on / off state of electronic device 800, the relative positioning of components such as the display and keypad of electronic device 800, changes in position of electronic device 800 or a component of electronic device 800, the presence or absence of user contact with electronic device 800, orientation or acceleration / deceleration of electronic device 800, and temperature changes of electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.
[0142] Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices. Electronic device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the aforementioned communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
[0143] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.
[0144] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, which can be executed by a processor 820 of an electronic device 800 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.
[0145] The aforementioned device can be a standalone electronic device or a part of a standalone electronic device. For example, in one embodiment, the device can be an integrated circuit (IC) or a chip, wherein the integrated circuit can be a single IC or a collection of multiple ICs. The chip can include, but is not limited to, the following types: GPU (Graphics Processing Unit), CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), and SoC (System on Chip). The aforementioned integrated circuit or chip can be used to execute executable instructions (or code) to implement the aforementioned device response method. The executable instructions can be stored in the integrated circuit or chip or obtained from other devices or equipment. For example, the integrated circuit or chip includes a processor, memory, and an interface for communicating with other devices. The executable instruction can be stored in the memory, and when the executable instruction is executed by the processor, it implements the device response method described above; or, the integrated circuit or chip can receive the executable instruction through the interface and transmit it to the processor for execution to implement the device response method described above.
[0146] Therefore, in one exemplary embodiment, a chip is also provided, the chip including a processor and an interface; the processor is used to read instructions to execute the device response method in the above embodiments.
[0147] In another exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program executable by a programmable device, the computer program having a code portion for performing the device response method described above when executed by the programmable device.
[0148] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of this disclosure. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.
[0149] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.
Claims
1. A voice device answering method, characterized by, The method applied to a first voice device comprises: acquiring a voice wake-up command issued by a user; after detecting that the voice wake-up command contains a preset wake-up word, triggering a wake-up action of the first voice device, generating a first energy value according to a preset sound source energy algorithm, wherein the first energy value represents sound energy when the voice wake-up command propagates from a sound source to the first voice device; sending a first wake-up data packet to at least one second voice device, the first wake-up data packet comprising the first energy value, the first wake-up data packet being used for the second voice device to feed back a pre-wake-up data packet to the first voice device in the case that the second voice device receives the first wake-up data packet and is not woken up; after receiving all the pre-wake-up data packets sent by the second voice devices, determining whether the first voice device meets a preset response condition according to the pre-wake-up data packets and the preset response condition, wherein the pre-wake-up data packet comprises a second energy value, and the second energy value represents sound energy when the voice wake-up command propagates from the sound source to the second voice device; if the first voice device does not meet the preset response condition and does not receive a second wake-up data packet sent by any one of the second voice devices within a predetermined time, the first voice device responds to the voice wake-up command, and the second wake-up data packet comprises the second energy value and represents that the second voice device is woken up.
2. The voice device response method according to claim 1, wherein: the second wake-up data packet is sent by the second voice device after detecting that the voice wake-up command contains the preset wake-up word.
3. The voice device response method of claim 1, wherein, The method further comprises: if the first voice device meets the preset response condition, the first voice device responds to the voice wake-up command.
4. The voice device response method according to any one of claims 1-3, wherein: the first wake-up data packet further comprises device information of the first voice device, a wake-up time detected by the first voice device, and a transmission initiation time for the first wake-up data packet; the second wake-up data packet further comprises device information of the second voice device, a wake-up time detected by the second voice device, and a transmission initiation time for the second wake-up data packet.
5. The voice device response method according to any one of claims 1-3, wherein: the first voice device and the at least one second voice device are connected to a local area network and are in a same preset network group.
6. A voice device answering method, characterized by, The method applied to a second voice device comprises: In a case where the first wake-up data packet sent by the first voice device is received, a second energy value is generated according to a preset sound source energy algorithm, wherein the second energy value represents sound energy of the voice wake-up command emitted by the user from a sound source to the second voice device, the first wake-up data packet comprises a first energy value, the first energy value represents sound energy of the voice wake-up command emitted by the user from the sound source to the first voice device, and the first energy value is generated according to the preset sound source energy algorithm after the first voice device detects that the voice wake-up command contains a preset wake-up word and triggers a wake-up action of the first voice device; In a case where the first voice device is not woken up, a pre-wake-up data packet is sent to the first voice device, and the pre-wake-up data packet comprises the second energy value, wherein the pre-wake-up data packet is used for the first voice device to determine whether the first voice device meets a preset response condition according to the pre-wake-up data packet and the preset response condition, and the voice wake-up command is responded to in a case where the first voice device meets the preset response condition; After detecting that the voice wake-up command contains a preset wake-up word, a wake-up action is triggered, and a second wake-up data packet is sent to the first voice device, wherein the second wake-up data packet comprises the second energy value, and the second wake-up data packet is used for the first voice device to respond to the voice wake-up command in a case where the first voice device does not meet the preset response condition and does not receive any second wake-up data packet sent by the second voice device within a predetermined time.
7. The voice device response method according to claim 6, wherein the first voice device and the at least one second voice device are connected to a local area network and belong to a same preset network group. The method is applied to the first voice device and the second voice device, and the method comprises the following steps:
8. A voice device answering method, characterized by, The first voice device acquires a voice wake-up command emitted by a user; After detecting that the voice wake-up command contains a preset wake-up word, a wake-up action of the first voice device is triggered, and a first energy value is generated according to a preset sound source energy algorithm, wherein the first energy value represents sound energy of the voice wake-up command emitted by the user from a sound source to the first voice device; The first voice device sends a first wake-up data packet to the at least one second voice device, and the first wake-up data packet comprises the first energy value, wherein the first wake-up data packet is used for the second voice device to feed back a pre-wake-up data packet to the first voice device in a case where the first wake-up data packet is received and the second voice device is not woken up; The second voice device generates a second energy value according to the preset sound source energy algorithm after receiving the first wake-up data packet, wherein the second energy value represents sound energy of the voice wake-up command emitted by the user from the sound source to the second voice device; The second voice device sends a pre-wake-up data packet to the first voice device in a case where the second voice device is not woken up, and the pre-wake-up data packet comprises the second energy value. The second voice device triggers a wake-up action after detecting that the voice wake-up command contains a preset wake-up word, and sends a second wake-up data packet to the first voice device, wherein the second wake-up data packet comprises the second energy value; The first voice device determines whether the first voice device meets a preset response condition according to the pre-wake-up data packet and the preset response condition after receiving all the pre-wake-up data packets sent by the second voice devices; If the first voice device meets the preset response condition, the first voice device responds to the voice wake-up command; If the first voice device does not meet the preset response condition and does not receive any second wake-up data packet sent by the second voice devices within a predetermined time, the first voice device responds to the voice wake-up command.
9. A voice device answering apparatus characterized by comprising: The device applied to the first voice device comprises: A voice wake-up command acquisition module configured to acquire a voice wake-up command issued by a user; A first energy value generation module configured to trigger a wake-up action of the first voice device after detecting that the voice wake-up command contains a preset wake-up word, and generate a first energy value according to a preset sound source energy algorithm, wherein the first energy value represents sound energy of the voice wake-up command propagating from a sound source to the first voice device; A first wake-up data packet sending module configured to send a first wake-up data packet to at least one second voice device, wherein the first wake-up data packet comprises the first energy value, and the first wake-up data packet is used for the second voice device to feed back a pre-wake-up data packet to the first voice device in the case that the second voice device receives the first wake-up data packet and is not woken up; A response judgment module configured to determine whether the first voice device meets a preset response condition according to the pre-wake-up data packet and the preset response condition after receiving all the pre-wake-up data packets sent by the second voice devices, wherein the pre-wake-up data packet comprises a second energy value, and the second energy value represents sound energy of the voice wake-up command propagating from a sound source to the second voice device; A response module configured to respond to the voice wake-up command in the case that the first voice device does not meet the preset response condition and does not receive any second wake-up data packet sent by the second voice devices within a predetermined time, wherein the second wake-up data packet comprises the second energy value, and the second wake-up data packet indicates that the second voice device is woken up.
10. A voice device answering apparatus characterized by comprising: The device applied to the second voice device comprises: The second energy value generation module is configured to generate a second energy value according to a preset sound source energy algorithm in a case where a first wake-up data packet transmitted by a first voice device is received, wherein the second energy value represents sound energy of a voice wake-up command issued by a user when the voice wake-up command propagates from a sound source to the second voice device, the first wake-up data packet comprises a first energy value, the first energy value represents sound energy of the voice wake-up command when the voice wake-up command propagates from the sound source to the first voice device, and the first energy value is generated by the first voice device according to the preset sound source energy algorithm after the first voice device detects that the voice wake-up command contains a preset wake-up word; The pre-wake-up data packet transmission module is configured to transmit a pre-wake-up data packet to the first voice device in a case where the second voice device is not woken up, wherein the pre-wake-up data packet comprises the second energy value, and the pre-wake-up data packet is used for the first voice device to determine whether the first voice device meets a preset response condition according to the pre-wake-up data packet and the preset response condition, and to respond to the voice wake-up command in a case where the first voice device meets the preset response condition; The second wake-up data packet transmission module is configured to transmit a second wake-up data packet to the first voice device after the wake-up action is triggered in a case where the voice wake-up command contains the preset wake-up word, wherein the second wake-up data packet comprises the second energy value, and the second wake-up data packet is used for the first voice device to respond to the voice wake-up command in a case where the first voice device does not meet the preset response condition and does not receive any second wake-up data packet transmitted by the second voice device within a predetermined time.
11. An electronic device, comprising: comprise: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement steps of the method of any one of claims 1 to 7.
12. A computer-readable storage medium having stored thereon computer program instructions, wherein, The program instructions, when executed by the processor, implement steps of the method of any one of claims 1 to 7.
13. A chip, characterized by comprise a processor and an interface; the processor is used to read instructions to execute the method of any one of claims 1 to 7.
Citation Information
Patent Citations
Voice collaborative wake-up method and device, electronic equipment and storage medium
CN113689857A