Method, device and smart device for controlling smart device, storage medium

CN115016301BActive Publication Date: 2026-08-11QINGDAO HAIER AIR CONDITIONER GENERAL CORP LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-11
Publication Date
2026-08-11

AI Technical Summary

Technical Problem

因此,相关技术唤醒成功率提升有限,不利于保障各类群体用户的语音功能体验

Benefits of technology

[0017] In this embodiment, when audio content is detected being played on the smart device, it is further determined whether the user has performed a voice wake-up action. If a voice wake-up action is detected, the current real-time playback volume of the smart device is detected, and a wake-up reference volume associated with the user is matched based on the user's identity information. The wake-up reference volume is the maximum playback volume allowed when the smart device is simultaneously playing audio, assuming the voice wake-up function is operating normally. The wake-up reference volume for each user may not be the same. Therefore, by combining the real-time playback volume and the wake-up reference volume, this embodiment can control the smart device to make more accurate adjustments to adapt to the individual differences of different users. This further improves the wake-up success rate when the smart device is playing audio content, which is beneficial to ensuring the voice function experience for various user groups.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115016301B_ABST
    Figure CN115016301B_ABST
Patent Text Reader

Abstract

This application relates to the field of voice control technology, and discloses a method for controlling a smart device, comprising: detecting user action information when audio content is detected playing on the smart device; determining the real-time playback volume of the smart device and identifying the user's identity information when a voice wake-up action is detected; matching a corresponding wake-up reference volume based on the user's identity information; and controlling the smart device to make functional adjustments based on the real-time playback volume and the wake-up reference volume to assist in waking up the smart device. This application, by combining the real-time playback volume and the wake-up reference volume, enables more accurate control of the smart device to adapt to individual differences among users. This further improves the wake-up success rate when the smart device plays audio content, thus ensuring a better voice function experience for various user groups. This application also discloses a device for controlling a smart device, the smart device itself, and a storage medium.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of voice control technology, such as a method, apparatus, and smart device or storage medium for controlling smart devices. Background Technology

[0002] Currently, with the increasing prevalence of smart technology, voice recognition technology is gradually being applied to various home appliances. Based on this technology, users can control smart devices using voice commands to manipulate them and adjust their functions. However, when existing smart devices play audio content, the device's own voice can easily mask the user's voice, potentially making it impossible to recognize the wake word. This increases the difficulty of waking up smart devices and negatively impacts the user's voice experience.

[0003] To address this, a voice wake-up method has been proposed, comprising: acquiring ambient sound parameters of the environment in which the electrical appliance is located; determining whether the ambient sound parameters of the environment in which the electrical appliance is located are greater than a set sound parameter; if the ambient sound parameters of the environment in which the electrical appliance is located are greater than the set sound parameter, determining whether a voice wake-up action exists in the environment in which the electrical appliance is located; if a voice wake-up action exists in the environment in which the electrical appliance is located, reducing the volume of the sound broadcast in the environment in which the electrical appliance is located, so as to wake up the electrical appliance by voice based on the voice wake-up action in the environment in which the electrical appliance is located while reducing the volume of the sound broadcast in the environment in which the electrical appliance is located.

[0004] In the process of implementing the embodiments of this disclosure, at least the following problems were found in the related art:

[0005] The existing technologies fail to account for the differences among user groups. For users with soft voices, even after adjustments, wake-up may still fail. Therefore, the improvement in wake-up success rate is limited, which is detrimental to ensuring a good voice function experience for all user groups. Summary of the Invention

[0006] To provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not intended as a general commentary, nor is it intended to identify key / important components or describe the scope of protection of these embodiments, but rather as a prelude to the detailed description that follows.

[0007] This disclosure provides a method, apparatus, and smart device and storage medium for controlling smart devices, which can further improve the wake-up success rate and help ensure the voice function experience of various user groups.

[0008] In some embodiments, the method includes:

[0009] When audio content is detected being played on a smart device, the user's action information is detected.

[0010] Upon detecting a user's voice wake-up action, determine the real-time playback volume of the smart device and identify the user's identity information;

[0011] Match the corresponding wake-up baseline volume based on the user's identity information;

[0012] Based on the real-time playback volume and the wake-up reference volume, the system controls the smart device to make functional adjustments to assist in waking up the smart device.

[0013] In some embodiments, the apparatus includes a processor and a memory storing program instructions, the processor being configured to execute the method described above for controlling a smart device when the program instructions are executed.

[0014] In some embodiments, the smart device includes the means described above for controlling the smart device.

[0015] In some embodiments, the storage medium stores program instructions that, when executed, perform the methods described above for controlling smart devices.

[0016] The method, apparatus, smart device, and storage medium for controlling smart devices provided in this disclosure can achieve the following technical effects:

[0017] In this embodiment, when audio content is detected being played on the smart device, it is further determined whether the user has performed a voice wake-up action. If a voice wake-up action is detected, the current real-time playback volume of the smart device is detected, and a wake-up reference volume associated with the user is matched based on the user's identity information. The wake-up reference volume is the maximum playback volume allowed when the smart device is simultaneously playing audio, assuming the voice wake-up function is operating normally. The wake-up reference volume for each user may not be the same. Therefore, by combining the real-time playback volume and the wake-up reference volume, this embodiment can control the smart device to make more accurate adjustments to adapt to the individual differences of different users. This further improves the wake-up success rate when the smart device is playing audio content, which is beneficial to ensuring the voice function experience for various user groups.

[0018] The above general description and the description below are exemplary and illustrative only and are not intended to limit this application. Attached Figure Description

[0019] One or more embodiments are illustrated by way of example with reference to the accompanying drawings. These illustrations and drawings do not constitute a limitation on the embodiments. Elements having the same reference numerals in the drawings are shown as similar elements. The drawings are not to be scaled. And wherein:

[0020] Figure 1This is a schematic diagram of a method for controlling a smart device provided in an embodiment of this disclosure;

[0021] Figure 2 This is a schematic diagram of another method for controlling a smart device provided in an embodiment of this disclosure;

[0022] Figure 3 This is a schematic diagram of another method for controlling a smart device provided in an embodiment of this disclosure;

[0023] Figure 4 This is a schematic diagram of another method for controlling a smart device provided in an embodiment of this disclosure;

[0024] Figure 5 This is a schematic diagram of another method for controlling a smart device provided in an embodiment of this disclosure;

[0025] Figure 6 This is a schematic diagram of another method for controlling a smart device provided in an embodiment of this disclosure;

[0026] Figure 7 This is a schematic diagram of a device for controlling a smart device provided in an embodiment of this disclosure. Detailed Implementation

[0027] To provide a more detailed understanding of the features and technical content of the embodiments of this disclosure, the implementation of the embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. The accompanying drawings are for illustrative purposes only and are not intended to limit the embodiments of this disclosure. In the following technical description, for ease of explanation, several details are used to provide a full understanding of the disclosed embodiments. However, one or more embodiments may still be implemented without these details. In other cases, well-known structures and devices may be simplified in their depiction to simplify the drawings.

[0028] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate for the embodiments of this disclosure described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion.

[0029] Unless otherwise stated, the term "multiple" means two or more.

[0030] In this embodiment of the disclosure, the character " / " indicates that the objects before and after it are in an "or" relationship. For example, A / B means: A or B.

[0031] The term "and / or" describes an association between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or A and B.

[0032] The term "correspondence" can refer to an association or binding relationship. The correspondence between A and B means that there is an association or binding relationship between A and B.

[0033] In this embodiment of the disclosure, a smart device refers to a home appliance product formed by introducing microprocessor, sensor technology, network communication technology, and voice recognition technology into home appliances. It has the characteristics of intelligent control, intelligent sensing, and intelligent application. The operation of a smart device often relies on the application and processing of modern technologies such as the Internet of Things, the Internet, and electronic chips. For example, a smart device can connect to a server and realize the user's voice control by detecting the user's voice commands.

[0034] Currently, with the increasing prevalence of smart technology, voice recognition technology is gradually being applied to various home appliances. Based on this technology, users can control smart devices using voice commands to manipulate them and adjust their functions. However, when existing smart devices play audio content, the device's own voice can easily mask the user's voice, potentially making it impossible to recognize the wake word. This increases the difficulty of waking up smart devices and negatively impacts the user's voice experience.

[0035] To address this, a voice wake-up method has been proposed, comprising: acquiring ambient sound parameters of the environment in which the electrical appliance is located; determining whether the ambient sound parameters of the environment in which the electrical appliance is located are greater than a set sound parameter; if the ambient sound parameters of the environment in which the electrical appliance is located are greater than the set sound parameter, determining whether a voice wake-up action exists in the environment in which the electrical appliance is located; if a voice wake-up action exists in the environment in which the electrical appliance is located, reducing the volume of the sound broadcast in the environment in which the electrical appliance is located, so as to wake up the electrical appliance by voice based on the voice wake-up action in the environment in which the electrical appliance is located while reducing the volume of the sound broadcast in the environment in which the electrical appliance is located.

[0036] However, these technologies cannot take into account the differences among user groups. For users with soft voices, even after adjustments by the technology, there is still a possibility of wake-up failure. Therefore, the improvement in wake-up success rate by these technologies is limited, which is not conducive to ensuring a good voice function experience for users of all types.

[0037] Combination Figure 1 As shown, this disclosure provides a method for controlling a smart device, including:

[0038] S101, when the processor detects that the smart device is playing audio content, it detects the user's action information.

[0039] S102, upon detecting a user's voice wake-up action, the processor determines the real-time playback volume of the smart device and identifies the user's identity information.

[0040] S103, the processor matches the corresponding wake-up reference volume based on the user's identity information.

[0041] S104, the processor controls the smart device to make functional adjustments based on the real-time playback volume and the wake-up reference volume to assist the smart device in being woken up.

[0042] The method for controlling a smart device provided in this disclosure, when detecting audio content playback on the smart device, further determines whether the user has performed a voice wake-up action. If a voice wake-up action is detected, the current real-time playback volume of the smart device is detected, and a wake-up reference volume associated with the user is matched based on the user's identity information. The wake-up reference volume is the maximum allowed playback volume of the smart device while simultaneously playing audio, assuming the voice wake-up function is operating normally. The wake-up reference volume for each user may not be the same. Therefore, by combining the real-time playback volume and the wake-up reference volume, this disclosure can control the smart device to make more accurate adjustments to adapt to the individual differences of different users. This further improves the wake-up success rate when the smart device is playing audio content, which is beneficial to ensuring the voice function experience for various user groups.

[0043] Optionally, the method for controlling a smart device can be executed in the smart device or in a server communicating with the smart device. In this embodiment, the solution is described with the processor in the smart device as the execution entity.

[0044] Optionally, the processor controls the smart device to make functional adjustments based on the real-time playback volume and the wake-up reference volume, including: when the real-time playback volume is greater than the wake-up reference volume, the processor controls the smart device to reduce the real-time playback volume to the wake-up reference volume. Thus, when it is detected that the real-time playback volume of the smart device playing audio content is too high and exceeds the wake-up reference volume, by reducing the device's playback volume, this embodiment of the present disclosure can ensure that the sound emitted by the smart device itself does not completely cover the user's voice. This reduces the possibility of the smart device missing the user's wake-up command and causing wake-up failure, further improving the wake-up success rate of the smart device and helping to ensure the user's voice function experience.

[0045] Optionally, the processor detects the user's action information by: controlling the camera to capture the user's image; and analyzing the user's image to obtain the user's action information. Thus, this embodiment of the disclosure captures the user's image information by installing a high-definition camera, thereby accurately analyzing the user's action information. Based on whether a voice wake-up action is present, this embodiment of the disclosure can determine whether the smart device needs to make adjustments to assist the user's wake-up process. This further improves the wake-up success rate when the smart device plays audio content, which is beneficial for ensuring a good voice function experience for various user groups.

[0046] Optionally, the voice wake-up action includes one or more of the following: preset user lip movements, preset user gestures, and preset user postures. Thus, embodiments of this disclosure can detect these actions to identify whether the user intends to wake up the device, and accordingly determine whether the smart device needs to make adjustments. This further improves the wake-up success rate when the smart device plays audio content, helping to ensure a better voice function experience for various user groups.

[0047] Optionally, the processor determines the user's identity information by: controlling the camera to capture the user's image; and determining the user's identity information based on the user's image. Thus, this embodiment of the disclosure, by installing a high-definition camera to capture the user's image information, can quickly identify the user's identity. This also allows for matching a more reasonable wake-up reference volume, facilitating more accurate adjustments by the smart device, further improving the wake-up success rate, and ensuring a better voice function experience for various user groups.

[0048] Combination Figure 2 As shown in the embodiments of this disclosure, another method for controlling a smart device is provided, including:

[0049] S201, when the processor detects that a smart device is playing audio content, it detects the user's action information.

[0050] S202, upon detecting a user's voice wake-up action, the processor determines the real-time playback volume of the smart device and identifies the user's identity information.

[0051] S203: The processor matches the corresponding wake-up reference volume based on the user's identity information.

[0052] S204, when the real-time playback volume is greater than the wake-up reference volume, the processor controls the smart device to reduce the real-time playback volume to the wake-up reference volume.

[0053] The method for controlling a smart device provided in this disclosure further determines whether a user has performed a voice wake-up action when the smart device is playing audio content. If a voice wake-up action is detected, the current real-time playback volume of the smart device is detected, and a wake-up reference volume associated with the user's identity information is matched. The wake-up reference volume is the maximum allowed playback volume of the smart device while simultaneously playing audio, assuming the voice wake-up function is operating normally. When the real-time playback volume of the smart device playing audio content is detected to be too high and exceeds the wake-up reference volume, the device's playback volume is reduced. This disclosure ensures that the sound emitted by the smart device itself will not completely cover the user's voice, thereby reducing the possibility of the smart device missing the user's wake-up command and failing to wake up. Furthermore, the wake-up reference volume may not be the same for each user. By combining the real-time playback volume and the wake-up reference volume, this disclosure enables the smart device to make more accurate adjustments to adapt to the individual differences of different users. This further improves the wake-up success rate when the smart device is playing audio content, which is beneficial for ensuring the voice function experience for various user groups.

[0054] Optionally, the method for controlling a smart device can be executed in the smart device or in a server communicating with the smart device. In this embodiment, the solution is described with the processor in the smart device as the execution entity.

[0055] Combination Figure 3 As shown in the embodiments of this disclosure, another method for controlling a smart device is provided, including:

[0056] S301, the processor measures the critical playback volume and pre-stores the critical playback volume as the wake-up reference volume.

[0057] S302, the processor establishes the association between the wake-up reference volume and the user identity information.

[0058] S303: When the processor detects that a smart device is playing audio content, it detects the user's action information.

[0059] S304, upon detecting a user's voice wake-up action, the processor determines the real-time playback volume of the smart device and identifies the user's identity information.

[0060] S305: The processor matches the corresponding wake-up baseline volume based on the user's identity information.

[0061] The S306 processor controls the smart device to make functional adjustments based on the real-time playback volume and the wake-up reference volume to assist the smart device in being woken up.

[0062] The method for controlling a smart device provided in this disclosure simultaneously performs a wake-up reference volume test during the process of a user binding the voice function of the smart device. By measuring the wake-up reference volume and associating it with the currently bound user, this disclosure can set corresponding wake-up reference volumes for different users, thereby improving the voice function experience for each authorized user. In the subsequent voice function activation stage, when audio content is detected playing on the smart device, this disclosure further determines whether the user has performed a voice wake-up action. If a voice wake-up action is detected, the current real-time playback volume of the smart device is detected, and the associated wake-up reference volume is matched according to the user's identity information. The wake-up reference volume is the maximum allowed playback volume when the smart device is simultaneously playing audio, based on the premise that the voice wake-up function is operating normally. The wake-up reference volume for each user may not be the same. Therefore, by combining the real-time playback volume and the wake-up reference volume, this disclosure can control the smart device to make more accurate adjustments to adapt to the individual differences of different users. This further improves the wake-up success rate when the smart device plays audio content, thus ensuring a better voice function experience for various user groups.

[0063] Optionally, the method for controlling a smart device can be executed in the smart device or in a server communicating with the smart device. In this embodiment, the solution is described with the processor in the smart device as the execution entity.

[0064] Optionally, the processor measures the critical playback volume by: controlling the smart device to gradually increase the test playback volume while receiving a user wake-up command and recording the voice wake-up result; and analyzing the voice wake-up results at different test playback volumes to measure the critical playback volume. In this way, by gradually increasing the test playback volume and recording the voice wake-up result after receiving the user wake-up command, the embodiments of this disclosure can gradually approach the critical playback volume, thereby measuring an accurate wake-up reference volume. Therefore, this facilitates more accurate adjustments by the smart device, further improving the wake-up success rate.

[0065] Optionally, the processor controlling the smart device to gradually increase the test playback volume includes: the processor controlling the test playback volume to increase from an initial playback volume in preset volume steps, based on the number of tests. In this way, the embodiments of this disclosure can more accurately measure the critical playback volume, thereby improving the testing accuracy of the wake-up reference volume. Therefore, it also allows the smart device to make more accurate adjustments, further improving the wake-up success rate.

[0066] Optionally, the initial playback volume can be set according to the user's needs. Preferably, the initial playback volume can be set to 30%. This value can also be adjusted according to the smart device's own configuration, or set to any other value such as 20% or 40%. For example, for larger smart devices, the initial playback volume can be adjusted lower, while for smaller smart devices, the initial playback volume can be adjusted higher. This can shorten the number of tests and reduce the testing time, thereby improving the user's testing experience.

[0067] Optionally, the preset volume step size can be set according to the user's needs. Preferably, the preset volume step size can be set to 10%. This value can also be adjusted according to the smart device's own configuration, or set to any other value such as 5% or 15%. For example, for larger smart devices, the preset volume step size can be adjusted higher. For smaller smart devices, the preset volume step size can be adjusted lower. This improves testing accuracy, obtains a more accurate wake-up reference volume, and thus helps improve the wake-up success rate.

[0068] Optionally, the user wake-up commands received during each test must maintain the same condition parameters. Specifically, the volume of the received user wake-up commands must be kept consistent. This avoids interference with test accuracy caused by frequent changes in the user's own volume. Furthermore, the user's position during the test must also be kept consistent. This avoids interference with test accuracy caused by changes in the user's own position.

[0069] Optionally, the processor analyzes the voice wake-up results under different test playback volumes to determine the critical playback volume. This includes: if voice wake-up is successful, the processor returns to the steps of controlling the smart device to gradually increase the test playback volume, while simultaneously receiving the user's wake-up command and recording the voice wake-up result; if voice wake-up fails, the most recent successful test playback volume is determined as the critical playback volume. Thus, this embodiment of the present disclosure can determine whether the test should continue based on the voice wake-up result, gradually approaching the critical playback volume to determine an accurate wake-up reference volume. Therefore, this embodiment of the present disclosure facilitates more accurate control by the smart device, further improving the wake-up success rate.

[0070] Combination Figure 4 As shown in the embodiments of this disclosure, another method for controlling a smart device is provided, including:

[0071] S401, when the processor detects that a smart device is playing audio content, it detects the user's action information.

[0072] S402, upon detecting a user's voice wake-up action, the processor determines the real-time playback volume of the smart device and identifies the user's identity information.

[0073] S403: The processor matches the corresponding wake-up reference volume based on the user's identity information.

[0074] S404, the processor obtains distance information between the smart device and the user.

[0075] S405, the processor adjusts the wake-up reference volume based on distance information.

[0076] The S406 processor controls the smart device to make functional adjustments based on the real-time playback volume and the wake-up reference volume to assist in waking the smart device.

[0077] The method for controlling a smart device provided in this disclosure further determines whether a user has performed a voice wake-up action when the smart device is playing audio content. If a voice wake-up action is detected, the current real-time playback volume of the smart device is detected, and a wake-up reference volume associated with the user is matched based on the user's identity information. The wake-up reference volume is the maximum allowed playback volume of the smart device while simultaneously playing audio, assuming the voice wake-up function is operating normally. The wake-up reference volume for each user may not be the same. Furthermore, this disclosure also incorporates the distance between the smart device and the user to correct the wake-up reference volume, thereby reducing errors caused by distance differences. By combining the real-time playback volume and the wake-up reference volume, this disclosure enables the smart device to make more accurate adjustments to adapt to individual differences among users. This further improves the wake-up success rate when the smart device is playing audio content, thus ensuring a better voice function experience for various user groups.

[0078] Optionally, the method for controlling a smart device can be executed in the smart device or in a server communicating with the smart device. In this embodiment, the solution is described with the processor in the smart device as the execution entity.

[0079] Optionally, the processor adjusts the wake-up reference volume based on distance information, including: comparing the distance information with the user's test distance; decreasing the wake-up reference volume when the distance information is greater than the user's test distance; and increasing the wake-up reference volume when the distance information is less than the user's test distance. The user's test distance matches the distance between the user's location and the smart device during the wake-up reference volume testing phase. Thus, this embodiment of the present disclosure can reasonably adjust the specific value of the wake-up reference volume based on changes in user distance during the testing and usage phases, thereby reducing errors caused by distance differences. Therefore, this embodiment of the present disclosure facilitates more accurate control by the smart device, further improving the wake-up success rate.

[0080] Combination Figure 5As shown in the embodiments of this disclosure, another method for controlling a smart device is provided, including:

[0081] S501, when it detects that a smart device is playing audio content, the processor detects the user's action information.

[0082] S502, upon detecting a user's voice wake-up action, the processor determines the real-time playback volume of the smart device and identifies the user's identity information.

[0083] The S503 processor matches the corresponding wake-up baseline volume based on the user's identity information.

[0084] The S504 processor controls the smart device to make functional adjustments based on the real-time playback volume and the wake-up reference volume to assist in waking the smart device.

[0085] Upon receiving a user wake-up command, the S505 processor controls the smart device to respond to the user's voice control commands.

[0086] The method for controlling a smart device provided in this disclosure further determines whether a user has performed a voice wake-up action when the smart device is playing audio content. If a voice wake-up action is detected, the current real-time playback volume of the smart device is detected, and a wake-up reference volume associated with the user is matched based on the user's identity information. The wake-up reference volume is the maximum allowed playback volume of the smart device while simultaneously playing audio, assuming the voice wake-up function is operating normally. The wake-up reference volume for each user may not be the same. Therefore, by combining the real-time playback volume and the wake-up reference volume, this disclosure can control the smart device to make more accurate adjustments to adapt to the individual differences of different users. This further improves the wake-up success rate when the smart device is playing audio content, which is beneficial to ensuring the voice function experience of various user groups. After a successful wake-up, this disclosure also controls the smart device to continuously respond to the user's voice control commands and execute related actions. This allows the user to enjoy the convenience brought by voice control normally, which is beneficial to ensuring their voice function experience.

[0087] Optionally, the method for controlling a smart device can be executed in the smart device or in a server communicating with the smart device. In this embodiment, the solution is described with the processor in the smart device as the execution entity.

[0088] Combination Figure 6 As shown in the embodiments of this disclosure, another method for controlling a smart device is provided, including:

[0089] S601, when it detects that a smart device is playing audio content, the processor detects the user's action information.

[0090] S602, upon detecting a user's voice wake-up action, the processor determines the real-time playback volume of the smart device and identifies the user's identity information.

[0091] The S603 processor matches the corresponding wake-up baseline volume based on the user's identity information.

[0092] S604: When the real-time playback volume is greater than the wake-up reference volume, the processor controls the smart device to reduce the real-time playback volume to the wake-up reference volume.

[0093] Upon receiving a user wake-up command, the S605 processor controls the smart device to respond to the user's voice control commands.

[0094] When the S606 detects that voice control has ended, the processor controls the smart device to restore the real-time playback volume to the level before it was lowered.

[0095] The method for controlling a smart device provided in this disclosure further determines whether a user has performed a voice wake-up action when the smart device is detected playing audio content. If a voice wake-up action is detected, the current real-time playback volume of the smart device is detected, and a wake-up reference volume associated with the user is matched based on the user's identity information. The wake-up reference volume is the maximum allowed playback volume of the smart device while simultaneously playing audio, assuming the voice wake-up function is operating normally. When the real-time playback volume of the smart device playing audio content is detected to be too high and exceeds the wake-up reference volume, the device's playback volume is reduced. This disclosure ensures that the sound emitted by the smart device itself will not completely cover the user's voice, thereby reducing the possibility of the smart device missing the user's wake-up command and failing to wake up. Furthermore, the wake-up reference volume may not be the same for each user. By combining the real-time playback volume and the wake-up reference volume, this disclosure can control the smart device to make more accurate adjustments to adapt to the individual differences of different users. This further improves the wake-up success rate when the smart device is playing audio content, which is beneficial to ensuring the voice function experience of various user groups. After a successful wake-up, this disclosure also controls the smart device to maintain the current playback volume while continuously responding to the user's voice control commands and performing related actions. This allows users to fully enjoy the convenience of voice control and ensures a good user experience with the voice function. Until the user ends voice control of the smart device, this embodiment controls the smart device to restore the playback volume to its previous level. This further improves the user's audiovisual experience without affecting the effectiveness of the voice function.

[0096] Optionally, the method for controlling a smart device can be executed in the smart device or in a server communicating with the smart device. In this embodiment, the solution is described with the processor in the smart device as the execution entity.

[0097] Combination Figure 7 As shown, this disclosure provides an apparatus for controlling a smart device, including a processor 701 and a memory 702. Optionally, the apparatus may further include a communication interface 703 and a bus 704. The processor 701, communication interface 703, and memory 702 can communicate with each other via the bus 704. The communication interface 703 can be used for information transmission. The processor 701 can call logical instructions in the memory 702 to execute the method for controlling the smart device described in the above embodiment.

[0098] Furthermore, the logic instructions in the aforementioned memory 702 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium.

[0099] The memory 702, as a computer-readable storage medium, can be used to store software programs and computer-executable programs, such as program instructions / modules corresponding to the methods in the embodiments of this disclosure. The processor 701 executes functional applications and data processing by running the program instructions / modules stored in the memory 702, that is, it implements the method for controlling the smart device in the above embodiments.

[0100] The memory 702 may include a program storage area and a data storage area. The program storage area may store the operating system and application programs required for at least one function; the data storage area may store data created based on the use of the terminal device. Furthermore, the memory 702 may include high-speed random access memory and may also include non-volatile memory.

[0101] This disclosure provides an intelligent device that includes the above-described means for controlling the intelligent device.

[0102] This disclosure provides a storage medium storing computer-executable instructions, which, when executed, perform the aforementioned method for controlling a smart device.

[0103] The aforementioned storage medium can be a transient computer-readable storage medium or a non-transitory computer-readable storage medium.

[0104] The technical solutions of this disclosure can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes one or more instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in this disclosure. The aforementioned storage medium can be a non-transitory storage medium, including: a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and other media capable of storing program code; it can also be a transient storage medium.

[0105] The foregoing description and accompanying drawings fully illustrate embodiments of this disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. The embodiments represent only possible variations. Individual components and functions are optional unless explicitly required, and the order of operation may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. Moreover, the terminology used in this application is for describing embodiments only and is not intended to limit the claims. As used in the description of embodiments and claims, the singular forms “a,” “an,” and “the” are intended to equally include the plural forms unless the context clearly indicates otherwise. Similarly, the term “and / or” as used in this application means including one or more of the associated listed items and all possible combinations thereof. Additionally, when used in this application, the term "comprise" and its variations "comprises" and / or "comprising" refer to the presence of stated features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof. Without further limitations, an element defined by the phrase "comprises a..." does not exclude the presence of other identical elements in the process, method, or apparatus that includes said element. In this document, each embodiment may focus on the differences from other embodiments, and similar or identical parts between embodiments can be referred to mutually. For methods, products, etc., disclosed in the embodiments, if they correspond to the method section disclosed in the embodiments, the relevant parts can be referred to the description of the method section.

[0106] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this disclosure. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0107] The methods and products (including but not limited to devices and equipment) disclosed in the embodiments herein can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of units may be merely a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the shown or discussed units may be through some interfaces, and the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the units may be selected to implement this embodiment according to actual needs. Furthermore, the functional units in the embodiments of this disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0108] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than that shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different blocks may also occur in a different order than disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. Each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

Claims

1. A method for controlling a smart device, characterized in that, include: Measure the critical playback volume and pre-store the critical playback volume as the wake-up reference volume; Establish a correlation between the wake-up baseline volume and user identity information; When audio content is detected being played on a smart device, the user's action information is detected. Upon detecting a user's voice wake-up action, determine the real-time playback volume of the smart device and identify the user's identity information; Match the corresponding wake-up baseline volume based on the user's identity information; Obtain distance information between smart devices and users; The wake-up reference volume is adjusted based on distance information; Based on the real-time playback volume and the wake-up reference volume, the system controls the smart device to make functional adjustments to assist in waking up the smart device. The process of measuring the critical playback volume includes: controlling the smart device to gradually increase the test playback volume, while receiving the user's wake-up command and recording the voice wake-up result; analyzing the voice wake-up result under different test playback volumes to measure the critical playback volume. Based on the distance information, the wake-up reference volume is adjusted, including: comparing the distance information with the user's test distance; decreasing the wake-up reference volume when the distance information is greater than the user's test distance; and increasing the wake-up reference volume when the distance information is less than the user's test distance; wherein, the user's test distance is matched with the distance between the user's location and the smart device during the wake-up reference volume test phase. The step of controlling the smart device to make functional adjustments based on the real-time playback volume and the wake-up reference volume includes: when the real-time playback volume is greater than the wake-up reference volume, controlling the smart device to reduce the real-time playback volume to the wake-up reference volume.

2. The method according to claim 1, characterized in that, The analysis of voice wake-up results under different test playback volumes, and the determination of the critical playback volume, includes: If voice wake-up is successful, return to the steps of gradually increasing the test playback volume of the smart device, receiving the user's wake-up command, and recording the voice wake-up result. In the event of a failed voice wake-up, the test playback volume of the most recent successful voice wake-up is determined as the critical playback volume.

3. The method according to claim 1 or 2, characterized in that, The method of controlling the smart device to make functional adjustments based on the real-time playback volume and the wake-up reference volume to assist the smart device after it is woken up also includes: Upon receiving a user's wake-up command, the system controls the smart device to respond to the user's voice control commands.

4. The method according to claim 3, characterized in that, After receiving a user wake-up command and controlling the smart device to respond to the user's voice control command, the method further includes: Upon detecting the end of voice control, the control smart device will restore the real-time playback volume to its previous level.

5. An apparatus for controlling a smart device, comprising a processor and a memory storing program instructions, characterized in that, The processor is configured to, when executing the program instructions, perform the method for controlling a smart device as described in any one of claims 1 to 4.

6. A smart device, characterized in that, Includes the apparatus for controlling smart devices as described in claim 5.

7. A storage medium storing program instructions, characterized in that, When the program instructions are executed, they perform the method for controlling a smart device as described in any one of claims 1 to 4.

Citation Information

Patent Citations

  • Sound awakening method and device, storage medium and electrical equipment

    CN111651135A

  • Controller, program and control method

    JP2019032387A