Voice interaction method, device and system, electronic equipment and storage medium

Abstract

The invention provides a voice interaction method, device and system, electronic equipment and a storage medium. The method comprises the following steps: receiving a first control instruction for at least one voice interaction device, wherein the first control instruction is used for starting a voice broadcast function of the voice interaction device; receiving voice notification information; and when it is detected that the distance between the person and the voice interaction device meets a preset condition, the voice interaction device broadcasts the voice notification information. Through the embodiment of the invention, the voice information can be broadcasted by the voice interaction equipment, so that a user does not need to use a user terminal to check the information related to the air treatment equipment, and in addition, the user does not need to move to the front of devices such as a wire controller or a remote controller to check the information related to the air treatment equipment; therefore, the use convenience of the user is improved; in addition, care voice can provide timely and considerate voice prompts for the user, and better experience is provided for the user.

Description

Technical Field

[0001] This application relates to the field of air conditioning, and particularly to a voice interaction method, apparatus, system, electronic device, and storage medium. Background Art

[0002] With the continuous progress of science and technology and the improvement of living standards, people's requirements for the living environment are getting higher and higher. In recent years, air treatment systems including devices such as air conditioners are widely used. Users generally perform operations related to devices such as air conditioners through applications (APPs) on user terminals, wired controllers, or remote controls, etc., so as to control the operation of devices such as air conditioners.

[0003] After setting the operation of devices such as air conditioners, users can understand the operation status of devices such as air conditioners through the display interfaces of devices such as user terminals, wired controllers, or remote controls.

[0004] It should be noted that the above introduction of the technical background is only for the convenience of clearly and completely explaining the technical solutions of this application and facilitating the understanding of those skilled in the art. It cannot be considered that the above technical solutions are well known to those skilled in the art just because these solutions are described in the background art part of this application. Summary of the Invention

[0005] The inventors found that during the use of the air treatment system, users may sometimes be inconvenient to check the operation status of devices such as air conditioners. For example, users are not familiar with using user terminals, or the users are far away from devices such as wired controllers or remote controls, or the users are elderly or children with inconvenient mobility and are not very convenient to move near devices such as wired controllers or remote controls. Therefore, it is necessary to develop a more convenient interaction method to enable users to conveniently understand information related to the operation of the air treatment system.

[0006] To solve one or more of the above problems, embodiments of this application provide a voice interaction method, apparatus, system, electronic device, and storage medium.

[0007] According to the first aspect of the embodiments of this application, a voice interaction method is provided. The method includes:

[0008] Receiving a first control instruction for at least one voice interaction device in a target space, where the first control instruction is used to turn on the voice broadcast function of the at least one voice interaction device;

[0009] Receiving voice notification information;

[0010] Detecting the distance between a person in the target space and the at least one voice interaction device;

[0011] Determine a voice interaction device for broadcasting the voice notification information from the at least one voice interaction device according to the detected distance between the person and the at least one voice interaction device; and

[0012] Use the determined voice interaction device to broadcast the voice notification information. According to a second aspect of the embodiments of the present application, there is provided a voice interaction system, the voice interaction system including:

[0013] A control device, an Internet of Things platform, and at least one voice interaction device in a target space, wherein the at least one voice interaction device and the control device are connected to the Internet of Things platform;

[0014] The control device sends a first control instruction for the at least one voice interaction device, and the first control instruction is used to turn on the voice broadcast function of the at least one voice interaction device;

[0015] The Internet of Things platform generates voice notification information and sends the voice notification information to the voice interaction device; and

[0016] Detect the distance between a person in the target space and the at least one voice interaction device;

[0017] The control device determines a voice interaction device for broadcasting the voice notification information from the at least one voice interaction device according to the detected distance between the person and the at least one voice interaction device; and

[0018] The determined voice interaction device broadcasts the voice notification information. According to a third aspect of the embodiments of the present application, there is provided a voice interaction device, the voice interaction device including:

[0019] A first control module, a second control module, and at least one voice interaction module in a target space,

[0020] wherein the at least one voice interaction module and the first control module are connected to the second control module;

[0021] The first control module sends a first control instruction for the at least one voice interaction module, and the first control instruction is used to turn on the voice broadcast function of the at least one voice interaction module;

[0022] The second control module generates voice notification information and sends the voice notification information to the voice interaction module;

[0023] Detect the distance between a person in the target space and the at least one voice interaction module;

[0024] The first control module determines, according to the distance between the detected person and the at least one voice interaction module, the voice interaction module for broadcasting the voice notification information from the at least one voice interaction module; and

[0025] The determined voice interaction module broadcasts the voice notification information.

[0026] According to the fourth aspect of the embodiments of the present application, there is provided an electronic device, including: a memory storing a computer program; and a processor that implements the method described in the first aspect of the embodiments of the present application when executing the computer program.

[0027] According to the fifth aspect of the embodiments of the present application, there is provided a computer-readable storage medium, on which a computer program is stored, and the computer program implements the method described in the first aspect of the embodiments of the present application when executed by a processor.

[0028] One of the beneficial effects of the embodiments of the present application is that:

[0029] Through the embodiments of the present application, a voice interaction device can broadcast voice information, so that the user does not have to use a user terminal to view information related to the air handling device. In addition, the user does not have to move close to a device such as a wired controller or a remote controller to view information related to the air handling device. Therefore, the convenience of user use is improved; in addition, the caring voice can provide timely and considerate voice prompts to the user, providing a better experience for the user.

[0030] Referring to the following description and drawings, specific embodiments of the present application are disclosed in detail, indicating the ways in which the principles of the present application can be adopted. It should be understood that the embodiments of the present application are not limited in scope thereby. Within the spirit and terms of the appended claims, the embodiments of the present application include many changes, modifications and equivalents.

[0031] The characteristic information described and illustrated for one embodiment can be used in the same or similar manner in one or more other embodiments, combined with the characteristic information in other embodiments, or replace the characteristic information in other embodiments.

[0032] It should be emphasized that the term "including / comprising" when used herein refers to the presence of characteristic information, whole, step or component, but does not exclude the presence or addition of one or more other characteristic information, whole, step or component. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Many aspects of the present application can be better understood with reference to the following accompanying drawings. The components in the drawings are not drawn to scale, but are only for showing the principles of the present application. For the convenience of showing and describing some parts of the present application, the corresponding parts in the drawings may be enlarged or reduced. The elements and feature information described in one drawing or one embodiment of the present application can be combined with the elements and feature information shown in one or more other drawings or embodiments. In addition, in the drawings, like reference numerals denote corresponding components in several drawings and can be used to indicate corresponding components used in more than one embodiment.

[0034] In the drawings:

[0035] Figure 1 is a block diagram of the voice interaction method according to an embodiment of the present application;

[0036] Figure 2 is a schematic diagram of a voice interaction system;

[0037] Figure 3 is a flowchart of the voice interaction method according to an embodiment of the present application;

[0038] Figure 4 is a schematic diagram of the voice interaction device according to an embodiment of the present application;

[0039] Figure 5 is a schematic block diagram of the system composition of an electronic device according to an embodiment of the present application. Detailed Embodiments

[0040] The preferred embodiments of the present application will be described below with reference to the accompanying drawings.

[0041] Embodiments of the First Aspect

[0042] Embodiments of the first aspect of the present application provide a voice interaction method.

[0043] Figure 1 is a block diagram of the voice interaction method according to an embodiment of the present application. As Figure 1 shown, the method includes:

[0044] Operation 101: Receive a first control instruction for at least one voice interaction device in a target space, where the first control instruction is used to turn on the voice broadcast function of the at least one voice interaction device;

[0045] Operation 102: Receive voice notification information;

[0046] Operation 103: Detect the distance between a person in the target space and the at least one voice interaction device;

[0047] Operation 104: Determine a voice interaction device for broadcasting the voice notification information from the at least one voice interaction device according to the detected distance between the person and the at least one voice interaction device;

[0048] Operation 105: Use the determined voice interaction device to broadcast the voice notification information.

[0049] In this application, the voice notification information may include at least one of the operating parameter information of the air handling device and the caring voice. Among them, the caring voice includes at least one of a voice for reminding a person based on the operation of the air handling device and a voice for giving suggestions.

[0050] Through the embodiments of this application, a voice interaction device can broadcast voice information, so that the user does not have to use a user terminal to view information related to the air handling device. In addition, the user does not have to move close to devices such as a wired controller or a remote controller to view information related to the air handling device. Therefore, the convenience of user use is improved; in addition, the caring voice can provide users with timely and considerate voice prompts, providing a better experience for users.

[0051] In particular, when a child away from home turns on the air handling device for an elderly person or a person with limited mobility at home, and the elderly person or the person with limited mobility is unaware, if there is no voice broadcast function, the child needs to notify the elderly person or the person with limited mobility by calling or by other means. In this application, the voice interaction device broadcasts the voice notification information, enabling the elderly person or the person with limited mobility indoors to learn about the information of the air handling device or the caring voice, thereby improving the user experience; in addition, the voice interaction device can also feedback information such as the feelings of the elderly person or the person with limited mobility at home to the child away from home, facilitating interaction.

[0052] Figure 1 The illustrated voice interaction method can be implemented by a voice interaction system. Figure 2 is a schematic diagram of a voice interaction system, as Figure 2 shown, the voice interaction system 200 includes: a control device 21, an Internet of Things platform 22, and a voice interaction device 23.

[0053] Among them, the number of control devices 21 is one or more; the number of voice interaction devices 23 is one or more, that is, at least one.

[0054] The voice interaction device 23 and the control device 21 are connected to the Internet of Things platform 22 through a wired or wireless network. In addition, other devices can also be connected to the Internet of Things platform 22. For example, the other devices can be an air handling device, a water treatment device, a home audio-visual entertainment device, a lighting device, etc.

[0055] In the voice interaction system 200, the control device 21 and the like can control the other devices via the Internet of Things platform 22.

[0056] The control device 21 can be at least one of a user terminal, a server, a gateway device, a central controller, a line controller, a remote controller, and a control board. For example, the control device 21 is a user terminal, and the user terminal has an application (APP). By operating the user terminal, the user can generate a device control instruction, and the device control instruction can be sent to the other device through the Internet of Things platform 22 to control the other device.

[0057] The voice interaction device 23 can be at least one of a central controller, a line controller, a remote controller, a user terminal, a smart speaker, or other smart devices (such as a television, etc.). The voice interaction device 23 can be set in a target space, such as indoors, in a living room, in a bedroom, etc. In the same target space, more than one voice interaction device 23 can be set.

[0058] In some examples, the voice interaction device 23 and the control device 21 are separate independent devices. For example, the voice interaction device 23 is a central controller. The voice interaction device 23 can receive a control command (such as a first operation instruction) from the control device 21 through the Internet of Things platform 22; the voice interaction device 23 can also receive voice notification information generated by the Internet of Things platform 22 and broadcast it. For example, the voice interaction device 23 has a speaker; in addition, the voice interaction device 23 can also receive feedback information from a person and send the feedback information to the control device 21 through the Internet of Things platform 22 to generate a device control instruction. For example, the voice interaction device 23 has devices such as a microphone and can receive the voice emitted by a person as feedback information.

[0059] In addition, the present application is not limited to this. In some other examples, the voice interaction device 23 and the control device 21 can also be integrated in a hardware device. In this case, the voice interaction device 23 and the control device 21 can directly interact without going through the Internet of Things platform 22 for interaction.

[0060] Taking the voice interaction device 23 as a central controller as an example, the central controller can be set in each room indoors, that is, there can be multiple central controllers indoors. Each central controller can be connected to the Internet of Things platform 22 in various ways.

[0061] In one way, the centralized controller can be connected to the gateway modem of the communication operator through a predetermined gateway, and then connected to the Internet of Things platform 22. Among them, the predetermined gateway can be connected to multiple air handling devices indoors (for example, multiple air conditioners, air sensors, etc. indoors can be connected to the predetermined gateway, and then connected to the gateway modem of the communication operator through the predetermined gateway).

[0062] In addition, the predetermined gateway can also be directly connected to the Internet of Things platform 22 without passing through the gateway modem of the communication operator. For example, the predetermined gateway can be directly connected to the Internet of Things platform 22 through narrowband Internet of Things (NB-IOT) technology. For another example, the predetermined gateway can have a switching module that can select between different communication paths. Thus, it can either switch to connect to the Internet of Things platform 22 through the gateway modem of the communication operator or switch to directly connect to the Internet of Things platform 22 through narrowband Internet of Things (NB-IOT) technology.

[0063] In another way, the centralized controller can be directly connected to the gateway modem of the communication operator, and then connected to the Internet of Things platform 22. In this way, the centralized controller can have the functions of the above-mentioned predetermined gateway. For example, multiple air handling devices indoors can be connected to the centralized controller.

[0064] In yet another way, the centralized controller can be directly connected to the Internet of Things platform 22 by using technologies such as narrowband Internet of Things (NB-IOT).

[0065] In the embodiments of the present application, the centralized controller can be connected to multiple air handling devices (for example, the centralized controller is directly connected to multiple air handling devices, or the centralized controller is connected to multiple air handling devices through a predetermined gateway). Therefore, the centralized controller can play voice notification information corresponding to different air handling devices based on the identification information of the air handling devices. For example, the voice notification information broadcast by the centralized controller set in the living room can be "So-and-so has turned on the air conditioner in the master bedroom. Please pay attention not to catch a cold."

[0066] In the traditional intelligent home appliance control system, voice interaction devices are not set in each room. In addition, voice interaction devices (such as intelligent air conditioners, etc.) can usually only broadcast the operating conditions of their own devices and cannot broadcast the operating conditions of other devices. For example, when a user interacts with the air conditioner in the living room, they can only obtain information such as "whether the air conditioner in the living room is turned on" and cannot hear voice information such as "the air conditioner in the master bedroom has been turned on."

[0067] The above description of the centralized controller also applies to the example where the voice interaction device 23 is other devices.

[0068] In the following embodiments of the present application, taking the control of an air handling device by the voice interaction system 200 as an example (i.e., the other device connected to the Internet of Things platform 22 includes an air handling device), the voice interaction method of the present application will be described. Among them, the voice interaction system 200 and the air handling device can form an air handling system. It should be noted that the voice interaction method of the present application is not only applicable to the application scenario of air handling devices, but also applicable to other scenarios (i.e., the scenario where the other device is a device other than an air handling device).

[0069] The air handling device in the embodiments of the present application can be various devices related to air handling. For example, the air handling device includes at least one of an indoor unit, a ventilation device, a humidity control device, a floor heating device, and an air detection device. For example, the air detection device can be an air quality sensor, and the control device 21 can remotely control the operation of the air quality sensor. For example, the graphical user interface (GUI) of the control device 21 can display a control interface for controlling the air quality sensor, etc.

[0070] In some embodiments, the indoor unit is an indoor unit in an air conditioning system, and the air conditioning system can be a commercial air conditioning system or a household air conditioning system.

[0071] In some embodiments, the air conditioning system can include at least one set of outdoor units and at least one indoor unit connected to each set of outdoor units. That is to say, in the air conditioning system, one or more sets of outdoor units can be included, and each set of outdoor units includes at least one outdoor unit; for one set of outdoor units, the set of outdoor units is connected to at least one indoor unit.

[0072] For example, the air conditioning system includes one outdoor unit and one indoor unit connected to the outdoor unit.

[0073] For example, the air conditioning system includes one outdoor unit and at least two indoor units connected to the outdoor unit.

[0074] For example, the air conditioning system includes at least two outdoor units and at least two indoor units connected to the at least two outdoor units.

[0075] For example, one set of outdoor units and at least one indoor unit connected to the set of outdoor units form a refrigerant system, or multiple sets of outdoor units and at least one indoor unit respectively connected to the multiple sets of outdoor units form multiple refrigerant systems. Thus, the air conditioning system can include one refrigerant system or multiple refrigerant systems.

[0076] In some embodiments, the outdoor unit and the indoor unit can be air conditioning devices of various models, types, forms, and capacities. For example, the form of the indoor unit can be four-way air outlet, two-way air outlet, duct type, floor air outlet, or skirting board air outlet, etc.; the form of the outdoor unit can be single-fan top air outlet, double-fan top air outlet, single-fan front air outlet, or double-fan front air outlet, etc.

[0077] In some embodiments, the air supply device includes at least one of a fresh air treatment device, a total heat exchange device (for example, with or without an internal circulation function), and a ventilation device (for example, with or without an internal circulation function).

[0078] In some embodiments, the humidity control device has at least one of a humidifying function and a dehumidifying function. For example, the humidity control device is arranged on the output side of the air supply device to adjust the humidity of the air output by the air supply device. For example, it humidifies or dehumidifies the air output by the air supply device and introduces the humidified or dehumidified air into the indoor space. For example, the humidity control device has a heat exchanger, and the heat exchanger can operate as an evaporator.

[0079] In some embodiments, the floor heating device is connected to the outdoor unit through a refrigerant pipeline, and the floor heating device is connected to the floor heating pipeline in the indoor space through a floor heating water pipeline. For example, the outdoor unit and the floor heating device form an air source heat pump water heater, which uses the heat in the air and the operation of the compressor to heat water; the floor heating device may include a water heat exchange unit, and the refrigerant flowing out of the compressor of the outdoor unit enters the water heat exchange unit of the floor heating device through the refrigerant pipeline to exchange heat with water, so as to achieve the purpose of heating water, and the heated water is introduced into the floor heating pipeline in the indoor space through the floor heating water pipeline to heat the indoor space. In some embodiments, the outdoor unit and the floor heating device are split-type or integrated.

[0080] In the following description of the present application: The control device 21 can be a user terminal; the voice interaction device 23 is a centralized controller, which is arranged indoors; the air conditioning device is used to adjust the air in the room.

[0081] In the voice interaction method of the present application, in one embodiment of operation 101, the control device 21 sends a first control instruction to the voice interaction device 23, and the first control instruction is used to turn on the voice broadcast function of the voice interaction device 23. For example, the control device 21 sends the first control instruction to the Internet of Things platform 22, and the Internet of Things platform 22 then sends the first control instruction to the voice interaction device 23. Thus, after receiving the first control instruction, the voice interaction device 23 turns on its own voice broadcast function.

[0082] In operation 101, the first control instruction can be sent to one or more voice interaction devices 23. The voice interaction devices 23 that receive the first control instruction turn on their own voice broadcast functions, while the voice interaction devices 23 that do not receive the first control instruction do not turn on their own voice broadcast functions.

[0083] In addition, in operation 101, if the control device 21 does not send the first control instruction to any of the voice interaction devices 23 in the voice interaction system 200, or if any of the voice interaction devices 23 in the voice interaction system 200 does not receive the first control instruction, then none of the voice interaction devices 23 in the voice interaction system 200 turn on their voice broadcast functions.

[0084] In addition, in operation 101, the first control instruction can also be detected or saved by the Internet of Things platform 22. Thus, the Internet of Things platform 22 can determine which voice interaction device or devices 23 have their voice broadcast functions turned on.

[0085] In an embodiment of operation 102, the Internet of Things platform 22 generates voice notification information and sends the voice notification information to the voice interaction devices 23. For example, when the Internet of Things platform 22 determines that the voice broadcast function of the voice interaction device 23 is turned on, it generates voice notification information and sends it to the voice interaction device 23 with the voice broadcast function turned on; or, the Internet of Things platform 22 sends the generated voice notification information to all the voice interaction devices 23 in the voice interaction system 200.

[0086] In an embodiment of operation 103, the voice recognition function or distance recognition function of the voice interaction device 23 can be activated to detect the distance between the person and the voice interaction device 23.

[0087] For example, the voice recognition function can identify the distance between the person and each voice interaction device 23 based on the sound emitted by the person. Specifically, voice recognition can be performed through a voice recognition matrix. The voice recognition matrix can have multiple microphones. The voice recognition matrix can determine the distance between the person and the voice interaction device based on the time difference of the sound reaching different microphones. The voice recognition matrix can be independently set indoors. In addition, the voice recognition matrix can also be set in the voice interaction device 23 (that is, the multiple microphones of the voice interaction device 23 can be used as a voice recognition matrix to collect the sound information of the indoor person).

[0088] For another example, the distance recognition function can be implemented by a distance sensor such as an infrared sensor, which can determine the distance between a person and each voice interaction device 23 based on infrared light. The infrared sensor can be arranged indoors. Each infrared sensor can be arranged independently of the voice interaction device 23. For example, each infrared sensor is arranged near each voice interaction device 23; alternatively, the infrared sensor can also be integrated into the voice interaction device 23.

[0089] In the present application, the control device 21 or the voice interaction device 23 can activate the voice recognition function or the distance recognition function, so as to detect the distance between the person and the voice interaction device 23.

[0090] In some embodiments of operation 103, the distance information between the person and the voice interaction device 23 detected according to the voice recognition function or the distance recognition function can be sent to the distance determination device ( Figure 2 not shown).

[0091] In operation 104, the distance determination device can determine which one or which voice interaction devices 23 have a distance from the person that meets the predetermined conditions, and issue a broadcast instruction to the voice 23.

[0092] For example, in the case where there are multiple voice interaction devices 23 in the same target space, the distance determination device receives the distances between the person and each of the voice interaction devices 23 (that is, receives multiple distances), compares the received distances with each other, determines the minimum distance, and thus determines the voice interaction device 23 closest to the person, and causes the voice interaction device 23 to broadcast the voice notification information generated by the Internet of Things platform 22. At this time, the number of voice interaction devices 23 that broadcast the voice notification information is 1;

[0093] Alternatively, if the multiple distances are equal, at least one of the voice interaction devices 23 corresponding to the multiple distances can broadcast the voice information. Specifically, one of the voice interaction devices 23 can broadcast the voice information, or all of the voice interaction devices 23 having the same distance to the person can broadcast the voice information;

[0094] Alternatively, on the basis of determining the minimum distance L0 between the person indoors and the voice interaction device 23, the difference ΔL (i.e., ΔL = Li - L0) between the distance Li between the person indoors and other voice interaction devices 23 and L0 can be further calculated. When the difference ΔL is less than a predetermined value (for example, the predetermined value is 2 meters), the voice interaction device 23 corresponding to the distance Li and the voice interaction device corresponding to the minimum distance L0 both broadcast the voice notification information. Thus, the voice interaction devices 23 with relatively close distances around the person indoors all broadcast the voice notification information, and even when there are obstacles between some voice interaction devices and the person, it can be ensured that the person hears the voice notification information.

[0095] For another example, in the case where there are multiple voice interaction devices 23 (for example, N voice interaction devices 23, N is a natural number greater than or equal to 2) and multiple persons (for example, M persons, M is a natural number greater than or equal to 2) in the same target space, for each person, the distance determination device receives the distances between the person and each of the N voice interaction devices 23. Thus, for the multiple persons, the distance determination device receives N * M distances, compares the received N * M distances, determines the minimum distance, and thereby determines the combination of the person with the closest distance and the voice interaction device 23, and makes the voice interaction device 23 in the combination broadcast the voice notification information generated by the Internet of Things platform 22. At this time, the number of voice interaction devices 23 that broadcast the voice notification information is 1; in addition, if multiple distances are equal, at least one of the voice interaction devices 23 corresponding to the multiple distances can be used to broadcast the voice information.

[0096] For another example, the distance determination device compares each received distance with a threshold value. For the case where the distance is less than the threshold value, it is determined that the person is relatively close to the voice interaction device 23, and the distance determination device makes the voice interaction device 23 broadcast the voice notification information generated by the Internet of Things platform 22. At this time, the number of voice interaction devices 23 that broadcast the voice notification information is 1 or more.

[0097] For yet another example, if each distance received by the distance determination device does not meet the predetermined conditions, or no distance information is received (for example, there is no person indoors or the person does not make a sound, and thus the voice recognition function or the distance recognition function does not detect the distance between the person and the voice interaction device 23), then no broadcast instruction is issued, and thus, each voice interaction device 23 does not broadcast the voice notification information. In addition, in this case, the voice interaction device 23 can store the voice notification information, and when a broadcast instruction is received (for example, a person approaches the voice interaction device 23 indoors, so that the distance between the person and the voice interaction device 23 meets the predetermined conditions), the voice interaction device 23 broadcasts the stored voice notification information.

[0098] In some embodiments, the distance determination device may be disposed in the control device 21 or the voice interaction device 23. For example, when the distance determination device is disposed in the control device 21, the function of the distance determination device may be implemented by the control device 21; when the distance determination device is disposed in the voice interaction device 23, the function of the distance determination device may be implemented by the voice interaction device 23. In addition, this application is not limited thereto. For example, the distance determination device may be disposed independently of the control device 21 and the voice interaction device 23.

[0099] In operation 105 of this application, information such as the voiceprint of the indoor personnel may also be authenticated. When the information such as the voiceprint of the indoor personnel conforms to the authentication information, a voice notification message is broadcast. For example, the voice interaction device 23 may analyze the voice information of the indoor personnel, extract voice features (such as voiceprint and other information), and compare the voice features with the authentication information. When the two match, it is determined that the authentication is successful, and thus the voice notification message is broadcast. For specific details regarding authentication, reference may be made to related technologies.

[0100] In operation 105 of this application, the number of times the voice interaction device 23 broadcasts the voice notification message may be once or more than once. For example, the voice interaction device 23 may continuously broadcast the voice notification message N times within a predetermined time period (for example, within 1 minute), where N may be a natural number greater than or equal to 2; or, the voice interaction device 23 may broadcast the voice notification message once every certain period of time (for example, every 15 seconds) within a predetermined time period (for example, within 1 minute).

[0101] The voice notification message broadcast by the voice interaction device 23 may include at least one of the operating parameter information of the air handling device and the caring voice.

[0102] In addition, the summary of the voice notification message broadcast by the voice interaction device 23 may also include the identification information of the air handling device. The identification information may be the name or number of the air handling device set in advance, such as "baby room", "main air conditioner", etc.; in addition, the identification information may also be the information including the location of the air handling device, such as the identification information may be "the air conditioner in the master bedroom", "the air conditioner in the living room", etc.

[0103] The operating parameters of the air handling device include at least one of the set temperature, the set air volume, and the set humidity. For example, the Internet of Things platform 22 collects the operating parameters of the air handling devices connected to the Internet of Things platform 22 and generates voice notification messages corresponding to the operating parameters of each air handling device.

[0104] The caring voice includes at least one of a voice for reminding personnel and a voice for giving suggestions based on the operation of the air handling device. For example, the Internet of Things platform 22 collects the operation parameters of the air handling devices connected to the Internet of Things platform 22, as well as the feedback information of the indoor personnel (for example, the feedback information includes at least one of the voice information of the personnel, the operation information of the personnel on the control device 21, and the operation information of the personnel on the voice interaction device 23), and generates voice notification information corresponding to the operation parameters of each air handling device.

[0105] In addition, the Internet of Things platform 22 can also collect other information to generate caring voices. For example, the other information can include at least one of the following information: outdoor weather information, the location of the indoor area where the personnel are located, the environmental information of the target space indoors, etc.

[0106] In some embodiments, the caring voice can be associated with the outdoor weather information. In some examples, when the gap between the outdoor weather parameters and the target parameters is large, a caring voice can be generated. For example, when the outdoor temperature is too high or too low, and the difference from the target temperature of the air handling device exceeds the threshold, in this case, the air handling device will operate at a high load state in a short time, and the air volume is large. At this time, the caring voice will prompt "The outdoor temperature is too high (or too low), and the air volume of the living room air conditioner will be large within 10 minutes." Thus, the user can have sufficient psychological expectations for the operation state of the air handling device, improving the user experience.

[0107] In some embodiments, the caring voice can be associated with the voice information obtained through voice recognition. Among them, the voice information obtained through voice recognition can be, for example, the voice information of the indoor personnel collected by the aforementioned voice recognition matrix, and this voice information is sent to the Internet of Things platform 22.

[0108] Among them, the Internet of Things platform 22 can analyze the voice information obtained through voice recognition, identify the information reflecting the user's needs therein, and generate a caring voice according to the information reflecting the user's needs; in addition, it can also generate a device control instruction according to the information reflecting the user's needs to control the operation of the air handling device to meet the user's needs.

[0109] In this application, the information of the user's needs can be the needs information of the indoor personnel. For example, the voice uttered by the indoor personnel is "It's too hot", and after analyzing this voice, the information reflecting the user's needs identified therein is "Need cooling", so the generated caring voice is "You feel it's too hot, so I help you turn on the living room air conditioner and set it to 24 degrees for cooling."

[0110] In this application, the information of the user's needs can also be the needs information related to other persons (i.e., persons not inside the room). For example, the voice uttered by a person inside the room is "It's too hot today". After analyzing this voice, it is recognized that this scenario matches the need or intention of "caring for the elderly by children". Therefore, the generated caring voice is "The temperature is relatively high today. Your daughter has turned on the living room air conditioner and set it to 24 degrees for cooling. Do you think it's suitable?" Thus, the caring voice can reflect the needs or intentions of other persons.

[0111] In addition, the Internet of Things platform 22 can also generate a device control instruction and send the device control instruction to the air handling device to control the air handling device to operate in a cooling mode. In addition, the device control instruction generated by the Internet of Things platform 22 can also be sent to at least one of the control device 21 and the voice interaction device 23. Thus, at least one of the display interfaces of the control device 21 and the voice interaction device 23 can display at least one of the set parameters and operation information of the air handling device.

[0112] In some embodiments, the caring voice can be associated with the location inside the room where the person is located. Among them, the Internet of Things platform 22 can analyze the location inside the room where the user is located (for example, determine the location inside the room where the person is located according to the determination result of the above distance determination device) and generate the caring voice. In addition, the caring voice can also be generated based on the operation information of the air handling device at the location inside the room where the user is located. For example, if the person is in the bathroom, the caring voice can be, for example, "The temperature of the bathroom air conditioner should not be too low, as it is easy to catch a cold." Another example is that if the person is in the bathroom, the caring voice can be, for example, "The temperature of the bathroom air conditioner should not be too low, as it is easy to catch a cold." If the current set temperature of the bathroom air conditioner is relatively low (for example, lower than 25 degrees) and the current air volume of the bathroom air conditioner is also relatively large (for example, it is the maximum air volume), the caring voice can be, for example, "The temperature of the bathroom air conditioner is too low and the air volume is too large, which is easy to catch a cold."

[0113] In some embodiments, the caring voice can be associated with the environmental information of the target space inside the room. Among them, the target space can be the space asked by the person. For example, if a person inside the room asks the voice interaction device 23 "Is it hot in the bedroom?", then the bedroom is set as the target space inside the room. Or, the target space inside the room can be a pre-set space. For example, the user pre-sets spaces such as the living room, bedroom, or bathroom as the target space. The Internet of Things platform 22 can obtain the environmental information of the target space through the environmental information sensors arranged in the target space. Such environmental information is, for example, temperature sensors, humidity sensors, illuminance sensors, etc. The environmental information sensors can be integrated in the air handling device or can be arranged independently of the air handling device.

[0114] The Internet of Things platform 22 can generate care information based on the environmental information of the target space; in addition, the Internet of Things platform 22 can also generate care information based on the environmental information of the target space and the operation information or parameter setting information of the air handling equipment in the target space. For example, if the target space is a bedroom and the current temperature in the bedroom is 30 degrees, the care voice could be, for example, "The bedroom temperature is 30 degrees. You can turn on the air conditioner."; Another example is that if the target space is a bedroom, the current temperature in the bedroom is 30 degrees, and the target temperature set for the bedroom air conditioner is 24 degrees, the care voice could be, for example, "The bedroom temperature is 30 degrees, and the set temperature of the bedroom air conditioner is 24 degrees. The set temperature is relatively low. Please pay attention to keeping warm."

[0115] In this application, the care voice can be generated based on a deep learning model, thereby improving the accuracy and timeliness of the care voice and providing a more intelligent and convenient usage experience for users. In addition, this application is not limited to this, and the care voice can also be generated based on other models or principles.

[0116] As Figure 1 shown, in some embodiments, the voice interaction method of this application may further include operation 106. Operation 106 may include at least one of the following operations:

[0117] Receiving feedback information from the people indoors and sending the feedback information to the control end; and

[0118] Controlling the air handling equipment according to the feedback information of the people indoors.

[0119] Among them, the control end can be at least one of the control device 21, the Internet of Things platform 22, and the voice interaction device 23. The voice interaction device 23 receiving the feedback information from the people can be the voice information of the people (for example, the voice interaction device 23 has devices such as a microphone and can receive the voice emitted by the people as feedback information), or the operation information of the people (for example, operations such as touching, pressing, and rotating the voice interaction device 23 by the people).

[0120] For example, in operation 106, the voice interaction device 23 can receive the feedback information from the people, send the feedback information to the Internet of Things platform 22, or send the feedback information to the control device 21 through the Internet of Things platform 22. Thus, the Internet of Things platform 22 or the control device 21 can generate a device control instruction to control the air handling equipment.

[0121] In a specific example, for example, the care voice is "The temperature is relatively high today. Your daughter has turned on the living room air conditioner and set it to 24 degrees for cooling. Do you think it's appropriate?", and the people indoors can give feedback through voice. Specifically:

[0122] For example, an indoor occupant issues voice messages such as "Got it" or "Okay" as confirmation messages. Based on this confirmation message, the air handling device operates according to the current set parameters (i.e., cooling at 24 degrees).

[0123] Also, for example, an indoor occupant issues voice messages such as "Turn off the living room air conditioner" or "Set the living room air conditioner to 26 degrees". The voice interaction system 200 can, based on this voice feedback from the indoor occupant, reset the operating parameters of the air handling device (e.g., turn off the living room air conditioner or set the living room air conditioner to 26 degrees). After the reset is completed, the voice interaction device 23 can broadcast new voice notification messages, such as "The living room air conditioner has been turned off" or "The living room air conditioner has been set to 26 degrees". The indoor occupant can issue voice messages such as "Got it" or "Okay" as confirmation. Based on this confirmation message, the air handling device performs the corresponding shutdown operation or operation according to the current set parameters (i.e., turn off the living room air conditioner or set the living room air conditioner to 26 degrees); thus, the indoor occupants can control the air handling device by voice.

[0124] In this way, through voice interaction, the relevant air handling devices can be conveniently and timely controlled, further improving the user experience.

[0125] In one example, the control end is the control device 21 (e.g., a user terminal equipped with an APP). This feedback message is fed back to the control device 21. In this way, a remotely controlling person can control the air handling device (e.g., an air conditioner) through the control device 21. For example, a remotely controlling person (e.g., a child away from home) remotely turns on the air conditioner for the elderly at home through the control device 21. The elderly person feels that the air conditioner temperature is too low and replies that the cooling temperature is too low. This voice message is fed back to the child's control device 21, and the child can then remotely increase the temperature of the home air conditioner through the control device 21.

[0126] In another example, the control end is the voice interaction device 23. This voice interaction device 23 is, for example, a centralized controller capable of controlling the air handling devices in the home. The voice issued by an indoor occupant (e.g., an elderly person at home) is received by the voice interaction device 23 (e.g., the centralized controller) closest to the person. The voice information of the indoor occupant can be displayed on the display of this voice interaction device 23. Also, the indoor occupant can confirm or modify this voice information by voice or clicking. After this voice information is confirmed, the voice interaction device 23 (e.g., the centralized controller) can control the air handling devices in the home based on this voice information.

[0127] The above two examples can be implemented in combination. Thus, both the remote controller and the indoor user can be aware of each other's control actions and requirements, and there are multiple control options, improving the user's control experience. In addition, the above two examples can also be implemented separately.

[0128] Figure 3 is a flowchart of the voice interaction method according to an embodiment of the present application. As Figure 3 shown, the process of the voice interaction method includes:

[0129] Operation 301: Turn on the control device 21;

[0130] Operation 302: Each voice interaction device determines whether it has received a first control instruction for turning on the voice broadcast function of the voice interaction device. If the determination is yes, operation 303 is performed; otherwise, the process ends.

[0131] Operation 303: Determine whether to generate a caring voice. If the determination is yes, operation 304 is performed; otherwise, operation 303a is performed.

[0132] Operation 303a: Do not generate a caring voice;

[0133] Operation 304: Generate a voice notification message containing a caring voice and send it to the voice interaction device 23;

[0134] Operation 305: Start voice recognition or distance recognition to detect the distance between the indoor person and the voice interaction device 23;

[0135] Operation 306: When it is determined that the distance between the person and the voice interaction device meets a predetermined condition (for example, the distance between the voice interaction device and the person is the closest), cause the voice interaction device 23 to broadcast the voice notification message.

[0136] For the specific implementation of operations 301 - 306, reference can be made to Figure 1 the relevant descriptions of each step therein, which will not be repeated here.

[0137] According to the embodiments of the present application, the voice interaction device can broadcast voice information, so that the user does not have to use the user terminal to view information related to the air handling device. In addition, the user does not have to move close to devices such as the wire controller or remote controller to view information related to the air handling device. Therefore, the convenience of user use is improved; in addition, the caring voice can provide timely and considerate voice prompts to the user, providing a better experience for the user.

[0138] Embodiments of the second aspect

[0139] The second aspect of the embodiments of the present application provides a voice interaction device. The voice interaction device corresponds to the voice interaction method described in Embodiment 1, and the specific content can be referred to the description in Embodiment 1.

[0140] Figure 4 It is a schematic diagram of the voice interaction device according to the embodiments of the present application. As Figure 4 shown, the device 40 includes: a first control module 41, a second control module 42, and at least one voice interaction module 43 in the target space.

[0141] Among them, the voice interaction module 43 is connected to the first control module 41 and the second control module 42; the first control module 41 sends a first control instruction for the voice interaction module 43, and the first control instruction is used to turn on the voice broadcast function of the voice interaction module 43; the second control module generates voice notification information 42 and sends the voice notification information to the voice interaction module 43; detects the distance between the person in the target space and at least one voice interaction module 43; the first control module 41 determines the voice interaction module 43 that broadcasts the voice notification information from at least one voice interaction module 43 according to the detected distance between the person and at least one voice interaction module 43; the determined voice interaction module 43 broadcasts the voice notification information.

[0142] The specific functions of the above-mentioned modules can be referred to the relevant steps in Embodiment 1, and will not be elaborated here.

[0143] According to the embodiments of the present application, voice information can be broadcasted, so that users do not have to use user terminals to view information related to air treatment devices. In addition, users do not have to move close to devices such as line controllers or remote controls to view information related to air treatment devices, thus improving the convenience of user use; in addition, the caring voice can provide users with timely and considerate voice prompts, providing a better experience for users.

[0144] Embodiments of the third aspect

[0145] The third aspect of the embodiments of the present application provides an electronic device. The steps executed by the processor of the electronic device correspond to all or part of the steps of the voice interaction method described in Embodiment 1, and the specific content can be referred to the description in Embodiment 1.

[0146] Figure 5 It is a schematic block diagram of the system composition of the electronic device according to the embodiments of the present application. As Figure 5 shown, the electronic device 500 may include a processor 510 and a memory 520; the memory 520 is coupled to the processor 510. It should be noted that this figure is exemplary; other types of structures can also be used to supplement or replace this structure to implement telecommunication functions or other functions.

[0147] In one embodiment, the processor 510 may be configured to: receive a first control instruction for at least one voice interaction device, the first control instruction being used to turn on the voice broadcast function of the voice interaction device; receive voice notification information; and when it is detected that the distance between a person and the voice interaction device meets a predetermined condition, control the voice interaction device to broadcast the voice notification information.

[0148] As Figure 5 shown, the electronic device 500 may further include: a communication module 530, an input unit 540, a display 550, a speaker 560, a microphone 570, and a power supply 580. It should be noted that the electronic device 500 does not necessarily have to include Figure 5 all the components shown in Figure 5 ; in addition, the electronic device 500 may further include

[0149] As Figure 5 shown, the processor 510, sometimes also referred to as a controller or operation control, may include a microprocessor or other processor device or logic device, and the processor 510 receives inputs and controls the operations of the various components of the electronic device 500.

[0150] Among them, the memory 520 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable medium, a volatile memory, a non-volatile memory, or other suitable devices. It can store various data, and can also store programs for executing relevant information. And the processor 510 can execute the programs stored in the memory 520 to implement information storage or processing, etc. The functions of other components are similar to those in the prior art and will not be elaborated here. The various components of the electronic device 500 can be implemented by dedicated hardware, firmware, software, or a combination thereof without departing from the scope of the present invention.

[0151] According to the embodiments of the present application, voice information can be broadcast by a voice interaction device, so that the user does not have to use a user terminal to view information related to the air handling device. In addition, the user does not have to move close to a device such as a wired controller or a remote control to view information related to the air handling device, thus improving the convenience of user use; in addition, the caring voice can provide timely and considerate voice prompts to the user, providing a better experience for the user.

[0152] The embodiments of the present application also provide a computer-readable program, wherein when the program is executed, the program causes a computer to execute the voice interaction method described in the embodiments of the present application.

[0153] The embodiments of the present application also provide a computer-readable storage medium, wherein the storage medium stores a computer program, and the computer-readable program enables a computer to execute the voice interaction method described in the embodiments of the present application.

[0154] The devices and methods above the embodiments of the present application can be implemented by hardware or by a combination of hardware and software. The present application relates to such a computer-readable program that when executed by a logic component, can enable the logic component to implement the above device or component, or enable the logic component to implement the above various methods or steps.

[0155] The embodiments of the present application also relate to a storage medium for storing the above program, such as a hard disk, a magnetic disk, an optical disk, a DVD, a flash memory, etc.

[0156] It should be noted that the limitations of the various steps involved in the present application, without affecting the implementation of the specific solution, are not considered as limiting the order of the steps. The steps written in the front can be executed first, or can be executed later, or even can be executed simultaneously. As long as the solution can be implemented, it should be regarded as falling within the protection scope of the present application.

[0157] The above has described the present application in combination with specific implementation manners, but those skilled in the art should understand that these descriptions are exemplary and not a limitation on the protection scope of the present application. Those skilled in the art can make various modifications and variations to the present application according to the spirit and principle of the present application, and these modifications and variations are also within the scope of the present application.

Claims

1. A voice interaction method, characterized in that, The method includes: Receiving a first control instruction for at least one voice interaction device in a target space, where the first control instruction is used to turn on the voice broadcast function of the at least one voice interaction device; Receiving voice notification information; Detecting the distance between a person in the target space and the at least one voice interaction device; Determining, based on the detected distance between the person and the at least one voice interaction device, a voice interaction device from the at least one voice interaction device to broadcast the voice notification information; and Using the determined voice interaction device to broadcast the voice notification information.

2. The method according to claim 1, characterized in that The detecting the distance between a person in the target space and the at least one voice interaction device includes: Detecting the distance between the person and the at least one voice interaction device based on a voice recognition matrix.

3. The method according to claim 1 or 2, characterized in that There are multiple voice interaction devices in the target space, The determining, based on the detected distance between the person and the at least one voice interaction device, a voice interaction device from the at least one voice interaction device to broadcast the voice notification information includes: Determining the voice interaction device closest to the person among the multiple voice interaction devices as the voice interaction device to broadcast the voice notification information.

4. The method according to claim 1, characterized in that The voice notification information includes at least one of the operating parameter information of the air handling device and the caring voice, The caring voice includes: At least one of a voice for reminding the person and a voice for giving suggestions based on the operation of the air handling device.

5. The method according to claim 4, characterized in that The caring voice is associated with at least one of the following information: Outdoor weather information; Voice information obtained by voice recognition; The indoor location where the person is located; The environmental information of the indoor target space.

6. The method according to claim 4, characterized in that The caring voice is generated based on a deep learning model.

7. The method according to claim 4, characterized in that The air handling device includes at least one of an indoor unit, a air supply device, a humidity control device, and a floor heating device.

8. The method according to claim 7, characterized in that The operating parameters of the air handling device include at least one of a set temperature, a set air volume, and a set humidity.

9. The method according to claim 4, characterized in that The voice notification information contains the identification information of the air handling device.

10. The method according to claim 1, wherein The method further includes at least one of the following processes: Receiving the feedback information of the person and sending the feedback information to the control end; Controlling the air handling device according to the feedback information of the person.

11. The method according to claim 1, characterized in that The voice interaction device includes at least one of a central controller, a wired controller, a remote controller, a user terminal, and a smart speaker.

12. A voice interaction system, characterized in that, The voice interaction system includes: A control device (21), an Internet of Things platform (22), and at least one voice interaction device (23) in a target space, Wherein, the at least one voice interaction device and the control device are connected to the Internet of Things platform; The control device sends a first control instruction for the at least one voice interaction device, and the first control instruction is used to turn on the voice broadcast function of the at least one voice interaction device; The Internet of Things platform generates voice notification information and sends the voice notification information to the voice interaction device; Detect the distance between the person in the target space and the at least one voice interaction device; The control device determines the voice interaction device for broadcasting the voice notification information from the at least one voice interaction device according to the detected distance between the person and the at least one voice interaction device; and The determined voice interaction device broadcasts the voice notification information.

13. A voice interaction device, characterized in that, The voice interaction device includes: A first control module, a second control module and at least one voice interaction module in the target space, Wherein, the at least one voice interaction module and the first control module are connected to the second control module; The first control module sends a first control instruction for the at least one voice interaction module, and the first control instruction is used to turn on the voice broadcast function of the at least one voice interaction module; The second control module generates voice notification information and sends the voice notification information to the voice interaction module; Detect the distance between the person in the target space and the at least one voice interaction module; The first control module determines the voice interaction module for broadcasting the voice notification information from the at least one voice interaction module according to the detected distance between the person and the at least one voice interaction module; and The determined voice interaction module broadcasts the voice notification information.

14. An electronic device, characterized in that The electronic device includes a processor and a memory, wherein, The memory is used for storing a computer program; When the processor executes the program stored in the memory, the steps of the method according to any one of claims 1-11 are implemented.

15. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method according to any one of claims 1-11 are implemented.

Images