Voice equipment, control method and device thereof, storage medium and program product

Abstract

The invention provides a voice device and a control method and device thereof, a storage medium and a program product, and the method comprises the steps: the voice device is any voice device in a device network, and the device network comprises more than one voice device and more than one device without a voice function. The more than one voice device and the more than one device without the voice function communicate with each other through a routing gateway, and the control method comprises the following steps: receiving own working state information sent by the device without the voice function in the device network through the routing gateway; when the working state information of the device itself sent by any device without the voice function in the device network through the routing gateway is received, detecting whether there is a person in the room where the device is located; and if it is detected that someone is in the room, the received working state information is converted into corresponding voice information, and the voice information is broadcasted. The scheme provided by the invention can help a user to timely acquire the running state of the equipment.

Description

Technical Field

[0001] The present invention relates to the field of control, and in particular to a voice device and a control method, device, storage medium and program product thereof. Background Art

[0002] With the development of smart homes, the interconnection and interaction between devices, the era of the Internet of Everything has entered thousands of households. Smart home devices are used to form family health monitoring / nursing systems, etc. Some of the connected smart home devices have voice functions, while some do not. So how to enable devices without voice functions to have voice broadcast functions so that users can experience responses and reminders for everything in home devices, and be able to understand the operation of home devices in a timely manner, such as when the washing machine will finish washing clothes, when the water temperature of the water purifier reaches the ideal temperature, when the rice cooker will cook rice, when the cooking machine will cook vegetables, etc. These are so important in the minds of people living at home. For example, users often forget things because they are busy taking care of babies, and smart home devices fail to remind users of the operation of the device itself in time, such as forgetting to dry the clothes after washing them in the washing machine, forgetting to use the water purifier in time when the water temperature is suitable, etc. Summary of the invention

[0003] The main purpose of the present invention is to overcome the defects of the above-mentioned related technologies and to provide a voice device and its control method, device, storage medium and program product to solve the problem in the related technologies that home appliances fail to promptly remind users of their own operating conditions.

[0004] On one hand, the present invention provides a method for controlling a voice device, wherein the voice device is any voice device in a device network, wherein the device network includes one or more voice devices and one or more devices without voice function, wherein the one or more voice devices and one or more devices without voice function communicate with each other through a routing gateway, and the voice device is any voice device in the device network. The control method comprises: receiving working status information of the device without voice function in the device network sent through the routing gateway; when receiving working status information of the device without voice function in the device network sent through the routing gateway, detecting whether there is someone in the room; if it is detected that there is someone in the room, converting the received working status information into corresponding voice information and broadcasting it.

[0005] Optionally, it also includes: when the device network includes more than two voice devices, detecting the sound in the room; when a preset type of sound is detected in the room, sending a first notification message to other voice devices in the device network through the routing gateway; wherein, if any voice device in the device network receives the first notification message through the routing gateway, it detects whether there is someone in the room, and if it is detected that there is someone in the room, the first notification message is converted into corresponding voice information and broadcasted; and / or, when the device network includes more than two voice devices, receiving a second notification message sent by other voice devices in the device network through the routing gateway; wherein, if any voice device in the device network detects a preset type of sound in the room, it sends the second notification message through the routing gateway; if the second notification message sent by any other voice device in the device network is received through the routing gateway, it detects whether there is someone in the room, and if it is detected that there is someone in the room, the second notification message is converted into corresponding voice information and broadcasted.

[0006] Optionally, it also includes: when receiving execution result information sent by any device without voice function in the device network through the routing gateway after executing the first control instruction, converting the received execution result information into corresponding voice information and broadcasting it.

[0007] Optionally, it also includes: when receiving execution result information sent by any device without voice function in the device network through the routing gateway after executing the first control instruction, judging whether the device without voice function is an associated device of the voice device; if it is judged that the device without voice function is an associated device of the voice device, converting the received execution result information into corresponding voice information and broadcasting it, and detecting whether the voice device is running; if it is detected that the voice device is running, adjusting the control parameters of the voice device according to the user instruction executed by the associated device.

[0008] Optionally, it also includes: receiving a second control instruction; determining whether the received second control instruction is executed by the corresponding voice device; if so, the corresponding voice device performs a corresponding operation according to the second control instruction; if not, sending the second control instruction to the corresponding device in the device network through the routing gateway, and the corresponding device performs a corresponding operation.

[0009] On the other hand, the present invention provides a control device for a voice device, wherein the voice device is any voice device in a device network, wherein the device network includes more than one voice device and / or more than one device without voice function, wherein the more than one voice device and / or more than one device without voice function communicate with each other through a routing gateway, and the voice device is any voice device in the device network, and the control device includes: a first receiving unit, for receiving working status information of the device without voice function in the device network sent through the routing gateway; a first detection unit, for detecting whether there is someone in the room when the first receiving unit receives the working status information of the device without voice function in the device network sent through the routing gateway; and a broadcasting unit, for converting the received working status information into corresponding voice information and broadcasting it if the first detection unit detects that there is someone in the room.

[0010] Optionally, it also includes: a second detection unit, which is used to detect the sound in the room when the device network includes more than two voice devices; a first sending unit, which is used to send a first notification message to other voice devices in the device network through the routing gateway when the second detection unit detects that there is a preset type of sound in the room; wherein, if any voice device in the device network receives the first notification message through the routing gateway, it detects whether there is someone in the room, and if it is detected that there is someone in the room, the first notification message is converted into corresponding voice information and broadcasted; and / or, a second receiving unit, which is used to receive second notification information sent by other voice devices in the device network through the routing gateway when the device network includes more than two voice devices; wherein, if any voice device in the device network detects that there is a preset type of sound in the room, it sends the second notification message through the routing gateway; the first detection unit is also used to: if the second receiving unit receives the second notification message sent by any other voice device in the device network through the routing gateway, it detects whether there is someone in the room; the broadcasting unit is also used to: if it is detected that there is someone in the room, the second notification message is converted into corresponding voice information and broadcasted.

[0011] Optionally, it also includes: a third receiving unit, used to receive execution result information sent by any device without voice function in the device network through the routing gateway after executing the first control instruction; the broadcasting unit is also used to: when the third receiving unit receives execution result information sent by any device without voice function in the device network through the routing gateway after executing the first control instruction, convert the received execution result information into corresponding voice information and broadcast it.

[0012] Optionally, it also includes: a third receiving unit, used to receive execution result information sent by any device without voice function in the device network through the routing gateway after executing the first control instruction; a first judgment unit, used to determine whether the device without voice function is an associated device of the voice device when the third receiving unit receives the execution result information sent by any device without voice function in the device network through the routing gateway after executing the first control instruction; the broadcasting unit is also used to: if the first judgment unit determines that the device without voice function is an associated device of the voice device, convert the received execution result information into corresponding voice information and broadcast it; a third detection unit, used to detect whether the voice device is running; and an adjustment unit, used to adjust the control parameters of the voice device according to the user instruction executed by the associated device if the third detection unit detects that the voice device is running.

[0013] Optionally, it also includes: a fourth receiving unit, used to receive a second control instruction; a second judgment unit, used to judge whether the received second control instruction is executed by the corresponding voice device; an execution unit, used to, if it is judged that the received second control instruction is executed by the corresponding voice device, then the corresponding voice device performs a corresponding operation according to the second control instruction; a second sending unit, used to, if it is judged that the received second control instruction is not executed by the corresponding voice device, send the second control instruction to the corresponding device in the device network through the routing gateway, and the corresponding device performs a corresponding operation.

[0014] Another aspect of the present invention provides a storage medium having a computer program stored thereon, wherein the program implements the steps of any of the aforementioned methods when executed by a processor.

[0015] In another aspect, the present invention provides a voice device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the aforementioned methods when executing the program.

[0016] Another aspect of the present invention provides a voice device, comprising any of the aforementioned control devices.

[0017] In yet another aspect, the present invention provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the steps of any of the aforementioned methods are implemented.

[0018] According to the technical solution of the present invention, the working status of a device without a voice function can be broadcasted through a voice device with a voice function, so as to timely remind the user and help the user obtain the operating status of the device in time, allowing the user to handle matters at home in an organized manner, thereby providing the user with a more convenient smart life experience.

[0019] According to the technical solution of the present invention, devices with voice functions can empower devices without voice functions, devices with voice functions can broadcast the operation responses of devices without voice functions, and voice broadcasts the operating status of each device, helping users to obtain the status of devices in their home in time or be reminded in time to understand what they have done before, thereby further enhancing the user's smart life experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0021] Figure 1 is a method schematic diagram of an embodiment of a method for controlling a voice device provided by the present invention;

[0022] Figure 2 is a method schematic diagram of another embodiment of the method for controlling a voice device provided by the present invention;

[0023] Figure 3 is a method schematic diagram of another embodiment of the method for controlling a voice device provided by the present invention;

[0024] Figure 4 is a method schematic diagram of another embodiment of the method for controlling a voice device provided by the present invention;

[0025] Figure 5 is a method schematic diagram of another embodiment of the method for controlling a voice device provided by the present invention;

[0026] Figure 6 is a method schematic diagram of another embodiment of the method for controlling a voice device provided by the present invention;

[0027] Figure 7a It shows a schematic diagram of the linkage of household devices according to the present invention;

[0028] Figure 7b A schematic diagram of voice device control according to a specific scenario of the present invention is shown;

[0029] Figure 7c A schematic diagram of voice device control according to another specific scenario of the present invention is shown;

[0030] Figure 7d A schematic diagram of voice device control according to another specific scenario of the present invention is shown;

[0031] Figure 8 is a method schematic diagram of a specific embodiment of the method for controlling a voice device provided by the present invention;

[0032] Fig. 9is a structural block diagram of an embodiment of a control device for a voice device provided by the present invention;

[0033] Fig.10 is a structural block diagram of another embodiment of the control device for the speech device provided by the present invention;

[0034] Fig.11 is a structural block diagram of another embodiment of the control device of the speech device provided by the present invention;

[0035] Fig.12 is a structural block diagram of yet another embodiment of the control device for the speech device provided by the present invention;

[0036] Fig.13 is a structural block diagram of yet another embodiment of the control device for the speech device provided by the present invention;

[0037] Fig.14 It is a structural block diagram of another embodiment of the control device of the voice device provided by the present invention. DETAILED DESCRIPTION

[0038] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the specific embodiments of the present invention and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0039] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0040] The present invention provides a control method for a voice device. The voice device (i.e., the device implementing the control method) is any voice device in a device network, and the device network includes one or more voice devices and one or more devices without voice function, and the one or more voice devices and one or more devices without voice function communicate with each other through a routing gateway. The voice device is any voice device in the device network, that is, the voice device is networked with one or more other devices to form a home network, and communicates with each other through the routing gateway. The routing grid is specifically a router with a gateway function, which can be used as a gateway. The voice device can be any voice device in the composed device network. Preferably, the environment includes: more than two rooms, each room has at least one voice device. For example, the device network is a home device network, and the home (house) has more than two rooms, and each room has at least one voice device.

[0041] The voice device may specifically be a voice appliance, for example, may include at least one of an air conditioner, a refrigerator, a washing machine, a smart rice cooker, a smart cooking machine, a water purifier, an air purifier, a dehumidifier, an electric fan and an electric heater with voice function.

[0042] The device without voice function can specifically be an electrical appliance without voice function, for example, it can include at least one of an air conditioner, refrigerator, washing machine, smart rice cooker, smart cooking machine, water purifier, air purifier, dehumidifier, electric fan and electric heater without voice function, and can send its own status information to the voice device through gateway routing.

[0043] Figure 1 It is a method schematic diagram of an embodiment of a method for controlling a voice device provided by the present invention.

[0044] like Figure 1 As shown, according to an embodiment of the present invention, the control method of the voice device at least includes step S110, step S120 and step S130.

[0045] Step S110, receiving the working status information of the device without voice function in the device network sent through the routing gateway.

[0046] Specifically, the device without voice function sends its own working status information through the routing gateway, that is, the device without voice function in the device network sends its own working status information to the routing gateway, and the routing gateway forwards the working status information to the voice device to which it belongs. The voice device to which it belongs receives the working status information of the device without voice function forwarded by the routing gateway. For example, the voice device to which it belongs is an intelligent voice air conditioner, and each room has an intelligent voice air conditioner. The intelligent device communicates with the intelligent voice air conditioner in linkage, and the intelligent device sends its own working status information to the routing gateway, and the routing gateway forwards the working status information to each voice air conditioner. The working status information includes, for example, the status information of the water dispenser boiling water and the status information of the washing machine washing clothes.

[0047] Step S120, when receiving the working status information of any device without voice function in the device network sent through the routing gateway, it is detected whether there is anyone in the room.

[0048] In a specific implementation, a millimeter wave radar sensor is used to detect whether there is someone in the room, that is, the human sensing function of the millimeter wave radar is used to detect whether there is someone in the room. When detecting whether there is someone in the room, the millimeter wave radar sensor senses changes in the surrounding environment by emitting electromagnetic waves and receiving reflected signals of electromagnetic waves, especially detecting slight movements or presence of the human body. The radar module continuously emits millimeter wave signals, using frequency modulated continuous wave (FMCW) or phased array radar technology to enhance the detection capability of stationary objects. Millimeter waves will reflect when they encounter obstacles such as human bodies and furniture. The sensor receives the reflected signal and detects slight movements through the Doppler effect and phase difference. When someone in the room moves slightly (such as breathing or gestures), the frequency of the reflected signal detected by the radar will change slightly. Through the change of Doppler frequency, slight movements can be accurately detected. The receiving module extracts the amplitude, frequency and phase information of different reflected waves through the signal processing unit. People and other static objects are distinguished by analyzing the changes in the reflected signal. Through the analysis of phase difference and time difference, the millimeter wave radar can identify the static state of the human body (for example, sitting or standing still). When the human body is at rest, micro-movements such as breathing can also be detected by millimeter waves.

[0049] In another specific implementation, an image capture device is used to capture an environmental image of the room, and image recognition is used to determine whether there is anyone in the room.

[0050] Step S130: If it is detected that there is someone in the room, the received working status information is converted into corresponding voice information and broadcasted.

[0051] Specifically, if it is detected that there is someone in the room, the received working status information is converted into text information; speech synthesis is performed on the converted text information to generate voice information, and the generated voice information is broadcasted.

[0052] For example, any voice air conditioner receives the working status information forwarded by the device without voice function through the routing gateway, and detects whether there is someone in the room. If it is detected that there is someone in the room, the voice air conditioner processes the received working status information through the voice module, converts the received working status information into text information, and then generates voice information after voice synthesis processing, and broadcasts the generated voice information through the speaker of the voice device. If it is detected that there is no one in the room, no processing is performed.

[0053] Figure 2 It is a method schematic diagram of another embodiment of the method for controlling a voice device provided by the present invention.

[0054] like Figure 2 As shown, according to another embodiment of the present invention, the control method of the voice device further includes step S140 and step S141.

[0055] Step S140: When the device network includes more than two voice devices, detect the sound in the room.

[0056] Step S141, when a preset type of sound is detected in the room, a first notification message is sent to other voice devices in the device network through the routing gateway.

[0057] Among them, if any voice device in the device network receives the first notification information through the routing gateway, it detects whether there is someone in the room. If it is detected that there is someone in the room, the first notification information is converted into corresponding voice information and broadcasted.

[0058] The first notification information is to notify other voice devices in the device network that there is a preset type of sound in the room where the other voice devices are located. The preset type of sound is, for example, a crying child. For example, the voice air conditioner detects the sound in the environment in real time. When a crying child is detected, the voice air conditioner turns on the linkage reminder function. The voice air conditioner communicates with other voice air conditioners through the routing gateway. Each air conditioner starts the millimeter wave human sensing function to detect whether there is someone in the room. If the voice air conditioner in any room detects that there is someone in the room, the routing gateway forwards the information, processes the received information through the voice module, and broadcasts it through the speaker to remind the user that there is a crying child and to take care of the child in time. If there is no one, no processing is done.

[0059] Figure 3 It is a method schematic diagram of another embodiment of the method for controlling a voice device provided by the present invention.

[0060] like Figure 3 As shown, according to another embodiment of the present invention, the control method of the voice device further includes step S150 and step S152.

[0061] Step S150: When the device network includes more than two voice devices, second notification information sent by other voice devices in the device network is received through the routing gateway.

[0062] Specifically, when the device network includes more than two voice devices, that is, in addition to the voice device, there are other voice devices. For example, there is a voice device corresponding to each room in the device network. When any voice device in the device network detects a preset type of sound in the room where it is located, it sends the second notification information through the routing gateway. The second notification information is to notify other voice devices that there is a preset type of sound in the room where the device is located. The preset type of sound is, for example, a child crying. For example, each voice air conditioner in the device network detects the sound in the environment in real time. When any voice air conditioner detects the crying of a child, the voice air conditioner turns on the linkage reminder function, and the voice air conditioner communicates with other voice air conditioners through the routing gateway.

[0063] Step S152, if the second notification information sent by any other voice device in the device network is received through the routing gateway, it is detected whether there is someone in the room. If it is detected that there is someone in the room, the second notification information is converted into corresponding voice information and broadcasted.

[0064] Specifically, if the voice air conditioner receives the second notification information sent by any other voice air conditioner through the routing gateway, it detects whether there is someone in the room. If it is detected that there is someone in the room, the routing gateway forwards the information, processes the received information through the voice module, and broadcasts through the speaker to remind the user that there is a crying child and to take care of the child in time. If there is no one, no processing is done.

[0065] The voice air conditioner in any room receives the second notification information, parses the second notification information, and finds out that there is a child crying. Then the main control unit feeds back the millimeter wave sensor unit to detect whether there is anyone in the current environment. If there is someone, the main control unit determines that it is necessary to broadcast in this environment, so the main control unit communicates and feeds back the voice module unit, and feeds back the crying instruction to the voice module unit. The voice module unit receives the instruction sent by the main control unit (such as MCU) through the communication interface (such as serial port). The main control chip of the voice module parses the received data packet, and judges that this is a request to play audio resources according to the instruction code, reads the parameter part, and determines the audio resources that need to be played (such as "child crying" and the corresponding prompt voice). The voice module will load the corresponding audio resources according to the instruction, synthesize the prompt text into audio data by calling the TTS engine, or read the address of the "child crying" file from the audio resource library, load the file data and decode it into a playable audio stream.

[0066] Figure 4 It is a method schematic diagram of another embodiment of the method for controlling a voice device provided by the present invention.

[0067] like Figure 4 As shown, according to yet another embodiment of the present invention, the method for controlling the voice device further includes step S160.

[0068] Step S160, when receiving the execution result information sent by any device without voice function in the device network through the routing gateway after executing the first control instruction, converting the received execution result information into corresponding voice information and broadcasting it.

[0069] For example, the voice device is an air conditioner. When the user turns off the fan, the fan is turned off and the information of the turning off is sent to the air conditioner, and the air conditioner announces "the fan is turned off".

[0070] Figure 5 It is a method schematic diagram of another embodiment of the method for controlling a voice device provided by the present invention.

[0071] like Figure 5 As shown, preferably, according to another embodiment of the present invention, the control method of the voice device further includes step S160, step S161 and step S162.

[0072] Step S160, when receiving the execution result information sent by any device without voice function in the device network through the routing gateway after executing the first control instruction, it is determined whether the device without voice function is an associated device of the corresponding voice device.

[0073] Step S161, if it is determined that the device without voice function is an associated device of the corresponding voice device, the received execution result information is converted into corresponding voice information and broadcasted, and it is detected whether the corresponding voice device is running.

[0074] Step S162: If it is detected that the associated voice device is running, the control parameters of the associated voice device are adjusted according to the user instruction executed by the associated device.

[0075] The associated device may specifically be a device that is pre-associated with the corresponding voice device and has the same function or a collaborative function; for example, the corresponding voice device is an air conditioner, and the associated device is a fan, a dehumidifier and / or an air purifier. For example, when the user turns off the fan, the fan sends a shutdown message to the air conditioner, and the air conditioner announces "the fan is turned off" and checks whether the air conditioner itself is running. If the air conditioner is still running, in order to continue to maintain the circulation of the indoor ambient temperature, the air conditioner wind speed is automatically increased by one level, or the air sweep range is increased to the maximum.

[0076] Figure 6 It is a method schematic diagram of another embodiment of the method for controlling a voice device provided by the present invention.

[0077] like Figure 6 As shown, according to yet another embodiment of the present invention, the control method of the voice device further includes step S170, step S171 and step S172.

[0078] Step S170, receiving a second control instruction.

[0079] Step S171, determining whether the received second control instruction is executed by the corresponding voice device.

[0080] Step S172: If yes, the corresponding voice device performs a corresponding operation according to the second control instruction; if no, the second control instruction is sent to the corresponding device in the device network through the routing gateway, and the corresponding device performs a corresponding operation.

[0081] The second control instruction may specifically be a voice control instruction. For example, when a user turns off a fan by voice control, the voice air conditioner determines that the voice control instruction is not for controlling itself, that is, it is not executed by the voice air conditioner, and then sends the fan shutdown instruction to the gateway router, which forwards the instruction to the fan, and the fan executes the shutdown instruction after receiving the fan shutdown instruction.

[0082] The speech device of the present invention mainly includes a main control module, a wireless communication module, a speech module, a speaker module, and a millimeter wave sensor module. The main control module is mainly responsible for logic operations, scheduling control, etc.; the wireless communication module is responsible for network connection, local networking communication, communication with intelligent terminals, etc.; the speech module has a sound detection function, which can detect the crying of children, and is responsible for speech recognition, speech synthesis, etc., and processes text into audio for broadcasting; the speaker module is responsible for speech broadcasting, etc.; the millimeter wave sensor module is responsible for detecting and identifying whether there is someone in the room.

[0083] Figure 7a The schematic diagram of the linkage of household devices according to the present invention is shown. The air conditioner and the smart device form a home network, and the devices can communicate with each other through the gateway router. The smart devices include the air conditioner 1, refrigerator 2, washing machine 3, smart rice cooker 4, automatic cooking machine 5, water purifier 6, air purifier 7, and gas stove, which can send their own status information to the air conditioner through the gateway router 9.

[0084] The voice device control method of the present invention is described below in conjunction with specific scenarios:

[0085] Scenario 1: This scenario can be combined with Figure 7b To understand, Figure 7b A schematic diagram of voice device control according to a specific scenario of the present invention is shown.

[0086] The user is taking care of the child at home and needs to prepare milk powder for the child. At this time, the water purifier 6 in the living room chooses to boil water. The user does not know that the water is boiled, and the user cannot learn the news that the water is boiled in time. At this time, the water purifier 6 communicates with the air conditioner 1 in linkage, and broadcasts the information to the user through the air conditioner. The water purifier sends the message that the water has been boiled to the gateway router, and the gateway router 9 forwards the information to each air conditioner 1. When the air conditioner receives the information, each air conditioner 1 activates the millimeter wave human sensing function to detect whether there is someone in the room. If there is someone, the air conditioner processes the data information forwarded by the router through the voice module unit, and after the received information is processed by the voice module through voice synthesis, it broadcasts the operating status of the device through the speaker, broadcasting "The water is boiled". If there is no one, the air conditioner in the room will not be processed.

[0087] Scenario 2: This scenario can be combined with Figure 7c To understand, Figure 7c A schematic diagram of voice device control according to another specific scenario of the present invention is shown.

[0088] Washing machine 3 washes clothes, but there is no announcement after washing clothes. The user cannot know the news that the clothes have been washed in time. At this time, washing machine 3 communicates with air conditioner 1 in linkage, and broadcasts the information to the user through air conditioner. Washing machine 3 sends the message that the clothes have been washed to gateway router 9, and gateway router 9 forwards the information to each air conditioner 1. When the air conditioner receives the information, each air conditioner 1 starts the millimeter wave human sensing function to detect whether there is someone in the room. If there is someone, the air conditioner processes the data information forwarded by the route through the voice module unit, and after the received information is processed by voice synthesis through the voice module, it broadcasts the operating status of the device through the speaker, such as "The clothes have been washed, please dry them in time". If the washing machine detects that the washing door has not been opened after 30 minutes, it continues to communicate with the air conditioner equipment in linkage, sends the information to the air conditioner for broadcasting, and the air conditioner broadcasts again "The clothes have been washed, please dry them in time"; if there is no one, the air conditioner in the room does not process it.

[0089] Scenario 3: This scenario can be combined with Figure 7d To understand, Figure 7d A schematic diagram of voice device control according to another specific scenario of the present invention is shown;

[0090] The user is doing housework in the kitchen, and the baby is sleeping in the room. The voice air conditioner detects the sound of the environment in real time. When the air conditioner detects the crying of a child, the air conditioner 1 turns on the linkage reminder function. The air conditioner communicates with other air conditioners through the routing gateway 9. Each air conditioner starts the millimeter wave human sensing function to detect whether there is someone in the room. If there is someone, the air conditioner processes the routing gateway to forward the information instruction, processes the received information through the voice module, and broadcasts through the speaker to remind the user that there is a crying child, such as "the child is crying". At this time, the user should go to take care of the child in time. If there is no one, the air conditioner in the room will not be processed.

[0091] In order to clearly illustrate the technical solution of the present invention, the execution process of the control method of the voice device provided by the present invention is described below with reference to a specific embodiment.

[0092] Figure 8 FIG. 1 is a method diagram of a specific embodiment of the method for controlling a voice device provided by the present invention. Figure 8 As shown, after the smart device without voice function finishes working, it reports its own working status information to the gateway router. The gateway router forwards the information to each air-conditioning device in the home. The air-conditioning turns on the human sensing function to sense whether there is someone in the environment. If there is no one, the air-conditioning will not process it. If there is someone, the air-conditioning will process the information through the voice module and broadcast the operating status of the device through the speaker.

[0093] The present invention also provides a control device for a voice device. The voice device (i.e., the device implementing the control method) is any voice device in a device network, and the device network includes one or more voice devices and one or more devices without voice function, and the one or more voice devices and one or more devices without voice function communicate with each other through a routing gateway. The voice device is any voice device in the device network, that is, the voice device is networked with one or more other devices to form a home network, and communicates with each other through the routing gateway. The routing grid is specifically a router with a gateway function, which can be used as a gateway. The voice device can be any voice device in the composed device network. Preferably, the environment includes: more than two rooms, each room has at least one voice device. For example, the device network is a home device network, and the home (house) has more than two rooms, and each room has at least one voice device.

[0094] The voice device may specifically be a voice appliance, for example, may include at least one of an air conditioner, a refrigerator, a washing machine, a smart rice cooker, a smart cooking machine, a water purifier, an air purifier, a dehumidifier, an electric fan and an electric heater with voice function.

[0095] The device without voice function can specifically be an electrical appliance without voice function, for example, it can include at least one of an air conditioner, refrigerator, washing machine, smart rice cooker, smart cooking machine, water purifier, air purifier, dehumidifier, electric fan and electric heater without voice function, and can send its own status information to the voice device through gateway routing.

[0096] Fig. 9 FIG. 1 is a structural block diagram of an embodiment of a control device for a voice device provided by the present invention. Fig. 9 As shown, the control device 100 of the voice device includes: a first receiving unit 110 , a first detecting unit 120 and a broadcasting unit 130 .

[0097] The first receiving unit 110 is used to receive the working status information of the device without voice function in the device network sent through the routing gateway.

[0098] Specifically, the device without voice function sends its own working status information through the routing gateway, that is, the device without voice function in the device network sends its own working status information to the routing gateway, and the routing gateway forwards the working status information to the voice device to which it belongs. The voice device to which it belongs receives the working status information of the device without voice function forwarded by the routing gateway. For example, the voice device to which it belongs is an intelligent voice air conditioner, and each room has an intelligent voice air conditioner. The intelligent device communicates with the intelligent voice air conditioner in linkage, and the intelligent device sends its own working status information to the routing gateway, and the routing gateway forwards the working status information to each voice air conditioner. The working status information includes, for example, the status information of the water dispenser boiling water and the status information of the washing machine washing clothes.

[0099] The first detection unit 120 detects whether there is anyone in the room when the first receiving unit receives the working status information of any device without voice function in the device network sent through the routing gateway.

[0100] In a specific implementation, a millimeter wave radar sensor is used to detect whether there is someone in the room, that is, the human sensing function of the millimeter wave radar is used to detect whether there is someone in the room. When detecting whether there is someone in the room, the millimeter wave radar sensor senses changes in the surrounding environment by emitting electromagnetic waves and receiving reflected signals of the electromagnetic waves, especially detecting slight movements or presence of the human body.

[0101] The radar module continuously transmits millimeter wave signals, using frequency modulated continuous wave (FMCW) or phased array radar technology to enhance the detection of stationary objects. Millimeter waves will reflect when they hit obstacles such as human bodies and furniture. The sensor receives the reflected signal and detects small movements through the Doppler effect and phase difference. When someone in the room moves slightly (such as breathing or gestures), the frequency of the reflected signal detected by the radar will change slightly. Through the change of Doppler frequency, small movements can be accurately detected. The receiving module extracts the amplitude, frequency and phase information of different reflected waves through the signal processing unit. People and other static objects are distinguished by analyzing the changes in the reflected signal. Through the analysis of phase difference and time difference, the millimeter wave radar can identify the stationary state of the human body (such as sitting or standing still). When the human body is in a stationary state, its micro-movements such as breathing will also be detected by the millimeter wave.

[0102] In another specific implementation, an image capture device is used to capture an environmental image of the room, and image recognition is used to determine whether there is anyone in the room.

[0103] The announcement unit 130 is used to convert the received working status information into corresponding voice information and announce it if the first detection unit 120 detects that there is someone in the room.

[0104] Specifically, if it is detected that there is someone in the room, the received working status information is converted into text information; speech synthesis is performed on the converted text information to generate voice information, and the generated voice information is broadcasted.

[0105] For example, any voice air conditioner receives the working status information forwarded by the device without voice function through the routing gateway, and detects whether there is someone in the room. If it is detected that there is someone in the room, the voice air conditioner processes the received working status information through the voice module, converts the received working status information into text information, and then generates voice information after voice synthesis processing, and broadcasts the generated voice information through the speaker of the voice device. If it is detected that there is no one in the room, no processing is performed.

[0106] Fig.10 FIG. 1 is a structural block diagram of another embodiment of the control device of the speech device provided by the present invention. Fig.10 As shown, the control device 100 of the voice device further includes: a second detection unit 140 and a first sending unit 141 .

[0107] The second detection unit 140 is configured to detect the sound in the room when the device network includes more than two voice devices.

[0108] The first sending unit 141 is configured to send first notification information to other voice devices in the device network through the routing gateway when the second detecting unit 140 detects a preset type of sound in the room.

[0109] Among them, if any voice device in the device network receives the first notification information through the routing gateway, it detects whether there is someone in the room. If it is detected that there is someone in the room, the first notification information is converted into corresponding voice information and broadcasted.

[0110] The first notification information is to notify other voice devices in the device network that there is a preset type of sound in the room where the other voice devices are located. The preset type of sound is, for example, a crying child. For example, the voice air conditioner detects the sound in the environment in real time. When a crying child is detected, the voice air conditioner turns on the linkage reminder function. The voice air conditioner communicates with other voice air conditioners through the routing gateway. Each air conditioner starts the millimeter wave human sensing function to detect whether there is someone in the room. If the voice air conditioner in any room detects that there is someone in the room, the routing gateway forwards the information, processes the received information through the voice module, and broadcasts it through the speaker to remind the user that there is a crying child and to take care of the child in time. If there is no one, no processing is done.

[0111] Fig.11 FIG. 1 is a structural block diagram of another embodiment of the control device of the speech device provided by the present invention. Fig.11 As shown, the control device 100 of the voice device further includes: a second receiving unit 150 .

[0112] The second receiving unit 150 is configured to receive second notification information sent by other voice devices in the device network through the routing gateway when the device network includes more than two voice devices.

[0113] Specifically, when the device network includes more than two voice devices, that is, in addition to the voice device, there are other voice devices. For example, there is a voice device corresponding to each room in the device network. When any voice device in the device network detects a preset type of sound in the room where it is located, it sends the second notification information through the routing gateway. The second notification information is to notify other voice devices that there is a preset type of sound in the room where the device is located. The preset type of sound is, for example, a child crying. For example, each voice air conditioner in the device network detects the sound in the environment in real time. When any voice air conditioner detects the crying of a child, the voice air conditioner turns on the linkage reminder function, and the voice air conditioner communicates with other voice air conditioners through the routing gateway.

[0114] The first detection unit 120 is further configured to detect whether there is someone in the room if the second receiving unit 150 receives the second notification information sent by any other voice device in the device network through the routing gateway. The broadcasting unit 130 is further configured to convert the second notification information into corresponding voice information and broadcast it if it is detected that there is someone in the room.

[0115] Specifically, if the voice air conditioner receives the second notification information sent by any other voice air conditioner through the routing gateway, it detects whether there is someone in the room. If it is detected that there is someone in the room, the routing gateway forwards the information, processes the received information through the voice module, and broadcasts through the speaker to remind the user that there is a crying child and to take care of the child in time. If there is no one, no processing is done.

[0116] The voice air conditioner in any room receives the second notification information, parses the second notification information, and finds out that there is a child crying. Then the main control unit feeds back the millimeter wave sensor unit to detect whether there is anyone in the current environment. If there is someone, the main control unit determines that it is necessary to broadcast in this environment, so the main control unit communicates and feeds back the voice module unit, and feeds back the crying instruction to the voice module unit. The voice module unit receives the instruction sent by the main control unit (such as MCU) through the communication interface (such as serial port). The main control chip of the voice module parses the received data packet, and judges that this is a request to play audio resources according to the instruction code, reads the parameter part, and determines the audio resources that need to be played (such as "child crying" and the corresponding prompt voice). The voice module will load the corresponding audio resources according to the instruction, synthesize the prompt text into audio data by calling the TTS engine, or read the address of the "child crying" file from the audio resource library, load the file data and decode it into a playable audio stream.

[0117] Fig.12 FIG. 1 is a structural block diagram of another embodiment of the control device of the speech device provided by the present invention. Fig.12 As shown, the control device 100 of the voice device further includes: a third receiving unit 160 .

[0118] The third receiving unit 160 is used to receive execution result information sent by any device without voice function in the device network through the routing gateway after executing the first control instruction; the broadcasting unit 130 is also used to: when the third receiving unit 160 receives execution result information sent by any device without voice function in the device network through the routing gateway after executing the first control instruction, convert the received execution result information into corresponding voice information and broadcast it.

[0119] For example, the voice device is an air conditioner. When the user turns off the fan, the fan is turned off and the information of the turning off is sent to the air conditioner, and the air conditioner announces "the fan is turned off".

[0120] Fig.13 FIG. 1 is a structural block diagram of another embodiment of the control device of the speech device provided by the present invention. Fig.13 As shown, the control device 100 of the voice device further includes: a third receiving unit 160 , a first judging unit 161 , a third detecting unit 162 , and an adjusting unit 163 .

[0121] The third receiving unit 160 is used to receive execution result information sent by any device without voice function in the device network through the routing gateway after executing the first control instruction.

[0122] The first judgment unit 161 is used to judge whether any device without voice function in the device network is an associated device of the corresponding voice device when the third receiving unit receives execution result information sent by the routing gateway after the device executes the first control instruction.

[0123] The reporting unit 130 is further configured to: if the first determining unit 161 determines that the device without voice function is an associated device of the voice device, convert the received execution result information into corresponding voice information and report it.

[0124] The third detection unit 162 is used to detect whether the corresponding voice device is running.

[0125] The adjustment unit 163 is configured to adjust the control parameters of the associated voice device according to the user instruction executed by the associated device if the third detection unit 162 detects that the associated voice device is running.

[0126] The associated device may specifically be a device that is pre-associated with the corresponding voice device and has the same function or a collaborative function; for example, the corresponding voice device is an air conditioner, and the associated device is a fan, a dehumidifier and / or an air purifier. For example, when the user turns off the fan, the fan sends a shutdown message to the air conditioner, and the air conditioner announces "the fan is turned off" and checks whether the air conditioner itself is running. If the air conditioner is still running, in order to continue to maintain the circulation of the indoor ambient temperature, the air conditioner wind speed is automatically increased by one level, or the air sweep range is increased to the maximum.

[0127] Fig.14 FIG. 1 is a structural block diagram of another embodiment of the control device of the speech device provided by the present invention. Fig.14 As shown, the control device 100 of the voice device further includes: a fourth receiving unit 170 , a second judging unit 171 , and an executing unit 172 .

[0128] The fourth receiving unit 170 is used to receive a second control instruction; the second judging unit 171 is used to judge whether the received second control instruction is executed by the corresponding voice device; the executing unit 172 is used to, if it is judged that the received second control instruction is executed by the corresponding voice device, then the corresponding voice device performs a corresponding operation according to the second control instruction; the second sending unit 173 is used to, if it is judged that the received second control instruction is not executed by the corresponding voice device, then send the second control instruction to the corresponding device in the device network through the routing gateway, and the corresponding device performs a corresponding operation.

[0129] The second control instruction may specifically be a voice control instruction. For example, when a user turns off a fan by voice control, the voice air conditioner determines that the voice control instruction is not for controlling itself, that is, it is not executed by the voice air conditioner, and then sends the fan shutdown instruction to the gateway router, which forwards the instruction to the fan, and the fan executes the shutdown instruction after receiving the fan shutdown instruction.

[0130] The present invention also provides a storage medium corresponding to the control method of the voice device, on which a computer program is stored, and when the computer program is executed by a processor, the steps of any of the above methods are implemented.

[0131] The present invention also provides a voice device corresponding to the control method of the voice device, including a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the aforementioned methods when executing the computer program.

[0132] The present invention also provides a voice device corresponding to the control device of the voice device, comprising any of the control devices described above.

[0133] The present invention also provides a computer program product corresponding to the control method of the voice device, comprising a computer program, and when the computer program is executed by a processor, the steps of any of the aforementioned methods are implemented.

[0134] Based on this, the solution provided by the present invention can broadcast the working status of devices without voice functions through voice devices with voice functions, timely remind users, help users obtain the operating status of devices in time, allow users to handle household affairs in an organized manner, and provide users with a more convenient smart life experience.

[0135] According to the technical solution of the present invention, devices with voice functions can empower devices without voice functions, devices with voice functions can broadcast the operation responses of devices without voice functions, and voice broadcasts the operating status of each device, helping users to obtain the status of devices in their home in time or be reminded in time to understand what they have done before, thereby further enhancing the user's smart life experience.

[0136] The functions described herein may be implemented in hardware, software executed by a processor, firmware, or any combination thereof. If implemented in software executed by a processor, the functions may be stored as one or more instructions or codes on a computer-readable medium or transmitted via a computer-readable medium. Other examples and implementations are within the scope and spirit of the present invention and the appended claims. For example, due to the nature of software, the functions described above may be implemented using software executed by a processor, hardware, firmware, hard wiring, or a combination of any of these. In addition, each functional unit may be integrated into a processing unit, each unit may exist physically separately, or two or more units may be integrated into one unit.

[0137] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0138] The units described as separate components may or may not be physically separated, and the components of the control device may or may not be physical units, that is, they may be located in one place or distributed in multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0139] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the relevant technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

[0140] The above description is only an embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent substitution, improvement, etc. made within the spirit and principle of the present invention shall be included in the scope of the claims of the present invention.

Claims

1. A method for controlling a voice device, characterized in that: The voice device is any voice device in a device network, the device network includes one or more voice devices and one or more devices without voice function, the one or more voice devices and one or more devices without voice function communicate with each other through a routing gateway, the voice device is any voice device in the device network, and the control method includes: Receiving the working status information of the device without voice function in the device network sent by the routing gateway; When receiving the working status information of any device without voice function in the device network sent through the routing gateway, detecting whether there is someone in the room; If it is detected that there is someone in the room, the received working status information is converted into corresponding voice information and broadcasted.

2. The method according to claim 1, characterized in that Also includes: When the device network includes more than two voice devices, detecting the sound in the room; When a preset type of sound is detected in the room, a first notification message is sent to other voice devices in the device network through the routing gateway; Wherein, if any voice device in the device network receives the first notification information through the routing gateway, it detects whether there is someone in the room, and if it is detected that there is someone in the room, it converts the first notification information into corresponding voice information and broadcasts it; and / or, When the device network includes more than two voice devices, receiving second notification information sent by other voice devices in the device network through the routing gateway; Wherein, any voice device in the device network, when detecting a preset type of sound in the room, sends the second notification information through the routing gateway; If the second notification information sent by any other voice device in the device network is received through the routing gateway, it is detected whether there is someone in the room. If it is detected that there is someone in the room, the second notification information is converted into corresponding voice information and broadcasted.

3. The method according to claim 1 or 2, characterized in that: Also includes: When the execution result information is received from any device without voice function in the device network and sent through the routing gateway after executing the first control instruction, the received execution result information is converted into corresponding voice information and broadcasted.

4. The method according to claim 3, characterized in that: Also includes: When receiving execution result information sent by any device without voice function in the device network through the routing gateway after executing the first control instruction, determining whether the device without voice function is an associated device of the voice device; If it is determined that the device without voice function is an associated device of the voice device, the received execution result information is converted into corresponding voice information and broadcasted, and it is detected whether the voice device is running; If it is detected that the associated voice device is running, the control parameters of the associated voice device are adjusted according to the user instruction executed by the associated device.

5. The method according to claim 1 or 2, characterized in that: Also includes: receiving a second control instruction; Determining whether the received second control instruction is executed by the corresponding voice device; If so, the corresponding voice device performs a corresponding operation according to the second control instruction; if not, the second control instruction is sent to the corresponding device in the device network through the routing gateway, and the corresponding device performs a corresponding operation.

6. A control device for a voice device, characterized in that: The voice device is any voice device in the device network, the device network includes more than one voice device and / or more than one device without voice function, the more than one voice device and / or more than one device without voice function communicate with each other through a routing gateway, the voice device is any voice device in the device network, and the control device includes: A first receiving unit, configured to receive working status information of the device without voice function in the device network sent through the routing gateway; A first detection unit, when the first receiving unit receives the working status information of any device without voice function in the device network sent through the routing gateway, detects whether there is someone in the room; The broadcasting unit is used to convert the received working status information into corresponding voice information and broadcast it if the first detection unit detects that there is someone in the room.

7. The device according to claim 6, characterized in that Also includes: A second detection unit, configured to detect sound in a room when the device network includes more than two voice devices; A first sending unit, configured to send first notification information to other voice devices in the device network through the routing gateway when the second detection unit detects a preset type of sound in the room; Wherein, if any voice device in the device network receives the first notification information through the routing gateway, it detects whether there is someone in the room, and if it is detected that there is someone in the room, it converts the first notification information into corresponding voice information and broadcasts it; and / or, A second receiving unit, configured to receive, through the routing gateway, second notification information sent by other voice devices in the device network when the device network includes more than two voice devices; Wherein, any voice device in the device network, when detecting a preset type of sound in the room, sends the second notification information through the routing gateway; The first detection unit is further configured to: if the second receiving unit receives the second notification information sent by any other voice device in the device network through the routing gateway, detect whether there is anyone in the room; The broadcast unit is further used for: if it is detected that there is someone in the room, converting the second notification information into corresponding voice information and broadcasting it.

8. A storage medium, characterized in that: A computer program is stored thereon, and when the program is executed by a processor, the steps of any method described in claims 1-5 are implemented.

9. A voice device, characterized in that: The method comprises a processor, a memory and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any method described in claims 1-5 when executing the program, or comprises a control device described in any one of claims 6-7.

10. A computer program product, characterized in that The invention comprises a computer program, which implements the steps of any one of the methods of claims 1 to 5 when executed by a processor.

Images