Voice control method, device and system based on intelligent equipment, medium and product

Abstract

The invention discloses a voice control method, device and system based on intelligent equipment, a medium and a product. The method comprises the following steps: determining an actual sound source position of a target voice control signal; determining a target intelligent device according to an actual relative distance between the actual sound source position and each intelligent device in the controllable device set and an actual control function in a target voice control instruction associated with the target voice control signal; and sending the target voice control instruction to the target intelligent equipment, so that the target intelligent equipment executes a corresponding operation based on the target voice control instruction. According to the method, the target intelligent equipment can be accurately identified, and the condition of equipment misoperation is avoided; meanwhile, voice control is carried out on the target intelligent device through the target voice control instruction, intelligent and convenient operation of the intelligent device is achieved, manual touch is not needed, the technical problem that in the prior art, intelligent home operation is inconvenient is solved, and the use experience of a user is effectively improved.

Description

Technical Field

[0001] The present invention relates to the field of voice interaction technology, and in particular to a voice control method, device, system, medium and product based on intelligent devices. Background Art

[0002] With the rapid development of smart home technology, people's requirements for the convenience and intelligence of the home environment are increasing day by day. As an indispensable part of daily life, the intelligent control of sanitary ware space equipment is particularly important. Traditional sanitary ware equipment is complex to operate, especially for the elderly and children, there are problems of inconvenient operation. At the same time, there are various equipment in the sanitary ware space, and how to achieve precise control and improve the user experience has become an urgent problem to be solved. Summary of the Invention

[0003] The present invention provides a voice control method, device, system, medium and product based on intelligent devices to solve the technical problem of inconvenient operation of smart homes in the prior art.

[0004] According to one aspect of the present invention, there is provided a voice control method based on intelligent devices, including:

[0005] Determine the actual sound source position of the target voice control signal;

[0006] According to the actual relative distance and relative spatial relationship between the actual sound source position and each intelligent device in the set of controllable devices, and the actual control function in the target voice control instruction associated with the target voice control signal, determine the target intelligent device;

[0007] Control the target intelligent device to perform corresponding operations based on the target voice control instruction.

[0008] According to another aspect of the present invention, there is provided a voice control device based on intelligent devices, including:

[0009] The first determination module is used to determine the actual sound source position of the target voice control signal;

[0010] The second determination module is used to determine the target intelligent device according to the actual relative distance and relative spatial relationship between the actual sound source position and each intelligent device in the set of controllable devices, and the actual control function in the target voice control instruction associated with the target voice control signal;

[0011] The voice control module is used to control the target intelligent device to perform corresponding operations based on the target voice control instruction.

[0012] According to another aspect of the present invention, there is provided a voice control system based on kitchen and bathroom appliances, including: a voice control device and at least two kitchen and bathroom appliances;

[0013] Wherein, the voice control device establishes a communication connection with each of the kitchen and bathroom appliances;

[0014] The actual sound source position of the target voice control signal is determined by the voice control device, and the target kitchen and bathroom appliance is determined according to the actual relative distance and relative spatial relationship between the actual sound source position and each kitchen and bathroom appliance in the set of controllable devices, as well as the actual control function in the target voice control instruction associated with the target voice control signal; and the target kitchen and bathroom appliance is controlled to execute corresponding operations based on the target voice control instruction.

[0015] According to another aspect of the present invention, there is provided a computer-readable storage medium storing computer instructions for causing a second main control module to implement the voice control method based on intelligent devices according to any embodiment of the present invention when executed.

[0016] According to another aspect of the present invention, there is provided a computer program product including a computer program that implements the voice control method based on intelligent devices according to any embodiment of the present invention when executed by a second main control module.

[0017] The technical solution of the embodiment of the present invention can accurately identify the target intelligent device that is in the same spatial area as the user, has the actual control function, and has the smallest actual relative distance from the user, by virtue of the actual relative distance and relative spatial relationship between the actual sound source position of the target voice control signal and each intelligent device in the set of controllable devices, as well as the actual control function in the target voice control instruction, thus avoiding the situation of misoperation of the device; at the same time, the voice control of the target intelligent device is realized through the target voice control instruction, achieving the intelligent and convenient operation of the intelligent device without manual touch, solving the technical problem of inconvenient operation of smart home in the prior art, and effectively improving the user experience.

[0018] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present invention, nor is it used to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] To more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for description in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0020] Figure 1 is a flowchart of a voice control method based on an intelligent device provided by an embodiment of the present invention;

[0021] Figure 2 is a flowchart of another voice control method based on an intelligent device provided by an embodiment of the present invention;

[0022] Figure 3 is an interaction schematic diagram of voice control provided by an embodiment of the present invention;

[0023] Figure 4 is a structural block diagram of a voice control system based on kitchen and bathroom appliances provided by an embodiment of the present invention;

[0024] Figure 5 is another structural block diagram of a voice control system based on kitchen and bathroom appliances provided by an embodiment of the present invention;

[0025] Figure 6 is a configuration schematic diagram of the actual relative distance between a user and various kitchen and bathroom appliances provided by an embodiment of the present invention;

[0026] Figure 7 is an interaction flowchart of a user issuing a voice control command provided by an embodiment of the present invention;

[0027] Figure 8 is a structural schematic diagram of a voice control device provided by an embodiment of the present invention;

[0028] Figure 9 is a structural block diagram of a voice control device provided by an embodiment of the present invention. Detailed implementation manners

[0029] To enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0030] It should be noted that the terms "first", "second", "initial", "target", etc. in the specification, claims and above-mentioned drawings of the present invention are used to distinguish similar objects, and do not necessarily have to be used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present invention described here can be implemented in an order other than those illustrated or described here. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units does not have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0031] It should be noted that the intelligent device can be a kitchen and bathroom device (such as kitchen devices and bathroom devices), a media player device, etc.; different kitchen and bathroom devices or different media player devices can perform the same functions. For example, different kitchen and bathroom devices can perform functions such as water output, hot water output, warm water output, self-cleaning, stop water output and voice playback; different media player devices can play music, videos, news and online news, etc. In the present invention, taking the intelligent device as a kitchen and bathroom device as an example, the voice control method and system are described.

[0032] In one embodiment, Figure 1 is a flowchart of a voice control method based on an intelligent device provided by an embodiment of the present invention. This embodiment is applicable to the situation of voice control of bathroom devices in a bathroom space or each kitchen device in a kitchen space. This method can be executed by a voice control device based on an intelligent device. The voice control device based on an intelligent device can be implemented in the form of hardware and / or software, and the voice control device based on an intelligent device can be configured in a voice control device. As Figure 1 shown, the method includes:

[0033] S110. Determine the actual sound source position of the target voice control signal.

[0034] In one example, the target voice control signal refers to an operation signal with a clear control function sent by a user to the intelligent device in a voice input manner; the actual sound source position is used to characterize the current position of the user who sends the voice control signal in the bathroom space or the kitchen space. Generally speaking, the actual sound source position and the intelligent device to be controlled are in the same spatial area. For example, assuming that the actual sound source position is in the bathroom space, the control function carried by the target voice control signal is only valid for the bathroom devices inside the bathroom space; another example is that assuming that the actual sound source position is in the kitchen, the control function carried by the target voice control signal is only valid for the kitchen devices inside the kitchen.

[0035] In the actual operation process, the control function carried by the target voice control signal is related to the type of device to be controlled and the functions of the devices available. For example, assuming the intelligent device is a shower, the target voice control signal is a control signal associated with the actual control functions of the shower. For example, the target voice control signal is to turn on the shower and adjust the water temperature to 38°C. Another example, assuming the intelligent device is a range hood, the target voice control signal is a control signal associated with the actual control functions of the range hood. For example, the target voice control signal is to turn on the range hood and adjust the gear to the second gear.

[0036] In one example, a voice collection module can be configured in each intelligent device, and the initial voice control signal issued by the user can be collected through the voice collection module. In one example, the intelligent device can perform signal preprocessing on the initial voice control signal to obtain the target voice control signal, and send the target voice control signal to the voice control device; or, the intelligent device can directly send the initial voice control signal to the voice control device, so that the voice control device performs signal preprocessing on the initial voice control signal to obtain the target voice control signal. Among them, the initial voice control signal refers to the unprocessed voice control signal directly collected through the voice collection module in the intelligent device.

[0037] In one example, different signal feature information of the target voice control signal can be used to determine the actual sound source position of the target voice control signal. In one example, the signal feature information includes at least one of the following: the actual signal intensity value, the actual signal arrival time, and the actual signal arrival direction. In one example, the actual sound source position of the target voice control signal can be determined based on one of the actual signal intensity value, the actual signal arrival time, and the actual signal arrival direction. In one example, the actual sound source position of the target voice control signal can be jointly determined based on at least two of the actual signal intensity value, the actual signal arrival time, and the actual signal arrival direction to improve the positioning accuracy of the sound source position.

[0038] S120. Determine the target intelligent device according to the actual relative distance and relative spatial relationship between the actual sound source position and each intelligent device in the set of controllable devices, and the actual control function in the target voice control instruction associated with the target voice control signal.

[0039] In one example, the set of controllable devices refers to the set of all intelligent devices in the bathroom space that can be voice-controlled; among them, the intelligent devices refer to various devices in the bathroom space. For example, the intelligent devices can include, but are not limited to, one of the following: intelligent toilets, showers, bathroom heaters, bathroom cabinets, bathtubs, etc. In one example, the actual relative distance refers to the interval length between the actual sound source position and the position of each intelligent device in space, which is used to characterize the spatial position relationship between the actual sound source position and the intelligent device. For example, the actual relative distance can be characterized by a straight-line distance or a horizontal distance. In one example, the relative spatial relationship is used to characterize whether the user and the target intelligent device to be controlled are in the same space.

[0040] In one example, the actual control function refers to one of the functions that the user needs the intelligent device to execute included in the target voice control instruction; the target intelligent device refers to the intelligent device that needs to execute the operation instruction associated with the target voice control instruction, and can also be understood as the intelligent device in the set of controllable devices with the smallest relative distance from the actual sound source position and having the actual control function. Generally speaking, the target intelligent device can only be one of the intelligent devices in the set of controllable devices. In the embodiment, the voice control device can calculate the actual relative distance between the actual sound source position and each intelligent device, sort the intelligent devices in the set of controllable devices based on the actual relative distance, then screen out the intelligent devices irrelevant to the actual control function from the set of controllable devices based on the actual control function in the target voice control instruction, re-sort the intelligent devices related to the actual control function according to the actual relative distance, and use the intelligent device with the smallest actual relative distance as the target intelligent device.

[0041] S130. Control the target intelligent device to execute the corresponding operation based on the target voice control instruction.

[0042] In one example, in order to realize the communication connection between each intelligent device and the voice control device, a communication module is configured in each intelligent device and the voice control device. The communication module can be a wireless communication module or a wired communication module, and this is not limited. It can be understood that the intelligent device and the voice control device support wired or wireless communication methods to ensure data transmission between the intelligent device and the voice control device. It should be noted that whether a wired communication method or a wireless communication method is adopted between the intelligent device and the voice control device, the efficiency and stability of the voice control instruction transmission need to be ensured, and transmission delay or packet loss should be avoided.

[0043] In an embodiment, the voice control device can send the target voice control instruction to the target intelligent device through wired or wireless communication. After receiving the target voice control instruction, the target intelligent device performs corresponding related operations according to the target voice control instruction. Exemplarily, assume that the target intelligent device is a shower in a bathroom space, and the target voice control instruction is "turn on the shower and adjust the water temperature to 40 °C". Then, when the shower receives the target voice control instruction, it automatically turns on the shower and adjusts the water outlet temperature of the shower to 40 °C.

[0044] The technical solution of this embodiment can accurately identify the target intelligent device that is in the same spatial area as the user, has the actual control function, and has the smallest actual relative distance from the user, based on the actual sound source position of the target voice control signal and the actual relative distance between each intelligent device in the set of controllable devices, as well as the actual control function in the target voice control instruction, thus avoiding the situation of misoperation of the device. At the same time, by using the target voice control instruction to perform voice control on the target intelligent device, it realizes the intelligent and convenient operation of the intelligent device without manual touch, solves the technical problem of inconvenient operation of smart home in the prior art, and effectively improves the user experience.

[0045] In one embodiment, Figure 2 FIG. is a flowchart of another voice control method based on an intelligent device provided by an embodiment of the present invention. This embodiment further details the determination process of the actual sound source position of the target voice control instruction and the determination process of the target intelligent device on the basis of the above embodiment. As Figure 2 shown, the method includes:

[0046] S210. Obtain the actual signal strength value, actual signal arrival time, and actual signal arrival direction of each intelligent device in the set of controllable devices for the target voice control signal.

[0047] In an example, the signal feature information is used to characterize the relevant feature information of each intelligent device receiving the target voice control signal. In one embodiment, the signal feature information includes at least one of the following: actual signal strength value, actual signal arrival time, and actual signal arrival direction. Among them, the actual signal strength value is used to characterize the signal strength of the initial voice control signal received by each intelligent device; the actual signal arrival time is used to characterize the time stamp of each intelligent device receiving the initial voice control signal; the actual signal arrival direction is used to characterize the incoming wave direction of each intelligent device receiving the initial voice control signal.

[0048] In one example, when a user emits a voice signal, since the distances for the sound to travel to different smart devices are different, correspondingly, the times for the voice signal to reach each smart device are also different. That is, the initial voice control signal can be collected by the voice collection module in the smart device, and the timestamp of the collected initial voice control signal is used as the actual signal arrival time. In one example, when the user emits an initial voice control signal, since the positions of different smart devices in the bathroom space are different, correspondingly, the phases and amplitudes of the initial voice control signal reaching different smart devices also change. That is, the actual signal arrival direction of the voice signal can be determined by analyzing the phase difference and amplitude difference of the initial voice control signal received by the smart device. In one example, the positions of each smart device in the bathroom space are different. Correspondingly, when the user emits an initial voice control signal, the actual signal strength values of the initial voice control signal received by smart devices at different positions are also different.

[0049] S220. Determine the actual sound source position of the target voice control signal based on at least one of the actual signal strength value, the actual signal arrival time, and the actual signal arrival direction.

[0050] In one embodiment, determining the actual sound source position of the target voice control signal based on the actual signal arrival time includes: determining the actual signal time difference between different smart devices based on the actual signal arrival time of each smart device in the controllable device set for the target voice control signal; determining the actual distance difference between different smart devices based on the actual signal time difference; and determining the actual sound source position of the target voice control signal according to the intersection points of the curves drawn according to the actual distance difference. In one example, the actual signal time difference refers to the difference between the actual signal arrival times of different smart devices for the target voice control signal; the actual distance difference is used to represent the difference between the actual distances of different smart devices for the target voice control signal. In the embodiment, each smart device in the controllable device set can be used as a monitoring station, and then the voice signals from the same signal source are received simultaneously, and the time for the voice signal to reach each monitoring station is measured as the actual signal arrival time; then the actual signal arrival times of each smart device for the target voice control signal are subtracted to obtain the actual signal time difference between different smart devices; then the actual signal time difference is converted into an actual distance difference based on the signal transmission speed (for example, the speed of light in a vacuum), that is, the distance difference for the target voice control signal to reach different smart devices; then based on these actual distance differences, multiple hyperbolas or hyperboloids can be drawn in a two-dimensional or three-dimensional space, and the intersection points of these hyperbolas or hyperboloids are used as the actual sound source position of the target voice control signal.

[0051] In one embodiment, determining the actual sound source position of the target voice control signal based on the actual direction of signal arrival includes: determining the actual signal phase difference between different intelligent devices for the target voice control signal based on the actual signal arrival time of each intelligent device in the controllable device set for the target voice control signal; determining the arrival direction of each intelligent device for the target voice control signal based on the actual signal phase difference; and determining the actual sound source position of the target voice control signal according to the arrival direction and the geometric layout of the voice collection module in each intelligent device. In an example, the actual signal phase difference refers to the difference between the actual signals of different intelligent devices for the target voice control signal. In the embodiment, each intelligent device in the controllable device set can be used as a voice collection module (also referred to as a voice collection sensor), and then an array composed of voice collection sensors in multiple intelligent devices is used to receive voice signals from the same signal source, and the actual signal phase difference or time delay difference between the voice signals received by the array is analyzed. Based on the actual signal phase difference or time delay difference, the arrival direction of the voice signal is estimated; then, combined with the geometric layout of the array and the estimated arrival direction, the actual sound source position of the target voice control signal is calculated through triangulation or other geometric algorithms.

[0052] In one embodiment, determining the actual sound source position of the target voice control signal based on the actual signal intensity value includes: obtaining the relative spacing between the voice collection modules in each intelligent device in the controllable device; and determining the actual sound source position of the target voice control signal based on the relative spacing and the actual signal intensity value of each intelligent device for the target voice control signal. In an example, a voice collection sensor array can be formed by voice collection modules in multiple intelligent devices, and the intensity of the voice signals received by each sensor in the voice collection sensor array is measured as the actual signal intensity value of the target voice control signal. By comparing the signal intensity differences received by each voice collection sensor, the general direction and distance range of the actual sound source from which the target voice control signal is emitted can be initially determined; then, a geometric algorithm is used to determine the actual sound source position of the target voice control signal. For example, based on the intensity difference between two adjacent voice collection sensors and the relative spacing between the sensors, and according to the attenuation law and geometric relationship of the actual signal intensity value, the vertical distance from the sound source to the voice collection sensor array and the direction angle of the sound source can be calculated, and thus the actual sound source position of the target voice control signal can be determined.

[0053] S230. According to the relative spatial relationship between the actual sound source position and each intelligent device in the controllable device set, all intelligent devices located in the same spatial region as the actual sound source position are screened out to form an initial device set.

[0054] In one example, the process of determining the relative spatial relationship between the actual sound source position and each intelligent device in the set of controllable devices includes: determining the relative azimuth of the actual sound source with respect to each intelligent device according to the actual sound source position and the actual position of each intelligent device in the set of controllable devices; and determining the relative spatial relationship between the actual sound source position and each intelligent device in the set of controllable devices according to the relative azimuth of the actual sound source with respect to each intelligent device. Wherein, the actual position of each intelligent device refers to the actual spatial position of each intelligent device in the corresponding spatial area, and the actual position of the intelligent device includes: the actual spatial position of the kitchen device in the spatial area of the kitchen, and the actual spatial position of the bathroom device in the spatial area of the bathroom. In one example, the relative azimuth of the actual sound source with respect to each intelligent device refers to the relative direction in which the actual sound source position is located with respect to each intelligent device. For example, it can be located in the southeast direction of intelligent device 1 and in the due south direction of intelligent device 2, etc. In one example, the relative spatial relationship between the actual sound source position and each intelligent device in the set of controllable devices can be characterized by the position relationship, distance relationship, direction relationship, angle relationship, and spatial layout relationship between the actual sound source position and each intelligent device in the set of controllable devices. Among them, the spatial layout relationship is used to characterize whether the actual sound source position is included in the spatial area where each intelligent device in the set of controllable devices is located. In an embodiment, the relative azimuth of the actual sound source with respect to each intelligent device can be determined according to the actual sound source position and the actual position of each intelligent device in the set of controllable devices, and the relative position, relative distance, and relative angle between the actual sound source position and each intelligent device in the set of controllable devices can be determined based on the relative azimuth, and the relative spatial relationship between the actual sound source position and each intelligent device in the set of controllable devices can be determined based on the relative position, relative distance, relative angle, and relative azimuth between the actual sound source position and each intelligent device in the set of controllable devices. After determining the relative spatial relationship between the actual sound source position and each intelligent device in the set of controllable devices, all intelligent devices located in the same spatial area as the actual sound source position can be screened out to form an initial device set.

[0055] In one example, the actual position of the user associated with the actual sound source can also be directly detected by using the human body detection and tracking method, and all intelligent devices located in the same spatial area as the actual position can be screened out to form an initial device set.

[0056] In one example, an infrared human body detection module can also be set at the entrance of each spatial area to determine the spatial area where the user is located through the infrared human body detection module, that is, to obtain the actual position of the user, and then all intelligent devices located in the same spatial area as the actual position of the user can be screened out to form an initial device set.

[0057] S240. Screen the initial device set according to the actual control function in the target voice control instruction to obtain all intelligent devices with the actual control function, and form a candidate device set.

[0058] In one example, the candidate device set refers to all intelligent devices with the actual control function in the controllable device set; the candidate device set can be a subset of the controllable device set, that is, the number of devices included in the candidate device set is less than or equal to the number of devices included in the controllable device set. Exemplarily, assume that the actual control function in the target voice control instruction is "adjust the water temperature to 38°C", and the controllable device set includes a bathroom heater, a smart toilet, a bathroom cabinet, a shower, and a bathtub; screening the controllable device set according to the actual control function, the devices with the water temperature instruction can be screened out as the smart toilet, the shower, and the bathtub, and then these three intelligent devices form the candidate device set.

[0059] S250. Find the intelligent device with the smallest actual relative distance from the candidate device set to the actual sound source position as the target intelligent device.

[0060] In one example, sort each intelligent device in the candidate device set in descending or ascending order according to the relative distance between each intelligent device and the actual sound source position, and use the intelligent device with the smallest relative distance from the actual sound source position as the target intelligent device.

[0061] Of course, in one example, it is also possible to sort each intelligent device in the controllable device set in descending or ascending order according to the relative distance between each intelligent device and the actual sound source position, and then remove the intelligent devices irrelevant to the actual control function from the sorted controllable device set, so as to obtain the sorted candidate device set, and find the intelligent device with the smallest relative distance from the sorted candidate device set to the actual sound source position as the target intelligent device.

[0062] S260. Control the target intelligent device to execute the corresponding operation based on the target voice control instruction.

[0063] Based on the technical solution of the above embodiment, one or more sound source localization algorithms can be used to localize the sound source of the voice signal associated with the target voice control instruction in this embodiment, realizing the accurate localization of the actual sound source position, being able to accurately judge the position where the user makes a sound in the bathroom space, and then accurately identifying the target intelligent device, avoiding misoperation of other intelligent devices.

[0064] In one embodiment, before determining the actual sound source position of the target voice control signal, it further includes: obtaining an initial voice control signal associated with at least one intelligent device in the set of controllable devices; performing signal preprocessing on the initial voice control signal to obtain the target voice control signal. In one example, the signal preprocessing may include operations such as signal noise reduction and signal enhancement. In the embodiment, the voice control device can receive the initial voice control signal sent by the intelligent device, and then perform signal preprocessing operations such as noise reduction and signal enhancement on the initial voice control signal to obtain the target voice control signal, effectively improving the recognition rate of the target voice control signal.

[0065] In one embodiment, obtaining an initial voice control signal associated with at least one intelligent device in the set of controllable devices includes: receiving the initial voice control signal of at least one intelligent device in the set of controllable devices collected by a control terminal associated with the intelligent device; or, receiving the initial voice control signal collected by at least one intelligent device in the set of controllable devices.

[0066] In one example, the control terminal may be a relevant terminal that establishes a wireless communication connection with the intelligent device, and the control terminal needs to have a voice collection function. Exemplarily, the control terminal may be a control platform or a mobile terminal such as a smart phone. In one example, the initial voice control signal can be collected by the control terminal that establishes a wireless communication connection with the intelligent device, and the initial voice control signal can be sent to the voice control device through the control terminal, and the voice control device performs signal preprocessing on the initial voice control signal to obtain the target voice control signal.

[0067] In one example, after the user issues the initial voice control signal, the target intelligent device closest to the user can receive the initial voice control signal, and the target intelligent device sends the initial voice control signal to the voice control device, and the voice control device performs signal preprocessing on the initial voice control signal to obtain the target voice control signal, and then the voice control device converts the target voice control signal into a target voice control instruction, and determines the target intelligent device based on the actual control function included in the target voice control instruction and the actual relative distance to the actual sound source position being the smallest, and sends the target voice control to the target intelligent device, so that the target intelligent device can quickly respond to the target voice control instruction and perform operations related to the target voice control instruction, and can also coordinate with other intelligent devices. In one example, multiple intelligent devices can respond to the same target voice control instruction at the same time. At this time, the voice control device can ensure the accurate execution of the target voice control instruction on the target intelligent device and the reasonable allocation of the target intelligent device through its intelligent scheduling ability.

[0068] In one embodiment, a voice control method based on an intelligent device further includes: receiving an operation execution result fed back by a target intelligent device; determining the device health status of the target intelligent device according to the operation execution result. In an example, a voice playback module and a display screen can be configured in the voice control device. The operation execution result fed back by the target intelligent device can be played through the voice playback module; alternatively, the operation execution result fed back by the target intelligent device can be displayed through the display screen. In an example, the operation execution result is used to represent the status information generated after the target intelligent device executes the target voice control instruction. For example, the operation execution result may include: all operations are successfully executed; all operations are not successfully executed; only some operations are successfully executed; the device health status is used to represent the result of evaluating the various performances, operating conditions, and functional integrity of the intelligent device. The device health status may include, but is not limited to, at least one of the following: the hardware status of the intelligent device, the software system status, and the functional performance status; for example, the hardware status may include, but is not limited to, at least one of the following: the status of key components and the appearance damage situation; the software system status may include, but is not limited to, at least one of the following: the system operation stability and the network connection status; the functional performance status may include, but is not limited to, at least one of the following: functional integrity and performance indicators, etc. In the embodiment, after the intelligent device executes the operations related to the target voice control instruction, the intelligent device can feed back its own operation execution result to the voice control device through a wired communication method or a wireless communication method. The voice control device can display the operation execution result on its own display screen so that the user can more intuitively view the operation execution result of the target intelligent device; alternatively, the operation execution result can be broadcast in voice form through the voice playback module in the voice control device so that the user can directly hear the operation execution result, enabling the user to more simply and quickly obtain the operation execution result of the target intelligent device. At the same time, the voice control device can determine the evaluation results of the various performances, operating status, and functional integrity of the target intelligent device based on whether the target intelligent device has successfully executed all operations, the related operations that have been successfully executed, and the related operations that have not been successfully executed. Thus, the user can timely understand the device health status based on the operation execution result and can perform repairs in a timely manner, thereby extending the service life of the target intelligent device as much as possible and reducing the repair cost of the target intelligent device.

[0069] In one embodiment, Figure 3It is an interaction schematic diagram of voice control provided by an embodiment of the present invention. On the basis of the above embodiment, as a preferred embodiment, the intelligent device is a kitchen and bathroom device, the voice control device can be an integrated central control system, and the voice collection module in the voice control device is a microphone array. Moreover, taking the kitchen and bathroom device to preprocess the collected initial voice control instruction as an example, the voice control interaction process among the user, the kitchen and bathroom device, and the voice control device will be described. As Figure 3 shown, the voice control interaction process in this embodiment includes the following steps:

[0070] S310. The user issues an initial voice control signal.

[0071] S320. The microphone array in the kitchen and bathroom device collects the initial voice control signal.

[0072] S330. Preprocess the initial voice control signal to obtain a target voice control signal.

[0073] In one example, the preprocessing operations on the initial voice control signal may include operations such as filtering and noise reduction to obtain a target voice control signal; then, extract the signal feature information in the target voice control signal. For example, the signal feature information may include: the actual signal strength value, the actual signal arrival time, and the actual signal arrival direction. Among them, the time difference of arrival can be calculated through the actual signal arrival time, and the interaural level difference (ILD) can be calculated through the actual signal arrival direction.

[0074] S340. Send the target voice control signal and the signal feature information to the integrated central control system through the communication module.

[0075] S350. Obtain the actual sound source position of the target voice control signal through the sound source localization algorithm.

[0076] In one example, the specific position of the sound source can be calculated through the time difference of arrival (TDOA) algorithm and the direction of arrival (DOA) algorithm.

[0077] S360. Convert the target voice control signal into a target voice control instruction.

[0078] In one example, through advanced voice recognition technology, the target voice control signal is parsed and converted into a corresponding target voice control instruction.

[0079] S370. Screen the kitchen and bathroom devices in the set of controllable devices to obtain a set of candidate devices.

[0080] In an embodiment, based on the actual control function included in the target voice control instruction, all kitchen and bathroom appliances connected to the integrated central control system are filtered to exclude those without such actual control function. Then, based on the relative distance between the actual sound source position and each kitchen and bathroom appliance, the kitchen and bathroom appliance with the minimum relative distance to the actual sound source position is determined as the target kitchen and bathroom appliance.

[0081] S380. Send the target voice control instruction to the target kitchen and bathroom appliance through the communication module.

[0082] S390. Execute the operation corresponding to the target voice control instruction.

[0083] After the target kitchen and bathroom appliance receives the target voice control instruction, corresponding operations are executed.

[0084] S3100. Send the operation execution result of the target voice control instruction.

[0085] After the target kitchen and bathroom appliance executes the target voice control instruction, send the corresponding operation execution result to the integrated central control system through the communication module.

[0086] In one embodiment, Figure 4 is the structural block diagram of a voice control system for kitchen and bathroom appliances provided by an embodiment of the present invention. As Figure 4 shown, the voice control system for kitchen and bathroom appliances in this embodiment includes: a voice control device 410 and at least two kitchen and bathroom appliances 420;

[0087] Among them, the voice control device 410 establishes a communication connection with each kitchen and bathroom appliance 420;

[0088] The actual sound source position of the target voice control instruction is determined through the voice control device 410, and the target kitchen and bathroom appliance is determined based on the actual relative distance and relative spatial relationship between the actual sound source position and each kitchen and bathroom appliance 420 in the set of controllable devices, as well as the actual control function in the target voice control instruction associated with the target voice control signal; and the target kitchen and bathroom appliance is controlled to execute corresponding operations based on the target voice control instruction.

[0089] In one embodiment, the target kitchen and bathroom appliance is the one with the minimum actual relative distance to the actual sound source position found from the candidate device set; the candidate device set is the set of all kitchen and bathroom appliances with actual control functions obtained by screening the initial device set according to the actual control function of the target voice control instruction; the initial device set is the set of all kitchen and bathroom appliances in the same spatial area as the actual sound source position screened according to the relative spatial relationship between the actual sound source position and each kitchen and bathroom appliance in the set of controllable devices.

[0090] In an embodiment, at least one kitchen and bathroom device 420 in the set of controllable devices can receive an initial voice control signal issued by a user, and send the initial voice control signal to the voice control device 410 through its own communication module; then the voice control device 410 preprocesses the initial voice control signal to obtain a target voice control signal; then the voice control device 410 uses a sound source localization algorithm to determine the actual sound source position of the target voice control signal, and converts the target voice control signal into a corresponding target voice control instruction through voice recognition technology, and searches in the set of controllable devices for the kitchen and bathroom device with the smallest actual relative distance from the actual sound source position and associated with the actual control function in the target voice control instruction as the target kitchen and bathroom device; then controls the target kitchen and bathroom device to execute corresponding operations based on the target voice control instruction, effectively realizing the intelligent and convenient operation of the kitchen and bathroom devices, without manual touch, solving the technical problem of inconvenient operation of smart homes in the prior art, and effectively improving the user experience.

[0091] In one embodiment, the kitchen and bathroom device includes: a first communication module, a voice collection module, and a first main control module; the voice control device includes: a second communication module and a second main control module; wherein, a communication connection is established between the kitchen and bathroom device and the voice control device through the communication module; the initial voice control instruction is collected through the voice collection module in the kitchen and bathroom device, and the initial voice control instruction is preprocessed by the first main control module to obtain a target voice control instruction, and the target voice control instruction and associated signal feature information are sent to the second main control module in the voice control device through the first communication module and the second communication module. In one example, the first communication module included in the kitchen and bathroom device and the second communication module included in the voice control device can be communication modules of the same communication method. For example, when the first communication module is a wired communication module, the corresponding second communication module is also a wired communication module; when the first communication module is a wireless communication module, the corresponding second communication module is also a wireless communication module. In one example, the kitchen and bathroom device can include both a wired communication module and a wireless communication module. Similarly, the voice control device can also include both a wired communication module and a wireless communication module. In one example, the first main control module included in the kitchen and bathroom device and the second main control module included in the voice control device can be main control modules of the same function, used to execute computer programs such as related voice control instructions. Exemplarily, both the first main control module and the second main control module can be MCUs.

[0092] In one embodiment, the voice control device further includes: a display screen; wherein, the display screen is connected to the second main control module in the voice control device; and the actual operating parameters of the target kitchen and bathroom device are displayed on the display screen. In one example, the actual operating parameters refer to the current operating parameters of each kitchen and bathroom device. After the target kitchen and bathroom device executes the target voice control instruction, the operation execution result of the kitchen and bathroom device after executing the target voice control instruction can be displayed on the display screen. Of course, the current operating parameters of any one or more kitchen and bathroom devices in the set of controllable devices can also be displayed on the display screen of the voice control device, so that the user can intuitively view the current operating parameters of each kitchen and bathroom device and more intuitively determine the current operating state of each kitchen and bathroom device.

[0093] In one embodiment, Figure 5 FIG. is a structural block diagram of another voice control system based on kitchen and bathroom devices provided by an embodiment of the present invention. Based on the above embodiment, this embodiment illustrates the structure of the voice control system when the voice control system is applied to a bathroom space, that is, the corresponding kitchen and bathroom devices are bathroom devices. In this embodiment, taking the voice control device as an integrated central control system, the bathroom devices include: a bath heater, a shower, a toilet, a bathtub, and a bathroom cabinet. The first main control module and the second main control module are both MCUs, the first communication module and the second communication module are collectively referred to as the communication module, and the voice collection module is a microphone module. Taking the display screen as a control panel as an example, the structure of the voice control system is described. As Figure 5 shown, the structure of the voice control system in this embodiment is as follows:

[0094] Each of the bath heater, the shower, the toilet, the bathtub, and the bathroom cabinet includes a microphone array, a communication module, and an MCU; on the basis of including an MCU and a communication module in the integrated central control system, the integrated central control system further includes a storage module, an RTC, a control panel, and a power module; wherein, the storage module is used to store information such as voice control instructions and actual control functions, and the power module is used to supply power to the integrated central control system to ensure the normal operation of the integrated central control system; the RTC is used to ensure the clock synchronization between the integrated central control system and each kitchen and bathroom device; the control panel can be understood as an operation interface for interaction between the user and the device, and for setting, controlling, and displaying the current operating parameters of each kitchen and bathroom device.

[0095] In one example, the microphone (mic) module is integrated into each kitchen and bathroom device in the bathroom space and is used to collect the initial voice control signal issued by the user.

[0096] The integrated central control system is used to receive the voice control signal transmitted by the microphone module and perform sound source localization on the voice control signal; then convert the voice control signal to obtain the target voice control instruction; then parse the target voice control instruction and convert the target voice control instruction into a target voice control signal to be sent to the target kitchen and bathroom equipment.

[0097] Kitchen and bathroom equipment refers to various kitchen and bathroom equipment in the bathroom space, such as intelligent toilets, showers, bathroom heaters, bathroom cabinets, bathtubs, etc., which are used to receive the target voice control signal from the integrated central control system and perform corresponding actions.

[0098] Communication module: Supports wired or wireless communication methods to ensure data transmission between the microphone module, the integrated central control system, and the kitchen and bathroom equipment.

[0099] In this solution, the multi-microphone array technology is used, combined with the TDOA algorithm, DOA algorithm, and signal strength distribution algorithm for distance estimation to accurately locate the sound source position of the user's voice; and an acoustic propagation model and signal processing algorithm can be used to improve the accuracy and robustness of sound source localization.

[0100] The following example takes the target voice control instruction input by the user as "adjust the water temperature to 38°C" as a typical case to show how the voice control system responds and executes control operations.

[0101] Similarly, this interaction can be seamlessly applied to voice instructions for other device function controls or parameter adjustments, such as "adjust the water temperature", "turn on the warm air", and "adjust the air temperature".

[0102] Taking the voice control system based on bathroom equipment as an example, when the user stands in the bathroom space and issues the voice instruction "adjust the water temperature to 38°C", the nearest microphone module captures the instruction and transmits it to the integrated central control system. The integrated central control system determines the actual sound source position of the user through sound source localization and parses the actual control function included in the instruction in combination with voice recognition technology. Subsequently, based on the relative distance between the user's actual sound source position and the actual positions of each bathroom equipment with the water temperature adjustment instruction, it is determined that the bathroom equipment closest to the user is the intelligent toilet, and then the target voice control instruction of "adjust the water temperature to 38°C" is sent to the intelligent toilet with the water temperature modulation instruction. The intelligent toilet adjusts the washing water temperature to the comfortable temperature set by the user according to the target voice control instruction. This interaction can be seamlessly applied to voice instructions for other device function controls or parameter adjustments, such as "turn on the light", "turn on the warm air", and "adjust the water temperature".

[0103] It should be noted that these devices are all built-in with microphone (microphone) modules.

[0104] In one embodiment, Figure 6It is a schematic diagram of the configuration of the actual relative distance between the user and various kitchen and bathroom appliances provided by an embodiment of the present invention. As Figure 6 shown, the actual relative distances between the user and various kitchen and bathroom appliances are A (user, sound source --> bathroom heater), B (user, sound source --> toilet), C (user, sound source --> bathroom cabinet), D (user, sound source --> shower), and E (user, sound source --> bathtub).

[0105] Then, by sorting the actual relative distances through the integrated central control system, the distance sorting from the actual sound source position to each kitchen and bathroom appliance in the bathroom space can be obtained as: B < C < A < D < E.

[0106] Then, the integrated central control system filters out the kitchen and bathroom appliances associated with the actual control functions of the target voice control instruction. For example, the appliances with water temperature instructions are: B. Toilet (washing water temperature), D. Shower (outlet water temperature), E. Bathtub (outlet water temperature); the appliances without water temperature instructions are: A. Bathroom heater, C. Bathroom cabinet. Thus, the candidate device set can be obtained, including the toilet, shower, and bathtub.

[0107] Then, the integrated central control system sorts according to the actual relative distances between the actual sound source position and the appliances with water temperature instructions: B < D < E.

[0108] Figure 7 It is an interaction flowchart of a user issuing a voice control instruction provided by an embodiment of the present invention. The specific interaction process when the user issues a voice instruction "Adjust the water temperature to 38°C" is as Figure 7 shown.

[0109] First, the user stands in front of the toilet and issues an initial voice control signal of "Adjust the water temperature to 38°C". The built-in microphone of the device captures the initial voice control signal issued by the user and performs preprocessing such as noise reduction on the initial voice control signal to obtain a target voice control signal.

[0110] Then, the kitchen and bathroom appliance sends the target voice control signal obtained through preprocessing to the integrated central control system through the communication module.

[0111] Then, the integrated central control system uses voice recognition technology to convert the target voice control signal into a corresponding target voice control instruction, determines the actual sound source position according to the principle algorithm of time difference of arrival (TDOA) sound source localization, and determines the distance sorting from the actual sound source position to each kitchen and bathroom appliance as: B < C < A < D < E, and eliminates the kitchen and bathroom appliances A (bathroom cabinet) and C (bathroom heater) that do not have this instruction (adjust the water temperature to 38°C) to obtain a candidate device set, and determines the sorting of the relative distances between each kitchen and bathroom appliance in the candidate device set and the actual sound source position as: B < D < E, and finds the target kitchen and bathroom appliance B (toilet).

[0112] Then, the integrated central control system sends the target voice control instruction "adjust the water temperature to 38°C" to the target kitchen and bathroom device B (toilet) through the communication module, and the target kitchen and bathroom device B (toilet) adjusts the water temperature to 38°C according to the target voice control instruction.

[0113] Finally, the target kitchen and bathroom device B (toilet) feeds back the temperature adjustment result to the integrated central control system through the communication module.

[0114] In one embodiment, Figure 8 is a schematic structural diagram of a voice control device based on intelligent devices provided by an embodiment of the present invention. In this embodiment, the voice control device based on intelligent devices can be integrated as a logic module in the voice control device. For example, each logic module in the voice control device can be integrated in the second main control module of the voice control device. As Figure 8 shown, the device includes: a first determination module 810, a second determination module 820, and a voice control module 830.

[0115] The first determination module 810 is used to determine the actual sound source position of the target voice control signal;

[0116] The second determination module 820 is used to determine the target intelligent device according to the actual relative distance and relative spatial relationship between the actual sound source position and each intelligent device in the set of controllable devices, and the actual control function in the target voice control instruction associated with the target voice control signal;

[0117] The voice control module 830 is used to control the target intelligent device to perform corresponding operations based on the target voice control instruction.

[0118] In one embodiment, the first determination module 810 includes:

[0119] An acquisition unit is used to acquire the actual signal strength value, actual signal arrival time, and actual signal arrival direction of each intelligent device in the set of controllable devices for the target voice control signal;

[0120] A first determination unit is used to determine the actual sound source position of the target voice control signal based on at least one of the actual signal strength value, actual signal arrival time, and actual signal arrival direction.

[0121] In one embodiment, the second determination module 820 includes:

[0122] A first screening unit is used to screen out all intelligent devices in the same spatial region as the actual sound source position according to the relative spatial relationship between the actual sound source position and each intelligent device in the set of controllable devices, and form an initial device set;

[0123] A second screening unit, configured to screen devices from the initial device set according to the actual control function in the target voice control instruction, so as to obtain all intelligent devices with the actual control function, and form a candidate device set;

[0124] A second determination unit, configured to find the intelligent device with the smallest actual relative distance from the candidate device set to the actual sound source position as the target intelligent device.

[0125] In one embodiment, the process of determining the relative spatial relationship between the actual sound source position and each intelligent device in the controllable device set includes:

[0126] Determining the relative azimuth of the actual sound source for each intelligent device according to the actual sound source position and the actual position of each intelligent device in the controllable device set;

[0127] Determining the relative spatial relationship between the actual sound source position and each intelligent device in the controllable device set according to the relative azimuth of the actual sound source for each intelligent device.

[0128] In one embodiment, before determining the actual sound source position of the target voice control signal, the voice control device further includes:

[0129] An acquisition module, configured to acquire an initial voice control signal associated with at least one intelligent device in the controllable device set;

[0130] A preprocessor module, configured to perform signal preprocessing on the initial voice control signal to obtain a target voice control signal.

[0131] In one embodiment, the acquisition module is specifically configured to:

[0132] Receive an initial voice control signal of at least one intelligent device in the controllable device set collected by a control terminal associated with the intelligent device; or,

[0133] Receive an initial voice control signal collected by at least one intelligent device in the controllable device set.

[0134] In one embodiment, the voice control device further includes:

[0135] A receiving module, configured to receive an operation execution result fed back by the target intelligent device;

[0136] A third determination module, configured to determine the device health status of the target intelligent device according to the operation execution result.

[0137] The voice control device based on intelligent devices provided by the embodiments of the present invention can execute the voice control method based on intelligent devices provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method.

[0138] In one embodiment, Figure 9 is a structural block diagram of a voice control device based on an intelligent device provided by an embodiment of the present invention. As Figure 9 shown, it shows a schematic structural diagram of a voice control device 10 that can be used to implement the embodiments of the present invention. The voice control device is intended to represent various forms of digital computers, such as, for example, laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The voice control device can also represent various forms of mobile devices, such as, for example, personal digital processors, cellular telephones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0139] As Figure 9 shown, the voice control device 10 includes at least one second main control module 11, and a memory communicatively connected to the at least one second main control module 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc. Among them, the memory stores a computer program executable by the at least one second main control module. The second main control module 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the voice control device 10 can also be stored. The second main control module 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. The input / output (I / O) interface 15 is also connected to the bus 14.

[0140] Multiple components in the voice control device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a second communication module 19, such as a network card, a modem, a wireless communication transceiver, etc. The second communication module 19 allows the voice control device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0141] The second main control module 11 may be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the second main control module 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The second main control module 11 executes the various methods and processes described above, such as the voice control method based on the smart device.

[0142] In some embodiments, the voice control method based on the smart device may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed onto the voice control device 10 via the ROM 12 and / or the second communication module 19. When the computer program is loaded into the RAM 13 and executed by the second main control module 11, one or more steps of the voice control method based on the smart device described above may be executed. Alternatively, in other embodiments, the second main control module 11 may be configured to execute the voice control method based on the smart device in any other suitable manner (e.g., by means of firmware).

[0143] Various embodiments of the systems and techniques described above in this document may be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGA), application-specific integrated circuits (ASIC), application-specific standard products (ASSP), system-on-chip systems (SOC), complex programmable logic devices (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs being executable and / or interpretable on a programmable system including at least one programmable processor, the programmable processor being a special or general-purpose programmable processor, receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting the data and instructions to the storage system, the at least one input device, and the at least one output device.

[0144] The computer program for implementing the method of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowchart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0145] In the context of the present invention, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer-readable storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, the computer-readable storage medium can be a machine-readable signal medium. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0146] To provide for interaction with a user, the systems and techniques described herein can be implemented on a voice control device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the voice control device. Other kinds of devices can also be used to provide for interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, speech input, or tactile input).

[0147] The systems and techniques described herein can be implemented in a computing system that includes a back-end component (e.g., as a data server), or a computing system that includes a middleware component (e.g., an application server), or a computing system that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which the user can interact with an implementation of the systems and techniques described herein), or a computing system that includes any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0148] A computing system may include a client and a server. The client and the server are generally far from each other and usually interact via a communication network. The relationship between the client and the server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system, and solves the defects of difficult management and weak business scalability existing in traditional physical hosts and VPS services.

[0149] An embodiment of the present invention also provides a computer program product, including a computer program, which can implement the voice control method based on an intelligent device provided in any embodiment of the present application when executed by a second main control module.

[0150] In the process of implementing the computer program product, computer program code for performing the operations of the present application can be written in one or more programming languages or combinations thereof. The programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network - including a local area network (LAN) or a wide area network (WAN) - or can be connected to an external computer (for example, by using an Internet service provider to connect through the Internet).

[0151] It should be understood that various forms of the processes shown above can be used, reordering, adding, or deleting steps. For example, the steps described in the present invention can be executed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved, and no limitation is made herein.

[0152] The above specific embodiments do not constitute a limitation on the protection scope of the present invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims

1. A voice control method based on an intelligent device, characterized in that: include: Determine the actual sound source position of the target voice control signal; Determine the target smart device according to the actual relative distance and relative spatial relationship between the actual sound source position and each smart device in the controllable device set, and the actual control function in the target voice control instruction associated with the target voice control signal; Control the target smart device to perform a corresponding operation based on the target voice control instruction.

2. The method according to claim 1, characterized in that: The determining the actual sound source position of the target voice control signal comprises: Obtaining an actual signal strength value, an actual signal arrival time, and an actual signal arrival direction for a target voice control signal for each smart device in the set of controllable devices; The actual sound source position of the target voice control signal is determined based on at least one of the actual signal strength value, the actual signal arrival time, and the actual signal arrival direction.

3. The method according to claim 1, characterized in that The step of determining the target smart device according to the actual relative distance and relative spatial relationship between the actual sound source position and each smart device in the controllable device set, and the actual control function in the target voice control instruction associated with the target voice control signal, comprises: According to the relative spatial relationship between the actual sound source position and each smart device in the controllable device set, all smart devices in the same spatial area as the actual sound source position are screened to form an initial device set; Screening the initial device set according to the actual control function in the target voice control instruction to obtain all smart devices with the actual control function to form a candidate device set; A smart device having the smallest actual relative distance to the actual sound source position is searched from the candidate device set as the target smart device.

4. The method according to claim 3, characterized in that The process of determining the relative spatial relationship between the actual sound source position and each smart device in the controllable device set includes: Determine the relative position of the actual sound source to each smart device according to the actual sound source position and the actual position of each smart device in the set of controllable devices; The relative spatial relationship between the actual sound source position and each smart device in the controllable device set is determined according to the relative position of the actual sound source with respect to each smart device.

5. The method according to any one of claims 1 to 4, characterized in that: Before determining the actual sound source position of the target voice control signal, the method further includes: Acquire an initial voice control signal associated with at least one smart device in the controllable device set; The initial voice control signal is subjected to signal preprocessing to obtain a target voice control signal.

6. The method according to claim 5, characterized in that The obtaining of an initial voice control signal associated with at least one smart device in the set of controllable devices includes: Receiving an initial voice control signal of at least one smart device in the set of controllable devices collected by a control terminal associated with the smart device; or, An initial voice control signal collected by at least one smart device in the controllable device set is received.

7. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Receive the operation execution result fed back by the target smart device; The device health status of the target smart device is determined according to the operation execution result.

8. A voice control device based on an intelligent device, characterized in that: include: A first determination module, used to determine the actual sound source position of the target voice control signal; a second determination module, configured to determine a target smart device according to an actual relative distance and relative spatial relationship between the actual sound source position and each smart device in the set of controllable devices, and an actual control function in a target voice control instruction associated with the target voice control signal; The voice control module is used to control the target smart device to perform corresponding operations based on the target voice control instruction.

9. A voice control system based on kitchen and bathroom equipment, characterized in that: include: voice-controlled devices and at least two kitchen and bathroom fixtures; Wherein, the voice control device establishes a communication connection with each of the kitchen and bathroom equipment; The actual sound source position of the target voice control signal is determined by the voice control device, and the target kitchen and bathroom equipment is determined based on the actual relative distance and relative spatial relationship between the actual sound source position and each kitchen and bathroom equipment in the controllable device set, and the actual control function in the target voice control instruction associated with the target voice control signal; and the target kitchen and bathroom equipment is controlled to perform corresponding operations based on the target voice control instruction.

10. The voice control system according to claim 9, characterized in that: The target kitchen and bathroom equipment is the kitchen and bathroom equipment with the smallest actual relative distance to the actual sound source position found from the candidate equipment set; the candidate equipment set is a set of all kitchen and bathroom equipment with actual control function obtained by screening the initial equipment set according to the actual control function of the target voice control instruction; the initial equipment set is a set of all kitchen and bathroom equipment in the same spatial area as the actual sound source position, screened according to the relative spatial relationship between the actual sound source position and each kitchen and bathroom equipment in the controllable equipment set.

11. The voice control system according to claim 9, characterized in that: The kitchen and bathroom equipment includes: a first communication module, a voice collection module and a first main control module; the voice control device includes: a second communication module and a second main control module; wherein the communication connection between the kitchen and bathroom equipment and the voice control device is established through the communication module; An initial voice control signal is collected by the voice collection module in the kitchen and bathroom equipment, and the initial voice control signal is preprocessed by the first main control module to obtain a target voice control signal, and the target voice control signal and associated signal feature information are sent to the second main control module in the voice control device through the first communication module and the second communication module.

12. The voice control system according to claim 9, characterized in that: The voice control device further comprises: a display screen; wherein the display screen is connected to the second main control module in the voice control device; The actual operating parameters of the target kitchen and bathroom equipment are displayed on the display screen.

13. The voice control system according to claim 11, characterized in that: The voice control device also includes: A memory connected in communication with at least one second main control module; wherein, The memory stores a computer program that can be executed by the at least one second main control module, and the computer program is executed by the at least one second main control module so that the at least one second main control module can execute the voice control method based on kitchen and bathroom equipment described in any one of claims 1-7.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the second main control module to implement the voice control method based on kitchen and bathroom equipment according to any one of claims 1 to 7 when executed.

15. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by the second main control module, the voice control method based on kitchen and bathroom equipment according to any one of claims 1 to 7 is implemented.

Images