Control method and device of smart home equipment, electronic equipment and medium

Abstract

The embodiment of the invention provides a smart home equipment control method and device, electronic equipment and a medium, and the method comprises the steps: obtaining user voice, and recognizing the user voice; if the instruction information of the user voice cannot be identified, determining whether a first function of first smart home equipment bound with the user voice exists; if the first function of the first smart home device bound with the user voice does not exist, recommendation information is output to the user, and the recommendation information is used for recommending the function of the smart home device to the user; acquiring a second function of second smart home equipment selected by the user; and binding and storing the user voice and the second function of the second smart home device. According to the embodiment of the invention, under the condition that the instruction information of the user voice cannot be recognized, the user voice and the function of the smart home equipment selected by the user are bound and stored, so that the voice control function is completed, and the user tolerance is improved.

Description

Technical Field

[0001] The present invention relates to the field of smart home technology, and in particular to a control method, device, electronic device and computer-readable storage medium for smart home equipment. Background Art

[0002] With the rapid development of information technology and the Internet of Things, more and more smart home devices have come into people's view. Smart homes integrate various household devices such as refrigerators, washing machines, air conditioners, socket switches, and curtains through the Internet of Things technology, realizing all-round information interaction functions and providing users with higher comfort and better safety performance. In actual application scenarios, in order to improve user experience, the use of voice commands to control smart home devices is becoming more and more popular.

[0003] In the related art, usually after obtaining the user's voice command, the command text in the voice command is recognized, and then the smart home system is controlled to execute the corresponding command according to the recognized command text, thereby realizing voice control of smart home devices.

[0004] Due to the natural ambiguity and ambiguity of language, the accuracy of speech recognition is low and the errors in the recognized command information are large, resulting in the inability to correctly control smart home devices and a poor user experience. Summary of the invention

[0005] In view of the above problems, embodiments of the present invention are proposed to provide a control method, device, electronic device and computer-readable storage medium for smart home devices that overcome the above problems or at least partially solve the above problems.

[0006] In one aspect, an embodiment of the present invention provides a method for controlling a smart home device, the method comprising:

[0007] Acquire user voice and recognize the user voice;

[0008] If the command information of the user's voice is recognized, the corresponding smart home device is controlled to perform the corresponding function according to the command information;

[0009] If the instruction information of the user voice cannot be recognized, determining whether there is a first function of the first smart home device bound to the user voice;

[0010] If there is no first function of the first smart home device bound to the user voice, output recommendation information to the user, where the recommendation information is used to recommend the function of the smart home device to the user;

[0011] Obtaining a second function of a second smart home device selected by a user;

[0012] The user voice is bound to and stored with the second function of the second smart home device.

[0013] Optionally, before outputting the recommendation information to the user, the method further includes:

[0014] Determining whether there is a historical user voice similar to the user voice;

[0015] If there is a historical user voice similar to the user voice, the third function of the third smart home device bound to the historical user voice is executed.

[0016] Optionally, outputting the recommendation information to the user includes:

[0017] Determine candidate smart home devices, and output device recommendation information for the candidate smart home devices to the user;

[0018] After the user selects the second smart home device from the candidate smart home devices, candidate functions of the second smart home device are determined, and function recommendation information for the candidate functions of the second smart home device is output to the user.

[0019] Optionally, the outputting device recommendation information for the candidate smart home device to the user includes:

[0020] Displaying a device recommendation interface for the candidate smart home device to the user, and broadcasting voice information of the device recommendation interface for the candidate smart home device to the user;

[0021] The outputting the function recommendation information for the candidate function of the second smart home device to the user includes:

[0022] A function recommendation page for the candidate functions of the second smart home device is displayed to the user, and voice information of the function recommendation page for the candidate functions of the second smart home device is broadcast to the user.

[0023] Optionally, outputting the recommendation information to the user includes:

[0024] If the instruction information of the target function of the target smart home device cannot be identified in the user voice, but the target smart home device is identified in the user voice, function recommendation information of the candidate functions of the target smart home device is output to the user.

[0025] Optionally, determining a candidate smart home device includes:

[0026] Obtaining the usage frequency of the smart home device;

[0027] sorting the smart home devices according to the usage frequencies of the smart home devices to obtain first device sorting information;

[0028] Determine candidate smart home devices according to the first device sorting information.

[0029] Optionally, the outputting device recommendation information for the candidate smart home device to the user includes:

[0030] Obtaining the usage frequency of the candidate smart home device;

[0031] sorting the candidate smart home devices according to the usage frequencies of the candidate smart home devices to obtain second device sorting information;

[0032] Generate device recommendation information for the candidate smart home devices according to the second device ranking information.

[0033] Optionally, determining the candidate function of the second smart home device includes:

[0034] Obtaining a usage frequency of a function of the second smart home device;

[0035] sorting the functions of the second smart home devices according to the usage frequencies of the functions of the second smart home devices to obtain first function sorting information;

[0036] Determine candidate functions of the second smart home device according to the first function ranking information.

[0037] Optionally, the outputting function recommendation information for candidate functions of the second smart home device to the user includes:

[0038] Obtaining a usage frequency of a candidate function of the second smart home device;

[0039] sorting the candidate functions of the second smart home device according to the usage frequency of the candidate functions of the second smart home device to obtain second function sorting information;

[0040] Generate function recommendation information for candidate functions of the second smart home device according to the second function ranking information.

[0041] Optionally, determining a candidate smart home device includes:

[0042] Get the room information where the user is located;

[0043] The candidate smart home device is determined according to the room information.

[0044] On the other hand, an embodiment of the present invention provides a control device for a smart home device, the device comprising:

[0045] A speech recognition module, used to obtain user speech and recognize the user speech;

[0046] An instruction execution module, for controlling the corresponding smart home device to execute a corresponding function according to the instruction information if the instruction information of the user's voice is recognized;

[0047] a function determination module, configured to determine whether there is a first function of a first smart home device bound to the user voice if the instruction information of the user voice cannot be recognized;

[0048] A recommendation module, configured to output recommendation information to the user if there is no first function of the first smart home device bound to the user's voice, wherein the recommendation information is used to recommend the function of the smart home device to the user;

[0049] A function acquisition module, used to acquire a second function of a second smart home device selected by a user;

[0050] A voice binding module is used to bind and store the user voice with the second function of the second smart home device.

[0051] On the other hand, an embodiment of the present invention provides an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the steps of the control method of the smart home device as described above are implemented.

[0052] On the other hand, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the control method of the smart home device as described above are implemented.

[0053] The embodiments of the present invention include the following advantages:

[0054] After acquiring the user's voice, the user's voice is recognized. If the instruction information in the user's voice can be recognized, the corresponding smart home device is directly controlled to perform the corresponding function according to the instruction information. If the instruction information in the user's voice cannot be recognized, it is first determined whether there is a first function of the first smart home device bound to the user's voice. If there is no first function of the first smart home device bound to the user's voice, the recommendation information is output to the user, and after the user selects the smart home device and the function of the smart home device, the user's voice is bound to the smart home device and the function of the smart home device selected by the user and stored. In the case where the user's voice cannot be recognized, the user customizes the function that needs to be completed corresponding to the user's voice, and the user's voice and the function that needs to be completed are stored. When the user's voice is recognized again later, the smart home device can be directly controlled according to the function of the smart home device bound to the stored user voice. Thereby, the freedom and flexibility of voice control of smart home devices are improved, and the requirements for user expression ability are also reduced, thereby improving user tolerance. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] Figure 1 is a flowchart of a method for controlling a smart home device provided by an embodiment of the present invention;

[0056] Figure 2 is a flowchart of another method for controlling a smart home device provided by an embodiment of the present invention;

[0057] Figure 3 It is a structural block diagram of a control device for a smart home device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0058] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0059] With the rapid development of information technology and the Internet of Things, more and more smart home devices have come into people's view. Smart homes integrate various household devices such as refrigerators, washing machines, air conditioners, socket switches, and curtains through the Internet of Things technology, realizing all-round information interaction functions, and providing users with higher comfort and better safety performance. In actual application scenarios, in order to improve the user experience, it is becoming more and more popular to control smart home devices by voice commands. In related technologies, usually after obtaining the user's voice command, the command text in the voice command is recognized, and then according to the recognized command text, the smart home system is controlled to execute the corresponding command, thereby realizing voice control of smart home devices.

[0060] Due to the natural ambiguity and ambiguity of language, the accuracy of speech recognition is low and the errors in the recognized command information are large, resulting in the inability to correctly control smart home devices and a poor user experience.

[0061] When the embodiment of the present invention cannot recognize the instruction information in the user's voice, it outputs recommendation information to the user, and the user customizes the function that needs to be completed corresponding to the user's voice, and binds and stores the user's voice and the corresponding function that needs to be completed. When the user's voice is recognized again later, the smart home device can be directly controlled according to the function that needs to be completed corresponding to the stored user voice. The freedom and flexibility of voice control of smart home devices are improved, and user tolerance is also improved.

[0062] Reference Figure 1 , shows a flowchart of a method for controlling a smart home device provided by an embodiment of the present invention, and the method may specifically include the following steps:

[0063] Step 101, obtaining user voice and recognizing the user voice;

[0064] The user's voice is acquired through the electronic device used by the user, and an application is installed in the electronic device for acquiring the user's voice and recognizing the user's voice.

[0065] The electronic device may be a mobile phone, a tablet computer, a central control screen, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), or other electronic devices. The embodiments of the present invention do not impose any restrictions on the specific types of electronic devices.

[0066] Step 102: If the command information of the user's voice is recognized, the corresponding smart home device is controlled to execute the corresponding function according to the command information;

[0067] The electronic device used by the user can convert the user's voice into text information and extract instruction information from the text information, wherein the instruction information includes a target smart home device and a target function of the target smart home device.

[0068] As an example, if the user's voice is recognized and the text message "Please help lower the temperature of the air conditioner" is obtained, the instruction information "air conditioner" and "temperature reduction" can be extracted from the text message, where "air conditioner" is the target smart home device and "temperature reduction" is the target function of the target smart home device. Therefore, according to the instruction information, the air conditioner (the corresponding smart home device) is controlled to execute (the corresponding function) the function of lowering the temperature.

[0069] When the user expresses himself clearly and pronounces him standardly, the command information of the user's voice can be directly recognized, so that the corresponding smart home device can be controlled to perform the corresponding function according to the command information.

[0070] Step 103: if the instruction information of the user voice cannot be recognized, determining whether there is a first function of the first smart home device bound to the user voice;

[0071] When the user's expression is ambiguous or the pronunciation is not standard, it is often difficult to recognize the command information in the user's voice.

[0072] In some embodiments, when the user voice cannot recognize valid text information, that is, the recognized text information cannot be used as instruction information, the stored user voice is searched to see whether there is a stored user voice that is the same as the user voice.

[0073] If the user voice can be found in the stored user voices, it means that the user has bound the user voice to the corresponding smart home device function. Then the function of the smart home device bound to the user voice is found and executed, so that the voice control of the function required by the user can be completed when the instruction information of the user voice cannot be recognized.

[0074] Step 104: if there is no first function of the first smart home device bound to the user's voice, output recommendation information to the user, where the recommendation information is used to recommend the function of the smart home device to the user;

[0075] In some embodiments, if there is no first function of the first smart home device bound to the user voice, that is, the user voice cannot be found in the stored user voices, it means that the user has not bound the corresponding smart home device and function to the user voice. Therefore, the functions of the smart home devices can be recommended to the user, and the user selects the smart home device and its specific function to be controlled by the user voice, so that when the user voice is recognized again, the smart home device and specific function selected by the user to be controlled by the user voice can be directly executed. In this way, when the instruction information of the user voice cannot be recognized, the voice control of the function required by the user can be completed.

[0076] In some embodiments, before outputting the recommendation information to the user in step 104, the method further includes the following steps:

[0077] Determining whether there is a historical user voice similar to the user voice;

[0078] After determining that there is no first function of the first smart home device bound to the user voice, first determine whether there is a historical user voice similar to the user voice.

[0079] A similarity threshold is preset, and the similarity threshold is used to determine whether there is a historical user voice similar to the user voice. Specifically, the user voice is compared with the stored user voices for similarity. If the similarity between the user voice and a stored user voice reaches the similarity threshold, it is determined that there is a historical user voice similar to the user voice.

[0080] If there is a historical user voice similar to the user voice, executing a third function of a third smart home device bound to the historical user voice;

[0081] The stored user voice is bound to the corresponding third function of the third smart home device. After determining the historical user voice similar to the user voice, the third function of the third smart home device bound to the historical user voice is directly executed.

[0082] When it is determined that there is a historical user voice similar to the user voice, the function of the smart home device bound to the historical user voice is directly executed, which simplifies the user operation and improves the user's operation efficiency.

[0083] In some embodiments, step 104 includes the following sub-steps:

[0084] Sub-step S11, determining candidate smart home devices, and outputting device recommendation information for the candidate smart home devices to the user;

[0085] In some embodiments, if neither the instruction information of the user voice for the target function of the target smart home device can be recognized, nor can it be recognized that the user voice includes the target smart home device, candidate smart home devices are determined, and device recommendation information for the candidate smart home devices is output to the user.

[0086] Candidate smart home devices refer to smart home devices that can be selected and controlled by users. By determining the candidate smart home devices, device recommendation information for these candidate smart home devices is generated and sent to the user, so that the user can select the smart home device that needs to be controlled corresponding to the user's voice.

[0087] After the user selects the smart home device to be controlled by the user voice, the specific function of the smart home device to be controlled is subsequently selected, thereby completing the selection of the smart home device to be controlled by the user voice and the specific function, and using it for voice control.

[0088] In some embodiments, sub-step S11 includes the following specific steps:

[0089] Get the room information where the user is located;

[0090] The candidate smart home device is determined according to the room information.

[0091] The electronic device used by the user has a position positioning function. In some embodiments, the room information where the user is located is obtained by obtaining the room location where the user is located when the user voice recognition is performed.

[0092] The room information where the user is located includes the room name and room equipment information, etc. After obtaining the room information where the user is located, the room equipment information can be further obtained, thereby determining the specific smart home devices in the room where the user is located, and taking these smart home devices as candidate smart home devices, thereby generating device recommendation information for the candidate smart home devices.

[0093] As an example, if during user voice recognition, it is obtained that the room the user is in is a bedroom, the smart home device information in the bedroom is searched, and smart home devices such as "bedroom-air conditioner", "bedroom-desk lamp", and "bedroom-electric curtains" are obtained. "Bedroom-air conditioner", "bedroom-desk lamp", and "bedroom-electric curtains" are taken as candidate smart home devices.

[0094] Determining candidate smart home devices based on the room information where the user is when performing user voice recognition can increase the possibility of the smart home device required by the user among the candidate smart home devices, and to a certain extent can help the user quickly select the smart home device he or she requires.

[0095] In some embodiments, determining the candidate smart home devices in sub-step S11 specifically includes the following steps:

[0096] Obtaining the usage frequency of the smart home device;

[0097] sorting the smart home devices according to the usage frequencies of the smart home devices to obtain first device sorting information;

[0098] Determine candidate smart home devices according to the first device sorting information.

[0099] In some embodiments, first device ranking information is obtained based on the usage frequency of the smart home devices, and then candidate smart home devices are determined based on the first device ranking information.

[0100] According to the usage frequency of smart home devices, candidate smart home devices are determined, and smart home devices with higher usage frequency are recommended to users as candidate smart home devices, which can help users quickly select the smart home devices they need to a certain extent.

[0101] In some embodiments, the outputting of device recommendation information for the candidate smart home device to the user in sub-step S11 specifically includes the following steps:

[0102] Obtaining the usage frequency of the candidate smart home device;

[0103] sorting the candidate smart home devices according to the usage frequencies of the candidate smart home devices to obtain second device sorting information;

[0104] generating device recommendation information for the candidate smart home devices according to the second device ranking information;

[0105] In some embodiments, the usage frequencies of candidate smart home devices are first obtained, and the candidate smart home devices are sorted according to the usage frequencies of the candidate smart home devices to obtain second device sorting information, and then device recommendation information for the candidate smart home devices is generated based on the second device sorting information.

[0106] Candidate smart home devices are recommended according to their usage frequency. Smart home devices with higher usage frequency are placed at the front of the device recommendation information, while smart home devices with lower usage frequency are placed at the back of the device recommendation information. This can help users quickly select the smart home devices they need to a certain extent.

[0107] In some embodiments, sub-step S11 includes the following specific steps:

[0108] Displaying a device recommendation interface for the candidate smart home device to the user, and broadcasting voice information of the device recommendation interface for the candidate smart home device to the user;

[0109] When outputting device recommendation information for candidate smart home devices to the user, both visual and auditory considerations are combined to facilitate the user to receive the device recommendation information for the candidate smart home devices.

[0110] On the one hand, a device recommendation interface for the candidate smart home device is displayed to the user. In some embodiments, the device recommendation interface includes pictures and names of the candidate smart home devices, and the user can click on the picture or name of the candidate smart home device to select the corresponding candidate smart home device.

[0111] As an example, the device recommendation interface includes pictures and names of smart home devices such as air conditioners, televisions, desk lamps, electric curtains, etc. These smart home devices are arranged from top to bottom according to the frequency of use. When the user clicks on the picture corresponding to the air conditioner, the air conditioner is selected as the smart home device corresponding to the user's voice control.

[0112] On the other hand, voice information of the device recommendation interface for the candidate smart home device is broadcast to the user. In some embodiments, the device recommendation interface of the candidate smart home device includes voice information, which is used to describe the device information in the device recommendation interface to help the user quickly obtain the device information.

[0113] As an example, the device recommendation interface includes pictures and names of smart home devices such as air conditioners, televisions, desk lamps, electric curtains, etc. These smart home devices are arranged from top to bottom according to the frequency of use. The name of each smart home device is announced in turn by voice.

[0114] By outputting device recommendation information for candidate smart home devices to users from two aspects, users can obtain device recommendation information by browsing pages and listening to voice broadcasts, thereby improving user experience.

[0115] Sub-step S12, after the user selects a second smart home device from the candidate smart home devices, determining candidate functions of the second smart home device, and outputting function recommendation information for the candidate functions of the second smart home device to the user;

[0116] The user selects the second smart home device from the candidate smart home devices, which means that the user determines that the second smart home device needs to be controlled. Therefore, after the user selects the second smart home device from the candidate smart home devices, it is necessary to determine the candidate functions of the second smart home device, that is, to determine the specific functions of the second smart home device that can be controlled. And according to the specific functions of the second smart home device that can be controlled, function recommendation information for the candidate functions of the second smart home device is generated.

[0117] As an example, when the user selects an air conditioner as the second smart home device, the functions of the air conditioner, such as temperature, humidity, mode, timing, etc., are determined as candidate functions, and a corresponding function recommendation page is generated, which is used to display these functions.

[0118] Function recommendation information for candidate functions of the second smart home device is output to the user, and the user selects the specific function of the smart home device to be controlled, thereby completing the selection of the smart home device to be controlled and the specific function corresponding to the user's voice, and using it for voice control.

[0119] In some embodiments, determining the candidate function of the second smart home device in sub-step S12 specifically includes the following steps:

[0120] Obtaining a usage frequency of a function of the second smart home device;

[0121] sorting the functions of the second smart home devices according to the usage frequencies of the functions of the second smart home devices to obtain first function sorting information;

[0122] Determine candidate functions of the second smart home device according to the first function ranking information.

[0123] In some embodiments, first function ranking information is obtained based on the usage frequency of each function of the second smart home device, and then candidate functions of the second smart home device are determined based on the first function ranking information.

[0124] Recommending the functions with higher frequency of use among the functions of the second smart home device to the user as candidate functions can help the user quickly select the functions of the second smart home device that he needs to a certain extent.

[0125] In some embodiments, the outputting of function recommendation information for candidate functions of the second smart home device to the user in sub-step S12 specifically includes the following steps:

[0126] Obtaining a usage frequency of a candidate function of the second smart home device;

[0127] sorting the candidate functions of the second smart home device according to the usage frequency of the candidate functions of the second smart home device to obtain second function sorting information;

[0128] generating function recommendation information for candidate functions of the second smart home device according to the second function ranking information;

[0129] In some embodiments, the usage frequency of the candidate functions of the second smart home device is first obtained, and the candidate functions are sorted according to the usage frequency of the candidate functions of the second smart home device to obtain second function sorting information, and then function recommendation information for the candidate functions of the second smart home device is generated based on the second function sorting information.

[0130] The candidate functions of the second smart home device are recommended according to their usage frequency, with functions with higher usage frequency placed at the front of the function recommendation information and functions with lower usage frequency placed at the back of the function recommendation information. This can help users quickly select the functions of the smart home devices they need to a certain extent.

[0131] In some embodiments, sub-step S12 includes the following specific steps:

[0132] Displaying a function recommendation page for the candidate functions of the second smart home device to the user, and broadcasting voice information of the function recommendation page for the candidate functions of the second smart home device to the user;

[0133] When outputting the function recommendation information for the candidate functions of the second smart home device to the user, both visual and auditory considerations are combined to facilitate the user to receive the function recommendation information for the candidate functions of the second smart home device. The user can obtain the function recommendation information by browsing the page and listening to the voice broadcast, thereby improving the user experience.

[0134] On the one hand, a function recommendation page for candidate functions of the second smart home device is displayed to the user. In some embodiments, the function recommendation interface includes function button images and names of the candidate smart home devices, and the user can click on the image or name of the function button of the candidate smart home device to select the function of the corresponding candidate smart home device.

[0135] On the other hand, voice information of a function recommendation page for the candidate function of the second smart home device is broadcast to the user. In some embodiments, the function recommendation page for the candidate function of the second smart home device includes voice information, and the voice information is used for the function information in the function recommendation page to help the user quickly obtain the function information of the candidate function of the second smart home device.

[0136] In some embodiments, step 104 includes the following sub-steps:

[0137] Sub-step S21: If the instruction information of the target function of the target smart home device cannot be recognized in the user voice, but the target smart home device is recognized to be included in the user voice, function recommendation information of candidate functions of the target smart home device is output to the user.

[0138] As an example, if the user's voice is recognized, it can be recognized that the user's voice includes the target smart home device "air conditioner", but the instruction information for the target function of the target smart home device cannot be recognized, that is, the specific operation performed on the target smart home device "air conditioner" cannot be recognized. At this time, based on the identified target smart home device, function recommendation information for the candidate functions of the target smart home device is generated and output to the user. The user can directly select the specific function of the target smart home device based on the function recommendation information for the candidate functions of the target smart home device, which simplifies the user's operation process.

[0139] Step 105, obtaining a second function of a second smart home device selected by the user;

[0140] The smart home device selected by the user according to the recommendation information is used as the second smart home device, and the specific function of the second smart home device selected according to the recommendation information is used as the second function of the second smart home device.

[0141] Step 106, binding and storing the user voice with the second function of the second smart home device;

[0142] The user voice is bound to and stored with the second function of the second smart home device, so that the next time the user voice is recognized, the second function of the second smart home device corresponding to the user voice can be directly found and executed according to the binding relationship between the user voice and the second function of the second smart home device, thereby completing the voice control of the function required by the user when the instruction information of the user voice cannot be recognized.

[0143] It is worth noting that the first smart home device, the second smart home device, the third smart home device, the first function, the second function and the third function in the embodiment of the present invention are only used to distinguish the smart home devices and functions controlled by each step. In actual applications, the first smart home device, the second smart home device and the third smart home device can be the same smart home device or different smart home devices; correspondingly, the first function, the second function and the third function can be the same function or different functions.

[0144] After acquiring the user voice, the embodiment of the present invention recognizes the user voice. If the instruction information in the user voice can be recognized, the corresponding smart home device is directly controlled to perform the corresponding function according to the instruction information. If the instruction information in the user voice cannot be recognized, it is determined whether there is a first function of the first smart home device bound to the user voice. If there is no first function of the first smart home device bound to the user voice, the recommendation information is output to the user, and after the user selects the smart home device and the function of the smart home device, the user voice is bound to the smart home device and the function of the smart home device selected by the user and stored. In the case where the user voice cannot be recognized, the user customizes the function that needs to be completed corresponding to the user voice, and the user voice and the function that needs to be completed corresponding to the user voice are stored. When the user voice is recognized again later, the smart home device can be directly controlled according to the function that needs to be completed corresponding to the stored user voice. The freedom and flexibility of voice control of smart home devices are improved, and the requirements for user expression ability are also reduced, thereby improving user tolerance.

[0145] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0146] Reference Figure 2 , shows a flowchart of another method for controlling a smart home device provided by an embodiment of the present invention. In order to enable those skilled in the art to better understand the embodiment of the present invention, the embodiment of the present invention is described by an example:

[0147] 1) Recognize user voice for the first time

[0148] When the user's voice is recognized for the first time, if the instruction information of the user's voice is recognized, the corresponding smart home device is controlled to perform the corresponding function according to the instruction information. If the instruction information of the user's voice is not recognized, the recommendation information is output to the user, and the recommendation information is used to recommend the functions of the smart home device to the user.

[0149] 2) Recommended features

[0150] First, the user is recommended smart home devices that can be selected based on the smart home device information of the room where the user is located and the usage frequency of these smart home devices. After the user selects the smart home device that needs to be controlled by the user's voice, the functions of the smart home device are recommended to the user based on the usage frequency of each function of the smart home device, and the user selects the function of the smart home device that needs to be controlled by the user's voice.

[0151] 3) Binding function

[0152] After the user has completed the selection, that is, after determining that the user's voice corresponds to the function of the smart home device that needs to be controlled, the user's voice is bound to the function of the smart home device that needs to be controlled and stored.

[0153] 4) Re-recognize the user's voice

[0154] When the user voice is recognized again, the function of the smart home device corresponding to the user voice is directly searched based on the binding relationship between the user voice and the function of the corresponding smart home device.

[0155] 5) Execution function

[0156] After finding the function of the smart home device corresponding to the user voice, the function is directly executed. If the user voice cannot be recognized, the user customizes the function to be completed corresponding to the user voice, and stores the user voice and the function to be completed. In this way, when the user voice is recognized again in the future, the smart home device can be directly controlled according to the function to be completed corresponding to the stored user voice.

[0157] Reference Figure 3, shows a structural block diagram of a control device for a smart home device provided by an embodiment of the present invention, which may specifically include the following modules:

[0158] The speech recognition module 301 is used to obtain the user's speech and recognize the user's speech;

[0159] The user's voice is acquired through the electronic device used by the user, and an application is installed in the electronic device for acquiring the user's voice and recognizing the user's voice.

[0160] The instruction execution module 302 is used to control the corresponding smart home device to execute the corresponding function according to the instruction information if the instruction information of the user's voice is recognized;

[0161] The electronic device used by the user can convert the user's voice into text information and extract instruction information from the text information, wherein the instruction information includes a target smart home device and a target function of the target smart home device.

[0162] When the user expresses himself clearly and pronounces him standardly, the command information of the user's voice can be directly recognized, so that the corresponding smart home device can be controlled to perform the corresponding function according to the command information.

[0163] The function determination module 303 is used to determine whether there is a first function of the first smart home device bound to the user voice if the instruction information of the user voice cannot be recognized;

[0164] When the user's expression is ambiguous or the pronunciation is not standard, it is often difficult to recognize the command information in the user's voice.

[0165] In some embodiments, when the user voice cannot recognize valid text information, that is, the recognized text information cannot be used as instruction information, the stored user voice is searched to see whether there is a stored user voice that is the same as the user voice.

[0166] If the user voice can be found in the stored user voices, it means that the user has bound the user voice to the corresponding smart home device function. Then the function of the smart home device bound to the user voice is found and executed, so that the voice control of the function required by the user can be completed when the instruction information of the user voice cannot be recognized.

[0167] A recommendation module 304, configured to output recommendation information to the user if there is no first function of the first smart home device bound to the user's voice, wherein the recommendation information is used to recommend the function of the smart home device to the user;

[0168] In some embodiments, if there is no first function of the first smart home device bound to the user voice, that is, the user voice cannot be found in the stored user voices, it means that the user has not bound the corresponding smart home device and function to the user voice. Therefore, the functions of the smart home devices can be recommended to the user, and the user selects the smart home device and its specific function to be controlled by the user voice, so that when the user voice is recognized again, the smart home device and specific function selected by the user to be controlled by the user voice can be directly executed. In this way, when the instruction information of the user voice cannot be recognized, the voice control of the function required by the user can be completed.

[0169] In some embodiments, the apparatus further comprises:

[0170] A historical voice determination module, used to determine whether there is a historical user voice similar to the user voice;

[0171] After determining that there is no first function of the first smart home device bound to the user voice, first determine whether there is a historical user voice similar to the user voice.

[0172] A similarity threshold is preset, and the similarity threshold is used to determine whether there is a historical user voice similar to the user voice. Specifically, the user voice is compared with the stored user voices for similarity. If the similarity between the user voice and a stored user voice reaches the similarity threshold, it is determined that there is a historical user voice similar to the user voice.

[0173] A function execution module is used to execute a third function of a third smart home device bound to a historical user voice if there is a historical user voice similar to the user voice.

[0174] The stored user voice is bound to the corresponding third function of the third smart home device. After determining the historical user voice similar to the user voice, the third function of the third smart home device bound to the historical user voice is directly executed.

[0175] When it is determined that there is a historical user voice similar to the user voice, the function of the smart home device bound to the historical user voice is directly executed, which simplifies the user operation and improves the user's operation efficiency.

[0176] In some embodiments, the recommendation module 304 includes the following submodules:

[0177] A device recommendation submodule, configured to determine candidate smart home devices and output device recommendation information for the candidate smart home devices to the user;

[0178] Candidate smart home devices refer to smart home devices that can be selected and controlled by users. By determining the candidate smart home devices, device recommendation information for these candidate smart home devices is generated and sent to the user, so that the user can select the smart home device that needs to be controlled corresponding to the user's voice.

[0179] After the user selects the smart home device to be controlled by the user voice, the specific function of the smart home device to be controlled is subsequently selected, thereby completing the selection of the smart home device to be controlled by the user voice and the specific function, and using it for voice control.

[0180] In some embodiments, the device recommendation submodule includes the following units:

[0181] A room information acquisition unit, used to acquire the room information where the user is located;

[0182] A candidate device acquisition unit, configured to determine the candidate smart home device according to the room information;

[0183] The electronic device used by the user has a position positioning function. In some embodiments, the room information where the user is located is obtained by obtaining the room location where the user is located when the user voice recognition is performed.

[0184] The room information where the user is located includes the room name and room equipment information, etc. After obtaining the room information where the user is located, the room equipment information can be obtained, thereby determining the specific smart home devices in the room where the user is located, and taking these smart home devices as candidate smart home devices, thereby generating device recommendation information for the candidate smart home devices.

[0185] Determining candidate smart home devices based on the room information where the user is when performing user voice recognition can increase the possibility of the smart home device required by the user among the candidate smart home devices, and to a certain extent can help the user quickly select the smart home device he or she requires.

[0186] In some embodiments, the device recommendation submodule includes the following units:

[0187] A first device usage frequency acquisition unit, configured to acquire the usage frequency of the smart home device;

[0188] a first device ranking information acquiring unit, configured to sort the smart home devices according to the usage frequencies of the smart home devices to obtain first device ranking information;

[0189] a candidate device determining unit, configured to determine a candidate smart home device according to the first device ranking information;

[0190] According to the usage frequency of smart home devices, candidate smart home devices are determined, and smart home devices with higher usage frequency are recommended to users as candidate smart home devices, which can help users quickly select the smart home devices they need to a certain extent.

[0191] In some embodiments, the device recommendation submodule includes the following units:

[0192] A second device usage frequency acquisition unit, configured to acquire the usage frequency of the candidate smart home device;

[0193] A second device ranking information acquiring unit, configured to sort the candidate smart home devices according to the usage frequencies of the candidate smart home devices to obtain second device ranking information;

[0194] A first recommendation information generating unit, configured to generate device recommendation information for the candidate smart home device according to the second device ranking information;

[0195] In some embodiments, the usage frequencies of candidate smart home devices are first obtained, and the candidate smart home devices are sorted according to the usage frequencies of the candidate smart home devices to obtain second device sorting information, and then device recommendation information for the candidate smart home devices is generated based on the second device sorting information.

[0196] Candidate smart home devices are recommended according to their usage frequency. Smart home devices with higher usage frequency are placed at the front of the device recommendation information, while smart home devices with lower usage frequency are placed at the back of the device recommendation information. This can help users quickly select the smart home devices they need to a certain extent.

[0197] In some embodiments, the device recommendation submodule includes the following units:

[0198] A first interface display unit, configured to display a device recommendation interface for the candidate smart home device to the user;

[0199] A first text broadcasting unit, configured to broadcast text information of a device recommendation interface for the candidate smart home device to the user;

[0200] When outputting device recommendation information for candidate smart home devices to the user, both visual and auditory considerations are combined to facilitate the user to receive the device recommendation information for the candidate smart home devices.

[0201] On the one hand, a device recommendation interface for the candidate smart home device is displayed to the user. In some embodiments, the device recommendation interface includes pictures and names of the candidate smart home devices, and the user can click on the picture or name of the candidate smart home device to select the corresponding candidate smart home device.

[0202] On the other hand, voice information of the device recommendation interface for the candidate smart home device is broadcast to the user. In some embodiments, the device recommendation interface of the candidate smart home device includes voice information, which is used to describe the device information in the device recommendation interface to help the user quickly obtain the device information.

[0203] a first function recommendation submodule, configured to determine candidate functions of a second smart home device after a user selects the second smart home device from the candidate smart home devices, and output function recommendation information for the candidate functions of the second smart home device to the user;

[0204] The user selects the second smart home device from the candidate smart home devices, which means that the user determines that the second smart home device needs to be controlled. Therefore, after the user selects the second smart home device from the candidate smart home devices, it is necessary to determine the candidate functions of the second smart home device, that is, to determine the specific functions of the second smart home device that can be controlled. And according to the specific functions of the second smart home device that can be controlled, function recommendation information for the candidate functions of the second smart home device is generated.

[0205] Function recommendation information for candidate functions of the second smart home device is output to the user, and the user selects the specific function of the smart home device to be controlled, thereby completing the selection of the smart home device to be controlled and the specific function corresponding to the user's voice, and using it for voice control.

[0206] In some embodiments, the first function recommendation submodule includes the following units:

[0207] A first function usage frequency acquisition unit, configured to acquire a usage frequency of a function of the second smart home device;

[0208] a first function ranking information acquiring unit, configured to sort the functions of the second smart home devices according to the usage frequencies of the functions of the second smart home devices, to obtain first function ranking information;

[0209] a candidate function determining unit, configured to determine a candidate function of the second smart home device according to the first function ranking information;

[0210] In some embodiments, first function ranking information is obtained based on the usage frequency of each function of the second smart home device, and then candidate functions of the second smart home device are determined based on the first function ranking information.

[0211] Recommending the functions with higher frequency of use among the functions of the second smart home device to the user as candidate functions can help the user quickly select the functions of the second smart home device that he needs to a certain extent.

[0212] In some embodiments, the first function recommendation submodule includes the following units:

[0213] A second function usage frequency acquisition unit, configured to acquire a usage frequency of a candidate function of the second smart home device;

[0214] A second function ranking information acquiring unit, configured to rank the candidate functions of the second smart home device according to the usage frequency of the candidate functions of the second smart home device, to obtain second function ranking information;

[0215] A second recommendation information generating unit, configured to generate function recommendation information for candidate functions of the second smart home device according to the second function ranking information;

[0216] In some embodiments, the usage frequency of the candidate functions of the second smart home device is first obtained, and the candidate functions are sorted according to the usage frequency of the candidate functions of the second smart home device to obtain second function sorting information, and then function recommendation information for the candidate functions of the second smart home device is generated based on the second function sorting information.

[0217] The candidate functions of the second smart home device are recommended according to their usage frequency, with functions with higher usage frequency placed at the front of the function recommendation information and functions with lower usage frequency placed at the back of the function recommendation information. This can help users quickly select the functions of the smart home devices they need to a certain extent.

[0218] In some embodiments, the first function recommendation submodule includes the following units:

[0219] A second interface display unit, configured to display a function recommendation page for candidate functions of the second smart home device to the user;

[0220] A second text broadcasting unit, configured to broadcast text information of a function recommendation page for candidate functions of the second smart home device to the user;

[0221] When outputting the function recommendation information for the candidate functions of the second smart home device to the user, both visual and auditory considerations are combined to facilitate the user to receive the function recommendation information for the candidate functions of the second smart home device. The user can obtain the function recommendation information by browsing the page and listening to the voice broadcast, thereby improving the user experience.

[0222] On the one hand, a function recommendation page for candidate functions of the second smart home device is displayed to the user. In some embodiments, the function recommendation interface includes function button images and names of the candidate smart home devices, and the user can click on the image or name of the function button of the candidate smart home device to select the function of the corresponding candidate smart home device.

[0223] On the other hand, voice information of a function recommendation page for the candidate function of the second smart home device is broadcast to the user. In some embodiments, the function recommendation page for the candidate function of the second smart home device includes voice information, and the voice information is used for the function information in the function recommendation page to help the user quickly obtain the function information of the candidate function of the second smart home device.

[0224] In some embodiments, the recommendation module 304 includes:

[0225] The second function recommendation submodule is used to output function recommendation information for candidate functions of the target smart home device to the user if the instruction information of the target function of the target smart home device cannot be recognized from the user voice, but the target smart home device is recognized to be included in the user voice.

[0226] As an example, if the user's voice is recognized, it can be recognized that the user's voice includes the target smart home device "air conditioner", but the instruction information for the target function of the target smart home device cannot be recognized, that is, the specific operation performed on the target smart home device "air conditioner" cannot be recognized. At this time, based on the identified target smart home device, function recommendation information for the candidate functions of the target smart home device is generated and output to the user. The user can directly select the specific function of the target smart home device based on the function recommendation information for the candidate functions of the target smart home device, which simplifies the user's operation process.

[0227] The function acquisition module 305 is used to acquire the second function of the second smart home device selected by the user;

[0228] The smart home device selected by the user according to the recommendation information is used as the second smart home device, and the specific function of the second smart home device selected according to the recommendation information is used as the second function of the second smart home device.

[0229] In some embodiments, the second function of the second smart home device selected by the user is informed to the user by voice broadcast, so that the user can further confirm whether the second function of the second smart home device selected by the user is correct.

[0230] The voice binding module 306 is used to bind and store the user voice with the second function of the second smart home device.

[0231] The user voice is bound to and stored with the second function of the second smart home device, so that the next time the user voice is recognized, the second function of the second smart home device corresponding to the user voice can be directly found and executed according to the binding relationship between the user voice and the second function of the second smart home device, thereby completing the voice control of the function required by the user when the instruction information of the user voice cannot be recognized.

[0232] In the embodiment of the present invention, when the user voice cannot be recognized, the user customizes the function to be completed corresponding to the user voice, and stores the user voice and the function to be completed corresponding to the user voice. When the user voice is recognized again later, the smart home device can be directly controlled according to the function to be completed corresponding to the stored user voice. This improves the freedom and flexibility of voice control of smart home devices, while also reducing the requirements for the user's expressive ability, thereby improving user tolerance.

[0233] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0234] An embodiment of the present invention further provides an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, the various processes of the control method embodiment of the above-mentioned smart home device are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0235] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned smart home device control method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0236] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0237] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0238] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0239] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0240] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0241] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0242] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0243] The control method, device, electronic device and computer-readable storage medium of a smart home device provided by the present invention are introduced in detail above. Specific examples are used in this article to illustrate the principle and implementation mode of the present invention. The description of the above embodiments is only used to help understand the method and core idea of ​​the present invention. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation mode and application scope. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A control method for a smart home device, characterized in that: The method comprises: Acquire user voice and recognize the user voice; If the command information of the user's voice is recognized, the corresponding smart home device is controlled to perform the corresponding function according to the command information; If the instruction information of the user voice cannot be recognized, determining whether there is a first function of the first smart home device bound to the user voice; If there is no first function of the first smart home device bound to the user voice, output recommendation information to the user, where the recommendation information is used to recommend the function of the smart home device to the user; Obtaining a second function of a second smart home device selected by a user; The user voice is bound to and stored with the second function of the second smart home device.

2. The method according to claim 1, characterized in that Before outputting the recommendation information to the user, the method further includes: Determining whether there is a historical user voice similar to the user voice; If there is a historical user voice similar to the user voice, the third function of the third smart home device bound to the historical user voice is executed.

3. The method according to claim 1, characterized in that The outputting the recommendation information to the user comprises: Determine candidate smart home devices, and output device recommendation information for the candidate smart home devices to the user; After the user selects the second smart home device from the candidate smart home devices, candidate functions of the second smart home device are determined, and function recommendation information for the candidate functions of the second smart home device is output to the user.

4. The method according to claim 3, characterized in that The outputting device recommendation information for the candidate smart home device to the user includes: Displaying a device recommendation interface for the candidate smart home device to the user, and broadcasting voice information of the device recommendation interface for the candidate smart home device to the user; The outputting the function recommendation information for the candidate function of the second smart home device to the user includes: A function recommendation page for the candidate functions of the second smart home device is displayed to the user, and voice information of the function recommendation page for the candidate functions of the second smart home device is broadcast to the user.

5. The method according to claim 1, characterized in that The outputting the recommendation information to the user comprises: If the instruction information of the target function of the target smart home device cannot be identified in the user voice, but the target smart home device is identified in the user voice, function recommendation information of the candidate functions of the target smart home device is output to the user.

6. The method according to claim 3, characterized in that The step of determining candidate smart home devices comprises: Obtaining the usage frequency of the smart home device; sorting the smart home devices according to the usage frequencies of the smart home devices to obtain first device sorting information; Determine candidate smart home devices according to the first device sorting information.

7. The method according to claim 3, characterized in that The outputting device recommendation information for the candidate smart home device to the user includes: Obtaining the usage frequency of the candidate smart home device; sorting the candidate smart home devices according to the usage frequencies of the candidate smart home devices to obtain second device sorting information; Generate device recommendation information for the candidate smart home devices according to the second device ranking information.

8. The method according to claim 3, characterized in that The determining of the candidate function of the second smart home device includes: Obtaining a usage frequency of a function of the second smart home device; sorting the functions of the second smart home devices according to the usage frequencies of the functions of the second smart home devices to obtain first function sorting information; Determine candidate functions of the second smart home device according to the first function ranking information.

9. The method according to claim 3, characterized in that: The outputting the function recommendation information for the candidate function of the second smart home device to the user includes: Obtaining a usage frequency of a candidate function of the second smart home device; sorting the candidate functions of the second smart home device according to the usage frequency of the candidate functions of the second smart home device to obtain second function sorting information; Generate function recommendation information for candidate functions of the second smart home device according to the second function ranking information.

10. The method according to claim 3, characterized in that: The step of determining candidate smart home devices comprises: Get the room information where the user is located; The candidate smart home device is determined according to the room information.

11. A control device for a smart home device, characterized in that: The device comprises: A speech recognition module, used to obtain user speech and recognize the user speech; An instruction execution module, for controlling the corresponding smart home device to execute a corresponding function according to the instruction information if the instruction information of the user's voice is recognized; a function determination module, configured to determine whether there is a first function of a first smart home device bound to the user voice if the instruction information of the user voice cannot be recognized; A recommendation module, configured to output recommendation information to the user if there is no first function of the first smart home device bound to the user's voice, wherein the recommendation information is used to recommend the function of the smart home device to the user; A function acquisition module, used to acquire a second function of a second smart home device selected by a user; A voice binding module is used to bind and store the user voice with the second function of the second smart home device.

12. An electronic device, characterized in that: include: A processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the steps of the method for controlling a smart home device as described in any one of claims 1 to 10 are implemented.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method for controlling a smart home device according to any one of claims 1 to 10 are implemented.

Images