A smart home system and control method

Abstract

The present disclosure provides a smart home system and a control method. The smart home system includes a plurality of intelligent terminals and a central control cloud platform, wherein: the first intelligent terminal is configured to receive a voice command initiated by a user; judge the request command type of the voice command based on the semantics of the voice command; based on the request command type, judge whether to perform distributed voice control; if so, upload the voice command to the central control cloud platform; the central control cloud platform is configured to control at least one second intelligent terminal corresponding to the request command type to execute the voice command. By means of the present disclosure, the defect that smart home can perform cross-device control but services cannot be cross-device integrated is solved, and the service ability and user experience of smart home in the smart home are improved, especially the fusion interaction experience of smart home through voice interaction.

Description

Technical Field

[0001] The present invention relates to the technical field of the Internet of Things, and in particular, to a smart home system and a control method thereof. Background Art

[0002] With the development of the Internet of Things technology, smart homes have been gradually popularized. Currently, smart homes have connected AIOT (Artificial Intelligence & Internet of Things) device control, but there has been no breakthrough in voice services. It still remains at the stage of controlling smart home devices in a smart home through voice (single control or scenario control). However, how to obtain the services of another or a series of devices through voice at the device terminal of a smart home is still a difficult problem, and how to integrate smart home services through voice is still an issue to be solved. Summary of the Invention

[0003] To solve the problems of the prior art, embodiments of the present disclosure provide a smart home system and a control method thereof. The technical solutions are as follows:

[0004] According to one aspect of the present disclosure, a smart home system is provided. The smart home system includes a plurality of smart terminals and a central control cloud platform, wherein:

[0005] The first smart terminal is configured to receive a voice command initiated by a user; judge the request command type of the voice command based on the semantics of the voice command; judge whether to perform distributed voice control based on the request command type; if so, upload the voice command to the central control cloud platform;

[0006] The central control cloud platform is configured to control at least one second smart terminal corresponding to the request command type to execute the voice command.

[0007] Optionally, the first smart terminal is configured to:

[0008] If the request command type is the first command type, the judgment result of whether to perform distributed voice control is no, and the first command type is used to indicate that the voice command is to be responded to by the first smart terminal itself;

[0009] If the request command type is the second command type, the judgment result of whether to perform distributed voice control is yes, and the second command type is used to indicate that the voice command has the possibility of being responded to by a second smart terminal.

[0010] Optionally, the central control cloud platform is configured to determine at least one second smart terminal corresponding to the second command type, and send the voice command to the at least one second smart terminal;

[0011] The second intelligent terminal is used to execute the voice instruction and return the execution result of the voice instruction to the central control cloud platform.

[0012] Optionally, the first intelligent terminal is further used for:

[0013] When the request instruction type is the second instruction type, if the voice instruction is executed, the execution result of the voice instruction is uploaded to the central control cloud platform.

[0014] Optionally, the central control cloud platform is further used to return the final execution result of the voice instruction to the first intelligent terminal, and the final execution result includes the execution results of the first intelligent terminal and / or the at least one second intelligent terminal;

[0015] The first intelligent terminal is further used to perform user feedback processing on the final execution result.

[0016] Optionally, when the request instruction type is the first instruction type, if a replacement instruction initiated by the user is received during the execution of the voice instruction, the first intelligent terminal is further used to upload the voice instruction to the central control cloud platform;

[0017] The central control cloud platform is further used to control the third intelligent terminal corresponding to the first instruction type to execute the voice instruction and return the execution result of the third intelligent terminal to the first intelligent terminal.

[0018] Optionally, when receiving an update instruction for the fourth intelligent terminal initiated by the user, the first intelligent terminal is further used to upload the update instruction to the central control cloud platform;

[0019] The central control cloud platform is further used to send the update instruction to the fourth intelligent terminal;

[0020] The fourth intelligent terminal is used to execute the update instruction.

[0021] Optionally, the fourth intelligent terminal is further used to return the update result of the update instruction to the central control cloud platform;

[0022] The central control cloud platform is further used to return the update result to the first intelligent terminal;

[0023] The first intelligent terminal is further used to perform user feedback processing on the update result.

[0024] According to another aspect of the present disclosure, there is also provided a control method for a smart home system, the smart home system includes a plurality of intelligent terminals and a central control cloud platform, and the method includes:

[0025] Receive a voice command initiated by a user through a first intelligent terminal;

[0026] Based on the semantics of the voice command, determine the request command type of the voice command; based on the request command type, determine whether to perform distributed voice control;

[0027] If so, upload the voice command to the central control cloud platform;

[0028] Control at least one second intelligent terminal corresponding to the request command type to execute the voice command.

[0029] Optionally, the control method is implemented by a voice control module of the central control cloud platform.

[0030] The present disclosure performs integrated processing of smart home services through a smart home central control cloud platform, solves the drawback that smart home can perform cross-device control but services cannot be cross-device integrated, improves the service ability and user experience of smart home in the smart home, especially the integrated interaction experience of smart home in the smart home through voice interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In the following description of exemplary embodiments with reference to the drawings, more details, features, and advantages of the present disclosure are disclosed. In the drawings:

[0032] Figure 1 Shows a schematic diagram of a smart home system according to an exemplary embodiment of the present disclosure;

[0033] Figure 2 Shows a flowchart of a control method for a smart home system according to another exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0034] Embodiments of the present disclosure will be described in more detail below with reference to the drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0035] It should be understood that the steps recited in the method embodiments of the present disclosure can be executed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this regard.

[0036] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description. It should be noted that the concepts such as "first", "second", etc. mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0037] It should be noted that the modification of "one" and "a plurality of" mentioned in this disclosure is illustrative rather than restrictive. Those skilled in the art should understand that unless otherwise clearly specified in the context, it should be understood as "one or more".

[0038] The names of the messages or information exchanged between multiple devices in the embodiments of this disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0039] The solutions of this disclosure will be described below with reference to the accompanying drawings.

[0040] The embodiments of this disclosure provide a smart home system. Referring to Figure 1 the schematic diagram of the smart home system shown, the smart home system includes multiple intelligent terminals and a central control cloud platform. Among them:

[0041] The first intelligent terminal is used to receive a voice command initiated by a user; judge the request command type of the voice command based on the semantics of the voice command; based on the request command type, judge whether to perform distributed voice control; if so, upload the voice command to the central control cloud platform;

[0042] The central control cloud platform is used to control at least one second intelligent terminal corresponding to the request command type to execute the voice command.

[0043] Optionally, the central control cloud platform is used to determine at least one second intelligent terminal corresponding to the second command type and send the voice command to at least one second intelligent terminal;

[0044] The second intelligent terminal is used to execute the voice command and return the execution result of the voice command to the central control cloud platform.

[0045] In a possible implementation, a user can deploy intelligent terminals of multiple smart homes and a server of a central control cloud platform connected to the intelligent terminals in a smart home. The intelligent terminal authorizes the central control cloud platform to obtain device control and service access permissions, and the central control cloud platform registers the smart home service types of the intelligent terminal (such as: alarm reminder, office reminder, travel reminder, catering service, express service, shopping service, film and television entertainment, pet service, security service, etc.), registers according to the service types that the intelligent terminal can provide, and verifies the service during registration, that is, sends a test instruction to the intelligent terminal through the central control cloud platform, and the intelligent terminal should be able to respond with the response data of the registered service type. For example, when a device registers for "office reminder" (such as calling user xx to have a meeting at 3 o'clock), the central control cloud platform sends a corresponding test instruction to the device, and when the response of the device (the response is like: "calling user xx to have a meeting at 3 o'clock" has been set, device xx will remind you at 2:55 and call user xx on time at 3 o'clock) meets the registration standard, the registration of the "office reminder" service type is completed.

[0046] The user issues a voice command on a certain intelligent terminal (i.e., the first intelligent terminal) in the smart home. The first intelligent terminal judges whether the voice command is for the device itself or for distributed voice control, that is, for other devices or for combining multiple devices, according to the semantics of the voice command. If it is for distributed voice control, the first intelligent terminal can report the user's voice command to the central control cloud platform. The central control cloud platform selects other intelligent terminals (i.e., the second intelligent terminal) for responding to the voice command according to the authorization situation and service type of the intelligent terminal, and sends the voice command to the selected second intelligent terminal. The second intelligent terminal responds to the voice command sent by the central control cloud platform and returns the execution result.

[0047] Optionally, the first intelligent terminal can be used to perform the following processing:

[0048] If the request instruction type is the first instruction type, then the judgment result of whether to perform distributed voice control is no;

[0049] If the request instruction type is the second instruction type, then the judgment result of whether to perform distributed voice control is yes.

[0050] Among them, the first instruction type is used to indicate that the voice command is to be responded to by the first intelligent terminal itself. Usually, the voice conversation chat type and film and television music type of the device will be defaulted to be for the device itself, and the first instruction type is not limited in this embodiment.

[0051] The second instruction type is used to indicate the possibility that the voice instruction can be responded to by a second intelligent terminal, that is, distributed voice control can be performed to control other intelligent terminals. If the intelligent terminal registers for the smart home service type on the central control cloud platform, it is defaulted that this service type is for smart home services and distributed voice control can be performed. If it is not used to respond to smart home services, the corresponding permissions can be turned off at the terminal.

[0052] As an example, the user issues a sentence "What's the weather like today", corresponding to the weather service type. If the weather service type is the instruction type that the first intelligent terminal responds to by itself, the first intelligent terminal can respond to the weather service.

[0053] The user issues a sentence "What meetings do I have to attend today", corresponding to the office reminder service type. If the office reminder service type belongs to the smart home service type and distributed voice control can be performed, the first intelligent terminal can upload the corresponding voice instruction to the central control cloud platform.

[0054] Optionally, the first intelligent terminal can also be used to upload the execution result of the voice instruction to the central control cloud platform when the requested instruction type is the second instruction type and the voice instruction is executed.

[0055] In a possible implementation manner, when the voice instruction is of the smart home service type, the first intelligent terminal can also execute the voice instruction on the device itself and upload the execution result to the central control cloud platform.

[0056] As an example, the user issues a sentence "What meetings do I have to attend today", corresponding to the office reminder service type. If the office reminder service type belongs to the smart home service type and distributed voice control can be performed, the first intelligent terminal can query on the device itself whether there are meeting records that the user needs to attend and report the instruction execution result to the central control cloud platform. For example, if not, report none. Correspondingly, the instruction: "What meetings do I have to attend today"; instruction type: office reminder; execution device: the first intelligent terminal; instruction execution result: none. And synchronously report the user's voice instruction "What meetings do I have to attend today" to the central control cloud platform.

[0057] Optionally, the central control cloud platform is also used to return the final execution result of the voice instruction to the first intelligent terminal, and the final execution result includes the execution results of the first intelligent terminal and / or at least one second intelligent terminal;

[0058] The first intelligent terminal is also used to perform user feedback processing on the final execution result.

[0059] In a possible implementation, the central control cloud platform may integrate the execution results of all intelligent terminals for responding to voice instructions to obtain a final execution result, and return the final execution result to the first intelligent terminal. Furthermore, the first intelligent terminal may perform user feedback processing on the final execution result. For example, it may provide feedback to the user in the form of text, images, voice, etc.

[0060] As an example, if the intelligent terminals for responding to the above instruction "What meetings do I have to attend today?" are intelligent terminal C and intelligent terminal N, the information returned by intelligent terminal C may be "Instruction:

What meetings do I have to attend today?

Call user xx for a meeting at 3 o'clock

What meetings do I have to attend today?

[0061] Optionally, the first intelligent terminal is further configured to, when the requested instruction type is the first instruction type, if a replacement instruction initiated by the user is received during the execution of the voice instruction, upload the voice instruction to the central control cloud platform;

[0062] The central control cloud platform is further configured to control a third intelligent terminal corresponding to the first instruction type to execute the voice instruction, and return the execution result of the third intelligent terminal to the first intelligent terminal.

[0063] As an example, when the user issues a voice instruction "I want to listen to the cross talk of XX" to the first intelligent terminal, during the playback of the cross talk, if the user continuously says "It's not good to listen to", "It's too long", etc., a replacement instruction may be triggered. Then the first intelligent terminal may stop playing and upload the above voice instruction to the central control cloud platform. The central control cloud platform issues the voice instruction to the third intelligent terminal providing the corresponding service, and the third intelligent terminal queries the cross talk data of XX. After the central control cloud platform receives the cross talk data returned by the third intelligent terminal, it may return it to the first intelligent terminal and play the queried cross talk through the first intelligent terminal.

[0064] Optionally, the first intelligent terminal is further configured to, when receiving an update instruction initiated by the user for the fourth intelligent terminal, upload the update instruction to the central control cloud platform;

[0065] The central control cloud platform is also used to send an update instruction to the fourth intelligent terminal;

[0066] The fourth intelligent terminal is used to execute the update instruction.

[0067] Optionally, the fourth intelligent terminal is also used to return the update result of the update instruction to the central control cloud platform;

[0068] The central control cloud platform is also used to return the update result to the first intelligent terminal;

[0069] The first intelligent terminal is also used to perform user feedback processing on the update result.

[0070] In a possible implementation manner, a user can change and adjust the service status of each intelligent terminal. As an example, if it is necessary to cancel the meeting reminder of intelligent terminal C (i.e., the fourth intelligent terminal) today, the user can send a corresponding update instruction to intelligent terminal A (i.e., the first intelligent terminal), and intelligent terminal A uploads the instruction to the central control cloud platform. Further, the central control cloud platform can send the update instruction to intelligent terminal C, and intelligent terminal C completes the cancellation of the meeting and returns the update result. The central control cloud platform feeds back the update result to intelligent terminal A, and intelligent terminal A can send a feedback message "You have cancelled the meeting reminder of intelligent terminal C".

[0071] The present disclosure performs integrated processing of smart home services through a smart home central control cloud platform, solves the drawback that smart home can control across devices but services cannot be integrated across devices, improves the service ability and user experience of smart home in the smart home, especially the integrated interaction experience of smart home through voice interaction.

[0072] This embodiment provides the control method of the above smart home system. Refer to Figure 2 the shown control method flowchart. The control method includes the following steps 201-204.

[0073] Step 201, receiving a voice instruction initiated by a user through a first intelligent terminal;

[0074] Step 202, judging the request instruction type of the voice instruction based on the semantics of the voice instruction; based on the request instruction type, judging whether to perform distributed voice control;

[0075] Step 203, if so, uploading the voice instruction to the central control cloud platform;

[0076] Step 204, controlling at least one second intelligent terminal corresponding to the request instruction type to execute the voice instruction.

[0077] The implementation manners of the control method have been introduced in the above embodiments and will not be elaborated here.

[0078] Optionally, the control method may be implemented by a voice control module of the central control cloud platform. The voice control module may be distributed on each intelligent terminal and is used to convert the voice issued by the user into a corresponding voice command, thereby realizing voice interaction between the user and the device.

[0079] The present disclosure performs integrated processing of smart home services through the central control cloud platform of the smart home, solves the shortcoming that smart home can perform cross-device control but services cannot be cross-device integrated, improves the service ability and user experience of the smart home in the smart home, especially the integrated interaction experience of the smart home in the smart home through voice interaction.

Claims

1. A smart home system, characterized in that, the smart home system includes multiple intelligent terminals and a central control cloud platform, where: The first intelligent terminal is used to receive a voice command initiated by a user; judge the request command type of the voice command based on the semantics of the voice command; judge whether to perform distributed voice control based on the request command type; if so, upload the voice command to the central control cloud platform; The central control cloud platform is used to control at least one second intelligent terminal corresponding to the request command type to execute the voice command.

2. The smart home system according to claim 1, characterized in that, the first intelligent terminal is used for: If the request command type is the first command type, and the judgment result of whether to perform distributed voice control is no, the first command type is used to indicate that the voice command is to be responded to by the first intelligent terminal itself; If the request command type is the second command type, and the judgment result of whether to perform distributed voice control is yes, the second command type is used to indicate that the voice command has the possibility of being responded to by a second intelligent terminal.

3. The smart home system according to claim 2, characterized in that, The central control cloud platform is used to determine at least one second intelligent terminal corresponding to the second command type, and send the voice command to the at least one second intelligent terminal; The second intelligent terminal is used to execute the voice command and return the execution result of the voice command to the central control cloud platform.

4. The smart home system according to claim 2, characterized in that, The first intelligent terminal is further used for: When the request command type is the second command type, if the voice command is executed, upload the execution result of the voice command to the central control cloud platform.

5. The smart home system according to any one of claims 3 or 4, characterized in that, The central control cloud platform is further used to return the final execution result of the voice command to the first intelligent terminal, and the final execution result includes the execution results of the first intelligent terminal and / or the at least one second intelligent terminal; The first intelligent terminal is further used to perform user feedback processing on the final execution result.

6. The smart home system according to claim 2, characterized in that, The first intelligent terminal is further used for when the request command type is the first command type, if a replacement command initiated by the user is received during the execution of the voice command, upload the voice command to the central control cloud platform; The central control cloud platform is further used to control a third intelligent terminal corresponding to the first command type to execute the voice command, and return the execution result of the third intelligent terminal to the first intelligent terminal.

7. The smart home system according to claim 1, characterized in that, The first intelligent terminal is further used for when receiving an update command initiated by the user for the fourth intelligent terminal, uploading the update command to the central control cloud platform; The central control cloud platform is further used to send the update command to the fourth intelligent terminal; The fourth intelligent terminal is used to execute the update command.

8. The smart home system according to claim 7, wherein, the fourth smart terminal is further configured to return the update result of the update instruction to the central control cloud platform; the central control cloud platform is further configured to return the update result to the first smart terminal; the first smart terminal is further configured to perform user feedback processing on the update result.

9. A control method for a smart home system, wherein, the smart home system includes a plurality of smart terminals and a central control cloud platform, and the method includes: receiving a voice instruction initiated by a user through a first smart terminal; judging the request instruction type of the voice instruction based on the semantics of the voice instruction; judging whether to perform distributed voice control based on the request instruction type; if so, uploading the voice instruction to the central control cloud platform; controlling at least one second smart terminal corresponding to the request instruction type to execute the voice instruction.

10. The control method according to claim 9, wherein, the control method is implemented by a voice control module of the central control cloud platform.

Images