A voice remote control system and method based on smart home

Abstract

This invention discloses a voice remote control system based on smart homes. The system includes a voice command receiving device, an operation command issuing device, and an operation entity. The system is configured to: receive a first voice command issued by a user by the voice command receiving device; send the first voice command to the operation command issuing device by the voice command receiving device; convert the first voice command into multiple operation commands by the operation command issuing device and generate a first operation command queue; receive a second voice command issued by the user by the voice command receiving device; send the second voice command to the operation command issuing device by the voice command receiving device; convert the second voice command into a single operation command by the operation command issuing device; insert the single operation command into the first operation command queue by the operation command issuing device and prioritize sending the single operation command to the operation entity.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of smart home, and in particular to a voice remote control system and method based on smart home. BACKGROUND

[0002] Smart home system greatly facilitates people's life, for example, some more advanced smart home systems currently have allowed owners to voice control various smart home appliances, and the smart home appliances can run autonomously based on the voice commands of the owners without intervention. Such systems generally require the following components: a voice command receiving device, an operation command issuing device, and an operation entity. Among them, the voice command receiving device is used to receive the voice command of the owner, and then the voice command receiving device can encode the voice command of the owner in a known audio encoding method, and send the encoded audio signal to the operation command issuing device; after receiving the encoded audio signal, the operation command issuing device first synthesizes the signal into a voice command, and identifies the voice through known voice recognition software, and then the operation command issuing device generates a series of operation commands for operating the smart home appliances according to the command content of the owner identified, and controls the smart home appliances to run through the operation command, wherein the smart home appliances can be some examples of the operation entity.

[0003] In the operation process of the existing system, it is found that even without transmission delay, some commands still have obvious delay when executed. The existing technology has not found the mechanism of such delay, and lacks a solution to such delay. SUMMARY

[0004] To achieve the above-mentioned purpose, the present application provides a voice remote control system based on smart home, characterized in that the system comprises a voice command receiving device, an operation command issuing device and an operation entity, and the system is configured to:

[0005] receive a first voice command issued by a user by the voice command receiving device;

[0006] send the first voice command to the operation command issuing device by the voice command receiving device;

[0007] convert the first voice command into a plurality of operation commands by the operation command issuing device, and generate a first operation command queue, wherein the first operation command queue comprises a plurality of operation commands arranged in operation order and an anchor command;

[0008] receive a second voice command issued by a user by the voice command receiving device;

[0009] send the second voice command to the operation command issuing device by the voice command receiving device;

[0010] translating the second voice command into a single operation command by the operation command issuing device;

[0011] inserting the single operation command into the first operation command queue by the operation command issuing device, and sending the single operation command to the operation entity preferentially.

[0012] In a preferred embodiment, each of the plurality of operation commands has a priority level, wherein the first operation command queue comprises at least operation command A, operation command B and operation command C arranged in sequence;

[0013] inserting the single operation command into the first operation command queue by the operation command issuing device, and sending the single operation command to the operation entity preferentially, specifically comprises the following steps:

[0014] determining, by the operation command issuing device, whether the priority level of the single operation command is greater than the priority level of operation command A;

[0015] If the operation command issuing device determines that the priority level of the single operation command is less than the priority level of operation command A, the operation command issuing device continues to determine whether the priority level of the single operation command is greater than the priority level of operation command B.

[0016] In a preferred embodiment, inserting the single operation command into the first operation command queue by the operation command issuing device, and sending the single operation command to the operation entity preferentially, specifically further comprises the following steps:

[0017] If the operation command issuing device determines that the priority level of the single operation command is greater than the priority level of operation command B, the operation command issuing device continues to determine whether operation command B is contradictory to the anchor command after moving operation command B in the first operation command queue.

[0018] If the operation command issuing device determines that operation command B is not contradictory to the anchor command after moving operation command B in the first operation command queue, the operation command issuing device moves the single operation command before operation command B.

[0019] sending the single operation command to the operation entity by the operation command issuing device at a low transmission power.

[0020] In a preferred embodiment, the anchor command records an effective operation time range of operation command B, and determining whether operation command B is contradictory to the anchor command specifically comprises the following steps:

[0021] whether the time at which the operation command issuing device sends the operation command B is located in the valid operation time range of the operation command B after the operation command issuing device sends the single operation command to the operation entity preferentially;

[0022] If the operation command issuing device judges that the time at which the operation command B is sent is located in the valid operation time range of the operation command B, the operation command issuing device judges that the operation command B is not contradictory to the anchor command.

[0023] In a preferred embodiment, the system is further configured to:

[0024] After the operation command issuing device sends the single operation command to the operation entity at the low transmission power, the operation command issuing device judges whether the operation entity receives the single operation command;

[0025] If the operation command issuing device judges that the operation entity does not receive the single operation command, the operation command issuing device determines the position of the operation entity;

[0026] After the operation command issuing device determines the position of the operation entity, the operation command issuing device sends the moving command to the operation entity at the maximum transmission power;

[0027] After the operation entity receives the moving command, the operation entity moves the position of the operation entity according to the moving command.

[0028] In a preferred embodiment, the system is further configured to:

[0029] After the operation entity moves the position, the operation command issuing device sends the single operation command to the operation entity at the low transmission power again;

[0030] After the operation command issuing device sends the single operation command to the operation entity at the low transmission power again, the operation command issuing device re-judges whether the operation entity receives the single operation command;

[0031] If the operation command issuing device judges that the operation entity does not receive the single operation command, the operation command issuing device determines other operation entities located around the operation entity.

[0032] In a preferred embodiment, the system is further configured to:

[0033] After the operation command issuing device determines the other operation entities located around the operation entity, the operation command issuing device requires the other operation entities to establish the Bluetooth communication connection with the operation entity;

[0034] After the operation command issuing device determines the other operation entities located around the operation entity, the operation command issuing device sends the single operation command to the other operation entities;

[0035] sending the single operation command to the operation entity by the other operation entity through the Bluetooth communication mode.

[0036] The application provides a voice remote control method based on smart home, characterized in that the method comprises:

[0037] receiving, by the voice command receiving device, a first voice command issued by a user;

[0038] sending, by the voice command receiving device, the first voice command to the operation command issuing device;

[0039] converting, by the operation command issuing device, the first voice command into a plurality of operation commands, and generating a first operation command queue, wherein the first operation command queue comprises the plurality of operation commands arranged in operation sequence and an anchor command;

[0040] receiving, by the voice command receiving device, a second voice command issued by the user;

[0041] sending, by the voice command receiving device, the second voice command to the operation command issuing device;

[0042] converting, by the operation command issuing device, the second voice command into a single operation command;

[0043] inserting, by the operation command issuing device, the single operation command into the first operation command queue, and sending the single operation command to the operation entity preferentially.

[0044] In a preferred embodiment, each of the plurality of operation commands has a priority level, wherein the first operation command queue comprises at least operation command A, operation command B and operation command C arranged continuously;

[0045] wherein inserting, by the operation command issuing device, the single operation command into the first operation command queue, and sending the single operation command to the operation entity preferentially comprises the following steps:

[0046] judging, by the operation command issuing device, whether the priority level of the single operation command is greater than the priority level of operation command A;

[0047] if the operation command issuing device judges that the priority level of the single operation command is less than the priority level of operation command A, then the operation command issuing device continues to judge whether the priority level of the single operation command is greater than the priority level of operation command B.

[0048] In a preferred embodiment, inserting, by the operation command issuing device, the single operation command into the first operation command queue, and sending the single operation command to the operation entity preferentially further comprises the following steps:

[0049] If the operation command issuing device judges that the priority level of the single operation command is greater than the priority level of the operation command B, the operation command issuing device continues to judge whether the operation command B contradicts the anchor command after the single operation command is moved to the position before the operation command B in the first operation command queue;

[0050] If the operation command issuing device judges that the operation command B does not contradict the anchor command after the single operation command is moved to the position before the operation command B in the first operation command queue, the operation command issuing device moves the single operation command to the position before the operation command B.

[0051] The operation command issuing device sends the single operation command to the operation entity at a low transmission power.

[0052] Compared with the prior art, the present application has the following advantages. The prior art generally does not allow an operation command to be inserted before another time-sensitive operation command, so that the sending causes the sending time of certain operation commands to be delayed, thereby causing a large delay in the execution of certain voice commands in some cases. The method designed by the present application aims to solve the foregoing technical problems. BRIEF DESCRIPTION OF DRAWINGS

[0053] Figure 1 is a method flowchart of an embodiment of the present application. DETAILED DESCRIPTION

[0054] The specific embodiments of the present application are described in detail below with reference to the accompanying drawings, but it should be understood that the scope of protection of the present application is not limited by the specific embodiments.

[0055] After our research, we found that the execution of some voice commands has a large delay due to the following reasons: in the current system, the operation command issuing device converts the voice command into an operation command and then sends the operation command to the operation entity in sequence. In an example, the user issues a "stir-fry" voice command, and then the voice command receiving device sends the "stir-fry" voice command to the operation command issuing device. The operation command issuing device then converts the "stir-fry" voice command into multiple operation commands, such as heating-oil addition-ingredient addition-stir-fry-sauce addition-herb addition-heating oil completion. Then, the operation command issuing device sends these operation commands to the stir-fry machine in sequence according to the predetermined time. The entire stir-fry process lasts for 10 minutes, for example, and during the entire 10 minutes, the operation command issuing device may also receive a "sweeping" voice command issued by the user. The voice command receiving device then converts the "sweeping" voice command into an operation command to start the sweeping robot. In the existing execution logic, the prior art does not allow an operation command to start the sweeping robot to be inserted between the addition of the sauce and the addition of the herb, for example, because the time between the addition of the sauce and the addition of the herb is only 10 seconds, and both commands are time-sensitive operation commands. Therefore, if the operation command issuing device has sent the sauce addition command, and then generates an operation command to start the sweeping robot, the prior art does not allow the operation command to start the sweeping robot to be sent before the operation command to add the herb is sent, so the timing of sending the operation command to start the sweeping robot is delayed, resulting in a large delay in the execution of some voice commands in some cases. The method designed by the present application aims to solve the above technical problems.

[0056] Figure 1 The method flowchart of an embodiment of the present application is shown in the figure. As shown in the figure, the method of the present application comprises the following steps:

[0057] Step 1: receiving a first voice command issued by a user by a voice command receiving device; in an example, the first voice command may be a "stir-fry" voice command;

[0058] Step 2: sending the first voice command to the operation command issuing device by the voice command receiving device;

[0059] Step 3: converting the first voice command into a plurality of operation commands by the operation command issuing device, and generating a first operation command queue, wherein the first operation command queue comprises the plurality of operation commands arranged in operation sequence and an anchor command; in an example, the operation command issuing device can convert the voice command of "stir-frying" into a plurality of operation commands of "heating-oil injection-ingredient addition-stir-frying-sauce addition-flavoring addition-oil heating-finish", and put the plurality of operation commands into the first operation command queue, wherein the aforementioned commands are arranged in sequence in the first operation command queue;

[0060] Step 4: receiving a second voice command issued by a user by the voice command receiving device; in an example, the second voice command can be a voice command of "sweeping".

[0061] Step 5: sending the second voice command to the operation command issuing device by the voice command receiving device.

[0062] Step 6: converting the second voice command into a single operation command by the operation command issuing device; in an example, the operation command issuing device can convert the voice command of "sweeping" into an operation command of "sweeping".

[0063] Step 7: inserting the single operation command into the first operation command queue, and sending the single operation command to the operation entity preferentially by the operation command issuing device.

[0064] In a preferred embodiment, each of the plurality of operation commands has a priority level, wherein the first operation command queue comprises at least operation command A, operation command B and operation command C arranged in sequence; in an example, the four operation commands of heating, oil injection, ingredient addition and stir-frying can have the highest priority level, because the four commands are necessary operation commands for starting the entire stir-frying process; the three operation commands of sauce addition, flavoring addition and oil heating can have the lowest priority level, because the three commands are not necessary operation commands for starting the entire stir-frying process.

[0065] wherein inserting the single operation command into the first operation command queue and sending the single operation command to the operation entity preferentially by the operation command issuing device specifically comprises the following steps:

[0066] The operation command issuing device judges whether the priority level of the single operation command is greater than the priority level of the operation command A; the size relationship of the priority levels can be defined freely, for example, in one instance, the priority level of the single operation command can be defined as level 2, and the priority level of the operation command A can be level 1, in this case, the priority level of the single operation command is less than the priority level of the operation command A; in another instance, the priority level of the single operation command can be defined as level 2, and the priority level of the operation command A can be level 3, in this case, the priority level of the single operation command is less than the priority level of the operation command A;

[0067] If the operation command issuing device judges that the priority level of the single operation command is less than the priority level of the operation command A, the operation command issuing device continues to judge whether the priority level of the single operation command is greater than the priority level of the operation command B. It should be understood by those skilled in the art that, in the operation command A, the operation command B and the operation command C arranged in sequence, the priority level of the operation command B needs to be less than or equal to the priority level of the operation command A, and the priority level of the operation command C needs to be less than or equal to the priority level of the operation command B, through the setting of the operation command issuing device.

[0068] In a preferred embodiment, the operation command issuing device inserts the single operation command into the first operation command queue and preferentially sends the single operation command to the operation entity, and the method further comprises the following steps:

[0069] If the operation command issuing device judges that the priority level of the single operation command is greater than the priority level of the operation command B, the operation command issuing device continues to judge whether the operation command B is contradictory to the anchor command after moving the operation command B in the first operation command queue.

[0070] If the operation command issuing device judges that the operation command B is not contradictory to the anchor command after moving the operation command B in the first operation command queue, the operation command issuing device moves the single operation command before the operation command B.

[0071] The operation command issuing device sends the single operation command to the operation entity at a low transmission power.

[0072] In a preferred embodiment, the anchor command records the valid operation time range of the operation command B, in one instance, for example, the valid operation time range of the operation command B can be defined as (t, t+10s); for example, the valid operation time range of adding seasoning can be defined as (t, t+10s), that is, the operation command of adding seasoning can be sent at the earliest time t and needs to be sent at the latest time t+10s.

[0073] The judgment of whether the operation command B is contradictory to the anchor command comprises the following steps:

[0074] If the operation command issuing device predicts that the time of sending the operation command B by the operation command issuing device after sending the single operation command to the operation entity is located in the valid operation time range of the operation command B, for example, the valid operation time range of the operation command B can be defined as (t, t+10s) in an example, and the current time is t-1s, the operation command issuing device predicts the time required for sending the single operation command to the operation entity, for example, the time is 2s, and the predicted time of sending the operation command B is t+1s, which is located in the valid operation time range of the operation command B defined as (t, t+10s), that is, the operation command issuing device judges that the operation command B is not contradictory to the anchor command.

[0075] If the operation command issuing device judges that the time of sending the operation command B is located in the valid operation time range of the operation command B, the operation command issuing device judges that the operation command B is not contradictory to the anchor command.

[0076] In a preferred embodiment, the system is further configured to:

[0077] After the operation command issuing device sends the single operation command to the operation entity at a low transmission power, the operation command issuing device judges whether the operation entity receives the single operation command; in an example, if the operation command issuing device does not receive the feedback of having received the single operation command from the operation entity, the operation command issuing device considers that the operation entity does not receive the single operation command; in an example, if the operation command issuing device continuously sends the single operation command to the operation entity for multiple times, and the operation command issuing device does not receive the feedback of having received the single operation command from the operation entity all the time, the operation command issuing device considers that the operation entity does not receive the single operation command.

[0078] If the operation command issuing device judges that the operation entity does not receive the single operation command, the operation command issuing device determines the position of the operation entity; in an example, in the environment of the smart home, the common reason that the operation entity cannot receive the command sent by the operation command issuing device is that the operation entity is placed close to the corner of the house, and because the thickness of the concrete wall at the corner of the house is large, the operation entity cannot receive the command sent by the operation command issuing device, therefore, the present application designs the related method to solve the problem.

[0079] After the operation command issuing device determines the position of the operation entity, the operation command issuing device sends the moving command to the operation entity at a maximum transmission power.

[0080] After the operating entity receives the movement command, the operating entity moves its position according to the movement command.

[0081] In a preferred embodiment, the system is further configured to: after the operating entity moves the position, the operating command issuing device sends the single operating command to the operating entity again at the low transmission power; after the operating command issuing device sends the single operating command to the operating entity again at the low transmission power, the operating command issuing device re-determines whether the operating entity receives the single operating command; if the operating command issuing device determines that the operating entity does not receive the single operating command, the operating command issuing device determines other operating entities located around the operating entity.

[0082] The system is further configured to: after the operating command issuing device determines the other operating entities located around the operating entity, the operating command issuing device requires the other operating entities to establish a Bluetooth communication connection with the operating entity; after the operating command issuing device determines the other operating entities located around the operating entity, the operating command issuing device sends the single operating command to the other operating entities; the other operating entities send the single operating command to the operating entity through the Bluetooth communication mode.

[0083] It should be understood that the above specific embodiments of the present application are only used for illustrative or explanatory purposes of the principles of the present application, and do not constitute a limitation of the present application. Therefore, any modification, equivalent replacement, improvement, etc. made without departing from the spirit and scope of the present application shall be included in the protection scope of the present application. In addition, the appended claims of the present application are intended to cover all variations and modifications falling within the scope and boundary of the appended claims, or the equivalent forms of such scope and boundary.

Claims

1. A voice remote control system based on smart home, characterized by, The system comprises a voice command receiving device, an operation command issuing device and an operation entity, and is configured to: receive, by the voice command receiving device, a first voice command issued by a user; send, by the voice command receiving device, the first voice command to the operation command issuing device; the first voice command is a voice command for frying; convert, by the operation command issuing device, the first voice command into a plurality of operation commands, and generate a first operation command queue, wherein the first operation command queue comprises the plurality of operation commands arranged in an operation sequence and an anchor command; receive, by the voice command receiving device, a second voice command issued by a user; the second voice command is a voice command for sweeping; send, by the voice command receiving device, the second voice command to the operation command issuing device; convert, by the operation command issuing device, the second voice command into a single operation command; insert, by the operation command issuing device, the single operation command into the first operation command queue, and send the single operation command to the operation entity preferentially, wherein each of the plurality of operation commands has a priority level, and the first operation command queue comprises at least operation command A, operation command B and operation command C arranged in sequence; wherein the operation command issuing device inserts the single operation command into the first operation command queue and sends the single operation command to the operation entity preferentially, and the method further comprises the following steps: determine, by the operation command issuing device, whether the priority level of the single operation command is higher than that of operation command A; if the operation command issuing device determines that the priority level of the single operation command is lower than that of operation command A, continue to determine, by the operation command issuing device, whether the priority level of the single operation command is higher than that of operation command B; if the operation command issuing device determines that the priority level of the single operation command is higher than that of operation command B, continue to determine, by the operation command issuing device, whether operation command B conflicts with the anchor command after moving the position of operation command B in the first operation command queue; if the operation command issuing device determines that operation command B does not conflict with the anchor command after moving the position of operation command B in the first operation command queue, move, by the operation command issuing device, the single operation command before operation command B; send, by the operation command issuing device, the single operation command to the operation entity at a low transmission power.

2. The system of claim 1, wherein, The anchor command records an effective operation time range of operation command B, and the step of determining whether operation command B conflicts with the anchor command comprises the following steps: predict, by the operation command issuing device, whether the time at which the operation command issuing device sends operation command B after sending the single operation command to the operation entity preferentially is within the effective operation time range of operation command B. If the operation command issuing device judges that the time of sending the operation command B is located in the valid operation time range of the operation command B, the operation command issuing device judges that the operation command B is not contradictory to the anchor command.

3. The system of claim 2, wherein, The system is further configured to: After the operation command issuing device sends the single operation command to the operation entity at low transmission power, the operation command issuing device judges whether the single operation command is received by the operation entity; If the operation command issuing device judges that the single operation command is not received by the operation entity, the operation command issuing device determines the position of the operation entity; After the operation command issuing device determines the position of the operation entity, the operation command issuing device sends a moving command to the operation entity at maximum transmission power; After the operation entity receives the moving command, the operation entity moves the position of the operation entity according to the moving command.

4. The system of claim 3, wherein, The system is further configured to: After the operation entity moves the position, the operation command issuing device sends the single operation command to the operation entity at low transmission power again; After the operation command issuing device sends the single operation command to the operation entity at low transmission power again, the operation command issuing device re-judges whether the single operation command is received by the operation entity; If the operation command issuing device judges that the single operation command is not received by the operation entity, the operation command issuing device determines other operation entities located around the operation entity.

5. The system of claim 4, wherein, The system is further configured to: After the operation command issuing device determines the other operation entities located around the operation entity, the operation command issuing device requires the other operation entities to establish a Bluetooth communication connection with the operation entity; After the operation command issuing device determines the other operation entities located around the operation entity, the operation command issuing device sends the single operation command to the other operation entities; The other operation entities send the single operation command to the operation entity through Bluetooth communication.

Images