Smart home voice control system and method based on context awareness

Abstract

The invention discloses a smart home voice control system and method based on context awareness, and the system comprises a voice recognition module which is used for receiving and analyzing a voice instruction of a user; the context sensing module is used for collecting context information of a user; the equipment state monitoring module is used for monitoring the state of the intelligent home equipment in real time; the instruction optimization module is used for optimizing the execution logic of the voice instruction according to the context information and the equipment state; the multi-device cooperation module is used for coordinating operation of a plurality of devices; the user habit learning module is used for analyzing user behavior habits and providing personalized suggestions; the feedback module is used for feeding back an instruction execution result to a user and optimizing system performance; according to the invention, the context information is combined, so that wrong recognition and wrong operation of the voice instruction can be reduced; the system response time is shortened by optimizing instruction execution logic; and more intelligent voice control service is provided through personalized suggestions and multi-device cooperation.

Description

Technical Field

[0001] The present invention relates to the technical field of smart home, and particularly to a smart home voice control system and method based on context awareness. Background Art

[0002] With the popularization of smart home devices, voice control has become one of the main ways for users to interact with devices; however, the existing voice control systems have the following problems: 1. Insufficient context understanding: The system cannot optimize the understanding and execution of voice commands according to the user's context (such as time, location, behavior), resulting in misoperations or response delays.

[0003] 2. Low efficiency of multi-device collaboration: When the user controls multiple devices simultaneously, the system cannot dynamically adjust the command priority according to the device status and user needs.

[0004] 3. Poor personalized experience: The system lacks the ability to learn user habits and cannot provide personalized voice control services.

[0005] Therefore, there is an urgent need for a smart home system that can optimize voice control by combining context information. Summary of the Invention

[0006] The purpose of the present invention is to provide a smart home voice control system and method based on context awareness for the above problems in the prior art, thereby solving all or one of the above problems existing in the prior art.

[0007] To solve the above technical problems, the specific technical solutions of the present invention are as follows: On the one hand, the present invention provides a smart home voice control system based on context awareness, including: A voice recognition module for receiving and parsing the user's voice commands; A context awareness module for collecting the user's context information; A device status monitoring module for real-time monitoring of the status of smart home devices; A command optimization module for optimizing the execution logic of voice commands according to the context information and device status; A multi-device collaboration module for coordinating the operations of multiple devices; A user habit learning module for analyzing the user's behavior habits and providing personalized suggestions; A feedback module for feeding back the command execution results to the user and optimizing the system performance.

[0008] Further, the context information collected by the context awareness module includes time, location, and user behavior habits.

[0009] Further, the device status monitoring module monitors device status including switch status, operation mode, and energy consumption data.

[0010] Further, the instruction optimization module reduces misrecognition and misoperation of voice instructions by combining context information and device status.

[0011] Further, the multi-device collaboration module is also used to dynamically adjust instruction priorities according to device status and user requirements.

[0012] Further, the user habit learning module analyzes user behavior habits through machine learning algorithms.

[0013] Further, the feedback module feeds back the instruction execution result to the user in a voice or visual manner.

[0014] Further, the speech recognition module also supports multi-language and dialect recognition.

[0015] Further, the context awareness module collects user location information through sensors.

[0016] On the other hand, the present invention also provides a context-aware smart home voice control method, including the following steps: Call the speech recognition module to receive and parse the user's voice instruction; Call the context awareness module to collect user context information; Call the device status monitoring module to monitor the status of smart home devices in real time; Call the instruction optimization module to optimize the execution logic of voice instructions according to context information and device status; Call the multi-device collaboration module to coordinate the operations of multiple devices; Call the user habit learning module to analyze user behavior habits and provide personalized suggestions; Call the feedback module to feed back the instruction execution result to the user and optimize the system performance.

[0017] The beneficial effects of the technical solution of the present invention are: 1. The context-aware smart home voice control system described in the present invention can reduce misrecognition and misoperation of voice instructions by combining context information; shorten the system response time by optimizing the instruction execution logic; and provide a more intelligent voice control service through personalized suggestions and multi-device collaboration.

[0018] 2. The context-aware smart home voice control method described in the present invention can orderly call system modules, thereby implementing the system logic of the context-aware smart home voice control system described in the present invention. Brief Description of the Drawings

[0019] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for use in the description of the specific embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0020] Figure 1 It is a schematic diagram of the architecture of the context-aware smart home voice control system described in Embodiment 1 of the present invention; Figure 2 It is a schematic flowchart of the context-aware smart home voice control method described in Embodiment 2 of the present invention. Specific Embodiments

[0021] The following will elaborate on the preferred embodiments of the present invention in conjunction with the drawings, so that the advantages and features of the present invention can be more easily understood by those skilled in the art, thereby making a clearer and more definite definition of the protection scope of the present invention.

[0022] In the description of the present invention, it should be noted that the embodiments described in the present invention are some embodiments of the present invention, rather than all embodiments; based on the embodiments in the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0023] The terms "first", "second", etc. in the specification, claims and drawings of this article are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances, so that the embodiments described in this article can be implemented in an order other than those illustrated or described here. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, device, product or equipment that includes a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or equipment. Embodiment 1

[0024] This embodiment provides a context-aware smart home voice control system, as Figure 1 shown, including: A voice recognition module: used to receive and parse the user's voice commands.

[0025] A context awareness module: used to collect user context information, including time, location, behavior habits, etc.

[0026] Device Status Monitoring Module: Used to monitor the status of smart home devices in real time (such as on / off status, operating mode).

[0027] Instruction Optimization Module: Used to optimize the execution logic of voice instructions based on context information and device status.

[0028] Multi-Device Collaboration Module: Used to coordinate the operations of multiple devices to ensure the priority and order of instruction execution.

[0029] User Habit Learning Module: Used to analyze user behavior habits and provide personalized voice control suggestions.

[0030] Feedback Module: Used to feedback the instruction execution results to the user and optimize the system performance according to the user feedback.

[0031] Specifically, in one implementation, the working logic of each of the above modules is as follows: The voice recognition module receives the user's voice instruction and converts it into text information. For example, when the user says "Turn on the living room light", the system converts it into a text instruction.

[0032] The context awareness module collects the user's context information; for example, when the current time is 8 pm and the user is in the living room, the system determines that the user may need lighting.

[0033] The device status monitoring module checks the current status of the living room light; for example, if the light is off, the system is ready to execute the "turn on" instruction.

[0034] The instruction optimization module optimizes the instruction execution logic according to the context information and device status; for example, if the system detects that the user usually turns on the living room light at 8 pm, it gives priority to executing this instruction.

[0035] The multi-device collaboration module coordinates the operations of multiple devices; for example, when the user says "Turn on the living room light and dim the curtains", the system controls the light and curtain devices simultaneously.

[0036] The user habit learning module analyzes the user's behavior habits; for example, if the user often turns on the living room light at 8 pm, the system will pre-load the relevant instructions in advance.

[0037] The feedback module feedbacks the instruction execution results to the user; for example, the system prompts "The living room light has been turned on and the curtains have been dimmed".

[0038] Specifically, in one implementation, the system architecture of the present invention includes the following components: (i) Hardware layer: Includes voice collection devices (such as microphones), smart home devices (such as lights, curtains) and a central controller.

[0039] (ii)Communication layer: Used for data transmission between devices, supporting communication protocols such as Wi-Fi and Bluetooth.

[0040] (iii)Application layer: Includes speech recognition module, context awareness module, device status monitoring module, instruction optimization module, multi-device collaboration module, user habit learning module, and feedback module.

[0041] Specifically, in one implementation, taking the smart home scenario as an example, the application effects of this system are as follows: 1. The user enters the living room at 8 pm and says, "Turn on the living room lights and play music."

[0042] 2. The system determines the current time and location through the context awareness module, and checks the status of the lights and sound system in combination with the device status monitoring module.

[0043] 3. The instruction optimization module optimizes the instruction execution logic according to user habits (such as preferring to play light music).

[0044] 4. The multi-device collaboration module controls the lighting and sound devices simultaneously to ensure the priority and order of instruction execution.

[0045] 5. The feedback module prompts the user, "The living room lights have been turned on, and light music has been played."

[0046] It should be noted that the above examples are only for explaining the present invention and should not be used to limit the protection scope of the present invention. Embodiment 2

[0047] Based on the same inventive concept as the context-aware smart home voice control system described in Embodiment 1, this embodiment provides a context-aware smart home voice control method, as Figure 2 shown, including the following steps: S100. Call the speech recognition module to receive and parse the user's voice command; S200. Call the context awareness module to collect the user's context information; S300. Call the device status monitoring module to monitor the status of smart home devices in real time; S400. Call the instruction optimization module to optimize the execution logic of the voice command according to the context information and device status; S500. Call the multi-device collaboration module to coordinate the operations of multiple devices; S600. Call the user habit learning module to analyze the user's behavior habits and provide personalized suggestions; S700. Call the feedback module to feedback the instruction execution result to the user and optimize the system performance.

[0048] It should be understood that in various embodiments herein, the sequence numbers of the above processes do not imply the order of execution, and the order of execution of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments herein.

[0049] It should also be understood that in the embodiments herein, the term "and / or" is merely a relationship describing associated objects, indicating that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " herein generally represents an "or" relationship between the associated objects before and after.

[0050] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. To clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described according to functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professionals can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this article.

[0051] Those skilled in the art can clearly understand that for the convenience and conciseness of description, the specific logical processes of the methods described above can refer to the corresponding working processes of the systems, devices, and units in the foregoing method embodiments, and will not be elaborated herein.

[0052] In the several embodiments provided herein, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed couplings or direct couplings or communication connections to each other can be indirect couplings or communication connections through some interfaces, devices, or units, and can also be in electrical, mechanical, or other forms of connection.

[0053] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place, or can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiments herein.

[0054] In addition, in each of the embodiments described herein, the functional units may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0055] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution herein, or the part that contributes to the prior art, or all or part of the technical solution may be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the embodiments herein. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0056] The above are only the embodiments of the present invention, and do not limit the patent scope of the present invention accordingly. Any equivalent structural or equivalent process transformation made by using the content of the specification and drawings of the present invention, or directly or indirectly applied in other related technical fields, shall be equally included in the patent protection scope of the present invention.

Claims

1. A context-aware smart home voice control system, characterized in that: include: A speech recognition module, used to receive and analyze user's voice commands; A context-aware module for collecting user context information; Device status monitoring module, used to monitor the status of smart home devices in real time; A command optimization module, used to optimize the execution logic of voice commands based on context information and device status; Multi-device collaboration module, used to coordinate the operations of multiple devices; User habit learning module, used to analyze user behavior habits and provide personalized suggestions; The feedback module is used to provide feedback of instruction execution results to users and optimize system performance.

2. The context-aware smart home voice control system according to claim 1, characterized in that: The context information collected by the context awareness module includes time, location and user behavior habits.

3. The context-aware smart home voice control system according to claim 1, characterized in that: The device status monitored by the device status monitoring module includes switch status, operation mode and energy consumption data.

4. The context-aware smart home voice control system according to claim 1, characterized in that: The command optimization module reduces misrecognition and misoperation of voice commands by combining context information and device status.

5. The context-aware smart home voice control system according to claim 1, characterized in that: The multi-device collaboration module is also used to dynamically adjust instruction priorities according to device status and user needs.

6. The context-aware smart home voice control system according to claim 1, characterized in that: The user habit learning module analyzes user behavior habits through a machine learning algorithm.

7. The context-aware smart home voice control system according to claim 1, characterized in that: The feedback module feeds back the instruction execution result to the user through voice or visual means.

8. The context-aware smart home voice control system according to claim 1, characterized in that: The speech recognition module is also used to support multi-language and dialect recognition.

9. The context-aware smart home voice control system according to claim 1, characterized in that: The context awareness module collects user location information through sensors.

10. A context-aware smart home voice control method, characterized in that: The following steps are involved: Call the voice recognition module to receive and analyze the user's voice commands; Calling the context awareness module to collect user context information; Call the device status monitoring module to monitor the status of smart home devices in real time; The command optimization module is called to optimize the execution logic of the voice command according to the context information and the device status; Call the multi-device collaboration module to coordinate the operations of multiple devices; Call the user habit learning module to analyze user behavior habits and provide personalized suggestions; The call feedback module provides feedback on the command execution results to the user and optimizes system performance.

Images