Intelligent home appliance language interaction system based on large language model

Abstract

The application discloses an intelligent household appliance language interaction system based on a large language model, which is connected with a smart device through a router, and comprises a user terminal used for inputting and sending a control signal; a large language model cloud server connected with the user terminal and used for receiving a signal of the user terminal, analyzing parameters and generating a structured instruction signal; and an interaction controller connected with the large language model cloud server and used for receiving the structured instruction signal and sending the control to the smart device through the router to enable the smart device to execute a voice instruction. The application comprises the large language model cloud server, can receive different instruction signals, analyze parameters and generate structured instruction signals according to corresponding instruction signals, can satisfy complex, colloquial or language instructions, greatly improves the recognition performance, and improves the intelligence and effectiveness of the control.

Description

Technical Field

[0001] This invention belongs to the field of intelligent home appliance language interaction technology, specifically relating to an intelligent home appliance language interaction system based on a large language model. Background Technology

[0002] Smart home appliances are a common type of electrical appliance controlled by artificial intelligence. However, the voice assistants of existing smart home appliances are static and cannot understand complex, conversational, or contextualized commands. This can affect the language interaction capabilities of smart home appliances and the effectiveness of intelligent control. Summary of the Invention

[0003] The purpose of this invention is to provide a smart home appliance language interaction system based on a large language model.

[0004] The technical solution to achieve the purpose of this invention is a smart home appliance language interaction system based on a large language model, which connects to smart devices via a router and includes a user terminal for user input and control signal issuance. The large language model cloud server is connected to the user terminal for receiving signals from the user terminal, parsing parameters, and generating structured instruction signals. The interactive controller connects to the cloud server of the Big Language Model and is used to receive structured instruction signals and send control to smart devices through a router, enabling the smart devices to execute voice commands.

[0005] A further preferred embodiment is that the large language model cloud server includes an intent recognition module, used to understand user intent through the large language model; The entity extraction module is used to extract actions or parameters; The context management module is used to maintain the state of multi-turn dialogues.

[0006] A further preferred embodiment is that the interactive controller includes a voice input module for microphone array pickup; The text input module is used for inputting control information via a mobile app or remote controller; Multimodal input is used for camera to capture and recognize images.

[0007] A further preferred embodiment is that the system includes the following steps: Step A: The user inputs voice or text information; Step B: The user terminal converts the audio into a text signal; Step C: Construct the context and function list, and send them to the large language model cloud server; Step D: The large language model cloud server identifies the intent and calls a pre-stored function; Step E: The smart device receives the signal and executes the corresponding voice action according to the called function.

[0008] A further preferred embodiment is that in step E, the smart device receives the signal and maps out a specific device instruction signal based on the received signal.

[0009] Compared with the prior art, the present invention has the following positive effects: The present invention includes a large language model cloud server, which can receive different instruction signals, parse parameters according to the corresponding instruction signals and generate structured instruction signals, which can meet complex, colloquial or language instructions, greatly improve its recognition performance, and enhance the intelligence and effectiveness of control. Attached Figure Description

[0010] To make the content of this invention easier to understand, the invention will be further described in detail below with reference to specific embodiments and accompanying drawings, wherein: Figure 1 This is a schematic diagram of the structure of the present invention; Figure 2 This is a flowchart of the present invention.

[0011] Figure labels: Router 1, Smart device 2, User terminal 3, Large language model cloud server 4, Intent recognition module 41, Entity extraction module 42, Context management module 43, Interaction controller 5, Voice input module 51, Text input module 52, Multimodal input 53. Detailed Implementation

[0012] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention. Example

[0013] See Figure 1 and Figure 2As shown, a smart home appliance language interaction system based on a large language model (LLM) is constructed by connecting a router 1 to a smart device 2. The system includes a user terminal 3 for user input and control signals; a large language model (LLM) cloud server 4 connected to the user terminal for receiving signals, parsing parameters, and generating structured instruction signals; and an interaction controller 5 connected to the LLM cloud server for receiving structured instruction signals and sending control commands to the smart device via the router, enabling the smart device to execute voice commands. The LLM cloud server includes an intent recognition module 41 for understanding user intent using the LLM; an entity extraction module 42 for extracting actions or parameters; and a context management module 43 for maintaining multi-turn dialogue. The interaction controller includes a voice input module 51 for microphone array pickup; a text input module 52 for inputting control information via a mobile app or remote controller; and a multimodal input module 53 for capturing and recognizing images from a camera. This system can meet the needs of complex, conversational, and context-sensitive commands, improving the intelligence and effectiveness of control. Its smart devices can be various smart home appliances, such as lamps, air conditioners, televisions, cooking machines, etc.

[0014] In practical applications, the system includes the following steps: Step A: The user inputs voice or text information; Step B: The user terminal converts the audio into a text signal; Step C: Construct the context and function list, and send them to the large language model cloud server; Step D: The large language model cloud server identifies the intent and calls a pre-stored function; Step E: The smart device receives the signal and executes the corresponding voice action according to the called function.

[0015] In step E, the smart device receives the signal and maps out a specific device instruction signal based on the received signal.

[0016] Compared with the prior art, the present invention has the following positive effects: The present invention includes a large language model cloud server, which can receive different instruction signals, parse parameters according to the corresponding instruction signals and generate structured instruction signals, which can meet complex, colloquial or language instructions, greatly improve its recognition performance, and enhance the intelligence and effectiveness of control.

[0017] The standard parts used in this embodiment can be purchased directly from the market, and the non-standard structural parts described in the instruction manual can also be processed without any doubt based on existing technical common sense. At the same time, the connection methods of each component adopt mature conventional methods in the existing technology, and the machinery, parts and equipment all adopt conventional models in the existing technology, so they will not be described in detail here.

[0018] Obviously, the above embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not intended to limit the implementation of the present invention. Those skilled in the art will recognize that other variations or modifications can be made based on the above description. It is neither necessary nor possible to exhaustively list all possible implementations here. However, these obvious variations or modifications derived from the essential spirit of the present invention still fall within the scope of protection of the present invention.

Claims

1. A smart home appliance language interaction system based on a large language model, which connects to smart devices via a router, characterized in that: Includes a user terminal, used for user input and issuing control signals; The large language model cloud server is connected to the user terminal for receiving signals from the user terminal, parsing parameters, and generating structured instruction signals. The interactive controller connects to the cloud server of the Big Language Model and is used to receive structured instruction signals and send control to smart devices through a router, enabling the smart devices to execute voice commands.

2. The intelligent home appliance language interaction system based on a large language model according to claim 1, characterized in that: The large language model cloud server includes an intent recognition module, used to understand user intent through the large language model; The entity extraction module is used to extract actions or parameters; The context management module is used to maintain the state of multi-turn dialogues.

3. The intelligent home appliance language interaction system based on a large language model according to claim 2, characterized in that: The interactive controller includes a voice input module for microphone array pickup; The text input module is used for inputting control information via a mobile app or remote controller; Multimodal input is used for camera to capture and recognize images.

4. The intelligent home appliance language interaction system based on a large language model according to claim 3, characterized in that: The system includes the following steps: Step A: The user inputs voice or text information; Step B: The user terminal converts the audio into a text signal; Step C: Construct the context and function list, and send them to the large language model cloud server; Step D: The large language model cloud server identifies the intent and calls a pre-stored function; Step E: The smart device receives the signal and executes the corresponding voice action according to the called function.

5. The intelligent home appliance language interaction system based on a large language model according to claim 4, characterized in that: In step E, the smart device receives the signal and maps out a specific device instruction signal based on the received signal.

Images