Intelligent entrance machine system based on AI voice interaction and control method thereof

Abstract

The invention discloses an intelligent entrance machine system based on AI voice interaction and a control method thereof, and the system comprises an entrance machine host module, a communication module, an AI voice interaction module, a remote call module, an intelligent home linkage module, a cloud server module and a user terminal module. The communication module is connected with the entrance machine host module and the smart home linkage module, and the AI voice interaction module is connected with the entrance machine host module and the remote call module. Through the AI voice interaction technology, remote conversation, intelligent unlocking and linkage control with intelligent home equipment can be achieved, the user experience and home safety are improved, through the remote conversation and real-time monitoring function, a user can master the dynamic state of a door at any time, home safety is ensured, meanwhile, multiple rounds of conversation and complex instruction recognition are supported, and the user experience is improved. The limitation on user experience and function expansibility is reduced, and the requirements of the user for intelligence and convenience are met.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent door machines, and particularly to an intelligent door machine system based on AI voice interaction and its control method. Background Art

[0002] With the rapid development of Internet of Things (IoT) and artificial intelligence (AI) technologies, smart home systems have gradually become popular. Traditional door machine systems usually only have functions such as video surveillance, intercom, and unlocking, and are unable to conduct intelligent voice interaction with users or perform linkage control with other smart home devices. There are significant limitations in user experience and functional expandability, and they cannot meet the needs of users for intelligence and convenience. In view of the above problems, this application proposes an intelligent door machine system based on AI voice interaction and its control method. Summary of the Invention

[0003] Based on the technical problems existing in the background art, the present invention proposes an intelligent door machine system based on AI voice interaction and its control method.

[0004] The intelligent door machine system based on AI voice interaction proposed by the present invention includes a door machine host module, a communication module, an AI voice interaction module, a remote call module, a smart home linkage module, a cloud server module, and a user terminal module. The communication module is connected to the door machine host module and the smart home linkage module. The AI voice interaction module is connected to the door machine host module and the remote call module. The cloud server module is connected to the smart home linkage module and the user terminal module.

[0005] Preferably, the door machine host module includes a camera, a microphone array, a speaker, and a door lock control unit. The camera is used to collect images at the door, support high-definition video recording and real-time streaming media transmission. The microphone array is used to collect voice signals, support far-field voice recognition and noise suppression. The speaker is used to play voice prompts, visitor conversation content, or system notifications. The door lock control unit is used to control the opening and closing of the electronic door lock, support multiple unlocking methods, and the unlocking methods include password, fingerprint, and remote control.

[0006] Preferably, the communication module supports multiple communication protocols such as Wi-Fi, Bluetooth, and Zigbee, and is used for data interaction with user terminals, cloud servers, and other smart home devices.

[0007] Preferably, the AI voice interaction module includes a speech recognition unit, a natural language processing unit, a dialogue management unit, and a speech synthesis unit. The speech recognition unit uses deep learning algorithms and supports speech recognition in multiple languages and dialects, capable of accurately recognizing user instructions in noisy environments. The natural language processing unit, based on a pre-trained language model, can understand complex user instructions and generate corresponding control commands. The dialogue management unit supports multi-turn conversations and can understand user intentions according to the context, such as "open the door", "call family members", "turn on the lights in the living room". The speech synthesis unit uses TTS (Text-to-Speech) technology and can generate natural and fluent voice feedback.

[0008] Preferably, the remote call module includes a real-time audio and video transmission module, a call notification module, and a remote unlocking module. The real-time audio and video transmission module supports real-time audio and video calls with user mobile phones, tablets, or smartwatch terminal devices via the Internet. The call notification module is used to automatically send notifications to the user terminal when a visitor presses the call button on the door machine, and the user can answer the call through the APP. The remote unlocking module is used for the user to remotely control the opening and closing of the door lock through voice commands or the APP interface.

[0009] Preferably, the smart home linkage module includes a device discovery and binding module, a scene mode configuration module, and an event trigger mechanism. The device discovery and binding module automatically discovers and binds smart home devices through an Internet of Things protocol, which is one of Zigbee, Z-Wave, and Wi-Fi. Smart home devices include smart lights, air conditioners, curtains, and security cameras. The scene mode configuration module supports users to customize scene modes, and the modes can be set as the home mode and the security mode. The home mode automatically turns on the lights and air conditioner in the living room after opening the door, and the security mode activates the security camera and sends an alarm when a stranger is detected. The event trigger mechanism supports event-based linkage control. For example, when the door machine detects the user's return, it automatically executes preset smart home operations.

[0010] Preferably, the cloud server module includes a data storage module, a remote upgrade module, a fault diagnosis module, and a security protection module. The data storage module is used to store user data, voice models, device status, and operation log information. The remote upgrade module supports remote upgrades of firmware and software to ensure the continuous optimization of system functions. The fault diagnosis module is used to monitor the system operation status in real time and provide a fault diagnosis report through cloud data analysis. The security protection module uses encryption communication and authentication technologies to ensure the security of user data.

[0011] Preferably, the user terminal module includes a mobile phone APP, a smartwatch integration module, and a voice assistant integration module. The mobile phone APP provides a user interface and supports functions such as remote control, real-time monitoring, and historical record query. The smartwatch integration module supports receiving notifications and performing simple operations (such as answering calls and remotely unlocking) through the smartwatch. The voice assistant integration module supports integration with third-party voice assistants to achieve cross-platform voice control.

[0012] The present invention also proposes a control method for an intelligent door machine based on AI voice interaction, including the following steps:

[0013] S1: After the door machine system is started, it automatically connects to the cloud server and synchronizes user data and device status;

[0014] S2: The user interacts with the door machine through voice commands and presets scene modes through the smart home linkage module, such as "open the door" or "turn on the lights in the living room". The door machine collects door images and voice signals through the camera and microphone;

[0015] S3: The AI voice interaction module identifies and processes the information collected in S2 to generate corresponding control commands;

[0016] S4: The door lock control unit performs corresponding operations according to the control instructions in S3, such as unlocking, initiating a remote call, or controlling smart home devices;

[0017] S5: The operation result is fed back to the user terminal module through the communication module, and a real-time notification is sent to the mobile phone APP;

[0018] S6: When a visitor presses the call button of the door machine, the door machine system automatically sends a notification to the user's mobile phone APP. The user can conduct a real-time audio and video call with the visitor through the mobile phone APP and control the opening and closing of the door lock;

[0019] S7: The user monitors the door status in real time and performs remote control through the user terminal module.

[0020] Compared with the existing technology, the beneficial effects of the present invention are:

[0021] Through the AI voice interaction technology, the present invention can achieve remote calls, intelligent unlocking, and linkage control with smart home devices, improving the user experience and home security. And through the remote call and real-time monitoring functions, users can always grasp the dynamics at the door to ensure home security. At the same time, it supports multi-round conversations and complex command recognition, reducing the limitations in user experience and functional scalability, and meeting the user's needs for intelligence and convenience. Description of the Drawings

[0022] Figure 1Block diagram of the intelligent door machine system based on AI voice interaction proposed by the present invention;

[0023] Figure 2 Flowchart of the control method of the intelligent door machine based on AI voice interaction proposed by the present invention. Detailed implementation manners

[0024] The present invention will be further explained below in conjunction with specific embodiments.

[0025] Embodiment

[0026] Refer to Figure 1-2 , this embodiment proposes an intelligent door machine system based on AI voice interaction, including a door machine host module, a communication module, an AI voice interaction module, a remote call module, a smart home linkage module, a cloud server module, and a user terminal module. The communication module is connected to the door machine host module and the smart home linkage module. The AI voice interaction module is connected to the door machine host module and the remote call module. The cloud server module is connected to the smart home linkage module and the user terminal module;

[0027] The door machine host module includes a camera, a microphone array, a speaker, and a door lock control unit. The camera is used to collect images at the door, support high-definition video recording and real-time streaming media transmission. The microphone array is used to collect voice signals, support far-field voice recognition and noise suppression. The speaker is used to play voice prompts, visitor conversation content, or system notifications. The door lock control unit is used to control the opening and closing of the electronic door lock, support multiple unlocking methods, and its unlocking methods include password, fingerprint, and remote control;

[0028] The communication module supports multiple communication protocols such as Wi-Fi, Bluetooth, and Zigbee, and is used for data interaction with user terminals, cloud servers, and other smart home devices;

[0029] The AI voice interaction module includes a voice recognition unit, a natural language processing unit, a dialogue management unit, and a voice synthesis unit. The voice recognition unit adopts deep learning algorithms, supports multi-language and multi-dialect voice recognition, and can accurately recognize user instructions in a noisy environment. The natural language processing unit is based on pre-trained language models (such as BERT, GPT), can understand complex user instructions and generate corresponding control commands. The dialogue management unit supports multi-round conversations and can understand user intentions according to the context, such as "open the door", "call family members", "turn on the lights in the living room". The voice synthesis unit adopts TTS (text-to-speech) technology and can generate natural and fluent voice feedback;

[0030] The remote call module includes a real-time audio and video transmission module, a call notification module, and a remote unlocking module. The real-time audio and video transmission module supports real-time audio and video calls with user mobile phones, tablets, or smartwatch terminal devices via the Internet. The call notification module is used to automatically send a notification to the user terminal when a visitor presses the call button on the door machine, and the user can answer the call through the APP. The remote unlocking module is used for the user to remotely control the opening and closing of the door lock through voice commands or the APP interface;

[0031] The smart home linkage module includes a device discovery and binding module, a scene mode configuration module, and an event trigger mechanism. The device discovery and binding module automatically discovers and binds smart home devices through an Internet of Things protocol, which is one of Zigbee, Z-Wave, and Wi-Fi. The smart home devices include smart lights, air conditioners, curtains, and security cameras. The scene mode configuration module supports users to customize scene modes, and the modes can be set to a home mode and a security mode. The home mode automatically turns on the lights and air conditioner in the living room after opening the door, and the security mode starts the security camera and sends an alarm when a stranger is detected. The event trigger mechanism supports event-based linkage control. For example, when the door machine detects that the user has returned home, it automatically executes preset smart home operations;

[0032] The cloud server module includes a data storage module, a remote upgrade module, a fault diagnosis module, and a security protection module. The data storage module is used to store user data, voice models, device status, and operation log information. The remote upgrade module supports remote upgrades of firmware and software to ensure the continuous optimization of system functions. The fault diagnosis module is used to monitor the system operation status in real time and provide a fault diagnosis report through cloud data analysis. The security protection module uses encryption communication and authentication technologies to ensure the security of user data;

[0033] The user terminal module includes a mobile phone APP, a smartwatch integration module, and a voice assistant integration module. The mobile phone APP provides a user interface and supports functions such as remote control, real-time monitoring, and historical record query. The smartwatch integration module supports receiving notifications and performing simple operations (such as answering calls, remote unlocking) through the smartwatch. The voice assistant integration module supports integration with third-party voice assistants to achieve cross-platform voice control.

[0034] This embodiment also proposes a control method for an intelligent door machine based on AI voice interaction, including the following steps:

[0035] S1: After the door machine system starts, it automatically connects to the cloud server and synchronizes user data and device status;

[0036] S2: The user interacts with the door machine through voice commands and preset scene modes through the smart home linkage module, such as "open the door" or "turn on the lights in the living room". The door machine collects the door image and voice signals through the camera and microphone;

[0037] S3: The AI voice interaction module identifies and processes the information collected in S2 to generate corresponding control commands;

[0038] S4: The door lock control unit performs corresponding operations according to the control instructions in S3, such as unlocking, starting a remote call, and controlling smart home devices. When the door machine detects that the user has returned home, it automatically turns on the lights and air conditioner in the living room;

[0039] S5: The operation result is fed back to the user terminal module through the communication module, and a real-time notification is sent to the mobile phone APP;

[0040] S6: When a visitor presses the call button on the door machine, the door machine system automatically sends a notification to the user's mobile phone APP. The user can have a real-time audio and video call with the visitor through the mobile phone APP and control the opening and closing of the door lock;

[0041] S7: The user monitors the door status in real time and performs remote control through the user terminal module;

[0042] Through the AI voice interaction technology, this embodiment can realize remote calls, intelligent unlocking, and linkage control with smart home devices, improving the user experience and home security. Moreover, through the remote call and real-time monitoring functions, users can keep track of the dynamics at the door at any time to ensure home security. At the same time, it supports multi-round conversations and complex instruction recognition, reducing the limitations in user experience and functional scalability and meeting the users' needs for intelligence and convenience.

[0043] The above is only a preferred specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention, according to the technical solution and inventive concept of the present invention, makes equivalent substitutions or changes, and all should be covered by the protection scope of the present invention.

Claims

1. An intelligent door machine system based on AI voice interaction, characterized in that, It includes a main door machine module, a communication module, an AI voice interaction module, a remote call module, a smart home linkage module, a cloud server module, and a user terminal module. The communication module is connected to the main door machine module and the smart home linkage module. The AI voice interaction module is connected to the main door machine module and the remote call module. The cloud server module is connected to the smart home linkage module and the user terminal module.

2. The intelligent door machine system based on AI voice interaction according to claim 1, wherein The main door machine module includes a camera, a microphone array, a speaker, and a door lock control unit. The camera is used to collect images at the door, support high-definition video recording and real-time streaming transmission. The microphone array is used to collect voice signals, support far-field voice recognition and noise suppression. The speaker is used to play voice prompts, visitor conversation content, or system notifications. The door lock control unit is used to control the opening and closing of the electronic door lock, support multiple unlocking methods, and its unlocking methods include password, fingerprint, and remote control.

3. The intelligent door machine system based on AI voice interaction according to claim 1, wherein, The communication module supports multiple communication protocols such as Wi-Fi, Bluetooth, and Zigbee, and is used for data interaction with user terminals, cloud servers, and other smart home devices.

4. The intelligent door machine system based on AI voice interaction according to claim 1, characterized in that, The AI voice interaction module includes a voice recognition unit, a natural language processing unit, a dialogue management unit, and a voice synthesis unit. The voice recognition unit uses deep learning algorithms, supports multi-language and multi-dialect voice recognition, and can accurately recognize user instructions in a noisy environment. The natural language processing unit is based on a pre-trained language model, can understand complex user instructions and generate corresponding control commands. The dialogue management unit supports multi-round conversations, can understand user intentions based on the context. The voice synthesis unit uses TTS (text-to-speech) technology and can generate natural and fluent voice feedback.

5. The intelligent door machine system based on AI voice interaction according to claim 1, characterized in that The remote call module includes a real-time audio and video transmission module, a call notification module, and a remote unlocking module. The real-time audio and video transmission module supports real-time audio and video calls with user mobile phones, tablets, or smartwatch terminal devices through the Internet. The call notification module is used to automatically send a notification to the user terminal when a visitor presses the call button on the door machine, and the user can answer the call through the APP. The remote unlocking module is used for the user to remotely control the opening and closing of the door lock through voice commands or the APP interface.

6. The intelligent door machine system based on AI voice interaction according to claim 1, characterized in that, The smart home linkage module includes a device discovery and binding module, a scene mode configuration module, and an event trigger mechanism. The device discovery and binding module automatically discovers and binds smart home devices through an Internet of Things protocol, and the Internet of Things protocol is one of Zigbee, Z-Wave, and Wi-Fi. Smart home devices include smart lights, air conditioners, curtains, and security cameras. The scene mode configuration module supports users to customize scene modes, and the event trigger mechanism supports event-based linkage control.

7. The intelligent door machine system based on AI voice interaction according to claim 1, characterized in that, The cloud server module includes a data storage module, a remote upgrade module, a fault diagnosis module, and a security protection module. The data storage module is used to store user data, voice models, device status, and operation log information. The remote upgrade module supports remote upgrades of firmware and software to ensure continuous optimization of system functions. The fault diagnosis module is used to monitor the system operation status in real time and provide a fault diagnosis report through cloud data analysis. The security protection module uses encryption communication and authentication technologies to ensure the security of user data.

8. The intelligent door machine system based on AI voice interaction according to claim 1, characterized in that The user terminal module includes a mobile phone APP, a smartwatch integration module, and a voice assistant integration module. The mobile phone APP provides a user interface and supports functions such as remote control, real-time monitoring, and historical record query. The smartwatch integration module supports receiving notifications and performing simple operations through the smartwatch. The voice assistant integration module supports integration with third-party voice assistants to achieve cross-platform voice control.

9. Control method of an intelligent door machine based on AI voice interaction, characterized in that, It includes the following steps: S1: After the door machine system starts, it automatically connects to the cloud server and synchronizes user data and device status; S2: The user interacts with the door machine through voice commands and presets a scene mode through the smart home linkage module. The door machine collects door images and voice signals through the camera and microphone; S3: The AI voice interaction module identifies and processes the information collected in S2 to generate corresponding control commands; S4: The door lock control unit performs corresponding operations according to the control instructions in S3; S5: The operation result is fed back to the user terminal module through the communication module, and a real-time notification is sent to the mobile phone APP; S6: When a visitor presses the call button of the door machine, the door machine system automatically sends a notification to the user's mobile phone APP. The user can have a real-time audio and video call with the visitor through the mobile phone APP and control the opening and closing of the door lock; S7: The user monitors the door status in real time and performs remote control through the user terminal module.

Images