An intercom system based on wireless network connection and mobile phone remote control

Abstract

A intercom system based on wireless network connection and mobile phone remote control includes a building intercom terminal module, a wireless network connection module, a mobile phone application control module, a cloud server module, a local processing module, an intelligent alarm module, and a remote maintenance module. The building intercom terminal module is used to realize audio and video acquisition and playback. The wireless network connection module provides high-speed, low-latency wireless network connection to improve communication stability and coverage. The mobile phone application control module provides applications for Android and IOS platforms to realize intelligent visitor recognition and voice control functions. The cloud server module is used to process the transfer and storage of audio and video data. The local processing module is used for real-time processing of local audio and video data. When an abnormal situation is detected, the intelligent alarm module sends an alarm notification to the user's mobile phone in real time via the wireless network and synchronizes it to the cloud server. The remote maintenance module provides remote maintenance and update functions.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent building intercom, in particular to an intercom system based on wireless network connection and mobile phone remote control. Background Art

[0002] The intercom system originally originated from early telephone communication technology and was used to provide simple voice communication functions. With the development of wireless communication technology, especially the rise of the Internet of Things and 5G technology in recent years, the intercom system is no longer limited to simple voice communication, but has achieved more intelligent and convenient functions through wireless network connection and mobile phone remote control.

[0003] In the field of intelligent building management, intercom systems, as a crucial component of security management, have expanded beyond simple intercom and broadcast functions. Modern intercom systems must be integrated with other intelligent building devices, such as video surveillance systems, access control systems, and fire alarm systems, to form a unified security management platform. This integration enables intercom systems to not only provide real-time voice communication but also environmental monitoring and event response using video and sensor data. In terms of market demand, with the accelerated urbanization of densely populated areas, security management in multi-story buildings and large public spaces has become a critical issue. Traditional security measures are no longer able to meet complex and changing security needs. Therefore, intercom systems, as an instant and efficient security communication tool, have attracted widespread attention and application, particularly in high-rise buildings, commercial complexes, schools, and hospitals. Intercom systems not only improve security management efficiency but also enhance user experience and living environments. Advances in wireless communication technology have driven the expansion of intercom systems' functionality and application scenarios. Traditional wired intercom systems suffer from complex wiring and high maintenance costs. Wireless network-based intercom systems, on the other hand, enable flexible device layout and rapid deployment, significantly improving system scalability and adaptability.

[0004] In summary, the intercom system based on wireless network connection and mobile phone remote control has important application prospects and research value in the development of security management and communication technology. With the continuous advancement of technology and the continuous expansion of market demand, the intercom system will continue to play an important role and provide more advanced and intelligent solutions for building security management and user life. Summary of the Invention

[0005] In view of the above problems, the present invention aims to provide an intercom system based on wireless network connection and mobile phone remote control to solve the problems raised in the above background technology.

[0006] The purpose of the present invention is achieved through the following technical solutions:

[0007] The present invention provides an intercom system based on wireless network connection and mobile phone remote control, including a building intercom terminal module, a wireless network connection module, a mobile phone application control module, a cloud server module, a local processing module, an intelligent alarm module, and a remote maintenance module. The building intercom terminal module includes a camera, a microphone, a speaker, and a display screen hardware device for realizing audio and video acquisition and playback. The wireless network connection module adopts Wi-Fi 6 technologies provide high-speed, low-latency wireless network connections, supporting 2.4GHz and 5GHz frequency bands and MIMO multiple-input multiple-output technology, improving communication stability and coverage. The mobile application control module provides applications for Android and iOS platforms, allowing users to view and control the building intercom terminal in real time via their mobile phones. It integrates facial recognition and voice recognition technologies to implement intelligent visitor identification and voice control functions. The cloud server module is deployed as a data processing and storage server in the cloud, responsible for the transfer and storage of audio and video data. The local processing module is integrated into the building intercom terminal for real-time processing of local audio and video data. It uses edge computing technology to reduce the burden on the cloud server and improve the system's response speed. The intelligent alarm module includes access control anomaly detection, fire alarm, and emergency assistance functions. When an anomaly is detected, an alarm notification is sent to the user's mobile phone in real time via the wireless network and synchronized to the cloud server. The remote maintenance module provides remote maintenance and update functions, using OTA (Over-The-Air) technology to achieve software upgrades and fault diagnosis. It supports multi-device management, allowing users to centrally manage and control multiple building intercom terminals through a mobile application.

[0008] Furthermore, the building intercom terminal module is responsible for the collection, processing and transmission of audio and video data. The building intercom terminal module is mainly composed of a camera, a microphone, a speaker and a display screen. The camera uses a CMOS sensor and improves the image quality by adjusting the white balance: let R, G, and B be the three color channels of the original image, and the color values ​​after white balance adjustment are R', G', and B', then: Among them, k r , k g , k b The system dynamically adjusts the white balance coefficient to achieve color balance and automatically controls exposure to ensure that the camera can output appropriate brightness under different lighting conditions. The target brightness is L target , the current brightness is L current , then the error is e(t)=(L target -L current ), the output u(t) is: where K p , K i , K dare the proportional, integral and differential coefficients. The noise in the image is reduced by noise suppression. The system uses a Gaussian filter for smoothing. The kernel function of the Gaussian filter is: σ 2 is the variance, is the pixel position coordinate in the image, by adjusting σ 2 The value of controls the strength of the smoothing effect; the microphone is responsible for collecting environmental sounds, and array microphone technology is used to improve the quality of audio signals. The array microphone consists of multiple microphone units, and uses spatial filtering technology to achieve sound source positioning and noise suppression. Assume that the microphone array has There are microphones, and the signal received at time t is x i (t), the output signal y(t) at time t is: Among them, w i is the beamforming weight coefficient, and the minimum mean square error algorithm is used. The update formula of the weight coefficient is:

[0009] w i (t+1)=w i (t)+μe(t)x i (t)

[0010] Among them, w i (t+1) is the updated weight coefficient, μ is the step size factor, and e(t) is the current error signal; the speaker is used to play the intercom signal; the display screen is used to display the images and other information collected by the camera in real time, using a high-resolution OLED screen. The system also integrates touch screen technology, and users can open doors and alarms through the touch screen.

[0011] Furthermore, the building intercom terminal module integrates face recognition and speech recognition technology. Face recognition is based on convolutional neural network, and the structure includes convolution layer, pooling layer and fully connected layer. Assuming that the input image is I, the output of the convolution operation is for:

[0012]

[0013] Where K and j represent the total number of horizontal and vertical pixels in the input image, respectively; i and j represent the unit horizontal and vertical pixel displacements. The speech recognition algorithm is based on a recursive neural network and is used to process time series data. The state update formula is:

[0014]

[0015] Among them, σ is the activation function, W and b are weights and biases, f t is the output of the forget gate, h t-1 , is the output of the previous layer, x t is the sequence data input to this layer, W fis the weight of the forget gate, b f is the bias of the forget gate, i t is the result of the first input gate, W C is the weight of the first input gate, b i is the bias of the first input gate, is the result of the second input gate, W i is the weight of the second input gate, b C is the bias of the second input gate, o t is the result of the output gate, W o is the weight of the output gate, b o is the bias of the output gate, C t-1 is the state of the previous layer, C t is the updated state, h t is the output of this layer.

[0016] Furthermore, the wireless network connection module is responsible for establishing a communication connection between the building intercom terminal and the user's mobile phone. This module integrates Wi-Fi 6 technology, which introduces OFDMA orthogonal frequency division multiple access and MIMO multiple-input multiple-output technology. By refining subcarrier allocation and spatial multiplexing, it improves spectrum efficiency and user concurrency performance. Specifically, OFDMA divides the wireless channel into multiple subcarriers, each of which is independently allocated to different users, reducing data transmission conflicts and delays. Assuming the total bandwidth is B and the number of subcarriers is N, the bandwidth of each subcarrier is: Assuming that there are M users transmitting data simultaneously, the number of subcarriers allocated to each user is MIMO achieves spatial multiplexing by transmitting and receiving data on multiple antennas simultaneously. Assuming the system is equipped with N t transmit antennas and N r receiving antennas, the system capacity is:

[0017]

[0018] Where P0 is the transmit power and N0 is the noise power spectral density.

[0019] Furthermore, the wireless network connection module reduces interference between adjacent networks by assigning different color identifiers to each basic service set and assigning basic service sets to different channels and colors to minimize total interference. The wireless network connection module integrates an efficient error detection and correction mechanism. Let the data frame be D(h t ), the generating polynomial is G(h t ), verification sequence C(h t )for:

[0020]

[0021] Among them, < >2 is a binary operation, n2 is the number of bits in the verification sequence, mod is the remainder calculation, the receiving end uses the Viterbi algorithm for decoding, and the optimal decoding is achieved through the shortest path search. The wireless network connection module further improves the intelligence and autonomous optimization capabilities of the system by combining edge computing and artificial intelligence technology. Edge computing processes data on the local device. Assume that the system state is state, the action is action, the reward is reward, and the state transition is state trans , transfer as action trans , then the optimization goal is to maximize the cumulative reward:

[0022]

[0023] Among them, γ is the reduction factor, and Q(s,a) is the state-action value function.

[0024] Furthermore, the mobile application control module provides an interactive interface between the user and the building intercom terminal, which is implemented through applications on the Android and iOS platforms. These applications enable users to remotely control and monitor anytime and anywhere through modern user interface design and efficient background communication mechanisms. The application uses the WebSocket protocol to maintain real-time two-way communication with the building intercom terminal. In terms of audio and video processing, the mobile application control module adopts codec technology and transmission protocol, and transmits it to the receiving end after quantization and entropy encoding. The audio encoding uses the Opus codec, which supports wide-band and high dynamic range audio processing, and is suitable for voice transmission of the intercom system. The Opus codec dynamically adjusts the bit rate and delay to adapt to different network conditions to ensure voice quality.

[0025] Furthermore, the cloud server module is responsible for data storage, processing, transmission and analysis. First, the cloud server module adopts a microservice architecture to decouple different functional modules and deploy and manage them independently. Each microservice communicates through RESTFUL API to ensure low coupling and high cohesion between services. This architecture makes the system highly scalable and fault-tolerant. The key to the microservice architecture lies in the splitting of services and the optimization of communication. Let the total service be S, which is decomposed into Temp microservices S i , the overall system performance P total for:

[0026]

[0027] Among them, P iFor the performance indicators of each microservice, in terms of data storage, the cloud server module adopts a hybrid storage solution that combines relational databases and non-relational databases. The data model of non-relational databases is key-value pairs, and the query time complexity is O(1). The cloud server module implements the storage and management of large-scale data through a distributed file system. The distributed file system divides data into blocks and stores them on multiple nodes. The reliability and availability of data are improved through redundancy and copy mechanisms. Assuming that the data block is a Document, there are k d On each node, the number of storage copies is r d , then the data availability is Among them, p d To ensure the availability of a single node, in terms of data processing, the cloud server module adopts the Apache Spark distributed computing framework. The distributed computing framework schedules and executes tasks through the MapReduce model. The MapReduce model divides computing tasks into two stages: Map and Reduce. In terms of data transmission, the cloud server module adopts CDN content distribution network and edge computing technology to ensure fast data transmission and low-latency access. The CDN content distribution network improves the speed and reliability of data transmission by distributing content cache to nodes around the world. Edge computing reduces data transmission latency and bandwidth consumption by deploying computing and storage resources close to users. Access control uses OAuth 2.0 identity authentication and RBAC permission management to ensure that only authorized users can access system resources. Security auditing detects and responds to security threats in real time through logging and monitoring.

[0028] Furthermore, the local processing module is responsible for data processing and real-time response on the local device intercom terminal to reduce dependence on the cloud and improve the real-time performance and reliability of the system. This module integrates the latest technologies of edge computing, machine learning, audio and video processing and security encryption. Through edge computing technology, data processing is performed on the local device to reduce the burden on the cloud and reduce the delay of data transmission. The core of edge computing is to transfer computing tasks from the centralized data center to the edge device close to the data source. Assume that the original data is Data, the computing task is Task, and the data transmission time is T trans , the calculation time is T comp , then the total processing time is: T total =T trans +T comp , by processing data locally, reducing t trans In order to ensure the security of data, the local processing module uses the advanced encryption standard to encrypt the data. Let the plaintext data be D M , the encryption key is K M , the encryption function is E, then the ciphertext data is The decryption function is D D , the decryption process is Encryption ensures data security during transmission and storage, preventing unauthorized access. The IoT platform enables remote monitoring, configuration, and updating of devices. The IoT platform uses the MQTT protocol for lightweight message transmission to ensure efficient communication between devices. The MQTT message format is:

[0029] Topic = {'device / update'}

[0030] Massage={'device id ':'12345','firmware version ':'1.0.1'}

[0031] Through the MQTT protocol, the system publishes device updates and configuration commands in real time and monitors the operating status of the device.

[0032] Furthermore, the intelligent alarm module is used to monitor, identify and respond to various emergency situations. It can intelligently monitor and promptly alarm abnormal conditions, realizing the interconnection of building equipment. All sensors and alarm devices are centrally managed and controlled through the IoT platform. The IoT platform adopts the lightweight MQTT protocol. Each device has a unique identifier. The system monitors the status of each device in real time and immediately sends an alarm notification when an abnormality is detected. Users can remotely view and manage devices through mobile applications, receive real-time alarm information, and take corresponding emergency measures. Sensor data and alarm information are not only processed locally, but also uploaded to the cloud server in real time for storage and further analysis. The cloud uses big data technology to mine and analyze historical data, discover potential risks and hidden dangers, and provide intelligent early warning services. Users can flexibly configure sensor types and alarm conditions according to their own needs. The intelligent voice assistant function is integrated. Users use voice commands to query device status, set alarm parameters and receive alarm notifications. The voice assistant uses natural language processing technology to understand and respond to user voice commands, improving the convenience and operability of the system.

[0033] Furthermore, the remote maintenance module is responsible for daily maintenance, troubleshooting and system upgrades of the intercom system to ensure the long-term stable operation and efficient management of the system. In combination with the latest technology, the module realizes automated, intelligent and secure remote maintenance, integrates intelligent diagnostic functions, automatically detects abnormal status of equipment and issues fault warnings, and can identify potential problems and notify administrators in advance by analyzing sensor data and operation logs. It supports automated update and upgrade functions. When the system releases a new firmware or software version, the remote maintenance module automatically pushes the update to the device, and the administrator sets the update policy through the platform. In addition, the system supports version rollback function. If there is a problem with the new version, it can quickly restore to the previous stable version to ensure the continuity and reliability of the system. It provides a user-friendly operation interface and rich function options. Administrators can intuitively view device status, operation records and maintenance logs through a graphical interface. The system supports multi-language and multi-device access, and administrators can perform remote management through PCs, tablets and mobile phones. In addition, the system also provides detailed operation guides and help documents to help administrators quickly get started and solve problems.

[0034] The beneficial effects of the invention are as follows: the invention makes full use of the development of wireless communication technology, abandons the complex wired wiring and connection methods in traditional intercom systems, and adopts a connection method based on wireless network. This technological innovation not only simplifies the installation and deployment process of the system, but also improves the flexibility and scalability of the system. Users can place intercom equipment more freely and are no longer restricted by fixed wired wiring methods, adapting to the needs of changeable and complex building environments; through mobile phone applications, real-time monitoring and remote operation of the intercom system can be achieved, and users can adjust, manage and monitor the intercom equipment through their mobile phones without being next to the equipment, which greatly improves the convenience and practicality of the system. This innovation not only facilitates the user's daily management, but also enhances the system's response speed and user experience; by integrating other intelligent The intercom system is a multi-functional and intelligent security management platform that is no longer a single-function device in the traditional sense, but a multi-functional and intelligent security management platform. The voice recognition algorithm uses a recursive neural network to construct a traceable neural network element layer by layer, and updates and iterates layer by layer, and realizes optimal decoding through the shortest path search. The wireless network connection module further enhances the intelligence and autonomous optimization capabilities of the system by combining edge computing and artificial intelligence technology. Edge computing reduces the burden on cloud servers and improves response speed by processing data on local devices. In addition, the present invention significantly improves the safety management efficiency of buildings and public places through real-time monitoring, remote operation and intelligent alarm functions. Administrators can monitor equipment status anytime and anywhere, discover and handle safety issues in a timely manner, effectively prevent and respond to emergencies, and ensure the safety of personnel and property. Equipment management and control can be achieved through mobile phone applications, which greatly improves the user's convenience and experience. Users can obtain equipment status and receive alarm information at any time and make flexibly adjustments to the equipment, which enhances the interactivity of the system and user satisfaction. Through intelligent remote maintenance functions, remote monitoring, fault diagnosis and upgrades of equipment can be achieved, reducing the number of maintenance personnel's appearances and maintenance costs, and reducing the operating costs of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The invention is further illustrated by the accompanying drawings, but the embodiments in the accompanying drawings do not constitute any limitation to the invention. A person skilled in the art can obtain other drawings based on the following drawings without making any creative effort.

[0036] Figure 1 It is a structural schematic diagram of the present invention. DETAILED DESCRIPTION

[0037] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0038] See also Figure 1 , the present invention is further described in conjunction with the following examples.

[0039] See also Figure 1 The present invention aims to provide an intercom system based on wireless network connection and mobile phone remote control, including a building intercom terminal module, a wireless network connection module, a mobile phone application control module, a cloud server module, a local processing module, an intelligent alarm module, and a remote maintenance module. The building intercom terminal module includes a camera, a microphone, a speaker, and a display screen hardware device for realizing audio and video acquisition and playback. The wireless network connection module adopts Wi-Fi 6 technologies provide high-speed, low-latency wireless network connections, supporting 2.4GHz and 5GHz frequency bands and MIMO multiple-input multiple-output technology, improving communication stability and coverage. The mobile application control module provides applications for Android and iOS platforms, allowing users to view and control the building intercom terminal in real time via their mobile phones. It integrates facial recognition and voice recognition technologies to implement intelligent visitor identification and voice control functions. The cloud server module is deployed as a data processing and storage server in the cloud, responsible for the transfer and storage of audio and video data. The local processing module is integrated into the building intercom terminal for real-time processing of local audio and video data. It uses edge computing technology to reduce the burden on the cloud server and improve the system's response speed. The intelligent alarm module includes access control anomaly detection, fire alarm, and emergency assistance functions. When an anomaly is detected, an alarm notification is sent to the user's mobile phone in real time via the wireless network and synchronized to the cloud server. The remote maintenance module provides remote maintenance and update functions, using OTA (Over-The-Air) technology to achieve software upgrades and fault diagnosis. It supports multi-device management, allowing users to centrally manage and control multiple building intercom terminals through a mobile application.

[0040] Specifically, the building intercom terminal module is responsible for the collection, processing and transmission of audio and video data. The building intercom terminal module is mainly composed of a camera, a microphone, a speaker and a display screen. The camera uses a CMOS sensor with high resolution and high sensitivity, which can capture clear images in low-light environments. The image quality is improved by white balance adjustment: let R, G, B be the three color channels of the original image, and the color values ​​after white balance adjustment are R', G', B', then: Among them, kr , k g , k b The white balance coefficient is used by the system to achieve color balance by dynamically adjusting the white balance coefficient.

[0041] Specifically, automatic exposure control is used to ensure that the camera can output appropriate brightness under different lighting conditions. The target brightness is set to L target , the current brightness is L current , then the error is e(t)=(L target -L current ), the output u(t) is: where K p , K i , K d are the proportional, integral and differential coefficients;

[0042] The noise in the image is reduced by noise suppression. The system uses a Gaussian filter for smoothing. The kernel function of the Gaussian filter is: σ 2 is the variance, is the pixel position coordinate in the image, by adjusting σ 2 The value of controls the strength of the smoothing effect;

[0043] Specifically, the microphone is responsible for collecting environmental sounds, and array microphone technology is used to improve the quality of audio signals. The array microphone consists of multiple microphone units, and spatial filtering technology is used to achieve sound source positioning and noise suppression. Assuming that the microphone array has There are microphones, and the signal received at time t is x i (t), the output signal y(t) at time t is:

[0044] Among them, w i is the beamforming weight coefficient. To optimize the weight coefficient, the minimum mean square error algorithm is used. Its goal is to minimize the mean square error between the output signal and the desired signal. The update formula of the weight coefficient is:

[0045] w i (t+1)=w i (t)+μe(t)x i (t)

[0046] Among them, w i (t+1) is the updated weight coefficient, μ is the step size factor, and e(t) is the current error signal;

[0047] Specifically, the loudspeaker is used to play the intercom signal;

[0048] Specifically, the display screen is used to display images and other information collected by the camera in real time, using a high-resolution OLED screen to ensure image clarity and color reproduction;

[0049] Specifically, in order to improve the user experience, the system also integrates touch screen technology, and users can open doors and sound alarms through the touch screen.

[0050] Specifically, the building intercom terminal module integrates face recognition and speech recognition technologies. Face recognition is based on a convolutional neural network, which includes a convolutional layer, a pooling layer, and a fully connected layer. Assuming that the input image is I, the output of the convolution operation is for:

[0051]

[0052] Where K and J represent the total number of horizontal and vertical pixels of the input image, respectively, and i and j represent the unit horizontal and vertical pixel displacement;

[0053] Specifically, the speech recognition algorithm is based on a recursive neural network and is used to process time series data. The state update formula is:

[0054]

[0055] Among them, σ is the activation function, W and b are weights and biases, f t is the output of the forget gate, h t-1, is the output of the previous layer, x t is the sequence data input to this layer, W f is the weight of the forget gate, b f is the bias of the forget gate, i t is the result of the first input gate, W C is the weight of the first input gate, b i is the bias of the first input gate, is the result of the second input gate, W i is the weight of the second input gate, b C is the bias of the second input gate, o t is the result of the output gate, W o is the weight of the output gate, b o is the bias of the output gate, C t-1 is the state of the previous layer, C t is the updated state, h t is the output of this layer.

[0056] Specifically, the wireless network connection module is responsible for establishing an efficient, stable, and low-latency communication connection between the building intercom terminal and the user's mobile phone. This module integrates Wi-Fi 6 technology to ensure that high-quality communication services can still be provided in complex network environments. Wi-Fi 6 technology introduces OFDMA orthogonal frequency division multiple access and MIMO multiple-input multiple-output technology, which improves spectrum efficiency and user concurrency performance by refining subcarrier allocation and spatial multiplexing.

[0057] Specifically, OFDMA divides the wireless channel into multiple subcarriers, each of which is independently allocated to different users, thereby reducing data transmission conflicts and delays. Assuming the total bandwidth is B and the number of subcarriers is N, the bandwidth of each subcarrier is: Assuming that there are M users transmitting data simultaneously, the number of subcarriers allocated to each user is MIMO achieves spatial multiplexing by transmitting and receiving data on multiple antennas simultaneously. Assuming the system is equipped with N t transmit antennas and N r receiving antennas, the system capacity is:

[0058]

[0059] Where P0 is the transmit power and N0 is the noise power spectral density.

[0060] Specifically, the wireless network connection module adopts the basic service set coloring technology. By assigning different color identifiers to each basic service set, the interference between adjacent networks is reduced and the basic service sets are assigned to different channels and colors to minimize the total interference. The wireless network connection module integrates an efficient error detection and correction mechanism. Suppose the data frame is D(h t ), the generating polynomial is G(h t ), verification sequence C(h t )for:

[0061]

[0062] Where < >2 is a binary operation, n2 is the number of bits in the verification sequence, and mod is the remainder calculation.

[0063] Specifically, the receiving end uses the Viterbi algorithm for decoding and achieves optimal decoding through the shortest path search. The wireless network connection module further enhances the system's intelligence and autonomous optimization capabilities by combining edge computing and artificial intelligence technologies.

[0064] Specifically, edge computing reduces the burden on cloud servers and improves response speed by processing data on local devices. Assume that the system state is state, the action is action, the reward is reward, and the state transition is statetrans , transfer as action trans , then the optimization goal is to maximize the cumulative reward:

[0065]

[0066] Among them, γ is the conversion factor, Q(s,a) is the state-action value function, and through machine learning, the system continuously learns and optimizes network performance.

[0067] Specifically, the mobile application control module provides an interactive interface between users and building intercom terminals. It also integrates a variety of advanced technologies and intelligent functions to enhance user experience and overall system performance. This is achieved through applications on Android and iOS platforms. These applications enable users to remotely control and monitor anytime, anywhere through modern user interface design (UI / UX) and efficient background communication mechanisms.

[0068] Specifically, to achieve efficient communication, the application uses the WebSocket protocol to maintain real-time two-way communication with the building intercom terminal. Compared with traditional HTTP polling technology, WebSocket has the characteristics of low latency and high efficiency, ensuring real-time transmission of audio and video data and rapid response to control commands.

[0069] Specifically, in terms of audio and video processing, the mobile application control module adopts the latest codec technology and transmission protocol, and transmits it to the receiving end after quantization and entropy coding. The audio coding adopts the Opus codec, which supports wide-band and high dynamic range audio processing and is suitable for voice transmission in intercom systems. The Opus codec dynamically adjusts the bit rate and delay to adapt to different network conditions and ensure voice quality.

[0070] Specifically, the cloud server module is responsible for data storage, processing, transmission and analysis. By integrating the latest cloud computing, distributed systems and artificial intelligence technologies, the module can provide high-performance, high-availability and high-security services to ensure the overall performance and user experience of the intercom system.

[0071] Specifically, first of all, the cloud server module adopts a microservice architecture to decouple different functional modules, deploy and manage them independently. Each microservice communicates through RESTFUL API to ensure low coupling and high cohesion between services. This architecture makes the system highly scalable and fault-tolerant. The key to the microservice architecture lies in the splitting of services and the optimization of communication. Let the total service be S, which is decomposed into Temp microservices S i , the overall system performance P total for:

[0072]

[0073] Among them, P i Performance metrics for each microservice.

[0074] Specifically, in terms of data storage, the cloud server module adopts a hybrid storage solution that combines relational databases and non-relational databases. Relational databases are mainly used to store structured data to ensure data consistency and integrity, while non-relational databases are used to store unstructured data and frequently accessed data, supporting horizontal expansion and high concurrent access. The data model of non-relational databases is key-value pairs, and the query time complexity is O(1).

[0075] Specifically, the cloud server module implements the storage and management of large-scale data through a distributed file system. The distributed file system divides data into blocks and stores them on multiple nodes. It improves the reliability and availability of data through redundancy and copy mechanisms. Assuming that the data block is a Document, there are k d On each node, the number of storage copies is r d , then the data availability is Among them, p d The availability of a single node.

[0076] Specifically, in terms of data processing, the cloud server module adopts the Apache Spark distributed computing framework to realize parallel processing and analysis of large-scale data. The distributed computing framework schedules and executes tasks through the MapReduce model, which divides computing tasks into two stages: Map and Reduce.

[0077] Specifically, in order to improve the system's real-time processing capabilities, the cloud server module also integrates the Apache Flink streaming computing framework to achieve real-time processing and analysis of data streams. Streaming computing achieves continuous data processing through window operations and state management.

[0078] Specifically, in terms of data transmission, the cloud server module uses CDN content distribution network and edge computing technology to ensure fast data transmission and low-latency access. The CDN content distribution network improves the speed and reliability of data transmission by distributing content cache to nodes around the world. Edge computing reduces data transmission delays and bandwidth consumption by deploying computing and storage resources close to users. Access control ensures that only authorized users can access system resources through OAuth 2.0 identity authentication and RBAC permission management. Security audits detect and respond to security threats in real time through logging and monitoring.

[0079] Specifically, the local processing module is responsible for data processing and real-time response on the local device intercom terminal to reduce dependence on the cloud and improve the real-time performance and reliability of the system. This module integrates the latest technologies in edge computing, machine learning, audio and video processing, and security encryption. It processes data on local devices through edge computing technology, reducing the burden on the cloud and reducing data transmission delays.

[0080] Specifically, the core of edge computing is to transfer computing tasks from centralized data centers to edge devices close to the data source. Assume that the original data is Data, the computing task is Task, and the data transmission time is T trans , the calculation time is T comp , then the total processing time is: T total =T trans +T comp , by processing data locally, reducing t trans .

[0081] Specifically, in order to ensure the security of data, the local processing module uses the advanced encryption standard to encrypt the data. M , the encryption key is K M , the encryption function is E, then the ciphertext data is The decryption function is D D , the decryption process is Encryption ensures the security of data during transmission and storage to prevent unauthorized access.

[0082] Specifically, in terms of edge AI inference, the local processing module adopts the TensorFlow Lite and ONNX Runtime lightweight inference framework, supports GPU, DSP, and NPU hardware acceleration, and integrates automated operation and maintenance and device management functions.

[0083] Specifically, the IoT platform enables remote monitoring, configuration, and updating of devices. The IoT platform uses the MQTT protocol for lightweight message transmission to ensure efficient communication between devices. The MQTT message format is:

[0084] Topic = {'device / update'}

[0085] Massage={'device id ':'12345','firmware version ':'1.0.1'}

[0086] Through the MQTT protocol, the system publishes device updates and configuration commands in real time and monitors the operating status of the device.

[0087] Specifically, the intelligent alarm module is used to monitor, identify and respond to various emergency situations. It can intelligently monitor abnormal conditions and promptly alarm, ensuring user safety and property protection, and realizing the interconnection of building equipment. All sensors and alarm devices are centrally managed and controlled through the IoT platform. The IoT platform adopts the lightweight MQTT protocol to achieve low-latency and efficient data transmission. Each device has a unique identifier. The system monitors the status of each device in real time and immediately sends an alarm notification when an anomaly is detected. Users can remotely view and manage these devices through mobile phone applications, receive real-time alarm information, and take corresponding emergency measures.

[0088] Specifically, sensor data and alarm information are not only processed locally, but also uploaded to the cloud server in real time for storage and further analysis. The cloud uses big data technology to mine and analyze historical data, discover potential risks and hidden dangers, and provide intelligent early warning services. The intelligent alarm module is highly flexible and customizable. Users can flexibly configure sensor types and alarm conditions according to their own needs. It integrates an intelligent voice assistant function. Users can query device status, set alarm parameters and receive alarm notifications through voice commands. The voice assistant uses natural language processing technology to understand and respond to user voice commands, thereby improving the convenience and operability of the system.

[0089] Specifically, the remote maintenance module is responsible for daily maintenance, troubleshooting and system upgrades of the intercom system to ensure the long-term stable operation and efficient management of the system. This module realizes automated, intelligent and secure remote maintenance, integrates intelligent diagnostic functions, automatically detects abnormal status of equipment and issues fault warnings. By analyzing sensor data and operation logs, the system can identify potential problems and notify administrators in advance, and supports automated update and upgrade functions.

[0090] Specifically, when the system releases a new firmware or software version, the remote maintenance module automatically pushes the update to each device. The update process is seamless and secure, ensuring that it will not affect the normal operation of the device. Administrators can set update policies through the platform, such as updating at night or during low-usage periods to reduce the impact on users.

[0091] Specifically, the system supports version rollback. If a problem occurs with the new version, it can be quickly restored to the previous stable version to ensure the continuity and reliability of the system. It provides a user-friendly operation interface and rich functional options. Administrators can intuitively view device status, operation records and maintenance logs through a graphical interface. The system supports multi-language and multi-device access, and administrators can perform remote management through PCs, tablets or mobile phones.

[0092] The beneficial effects of the invention are as follows: the invention makes full use of the development of wireless communication technology, abandons the complex wired wiring and connection methods in traditional intercom systems, and adopts a connection method based on wireless network. This technological innovation not only simplifies the installation and deployment process of the system, but also improves the flexibility and scalability of the system. Users can place intercom equipment more freely and are no longer restricted by fixed wired wiring methods, adapting to the needs of changeable and complex building environments; through mobile phone applications, real-time monitoring and remote operation of the intercom system can be achieved, and users can adjust, manage and monitor the intercom equipment through their mobile phones without being next to the equipment, which greatly improves the convenience and practicality of the system. This innovation not only facilitates the user's daily management, but also enhances the system's response speed and user experience; by integrating other intelligent The intercom system is a multi-functional and intelligent security management platform that is no longer a single-function device in the traditional sense, but a multi-functional and intelligent security management platform. The voice recognition algorithm uses a recursive neural network to construct a traceable neural network element layer by layer, and updates and iterates layer by layer, and realizes optimal decoding through the shortest path search. The wireless network connection module further enhances the intelligence and autonomous optimization capabilities of the system by combining edge computing and artificial intelligence technology. Edge computing reduces the burden on cloud servers and improves response speed by processing data on local devices. In addition, the present invention significantly improves the safety management efficiency of buildings and public places through real-time monitoring, remote operation and intelligent alarm functions. Administrators can monitor equipment status anytime and anywhere, discover and handle safety issues in a timely manner, effectively prevent and respond to emergencies, and ensure the safety of personnel and property. Equipment management and control can be achieved through mobile phone applications, which greatly improves the user's convenience and experience. Users can obtain equipment status and receive alarm information at any time and make flexibly adjustments to the equipment, which enhances the interactivity of the system and user satisfaction. Through intelligent remote maintenance functions, remote monitoring, fault diagnosis and upgrades of equipment can be achieved, reducing the number of maintenance personnel's appearances and maintenance costs, and reducing the operating costs of the system.

[0093] Specifically, the system also provides detailed operation guides and help documents to help administrators get started quickly and solve problems.

[0094] Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments, or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. An intercom system based on wireless network connection and mobile phone remote control, including a building intercom terminal module, a wireless network connection module, a mobile phone application control module, a cloud server module, a local processing module, an intelligent alarm module, and a remote maintenance module. The building intercom terminal module includes a camera, a microphone, a speaker, and a display hardware device for realizing audio and video acquisition and playback. The wireless network connection module adopts Wi-Fi 6 technologies provide high-speed, low-latency wireless network connections, supporting 2.4GHz and 5GHz frequency bands and MIMO multiple-input multiple-output technology to improve communication stability and coverage. The mobile application control module provides applications for Android and iOS platforms, allowing users to view and control the building intercom terminal in real time via their mobile phones. It integrates facial recognition and voice recognition technologies to implement intelligent visitor identification and voice control functions. The cloud server module is deployed as a data processing and storage server in the cloud, which is responsible for the transfer and storage of audio and video data. The local processing module is integrated into the building intercom terminal for real-time processing of local audio and video data. It uses edge computing technology to reduce the burden on the cloud server and improve the system's response speed. The intelligent alarm module includes access control anomaly detection, fire alarm, and emergency assistance functions. When an anomaly is detected, an alarm notification is sent to the user's mobile phone in real time via the wireless network and synchronized with the cloud server. The remote maintenance module provides remote maintenance and update functions, using OTA (Over-The-Air) technology to achieve software upgrades and fault diagnosis. It supports multi-device management, allowing users to centrally manage and control multiple building intercom terminals through a mobile application. The building intercom terminal module is responsible for the collection, processing and transmission of audio and video data. The building intercom terminal module is mainly composed of a camera, a microphone, a speaker and a display screen. The camera uses a CMOS sensor and improves the image quality by adjusting the white balance: The three color channels of the original image, the color values ​​after white balance adjustment are , then: ,in, , , The system dynamically adjusts the white balance coefficient to achieve color balance and automatically controls exposure to ensure that the camera can output appropriate brightness under different lighting conditions. The target brightness is set to , the current brightness is , then the error is , output for: ,in , , are the proportional, integral and differential coefficients. The noise in the image is reduced by noise suppression. The system uses a Gaussian filter for smoothing. The kernel function of the Gaussian filter is: , is the variance, is the pixel position coordinate in the image, by adjusting The value of controls the strength of the smoothing effect; the microphone is responsible for collecting environmental sounds, and array microphone technology is used to improve the quality of audio signals. The array microphone consists of multiple microphone units, and uses spatial filtering technology to achieve sound source positioning and noise suppression. Assume that the microphone array has A microphone, The signal received at the moment is , Output signal at all times for: ,in, is the beamforming weight coefficient, and the minimum mean square error algorithm is used. The update formula of the weight coefficient is: in, is the updated weight coefficient, is the step size factor, The system is used to display the current error signal; the speaker is used to play the intercom signal; the display screen is used to display the images and other information collected by the camera in real time, using a high-resolution OLED screen. The system also integrates touch screen technology, and users can open the door and alarm through the touch screen.

2. The intercom system based on wireless network connection and mobile phone remote control according to claim 1, characterized in that: The building intercom terminal module integrates face recognition and speech recognition technology. Face recognition is based on convolutional neural network, which includes convolution layer, pooling layer and full connection layer. Assume that the input image is , then the output of the convolution operation is for: in, and Respectively represent the total number of horizontal and vertical pixels of the input image, , Represents the unit horizontal and vertical pixel displacement. The speech recognition algorithm is based on a recursive neural network and is used to process time series data. The state update formula is: in is the activation function, and are weights and biases, is the output of the forget gate, is the output of the previous layer, is the sequence data input to this layer, is the weight of the forget gate, is the bias of the forget gate, is the result of the first input gate, is the weight of the first input gate, is the bias of the first input gate, is the result of the second input gate, is the weight of the second input gate, is the bias of the second input gate, is the result of the output gate, is the weight of the output gate, is the bias of the output gate, For the previous state, For the updated status, is the output of this layer.

3. The intercom system based on wireless network connection and mobile phone remote control according to claim 1, characterized in that: The wireless network connection module is responsible for establishing a communication connection between the building intercom terminal and the user's mobile phone. The module integrates Wi-Fi 6 technology, which introduces OFDMA orthogonal frequency division multiple access and MIMO multiple input multiple output technology. By refining subcarrier allocation and spatial multiplexing, it improves spectrum efficiency and user concurrency performance. Specifically, OFDMA divides the wireless channel into multiple subcarriers, each of which is independently allocated to different users to reduce data transmission conflicts and delays. Assume that the total bandwidth is , the number of subcarriers is , then the bandwidth of each subcarrier is: , assuming there is users transmit data simultaneously, the number of subcarriers allocated to each user is MIMO achieves spatial multiplexing by transmitting and receiving data on multiple antennas simultaneously. Assuming the system is equipped with transmit antennas and receiving antennas, the system capacity is: in, is the transmit power, is the noise power spectral density.

4. The intercom system based on wireless network connection and mobile phone remote control according to claim 1, characterized in that: The wireless network connection module reduces interference between adjacent networks by assigning different color identifiers to each basic service set and assigning basic service sets to different channels and colors to minimize total interference. The wireless network connection module integrates an efficient error detection and correction mechanism. Suppose the data frame is , the generating polynomial is , verify the sequence for: in, For binary operations, is the number of digits in the verification sequence, To calculate the remainder, the receiving end uses the Viterbi algorithm for decoding and achieves optimal decoding through the shortest path search. The wireless network connection module further improves the system's intelligence and autonomous optimization capabilities by combining edge computing and artificial intelligence technology. Edge computing processes data on local devices. Assuming the system state is , the action is , the reward is , the state transition is , transfer as , then the optimization goal is to maximize the cumulative reward: in, is the conversion factor, is the state-action value function.

5. The intercom system based on wireless network connection and mobile phone remote control according to claim 1, characterized in that: The mobile application control module provides an interactive interface between users and building intercom terminals, which is implemented through applications on the Android and iOS platforms. These applications enable users to remotely control and monitor anytime and anywhere through modern user interface design and efficient background communication mechanisms. The application uses the WebSocket protocol to maintain real-time two-way communication with the building intercom terminal. In terms of audio and video processing, the mobile application control module adopts codec technology and transmission protocol, and transmits it to the receiving end after quantization and entropy encoding. The audio encoding uses the Opus codec, which supports wide-band and high dynamic range audio processing and is suitable for voice transmission of intercom systems. The Opus codec dynamically adjusts the bit rate and delay to adapt to different network conditions to ensure voice quality.

6. The intercom system based on wireless network connection and mobile phone remote control according to claim 1, characterized in that: The cloud server module is responsible for data storage, processing, transmission and analysis. First, the cloud server module adopts a microservice architecture to decouple different functional modules and deploy and manage them independently. Each microservice communicates through a RESTFUL API to ensure low coupling and high cohesion between services. This architecture makes the system highly scalable and fault-tolerant. The key to the microservice architecture lies in the splitting of services and the optimization of communication. Let the total service be , decomposed into microservices , overall system performance for: in, For the performance indicators of each microservice, in terms of data storage, the cloud server module adopts a hybrid storage solution that combines relational databases and non-relational databases. The data model of non-relational databases is key-value pairs, and the query time complexity is The cloud server module realizes the storage and management of large-scale data through a distributed file system. The distributed file system divides data into blocks and stores them on multiple nodes. It improves the reliability and availability of data through redundancy and copy mechanisms. Assume that the data block is ,exist On nodes, the number of storage copies on each node is , then the data availability is ,in, To ensure the availability of a single node, in terms of data processing, the cloud server module adopts the Apache Spark distributed computing framework. The distributed computing framework schedules and executes tasks through the MapReduce model. The MapReduce model divides computing tasks into two stages: Map and Reduce. In terms of data transmission, the cloud server module adopts CDN content distribution network and edge computing technology to ensure fast data transmission and low-latency access. The CDN content distribution network improves the speed and reliability of data transmission by distributing content cache to nodes around the world. Edge computing reduces data transmission latency and bandwidth consumption by deploying computing and storage resources close to users. Access control uses OAuth 2.0 identity authentication and RBAC permission management to ensure that only authorized users can access system resources. Security auditing detects and responds to security threats in real time through logging and monitoring.

7. The intercom system based on wireless network connection and mobile phone remote control according to claim 1, characterized in that: The local processing module is responsible for data processing and real-time response on the local device intercom terminal to reduce dependence on the cloud and improve the real-time performance and reliability of the system. The module integrates the latest technologies of edge computing, machine learning, audio and video processing and security encryption. Through edge computing technology, data processing is performed on the local device to reduce the burden on the cloud and reduce the delay of data transmission. The core of edge computing is to transfer computing tasks from the centralized data center to the edge device close to the data source. Assuming the original data is , the computational task is , the data transmission time is , the calculation time is , the total processing time is: By processing data locally, we can reduce In order to ensure the security of data, the local processing module uses the advanced encryption standard to encrypt the data. , the encryption key is , the encryption function is , then the ciphertext data is , the decryption function is , the decryption process is , through encryption, ensure the security of data during transmission and storage, prevent unauthorized access, and realize remote monitoring, configuration and update of devices through the IoT platform. The IoT platform uses the MQTT protocol for lightweight message transmission to ensure efficient communication between devices. The MQTT message format is: Through the MQTT protocol, the system publishes device updates and configuration commands in real time and monitors the operating status of the device.

8. The intercom system based on wireless network connection and mobile phone remote control according to claim 1, characterized in that: The intelligent alarm module is used to monitor, identify and respond to various emergency situations. It can intelligently monitor and promptly alarm abnormal conditions, realizing the interconnection of building equipment. All sensors and alarm devices are centrally managed and controlled through the IoT platform. The IoT platform adopts the lightweight MQTT protocol. Each device has a unique identifier. The system monitors the status of each device in real time and sends an alarm notification immediately when an abnormality is detected. Users can remotely view and manage devices through mobile applications, receive real-time alarm information, and take appropriate emergency measures. Sensor data and alarm information are not only processed locally, but also uploaded to the cloud server in real time for storage and further analysis. The cloud uses big data technology to mine and analyze historical data, discover potential risks and hidden dangers, and provide intelligent early warning services. Users can flexibly configure sensor types and alarm conditions according to their own needs. The intelligent voice assistant function is integrated. Users can query device status, set alarm parameters and receive alarm notifications through voice commands. The voice assistant uses natural language processing technology to understand and respond to user voice commands, improving the convenience and operability of the system.

9. The intercom system based on wireless network connection and mobile phone remote control according to claim 1, characterized in that: The remote maintenance module is responsible for routine maintenance, troubleshooting, and system upgrades of the intercom system, ensuring long-term stable operation and efficient management. Incorporating the latest technologies, this module implements automated, intelligent, and secure remote maintenance. It integrates intelligent diagnostic functions to automatically detect abnormal device conditions and issue fault warnings. By analyzing sensor data and operation logs, the system can identify potential problems and notify administrators in advance. It supports automated updates and upgrades. When the system releases a new firmware or software version, the remote maintenance module automatically pushes the update to the device. Administrators can set update policies through the platform. In addition, the system supports version rollback. If problems arise with the new version, it can quickly restore to the previous stable version, ensuring system continuity and reliability. It provides a user-friendly operation interface and rich functional options. Administrators can intuitively view device status, operation records, and maintenance logs through a graphical interface. The system supports multi-language and multi-device access, and administrators can remotely manage via PCs, tablets, and mobile phones. In addition, the system provides detailed operation guides and help documents to help administrators quickly get started and resolve problems.

Images