Intelligent building intercom system and intercom control method

Abstract

The invention discloses an intelligent building intercom system and an intercom control method, and relates to the field of intelligent buildings. The system comprises a building doorway talkback unit, a communication unit, a video processing unit and an indoor talkback unit, the building doorway talkback unit is used for acquiring visitor information of visitors, and the visitor information comprises at least one of a figure video and first voice talkback information; the communication unit is connected with the building doorway talkback unit and is used for transmitting the visitor information; the video processing unit is connected with the communication unit and is used for generating corresponding sign language information according to sign language actions when identifying that the character video contains the sign language actions; and the indoor talkback unit is connected with the communication unit and is used for receiving the visitor information and / or the sign language information and displaying the sign language information on a first display screen of the indoor talkback unit in a character form. According to the invention, the barrier-free communication function of the system is enhanced, and the communication efficiency and convenience between visitors and residents are improved.

Description

Technical Field

[0001] The present application relates to the field of intelligent building technology, and in particular to an intelligent building intercom system and an intercom control method. Background Art

[0002] With the acceleration of urbanization and the continuous advancement of technology, building intercom systems have become an indispensable part of modern residential and commercial buildings. By integrating advanced communication technologies, building intercom systems provide functions such as visitor identity confirmation, real-time video calls, and remote access control, greatly improving the safety and convenience of buildings.

[0003] The building intercom system achieves efficient communication between residents, visitors and property management through digital and networked means. It also supports the integration of smart home systems, enhancing the intelligent living experience.

[0004] However, when visitors are deaf or mute or cannot speak, current building intercom systems cannot provide them with an effective and smooth way to communicate with people inside. Summary of the invention

[0005] In view of the above-mentioned technical problems and defects, the purpose of the present invention is to provide an intelligent building intercom system and an intercom control method, which enhances the barrier-free communication function of the system and improves the communication efficiency and convenience between visitors and residents by acquiring the visitor's personal video and voice information and converting the sign language movements in the personal video into text information.

[0006] In order to achieve the above-mentioned purpose, in a first aspect, the present invention provides an intelligent building intercom system, including a building door intercom unit, a communication unit, a video processing unit and an indoor intercom unit; the building door intercom unit is used to obtain visitor information of the visitor, and the visitor information includes at least one of a character video and a first voice intercom information; the communication unit is connected to the building door intercom unit for transmitting the visitor information; the video processing unit is connected to the communication unit for generating corresponding sign language information according to the sign language action when it is recognized that the character video contains a sign language action; the indoor intercom unit is connected to the communication unit for receiving the visitor information and / or the sign language information, and displaying the sign language information in the form of text on the first display screen of the indoor intercom unit.

[0007] The present invention can accurately identify the sign language movements of visitors through the video processing unit, and convert these movements into text information in real time, which is displayed on the display screen of the indoor intercom unit. This improves the communication experience between the deaf-mute visitor and the indoor personnel or residents. When the deaf-mute visitor arrives at the door of the building and uses sign language to express his or her visit intention, the video processing unit automatically captures the movement in the video stream and parses it, and then generates a text description. In this way, even if the resident is not familiar with sign language, he or she can understand the visit intention of the visitor by reading the converted text. This intelligent solution of the present embodiment can not only support the voice intercom needs of normal visitors, but also meet the visit and communication needs of the deaf-mute, improve the convenience and comfort of visitors, and realize inclusiveness and barrier-free access to all users and visitors, including the deaf-mute.

[0008] In combination with some embodiments of the first aspect, in some embodiments, the intelligent building intercom system also includes a voice conversion unit, which is respectively connected to the video processing unit and the communication unit, and the voice conversion unit is used to convert the sign language information into corresponding voice information, and send the voice information to the indoor intercom unit through the communication unit for voice playback.

[0009] By adopting the technical solution of the above embodiment and introducing a voice conversion unit, the barrier-free communication capability of the system is significantly improved. The unit converts sign language information into voice, providing indoor personnel with a way to receive auditory information and enhancing the convenience of their communication with visitors. The realization of this two-way communication not only reflects the care for special groups, but also optimizes the overall living experience and improves the inclusiveness and practicality of the smart building intercom system.

[0010] In combination with some embodiments of the first aspect, in some embodiments, the video processing unit is deployed with a trained sign language recognition model, which is used to determine whether the character video contains sign language movements and determine the sign language information corresponding to the sign language movements.

[0011] By adopting the technical solution of the above embodiment, the video processing unit is equipped with a professionally trained sign language recognition model, which greatly improves the accuracy and response speed of sign language recognition. This intelligent recognition capability ensures that the system can quickly and accurately convert sign language into text, providing an effective communication channel for hearing-impaired visitors, while also enhancing the system's technological advancement and user-friendliness.

[0012] In combination with some embodiments of the first aspect, in some embodiments, the indoor intercom unit is also used to obtain second voice intercom information of indoor personnel, and send the second voice intercom information to the building door intercom unit through the communication unit, and the building door intercom unit is also used to display the second voice intercom information in the form of text on the second display screen of the building door intercom unit.

[0013] By adopting the technical solution of the above embodiment, by enabling the indoor intercom unit to obtain and send the second voice intercom information, two-way text communication between visitors and residents is realized. This function not only allows visitors to understand the residents' replies through text, but also improves the clarity and accuracy of communication, especially for visitors with hearing impairments, this improvement significantly enhances their communication experience.

[0014] In combination with some embodiments of the first aspect, in some embodiments, the intelligent building intercom system also includes an access control unit and an elevator control unit, and the access control unit and the elevator control unit are respectively connected to the indoor intercom unit, and the indoor intercom unit is also used to send door opening instructions and elevator down instructions to the access control unit and the elevator control unit respectively, and the access control unit is used to open the building door according to the door opening instruction, and the elevator control unit is used to control the elevator to descend to the floor where the building door is located according to the elevator down instruction.

[0015] By adopting the technical solution of the above embodiment, the automation and intelligence of the visitor entry process is realized by integrating the access control unit and the elevator control unit. Residents can remotely control the access control and elevator through the indoor intercom unit, so that visitors can quickly enter the building and reach the corresponding floor. This improvement not only improves the convenience of visitors, but also optimizes the efficiency of property management and the safety of the building.

[0016] In combination with some embodiments of the first aspect, in some embodiments, the intelligent building intercom system also includes a cloud server, the communication unit is connected to the cloud server, and the cloud server is connected to the mobile terminal of the indoor personnel.

[0017] The technical solution of the above embodiment is adopted to provide powerful data support and remote access capabilities for the intelligent building intercom system through the integration of cloud servers. Residents can communicate with the system through mobile terminals to achieve cloud storage and remote processing of data, which improves the flexibility and scalability of the system and also provides a more efficient tool for property management.

[0018] In combination with some embodiments of the first aspect, in some embodiments, the intelligent building intercom system also includes a language translation unit connected to the communication unit. The language translation unit is used to translate the foreign language information into Chinese information when the first voice intercom information is identified as foreign language information, and send the Chinese information to the indoor intercom unit through the communication unit.

[0019] By adopting the technical solution of the above embodiment, the language translation unit recognizes and translates foreign language information, breaking the language barrier and enabling visitors with different language backgrounds to communicate smoothly with residents. This instant multilingual translation service significantly improves the internationalization level of the system and user satisfaction.

[0020] In combination with some embodiments of the first aspect, in some embodiments, the language translation unit is also used to translate the second voice intercom information of the indoor personnel collected by the indoor intercom unit into corresponding foreign language reply information, and send the foreign language reply information to the intercom unit at the door of the building through the communication unit.

[0021] The technical solution of the above embodiment is adopted to further expand the function of the language translation unit, which can not only translate foreign languages ​​into Chinese, but also translate Chinese replies into the visitor's native language, thus realizing barrier-free two-way language communication. This function strengthens the international service capability of the system and improves the communication efficiency between visitors and residents.

[0022] In combination with some embodiments of the first aspect, in some embodiments, the intelligent building intercom system also includes the communication unit including a wireless communication unit, which is connected to the delivery robot and is used to send the delivery request of the delivery robot to the indoor intercom unit.

[0023] By adopting the technical solution of the above embodiment, the connection between the wireless communication unit and the delivery robot brings modern logistics service capabilities to the intelligent building intercom system. The system can receive the delivery request of the delivery robot and notify the residents through the indoor intercom unit, which improves the efficiency of logistics services and provides residents with a more convenient life experience.

[0024] In a second aspect, the present invention provides a smart building intercom control method, which is applied to the smart building intercom system of the first aspect above, and the method includes: a communication unit receives visitor information obtained by an intercom unit at the door of a building, and the visitor information includes at least one of a character video and a first voice intercom information; the communication unit sends the visitor information to a video processing unit; the communication unit receives sign language information returned by the video processing unit, and the sign language information is generated by the video processing unit according to the sign language action when the video processing unit recognizes that the character video contains a sign language action; the communication unit sends the visitor information and / or the sign language information to the indoor intercom unit, so that the indoor intercom unit displays the sign language information in the form of text on the first display screen of the indoor intercom unit.

[0025] The technical effects of the intelligent building intercom control method of the present invention can refer to the technical effects that can be achieved by the intelligent building intercom system of the first aspect mentioned above, and will not be repeated here.

[0026] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. The system of the present invention significantly improves the barrier-free communication ability for hearing-impaired visitors by integrating a video processing unit and a sign language recognition model. The system can automatically recognize the sign language movements in the character video and convert them into text information to display to the residents. At the same time, through the voice conversion unit, the sign language information can also be converted into voice output, providing dual communication guarantees for hearing-impaired residents, greatly enhancing the inclusiveness of the system and the communication experience of visitors. " 2. The system of the present invention realizes two-way voice and text communication between visitors and residents through the coordinated work of the indoor intercom unit and the communication unit. Residents can send voice replies through the indoor intercom unit, and the system automatically converts these replies into text messages and displays them on the display screen of the intercom unit at the door of the building, which is convenient for visitors to read. This function not only improves the convenience of communication, but also provides visitors with more intuitive and clear information feedback, optimizing the overall visit experience of visitors. 3. The intelligent building intercom system of the present invention has a high degree of integration and automatic control capabilities. The system is not only connected to the access control unit and the elevator control unit to realize remote control of door locks and elevators, but also connected to the residents' mobile terminals through the cloud server, providing the possibility of remote access and control. In addition, the addition of the language translation unit enables the system to overcome language barriers and realize real-time translation of multiple languages. The connection between the wireless communication unit and the delivery robot integrates intelligent logistics services into building management, comprehensively improving the intelligent management and service level of the building. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The drawings herein are incorporated into and constitute a part of the specification, showing embodiments consistent with the present invention, and together with the specification, are used to explain the principles of the present invention. Obviously, the drawings described below are only some embodiments of the present invention, and for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work. In the drawings: Figure 1 It is a schematic diagram of the architecture of an intelligent building intercom system according to an embodiment of the present invention; Figure 2 Schematic diagram of another intelligent building intercom system according to an embodiment of the present invention; Figure 3 The present invention is a flowchart of an intelligent building intercom control method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0028] The terms used in the following embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to be used as limitations of the present invention. As used in the specification of the present invention and the appended claims, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless the context clearly indicates otherwise. It should also be understood that the term "or" used in the present invention refers to and includes any or all possible combinations of one or more listed items. Hereinafter, the terms "first" and "second" are used only for descriptive purposes and are used to distinguish technical features, and cannot be understood as implying relative importance or implicitly indicating the number of indicated technical features. In the description of the embodiments of the present invention, unless otherwise specified, the meaning of "multiple" is two or more.

[0029] It should also be noted that, unless otherwise clearly specified and limited, in the embodiments of the present invention, the terms such as "setting" and "connection" should be understood in a broad sense. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements; it can be a wired communication connection or a wireless communication connection. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0030] When a visitor needs to visit a resident or indoor person in a building, he or she usually communicates with the indoor person through voice intercom through the building intercom system to explain the purpose of the visit. However, when the visitor is deaf or mute or cannot speak, the current intelligent building intercom system cannot provide them with an effective and smooth way to communicate with the indoor person.

[0031] For example, in a residential community, a deaf-mute visitor stood at the door of a building. He pressed the house number of a resident in the building and needed to communicate or visit the resident, but the building intercom system only provided a voice intercom function and could not recognize his sign language. The resident heard the doorbell indoors and saw the visitor through the display screen of the indoor intercom unit, but because the visitor could not make any sound, the resident could not know his intention. The visitor tried to type on his mobile phone for the resident to see, but the lighting conditions were poor and the camera resolution was limited, so the resident had difficulty recognizing the content on the screen. This communication barrier not only made the visitor feel anxious and inconvenient, but also caused trouble for the residents in the building.

[0032] Therefore, the embodiment of the present invention provides an intelligent building intercom system, which can accurately identify the sign language movements of visitors through a video processing unit, and convert these movements into text information in real time, which is displayed on the display screen of the indoor intercom unit. This improves the communication experience between deaf-mute visitors and indoor personnel or residents. When a deaf-mute visitor arrives at the door of the building and uses sign language to express his or her visit intention, the video processing unit automatically captures the movements in the video stream and parses them, and then generates a text description. In this way, even if the residents are not familiar with sign language, they can understand the visit intention of the visitor by reading the converted text. This intelligent solution of the present embodiment can not only support the voice intercom needs of normal visitors, but also meet the visit and communication needs of deaf-mute people, improve the convenience and comfort of visitors, and realize inclusiveness and barrier-free access to all users and visitors, including deaf-mute people.

[0033] Combine the following Figure 1 The intelligent building intercom system (hereinafter referred to as the system) includes a building door intercom unit 101, a communication unit 102, a video processing unit 103 and an indoor intercom unit 104.

[0034] The building door intercom unit 101 is used to obtain visitor information of a visitor, and the visitor information includes at least one of a person video and a first voice intercom information.

[0035] In this embodiment, the building door intercom unit 101 is the front-end interface of the system, which is deployed at the entrance of the building and is responsible for capturing the identity information of visitors, including real-time video streams and voice intercom information collected by the device, covering at least one of these two types of information, so as to provide residents with an intuitive identity and intention of the visitor.

[0036] The communication unit 102 is connected to the building door intercom unit 101 for transmitting the visitor information.

[0037] In this embodiment, the communication unit 102 serves as the transmission core of the system and is connected to the building door intercom unit 101. It is responsible for safely and quickly transmitting the collected visitor information, whether video or voice data, to other parts of the system to ensure the real-time and accuracy of the information.

[0038] The communication unit 102 is the nerve center of the intelligent building intercom system and is responsible for the transmission of all key information. It is usually composed of high-performance network hardware, including but not limited to routers, switches, gateways, and wireless access points. These devices support wired (such as Ethernet) and wireless (such as Wi-Fi) communication protocols to ensure that data is transmitted stably and securely within the system. The communication unit may contain a dedicated hardware accelerator to optimize the processing speed of data packets, as well as an encryption module to protect the privacy and integrity of transmitted data. In addition, the communication unit is designed with high reliability and fault tolerance mechanisms, such as redundant design and fault switching functions to ensure that the system can continue to operate when some hardware fails, thereby ensuring the continuity and stability of the building intercom system communication.

[0039] The video processing unit 103 is connected to the communication unit 102, and is used to generate corresponding sign language information according to the sign language action when recognizing that the character video contains sign language action.

[0040] In this embodiment, the video processing unit 103 is the key to the intelligence of the system. It is connected to the communication unit 102 and has a certain video analysis function. When it detects sign language movements in the visitor's video, it can use artificial intelligence technology to analyze the sign language and generate corresponding sign language information.

[0041] The indoor intercom unit 104 is connected to the communication unit 102 and is used for receiving the visitor information and / or the sign language information, and displaying the sign language information in the form of text on the first display screen of the indoor intercom unit 104.

[0042] In this embodiment, the indoor intercom unit 104 serves as an interactive channel for indoor personnel to interact with the outside world. It is connected to the communication unit 102, and can receive the visitor's character video, the first voice intercom information, and the sign language information generated by the video processing unit 103, and convert these sign language information into text, which is clearly displayed on the display screen of the indoor intercom unit 104, so that even if the residents cannot hear the sound or understand the sign language, they can understand the communication content of the visitor, allowing the indoor personnel and the visitor to communicate without obstacles.

[0043] In some embodiments, Figure 2 As shown, the intelligent building intercom system also includes a voice conversion unit 105, which is connected to the video processing unit 103 and the communication unit 102 respectively. The voice conversion unit 105 is used to convert the sign language information into corresponding voice information, and send the voice information to the indoor intercom unit 104 through the communication unit 102 for voice playback.

[0044] Among them, the voice conversion unit 105, as a key part of the intelligent building intercom system, realizes the function of converting sign language information into corresponding voice information by integrating advanced text-to-speech (TTS) technology. After the video processing unit 103 recognizes the sign language action and generates the corresponding text description, the voice conversion unit 105 receives the text information and converts the text information into clear voice output using TTS technology. In this process, TTS technology converts the text sequence in the text into a voice signal with natural intonation and rhythm by simulating the vocal mechanism of the human vocal tract. The converted voice information is sent to the indoor intercom unit 104 through the communication unit 102, and finally played through the speaker, so that the indoor personnel can perceive the visitor's sign language content through hearing. In addition, the voice conversion unit 105 can also adjust the volume, speed and pitch of the voice according to the needs and settings of the user to adapt to the hearing preferences and comprehension abilities of different users, thereby providing more personalized and humanized communication services.

[0045] The voice conversion unit 105 greatly enhances the barrier-free communication capability of the intelligent building intercom system. By converting sign language information into voice information, a richer and more convenient way of communication is provided for indoor personnel. Deaf and mute visitors can effectively communicate with indoor personnel through sign language, and indoor personnel can hear the voice information converted from sign language in real time through the voice playback function of the indoor intercom unit 104, so as to quickly understand the visitor's intention.

[0046] In some embodiments, the video processing unit 103 is deployed with a trained sign language recognition model, which is used to determine whether the character video contains sign language movements and determine the sign language information corresponding to the sign language movements.

[0047] The sign language recognition model uses artificial intelligence technology to accurately determine whether a person's video contains sign language movements and determine the specific sign language information corresponding to these movements. The implementation of this technology enables the system to automatically recognize and process visitors' sign language without additional operations, greatly improving the system's response speed and accuracy. For visitors with language barriers, this function allows them to express their needs and intentions more conveniently, and for indoor residents, the sign language information automatically generated by the system also makes it easier for them to understand visitors, thereby improving the communication efficiency and living experience of the entire community.

[0048] In this embodiment, the sign language recognition model can use an existing model. The training process of the sign language recognition model includes the following steps: First, collect and build a sign language video database containing rich sign language gestures and daily expressions. These videos are composed of real sign language movements of the deaf-mute community, and each movement or phrase has accurate text annotations. Then, use computer vision technology to extract key frames from the video, and perform feature extraction on these frames to identify the hand area, track hand movements, and use these features to represent the visual information of the sign language. Subsequently, a deep learning algorithm, such as a convolutional neural network (CNN), is used to learn these features, and the network parameters are continuously adjusted through a large amount of training data to improve the model's recognition accuracy of sign language. During the training process, cross-validation and hyperparameter tuning are also required to optimize the model performance, and the generalization ability of the model is evaluated through a test set. Finally, after repeated iterations and optimization, a mature model that can accurately recognize a variety of sign language movements is formed. The model can convert the captured sign language movements into corresponding text descriptions, providing effective communication support for deaf-mute visitors in the intelligent building intercom system.

[0049] In some embodiments, the indoor intercom unit 104 is also used to obtain second voice intercom information of indoor personnel, and send the second voice intercom information to the building door intercom unit 101 through the communication unit 102. The building door intercom unit 101 is also used to display the second voice intercom information in the form of text on the second display screen of the building door intercom unit 101.

[0050] In this embodiment, the function of the indoor intercom unit 104 to obtain the second voice intercom information further enhances the two-way communication capability of the system. When the indoor personnel use the indoor intercom unit 104 to make a voice reply, these voice messages are first transmitted to the building door intercom unit 101 through the communication unit 102. At the building door intercom unit 101, the built-in voice recognition system converts the received voice reply into text information. This conversion process converts the original voice data into a visual text form, and then the text information is displayed on the second display screen equipped with the building door intercom unit 101. Such a design not only improves the accuracy and convenience of information transmission, but also takes into account the communication needs of hearing-impaired visitors, ensuring that all visitors can understand the indoor personnel's replies by reading the text, thereby achieving a more inclusive and barrier-free communication environment.

[0051] Among them, the building door intercom unit 101 adopts the existing voice recognition technology to convert voice into text, which will not be described in detail in this embodiment.

[0052] In some embodiments, the intelligent building intercom system also includes an access control unit 106 and an elevator control unit 107. The access control unit 106 and the elevator control unit 107 are respectively connected to the indoor intercom unit 104. The indoor intercom unit 104 is also used to send door opening instructions and elevator down instructions to the access control unit 106 and the elevator control unit 107 respectively. The access control unit 106 is used to open the building door according to the door opening instruction, and the elevator control unit 107 is used to control the elevator to descend to the floor where the building door is located according to the elevator down instruction.

[0053] In this embodiment, the combination of the access control unit 106 and the elevator control unit 107 can provide a smoother and more efficient visitor entry process. After the indoor personnel confirm the identity of the visitor and agree to his entry request, they can immediately send corresponding instructions to the access control unit 106 and the elevator control unit 107 through the indoor intercom unit 104. After receiving the door opening command, the access control unit 106 will automatically unlock the building door and allow the visitor to enter the building. At the same time, the elevator control unit 107 receives the elevator down command and will command the elevator to the floor where the building door is located to prepare for receiving visitors in advance. This intelligent collaborative operation not only improves the entry efficiency of visitors and reduces their waiting time at the building entrance, but also optimizes the use efficiency of the elevator, making the visitor experience more comfortable and convenient.

[0054] In some embodiments, the smart building intercom system further includes a cloud server 108, the communication unit 102 is connected to the cloud server 108, and the cloud server 108 is connected to a mobile terminal of indoor personnel.

[0055] This embodiment introduces the cloud server 108, which provides powerful data support and remote access capabilities for the intelligent building intercom system. Through the connection between the communication unit 102 and the cloud server 108, the system can realize cloud storage and remote processing of data, improving the efficiency and security of data processing. At the same time, the connection between the cloud server 108 and the mobile terminal of the indoor personnel enables the residents to receive visitor information, perform remote intercom and control operations anytime and anywhere through mobile phones or other mobile devices, which improves the flexibility and convenience of the system.

[0056] In some embodiments, the intelligent building intercom system also includes a language translation unit 109, which is connected to the communication unit 102. The language translation unit 109 is used to translate the foreign language information into Chinese information when the first voice intercom information is identified as foreign language information, and send the Chinese information to the indoor intercom unit 104 through the communication unit 102.

[0057] Specifically, the language translation unit 109 identifies and translates foreign language information by integrating natural language processing (NLP) technology and machine translation algorithms. When the system receives the visitor's voice intercom information, the language translation unit 109 first converts the voice signal into text data through voice recognition technology. Subsequently, the language recognition function in NLP is used to automatically detect the language type of this text data to determine whether it is a non-Chinese foreign language information. Once it is detected to be a foreign language, the translation unit will call the pre-trained multilingual translation model to translate the foreign language text into Chinese. This translation process involves an in-depth understanding of the source language, including grammar, vocabulary, and context to ensure the accuracy and readability of the translation. After the translation is completed, the system sends the Chinese translation result to the indoor intercom unit 104 through the communication unit 102, so that the residents can smoothly understand the visitor's intentions and information even when facing unfamiliar foreign languages, thereby breaking the language barrier and achieving barrier-free communication.

[0058] The language translation unit 109 of this embodiment provides the intelligent building intercom system with the ability of cross-language communication. This function breaks the language barrier and enables visitors and residents with different language backgrounds to communicate smoothly. Whether it is an international visitor or a multilingual community, the language translation unit 109 can provide effective support and improve the international service capabilities of the system. In addition, this function also helps to improve the living experience of residents, allowing them to communicate with visitors more conveniently.

[0059] In some embodiments, the language translation unit 109 is also used to translate the second voice intercom information of the indoor personnel collected by the indoor intercom unit 104 into corresponding foreign language reply information, and send the foreign language reply information to the building door intercom unit 101 through the communication unit 102.

[0060] This embodiment further enhances the cross-language communication capability of the system. In addition to translating the visitor's foreign language information into Chinese, the language translation unit 109 can also translate the resident's voice reply into the corresponding foreign language and then send it to the visitor. This function enables residents to communicate in their native language, and visitors can also receive reply information that they can understand. Whether in an international community or in a multilingual environment, this function can provide effective support and improve the communication efficiency and user experience of the system. In addition, this also reflects the humanization and internationalization considerations in the system design, so that every resident and visitor can enjoy a smooth communication experience.

[0061] In some embodiments, the intelligent building intercom system also includes the communication unit 102 including a wireless communication unit, which is connected to the delivery robot and is used to send the delivery request of the delivery robot to the indoor intercom unit 104.

[0062] The connection between the wireless communication unit and the delivery robot in this embodiment brings modern logistics service capabilities to the intelligent building intercom system. Through the wireless communication unit, the delivery robot can send the delivery request directly to the indoor intercom unit 104, so that the residents can receive the arrival notification of express delivery or takeout in time. This function not only improves the efficiency of logistics services, but also provides residents with a more convenient life experience. Whether on a busy weekday or when it is inconvenient to go out, residents can easily receive the delivered items. In addition, the realization of this function also reflects the modernization and foresight in the system design, and provides possibilities for the application of the intelligent building intercom system in the field of intelligent logistics.

[0063] In some embodiments, the video processing unit 103 can also analyze the character video to obtain the behavioral characteristics of the visitor, and determine whether the visitor has abnormal behavior based on the behavioral characteristics; if abnormal behavior exists, a notification can be sent to the property management or security personnel through the communication unit 102 to prevent potential safety issues.

[0064] Specifically, the video processing unit 103 can extract the visitor's behavioral characteristics from the character video, such as movement speed, direction change, posture, and residence time in a specific area, through computer vision technology. Using these characteristics, the unit will establish a normal model of visitor behavior and continuously optimize this model through continuous learning to adapt to different visitor behaviors. When it is detected that the visitor's behavior is significantly inconsistent with the normal model, such as fast movement, frequent entry and exit of the same area, or abnormal stay in an inactive area, the video processing unit 103 will analyze these behavioral characteristics and evaluate their matching degree with known abnormal behavior patterns. If it is judged that the visitor's behavioral characteristics are consistent with the abnormal behavior pattern, it will automatically mark the event and send an alarm to the property management or security personnel, providing detailed video and behavior analysis reports so that timely action can be taken to prevent possible safety risks or improper behavior. This intelligent monitoring and analysis capability significantly improves the efficiency and response speed of building safety management.

[0065] This embodiment proposes a highly integrated and intelligent building intercom system, which aims to improve residential safety and convenience and achieve barrier-free communication through a series of innovative functions. The core of the system lies in its multimodal interaction capability, which not only supports traditional voice and video communications, but also adds the recognition and conversion function of sign language, which greatly facilitates the use of deaf-mute people.

[0066] The system consists of multiple key units, including the building door intercom unit 101, the communication unit 102, the video processing unit 103, the indoor intercom unit 104, etc. The building door intercom unit 101 is responsible for collecting visitor information, including video and voice data. The communication unit 102 is responsible for transmitting information between the various parts of the system. The video processing unit 103 recognizes sign language movements through a deep learning model and converts them into text information to meet the communication needs of hearing-impaired visitors.

[0067] The indoor intercom unit 104 further enhances the interactivity of the system, allowing residents to respond via voice and converting these responses into text messages for visitors to understand. In addition, the system also integrates a voice conversion unit 105, which converts sign language information into voice output to provide assistance for visually impaired residents. The addition of a language translation unit 109 enables the system to overcome language barriers and achieve instant translation between foreign languages ​​and Chinese.

[0068] Another innovation of the system is the integration of the access control unit 106 and the elevator control unit 107. Residents can remotely control the opening and closing of the building door and the operation of the elevator through the indoor intercom unit 104, which improves the efficiency of visitor entry. The introduction of the cloud server 108 provides the system with powerful data support and remote access capabilities, while allowing residents to interact with the system through mobile terminals.

[0069] The system also includes a wireless communication unit that connects with the delivery robot to achieve access to intelligent logistics services. In addition, the intelligent building intercom control method defines the system's workflow, ensuring the smoothness and efficiency of the entire communication process.

[0070] Overall, this system builds a comprehensive, intelligent, and user-friendly building intercom system by integrating cutting-edge technologies such as artificial intelligence, machine learning, natural language processing, and speech recognition and synthesis. It not only improves the experience of visitors and residents, but also provides efficient tools for property management, which is a major innovation in the field of modern intelligent building management.

[0071] The embodiment of the present invention also provides a smart building intercom control method, which is applied to the smart building intercom system provided in the above embodiment. Figure 3 As shown, the method comprises the following steps: Step 201: The communication unit receives visitor information obtained by the intercom unit at the door of the building.

[0072] Among them, the visitor information includes at least one of the person video and the first voice intercom information. When the visitor arrives at the door of the building and uses the intercom equipment, the camera and microphone equipped with the intercom unit at the door of the building will capture the visitor's person video and the first voice intercom information in real time. This information is then encoded into a digital signal and sent to the communication unit via a wired or wireless network transmission method. After receiving these signals, the built-in receiver of the communication unit decodes and performs necessary data conversion to ensure the integrity and accuracy of the information. If the visitor information includes video, the communication unit will process the video stream data; if it includes voice, it will process the audio stream data. At least one of the person video or the first voice intercom information is successfully acquired and transmitted, so that the subsequent video processing unit or voice conversion unit can perform further processing and analysis to achieve smooth operation and effective communication of the system. This process requires the communication unit to have a high degree of compatibility and stability to adapt to data transmission in different formats and ensure the security and reliability of information during transmission.

[0073] Step 202: The communication unit sends the visitor information to the video processing unit.

[0074] Specifically, after receiving the person video and the first voice intercom information from the intercom unit at the door of the building, the communication unit first digitally encodes this information to ensure the uniformity and compatibility of the data format. Then, using the built-in network communication protocol of the system, the communication unit packages the encoded data into data packets and sends them to the video processing unit through the local area network or wide area network. In this process, the communication unit is also responsible for ensuring the security of data transmission, and may use encryption technology to protect visitor information from unauthorized access or tampering. Once the video processing unit receives these data packets, it will decode and analyze them to identify whether they contain sign language movements, and generate corresponding sign language information accordingly. The entire transmission process requires the communication unit to have efficient data processing capabilities and stable network connections to ensure that information can be quickly and accurately transmitted to the video processing unit, laying a solid foundation for subsequent intelligent analysis and information conversion.

[0075] Step 203: The communication unit receives the sign language information returned by the video processing unit.

[0076] The sign language information is generated by the video processing unit according to the sign language action when the video processing unit recognizes that the character video contains sign language action.

[0077] When the video processing unit completes the analysis of the person's video and identifies the sign language movements, it will use the built-in artificial intelligence algorithm and sign language recognition model to convert these movements into corresponding text descriptions to form sign language information. This information is then organized into a specific data format and sent back to the communication unit through the system's communication network. The communication unit has efficient data processing capabilities and can receive these data packets and decode them to ensure the integrity and accuracy of the information. During the reception process, the communication unit may also involve error detection and correction mechanisms to deal with possible data loss or damage and ensure the accurate transmission of sign language information. In addition, the communication unit is also responsible for integrating the received sign language information with the original visitor information for further transmission and display, so that the indoor intercom unit can display this information to the residents in text form, completing the entire process of information transmission and communication. This process not only reflects the intelligence level of the system, but also demonstrates the care for visitors with special needs and the importance of barrier-free communication.

[0078] Step 204: the communication unit sends the visitor information and / or the sign language information to the indoor intercom unit, so that the indoor intercom unit displays the sign language information in the form of text on the first display screen of the indoor intercom unit.

[0079] Specifically, after successfully receiving and decoding the sign language information returned by the video processing unit, the communication unit will integrate this information with the original visitor information to form a complete data packet. This data packet is sent to the indoor intercom unit through the internal network transmission mechanism, using appropriate protocols and encryption measures to ensure the security and integrity of the information. After the indoor intercom unit receives the data, its built-in processor will parse the data packet and render the sign language information in text form on the first display screen. In this way, even if the visitor uses sign language, the indoor personnel can read the text corresponding to the sign language through the display screen to achieve effective communication. At the same time, if the visitor's original voice information also needs to be displayed, the communication unit will also convert it into text and send it to the indoor intercom unit to provide a comprehensive information display. This process not only improves the system's barrier-free communication capabilities, but also enhances the convenience of residents and the user-friendliness of the system.

[0080] The technical effect of the intelligent building intercom control method of this embodiment is reflected in its comprehensive improvement of the intelligence level and user experience of the building intercom system. By accurately receiving and processing visitor information, including character video and voice intercom information, the system can adapt to a variety of visitor interaction scenarios. In particular, the intelligent recognition and conversion of sign language movements breaks the limitations of traditional intercom systems in special group communication, greatly facilitating the access and communication of hearing-impaired people. In addition, through an efficient communication unit, rapid transmission and real-time updating of information are achieved, ensuring the accuracy and timeliness of information. The indoor intercom unit displays sign language information in text form, which not only improves the accessibility of information, but also enhances the communication ability of residents. Overall, the control method integrates advanced artificial intelligence technology and communication technology to build a safe, convenient and efficient intelligent building intercom environment, whether it is for the confirmation of visitor identity, the transmission of information, or the satisfaction of special needs, it shows excellent performance and a high degree of humanistic care.

[0081] The method of this embodiment can also achieve other functions and technical effects of the system of the above embodiment, which will not be described in detail here.

[0082] The above is only a preferred specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. An intelligent building intercom system, characterized in that: include: An intercom unit at the door of a building, used to obtain visitor information of a visitor, wherein the visitor information includes at least one of a person video and a first voice intercom information; A communication unit connected to the intercom unit at the door of the building for transmitting the visitor information; A video processing unit connected to the communication unit, configured to generate corresponding sign language information according to the sign language action when recognizing that the character video contains a sign language action; The indoor intercom unit is connected to the communication unit and is used to receive the visitor information and / or the sign language information, and display the sign language information in the form of text on the first display screen of the indoor intercom unit.

2. The intelligent building intercom system according to claim 1, characterized in that: It also includes a voice conversion unit, which is connected to the video processing unit and the communication unit respectively. The voice conversion unit is used to convert the sign language information into corresponding voice information, and send the voice information to the indoor intercom unit through the communication unit for voice playback.

3. The intelligent building intercom system according to claim 1 is characterized in that: The video processing unit is deployed with a trained sign language recognition model, and the sign language recognition model is used to determine whether the character video contains sign language movements and determine the sign language information corresponding to the sign language movements.

4. The intelligent building intercom system according to claim 1, characterized in that: The indoor intercom unit is also used to obtain second voice intercom information of indoor personnel, and send the second voice intercom information to the building door intercom unit through the communication unit. The building door intercom unit is also used to display the second voice intercom information in the form of text on the second display screen of the building door intercom unit.

5. The intelligent building intercom system according to any one of claims 1 to 4, characterized in that: It also includes an access control unit and an elevator control unit, which are respectively connected to the indoor intercom unit. The indoor intercom unit is also used to send door opening instructions and elevator down instructions to the access control unit and the elevator control unit respectively. The access control unit is used to open the building door according to the door opening instruction, and the elevator control unit is used to control the elevator to descend to the floor where the building door is located according to the elevator down instruction.

6. The intelligent building intercom system according to any one of claims 1 to 4, characterized in that: It also includes a cloud server, the communication unit is connected to the cloud server, and the cloud server is connected to the mobile terminal of the indoor person.

7. The intelligent building intercom system according to any one of claims 1 to 4, characterized in that: It also includes a language translation unit connected to the communication unit. The language translation unit is used to translate the foreign language information into Chinese information when the first voice intercom information is identified as foreign language information, and send the Chinese information to the indoor intercom unit through the communication unit.

8. The intelligent building intercom system according to claim 7, characterized in that: The language translation unit is also used to translate the second voice intercom information of the indoor personnel collected by the indoor intercom unit into corresponding foreign language reply information, and send the foreign language reply information to the building door intercom unit through the communication unit.

9. The intelligent building intercom system according to claim 1, characterized in that: The communication unit also includes a wireless communication unit, which is connected to the delivery robot and is used to send the delivery request of the delivery robot to the indoor intercom unit.

10. A smart building intercom control method, characterized in that: Applied to the intelligent building intercom system according to any one of claims 1 to 9, the method comprises: The communication unit receives visitor information acquired by the intercom unit at the door of the building, wherein the visitor information includes at least one of a person video and a first voice intercom information; The communication unit sends the visitor information to the video processing unit; The communication unit receives the sign language information returned by the video processing unit, wherein the sign language information is generated by the video processing unit according to the sign language action when the video processing unit recognizes that the character video contains the sign language action; The communication unit sends the visitor information and / or the sign language information to the indoor intercom unit, so that the indoor intercom unit displays the sign language information in the form of text on the first display screen of the indoor intercom unit.

Images