Visitor information reminding method and device

A technology for information reminders and visitors, which is applied in the direction of instruments, calculations, and individual input/output registers, etc., can solve the problems of large amounts of data, low accuracy of visitor identification, and low efficiency of visitor identification, and achieve improved Experience and overcome the effect of low identity accuracy

Active Publication Date: 2019-12-20
深圳市海雀科技有限公司
9 Cites 8 Cited by

AI-Extracted Technical Summary

Problems solved by technology

[0003] In the known technology, the smart doorbell is equipped with a camera to monitor a certain area outside. When someone enters the monitoring area and presses the doorbell, the smart doorbell acquires the facial features of the person and compares them with the facial features of the person pre-stored in the smart doorbell. Comparison, the identity information of the person can be determined if the comparison is successful, so as to broadcast the identity information to indoor users; however, using a single feature informat...
View more

Method used

In this embodiment, the acquired visitor's feature information is divided into two types of biometric feature information and identity auxiliary feature information, and then local comparison is performed according to the biometric feature information and the local database to quickly obtain the visitor's identity information, If the local comparison fails, compare the visitor's characteristic information with the remote database to obtain the visitor's identity information, wherein the smart doorbell performs intelligent identification to obtain the identity information and preset information of the second preset person used to establish the remote database. Set the feature information, and finally execute the user reminder operation according to the obtained visitor's identity information, and quickly and accurately obtain the visitor's identity information and perform user reminder operations through double data comparison with the local database and the remote database, effectively improving the user's awareness of visitors. Identity reminder experience. In addition, if the comparison with the remote database fails, the comparison ends, and a comparison failure message is output to the user, prompting the customer that the visitor is not matched, for example, the voice output of the indoor unit of the smart doorbell is "comparison failure".
Taking a community as an example, after a certain intelligent doorbell in the community obtains the characteristic information of the visitor, it is preferred to use the biometric feature information and the pre-stored preset personnel information of the intelligent doorbell to perform local comparison, if the local comparison Success, such as the user's friends, colleagues, etc., can be fed back to the user. If the local comparison fails, the above feature information can be uploaded to the cloud server of the community, and the feature information can be compared and analyzed by the cloud server of the community to determine the visitor. Information; if the cloud server of the community also fails to compare, the characteristic information of the visitor can be uploaded to the general cloud server for comparison, so as to prevent dangerous people such as thieves and criminals from approaching the user's home, and the owner of the house will be reminded in time when dangerous people approach the house , and for takeaway personnel or property personnel who are often active in the community, it can also be intelligently identified to avoid false alarms caused by identification errors. The use of smart doorbells for intelligent identification can not only increase the width of visitor identification, but also share the identification results between multiple smart doorbells through cloud servers, further improving the accuracy of visitor identification.
The present embodiment divides the acquired visitor's feature information into biometric feature information and identity auxiliary feature information, and then performs local comparison according to the biometric feature information and the local database to quickly obtain the visitor's identity information, If the local comparison fails, compare the visitor's characteristic information with the remote database to obtain the visitor's identity information. Among them, the smart doorbell performs intelligent identification according to the preset machine learning model to obtain the second preset for establishing the remote database. Personnel’s identity information and preset feature information, and finally perform user reminder operations according to the obtained visitor’s identity information. Through the double data comparison with the local database and the remote database, the visitor's identity information can be quickly and accurately obtained and the user reminder operation can be performed, which effectively improves the user's experience of visitor identity reminder. In addition, if the comparison with the remote database fails, the comparison ends, and a comparison failure message is output to the user, prompting the customer that the visitor is not matched.
The present invention divides the acquired visitor's feature information into two types of biometric feature information and identity auxiliary feature information, and then conducts a preliminary comparison according to the biometric feature information and the first database to quickly obtain the visitor's identity information, If the initial comparison fails, a secondary comparison is performed based on the visitor's characteristic information and the second database to obtain the visitor's identity information, and finally the user reminder operation is performed according to the obtained visitor's identity information, which overcomes the problem of obtaining information based on a single characteristic in the prior art. Visitor identity leads to low identity accuracy, and obtaining visitor identity based on multiple characteristic information leads to technical problems of low identity determination efficiency. Through double comparison, visitor identity information can be quickly and accurately obtained and user reminders can be performed to ensure the speed of identity determination. Under the premise of ensuring the accuracy of identity determination, it can effectively improve the user's experience of visitor identity reminder.
[0083] The above provides a variety of visitor detection methods to improve the diversity of visitor detection methods; it is also possible to use the above-mentioned multiple methods to carry out visitor detection to ensure the accuracy of visitor detection results.
[0096] Step S404, adding the visitor's mark and its feature information to the remote database as the identity information and preset feature information of the second preset person respectively. The smart doorbell uploads the identified characteristic information and identity information of passing personnel, suspicious personnel, dangerous personnel, takeaway personnel, salespersons, courier personnel, property personnel, etc. to the cloud server for storage, which is convenient for subsequent comparisons and smart doorbells. Information Sharing.
[0123] The user reminding operation includes one or more of voice broadcasting of the visitor's identity information, sending the visitor's identity information to the smart mobile terminal of the designated user, and sending alarm information to the designated institution. Specifically, after obtaining the identity information of the visitor outside the door, the indoor unit of the smart doorbell can be controlled to perform voice broadcast, and the voice output of the visitor's identity information is convenient for the user to directly listen to the visitor's identity information; The information is transmitted to the designated user's smart mobile terminal through the network, such as a mobile phone, which is convenient for the user to remotely check the visitors at home; and when the identity information of the visitor outside the door is identified as a dangerous person, the smart doorbell can send an alarm message to the designated community security Or designate the smart terminals of the police at the police station, such as mobile phones or computers, to realize alarm processing and avoid harm to people at home.
[0133] Specifically, the user reminding operation includes voice broadcasting of the visitor's identity information and access information, sending the visitor's identity information and access information to the smart mobile terminal of the designated user, and sending alarm information to one or more of the designated institutions. Specifically, after obtaining the identity information and access information of the visitors outside the door, the indoor unit of the smart doorbell can be controlled to perform voice broadcast, and the identity information and access information of the visitors can be output by voice. In this embodiment, the access information includes access time and number of visits , so that the user can directly listen to the visitor's identity information and access information; it can also be set to transmit the visitor's identity information and access information to the specified user's smart mobile terminal through the network through the smart doorbell, such as a mobile phone, so that the user can remotely view the visitors at home; and When the identity information of the visitor outside the door is identified as a dangerous person, the smart doorbell can send an alarm message to the smart terminal of the designated community security or the police of the designated police station to realize alarm processing and avoid harm to people at home.
[0141] The present invention divides the visitor's feature information obtained by the information acquisition module 62 into two types of biometric feature information and identity auxiliary feature information, and the preliminary comparison module 63 performs preliminary comparison according to the b...
View more

Abstract

The invention discloses a visitor information reminding method and device. The visitor information reminding method includes the steps: dividing the acquired feature information of a visitor into thebiological recognition feature information and the identity auxiliary feature information; carrying out preliminary comparison according to the biological recognition feature information and a first database to obtain identity information of the visitor; if the preliminary comparison fails, performing secondary comparison according to the feature information of the visitor and a second database toobtain identity information of the visitor; and finally, executing a user reminding operation according to the obtained identity information of the visitor. The visitor information reminding method can overcome the technical problems that visitor identity is acquired according to single characteristic information so that identity accuracy is low, and identity determination efficiency is low caused by obtaining the identity of the visitor according to various feature information in the prior art, can quickly and accurately obtain the identity information of the visitor through dual comparison,and performs user reminding operation, so that the experience of a user for visitor identity reminding is effectively improved. The visitor information reminding method can be widely applied to the fields of smart home and the like.

Application Domain

Character and pattern recognitionIndividual entry/exit registers +1

Technology Topic

Data miningComputer science

Image

  • Visitor information reminding method and device
  • Visitor information reminding method and device
  • Visitor information reminding method and device

Examples

  • Experimental program(15)

Example Embodiment

[0057] Example 1
[0058] refer to figure 1 , figure 1 It is a flowchart of an embodiment of a visitor information reminder method in the present invention. This embodiment provides a visitor information reminder method, including:
[0059] Step S101, detecting whether there is a visitor within the monitoring range of the smart doorbell;
[0060] Step S102, if a visitor is detected, obtain the feature information of the visitor, the feature information includes biometric feature information that can determine the identity of the person and identity auxiliary feature information that can assist in determining the identity of the person;
[0061] Step S103, perform a preliminary comparison based on the visitor's biometric feature information and the first database, and quickly obtain the visitor's identity information according to the preliminary comparison result; the first database stores the identity information of the first preset person and the preset biometric Correspondence of feature information;
[0062] Step S104, if the initial comparison fails, perform a second comparison of the visitor's feature information with the second database, and obtain the visitor's identity information according to the result of the second comparison, and the second database stores the identity of the second preset person Correspondence between information and preset feature information;
[0063] Step S105, perform a user reminder operation according to the identity information of the visitor.
[0064] The present invention divides the obtained visitor's characteristic information into two types: biological identification characteristic information and identity auxiliary characteristic information, and then conducts a preliminary comparison according to the biological identification characteristic information and the first database to quickly obtain the visitor's identity information, and the preliminary comparison If it fails, a secondary comparison is performed based on the visitor's characteristic information and the second database to obtain the visitor's identity information, and finally the user reminder operation is performed according to the acquired visitor's identity information, which overcomes the problem of obtaining the visitor's identity based on a single characteristic information in the prior art. The accuracy of identity is low, and the technical problem of low efficiency of identity determination is caused by obtaining visitor identity based on various characteristic information. Through double comparison, visitor's identity information can be quickly and accurately obtained and user reminder operation can be carried out. On the premise of ensuring the speed of identity determination , can ensure the accuracy of identity determination, and effectively improve the user's experience of visitor identity reminder.

Example Embodiment

[0065] Example 2
[0066] In the known technology, in the process of determining the identity of the visitor by the smart doorbell, the smart doorbell often only compares it with the pre-stored information, resulting in inaccurate visitor information broadcast by the smart doorbell and poor user experience. Therefore, in this embodiment, the first The first database is a local database, which is set in the smart doorbell, and the second database is a remote database, which is set in the cloud server. refer to figure 2 , figure 2 It is a flowchart of another embodiment of the visitor information reminder method in the present invention, the visitor information reminder method includes:
[0067] Step S201, detecting whether there is a visitor within the monitoring range of the smart doorbell;
[0068] Step S202, if it is detected that there is a visitor within the monitoring range, the characteristic information of the visitor is obtained, and the characteristic information includes biometric characteristic information that can determine the identity of the person and auxiliary characteristic information that can assist in determining the identity of the person;
[0069] Step S203, perform a preliminary comparison based on the visitor's biometric feature information and the local database, and quickly obtain the visitor's identity information according to the preliminary comparison result. The local database stores the identity information of the first preset person and the preset biometric feature information The corresponding relationship; wherein, the local database is established by pre-stored information of the user of the smart doorbell, the first preset person can be a fixed member of the family, friends, colleagues, relatives, etc., by pre-collecting the characteristics of the first preset person The information is used as the preset biometric feature information, and the identity information of the first preset person is obtained to establish a local database. For example, when a colleague visits, the smart doorbell installed outside acquires the feature information (including facial features) of the colleague , the feature information is sent to the user’s mobile terminal (such as a mobile phone) designated by the smart doorbell through the network, and the user enters the colleague’s identity information on the mobile terminal after viewing the feature information of the colleague, and the smart doorbell uses the feature information of the colleague as Preset biometric feature information, and store the preset biometric feature information and corresponding identity information in a local database for use in subsequent local comparisons;
[0070] Step S204, if the local comparison fails, a secondary comparison is performed based on the visitor's feature information and the remote database, and the visitor's identity information is obtained according to the secondary comparison result. The remote database stores the identity information of the second preset person and the preset The corresponding relationship of feature information is set, wherein, the identity information of the second preset person and the preset feature information are obtained by intelligent identification in advance according to the preset machine learning model of the smart doorbell;
[0071] Step S205, perform a user reminder operation according to the identity information of the visitor.
[0072] In this embodiment, the acquired visitor's feature information is divided into two types: biometric feature information and identity auxiliary feature information, and then local comparison is performed according to the biometric feature information and the local database to quickly obtain the visitor's identity information, and the local comparison If it fails, compare the visitor's characteristic information with the remote database to obtain the visitor's identity information, wherein the smart doorbell performs intelligent identification according to the preset machine learning model to obtain the identity of the second preset person used to establish the remote database Information and preset feature information, and finally perform user reminder operations according to the acquired identity information of visitors. Through the double data comparison with the local database and the remote database, the visitor's identity information can be quickly and accurately obtained and the user reminder operation can be performed, which effectively improves the user's experience of visitor identity reminder. In addition, if the comparison with the remote database fails, the comparison ends, and a comparison failure message is output to the user, prompting the customer that the visitor is not matched.

Example Embodiment

[0073] Example 3
[0074] In this embodiment, the method for detecting whether there are visitors within the monitoring range of the smart doorbell is specifically described:
[0075] refer to image 3 , image 3 The structural block diagram of the smart doorbell is shown as an example. The smart doorbell includes an outdoor unit and an indoor unit. The outdoor unit is generally installed at the outdoor door, and the indoor unit is generally installed indoors to send out a reminder ring to remind visitors of visitors. Specifically, the indoor unit includes a speaker 313 for playing voice, a storage module 310 for storing information, a second microphone module 312 for collecting voice, and a second main control module 311 used as the main control center of the indoor unit; And the outdoor unit includes the first main control module 309 used as the main control center of the outdoor unit, the first microphone module 308 for collecting voice, the camera 301 for collecting the monitoring video and images at the door, and the camera 301 for collecting images for the camera 301. Or the supplementary light 304 of video supplementary light, the human body infrared sensor module 306 for realizing human body detection, the fingerprint recognition module 307 for fingerprint recognition, the iris image sensor 302 for obtaining iris information, and the trigger intelligence The trigger switch of the doorbell. In some application scenarios, the trigger switch can be the touch button 303 or the doorbell button 305. Once a visitor touches the touch button 303 of the outdoor unit or presses the doorbell button 305 of the outdoor unit, it will trigger the smart doorbell to control the speaker 313 issued a prompt bell.
[0076] refer to image 3 There is a communication connection between the first main control module 309 and the second main control module 311, which can be a wired connection or a wireless connection, such as establishing a communication connection through WiFi. Here, the first main control module 309 and the second main control module The communication connection mode between the control modules 311 is not limited. In actual use, the first microphone module 308 and the second microphone module 312 can be realized by a microphone array, and the fill light 304 can be realized by a ring fill light, which can be a ring LED fill light. In addition, the human body infrared sensing module 306 is realized by a human body infrared sensor. The smart doorbell is equipped with a fingerprint identification module 307 and an iris image sensor 302 to open the door according to the user's fingerprint information and iris information. Therefore, the smart doorbell also includes an electronic lock module. The first main control module 309 confirms that the user is a preset After the user, the first main control module 309 controls the electronic lock module to unlock to realize opening the door.
[0077] Methods for detecting whether there are visitors within the monitoring range of the smart doorbell include but are not limited to the following methods:
[0078] The first method of detecting whether there is a visitor is by detecting whether the trigger switch is triggered. When the switch is triggered, it indicates that there is a visitor within the monitoring range of the smart doorbell. It can detect whether the smart doorbell has a pressing operation, and if the judgment result is yes, it is determined that the smart doorbell is triggered; for example, it is detected whether the doorbell button is pressed, and when the doorbell button is pressed, a button signal is output to the first main control module, Then it can be determined that the smart doorbell is triggered. It may also be determined whether the touch button of the smart doorbell is touched, and if the judgment result is yes, it is determined that the trigger switch of the smart doorbell is triggered.
[0079] The second method of detecting whether there is a visitor is to judge whether there is a human figure in the image or video captured by the camera of the smart doorbell, and when the human figure is judged by image processing and intelligent recognition technology, it indicates that there is a visitor.
[0080] The third way to detect whether there is a visitor is to judge whether the human body infrared sensor module of the smart doorbell outputs a signal. When the human body infrared sensor module outputs a signal, it indicates that it detects the presence of a human body, that is, there is a visitor.
[0081] The fourth method of detecting whether there is a visitor, by judging whether the smart doorbell has received the iris image sent by the iris image sensor and/or the fingerprint recognition result information sent by the fingerprint recognition module, when the smart doorbell receives the iris image and/or the fingerprint recognition result information When the information is displayed, it indicates that someone is performing iris recognition or fingerprint recognition, that is, a visitor has come to the door.
[0082] The fifth method of detecting whether there is a visitor is to detect whether there is a sound in the monitoring area of ​​the outdoor door by controlling the smart doorbell. If there is a sound, it indicates that there is a visitor.
[0083]The above provides a variety of visitor detection methods to increase the diversity of visitor detection methods; the above multiple methods can also be used for visitor detection at the same time to ensure the accuracy of visitor detection results.

PUM

no PUM

Description & Claims & Application Information

We can also present the details of the Description, Claims and Application information to help users get a comprehensive understanding of the technical details of the patent, such as background art, summary of invention, brief description of drawings, description of embodiments, and other original content. On the other hand, users can also determine the specific scope of protection of the technology through the list of claims; as well as understand the changes in the life cycle of the technology with the presentation of the patent timeline. Login to view more.

Similar technology patents

Writing trace demonstration method and apparatus applied to writing brush

ActiveCN105046730AImprove experience
Owner:BEIJING SHENGSHI XUANHE INFORMATION TECH

URL filtering method and device

ActiveCN105721479ASecurityImprove experience
Owner:BEIJINGNETENTSEC

Mobile terminal and missed call diverting method

ActiveCN103167454AImprove experience
Owner:SHENZHEN TRANSSION HLDG CO LTD

Information sharing method and device

InactiveCN106156254AImprove experience
Owner:ALIBABA GRP HLDG LTD

Mobile phone and method for adjusting brightness of display based on mobile phone

InactiveCN102394972AImprove experienceavoid physical hazards
Owner:HUIZHOU TCL MOBILE COMM CO LTD

Classification and recommendation of technical efficacy words

  • Improve experience

Scalable search system using human searchers

InactiveUS20070174244A1improve experience
Owner:CHACHA SEARCH

Vehicle scheduling, apparatus and system

InactiveCN106373387AMake sure to accept the orderImprove experience
Owner:XIANFENG ZHIDAO BEIJING TECH CO LTD

Method and system for displaying panoramic video

ActiveCN104010225AImprove experienceAppreciate the angle and camera position to switch quickly and optimize
Owner:ALIBABA (CHINA) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products