Remote control method and system based on door

Abstract

The invention relates to a door-based remote control method and system, and relates to the field of door and window control technologies, and the method comprises the steps: obtaining a preset region recognition state of a visit waiting region; acquiring a waiting area image when the area identification state is consistent with a preset successful identification state; performing facial feature recognition in the waiting area image to determine the facial feature of the visitor; judging whether the face features of all visitors are in a preset request-free set or not; if the face features of all visitors are in the request-free set, determining that no action exists; if the facial features of all visitors are not in the no-request set, outputting a request processing signal, sending the request processing signal to a preset network connection address, and controlling a preset reply duration to count back; and receiving an actual control signal sent at the network connection address when the reply duration timing returns to zero, and controlling the door according to the actual control signal. The method has the effect of improving the overall experience effect when the visitor arrives.

Description

Technical Field

[0001] The present application relates to the field of door and window control technology, and in particular to a door-based remote control method and system. Background Art

[0002] The remote control of the door is generally achieved by an electronic device connected to the door, and the functions that can be achieved generally include opening and closing the door. Among them, when a visitor arrives and the owner is not at home, the user can unlock the door through the corresponding APP on the electronic device, so that the visitor does not need to wait at the door.

[0003] In the above-mentioned related technologies, when a visitor arrives, the visitor generally needs to contact the owner of the house by phone or other means, and the owner of the house then unlocks the door lock through the APP. This method still requires the visitor to wait in front of the door for a period of time, which makes the overall experience of the visitor poor and there is still room for improvement. Summary of the invention

[0004] In order to improve the overall experience of visitors when they arrive, the present application provides a door-based remote control method and system.

[0005] In a first aspect, the present application provides a door-based remote control method, which adopts the following technical solution:

[0006] A door-based remote control method, comprising:

[0007] Obtaining the area recognition status of the preset visit waiting area;

[0008] When the area recognition state is consistent with the preset successful recognition state, an image of the waiting area is acquired;

[0009] Perform facial feature recognition in the waiting area image to determine the visitor's facial features;

[0010] Determine whether all visitors' facial features are within the preset no-request set;

[0011] If all visitor facial features are in the no-request set, no action is taken;

[0012] If all the facial features of the visitors are not in the set of no request, a request processing signal is output and sent to the preset network connection address, and the preset response time countdown is controlled;

[0013] When the reply duration timer returns to zero, an actual control signal sent at the network connection address is received, and the door is controlled according to the actual control signal.

[0014] Optionally, a determination step without requesting a set is also included, the step comprising:

[0015] Establishing a fixed interval with the current time point as the end point and a width of a preset fixed time length on the preset time axis;

[0016] Acquire facial features of each visitor and a corresponding actual control signal in a fixed interval, and define the facial features of the visitor in the fixed interval as historical facial features;

[0017] Counting the actual control signals that are inconsistent with the preset door opening control signals in each historical facial feature to determine the number of reverse feedbacks;

[0018] Determine whether the reverse feedback quantity is greater than a preset reference reverse quantity;

[0019] If the reverse feedback quantity is not greater than the reference reverse quantity, no action will be taken;

[0020] If the reverse feedback quantity is greater than the reference reverse quantity, the historical facial features corresponding to the reverse feedback quantity are summarized into an initially empty request-free set.

[0021] Optionally, if all the facial features of the visitors are not in the no-request set, the door-based remote control method further includes:

[0022] The facial features of the current visitors that are in the no-request set are defined as stable facial features, and the remaining facial features of the visitors are defined as request facial features;

[0023] Counting the actual control signal that is consistent with the door opening control signal according to the single requested facial feature in a fixed interval to determine the number of positive feedbacks;

[0024] Determine whether there is a situation where the number of positive feedbacks is greater than a preset reference positive number;

[0025] If there is no situation where the number of positive feedbacks is greater than the reference number of positive feedbacks, the preset smooth request signal is output as the request processing signal;

[0026] If there is a situation where the number of positive feedbacks is greater than the reference positive number, a preset urgent request signal is output as a request processing signal, wherein the urgent request signal has a more significant prompting effect than the gentle request signal.

[0027] Optionally, if there is no situation where the number of positive feedbacks is greater than the reference number of positive feedbacks, the door-based remote control method further includes:

[0028] Determine whether there are stable facial features;

[0029] If there is no stable facial feature, the flattening request signal is output as a request processing signal;

[0030] If there are stable facial features, the current stable facial features are combined to construct a stable set;

[0031] Determine a single visitor set according to the facial features of the visitor at a single time point in a fixed interval, define the single visitor set containing the stable set as a valid analysis set, and count the valid analysis sets to determine the number of valid sets;

[0032] The effective analysis set when the actual control signal is consistent with the door opening control signal is defined as the door opening processing set, and the number of door opening sets is determined by counting the door opening processing sets;

[0033] Calculate the door opening ratio based on the number of valid sets and the number of door opening sets;

[0034] Determine whether the door opening ratio is greater than the preset benchmark demand ratio;

[0035] If the door opening ratio is greater than the baseline demand ratio, the smooth request signal is output as a request processing signal;

[0036] If the door opening ratio is not greater than the baseline demand ratio, no action will be taken.

[0037] Optionally, if there is no stable facial feature, the door-based remote control method further includes:

[0038] Perform clothing feature recognition based on the current waiting area image to determine the visitor's clothing features;

[0039] Determine clothing features of visitors according to the waiting area image corresponding to the facial features of each visitor in the unrequested set;

[0040] Counting the clothing features of the same person under the facial features of a single visitor to determine the number of clothing that appear, and counting the clothing features of the person under the facial features of a single visitor to determine the overall number of appearances;

[0041] The clothing appearance ratio is determined by calculation based on the number of clothing appearances and the overall number of clothing appearances, and the corresponding clothing features of the person when the clothing appearance ratio is greater than the preset upper limit appearance ratio are defined as clothing features that do not require requesting;

[0042] Construct an unnecessary clothing set according to all unnecessary clothing features, and determine whether all the current visitor's clothing features are in the unnecessary clothing set;

[0043] If the current visitor's clothing features are all in the unnecessary clothing set, no action is taken;

[0044] If the current visitor's clothing features are not all in the unnecessary clothing set, the smooth request signal is output as a request processing signal.

[0045] Optionally, after controlling the door according to the actual control signal, the door-based remote control method further includes:

[0046] Determine whether the actual control signal is consistent with the door opening control signal;

[0047] If the actual control signal is inconsistent with the door opening control signal, no action will be taken;

[0048] If the actual control signal is consistent with the door opening control signal, the permitted opening duration is obtained according to the actual control signal, and the detection interval is constructed according to the permitted opening duration;

[0049] Acquire the waiting area image in real time in the detection interval, and determine the visitor's facial features based on the waiting area image;

[0050] Determine whether all the facial features of the visitors in the detection interval correspond one-to-one with all the facial features of the visitors before the actual control signal is output;

[0051] If the facial features of all visitors in the detection interval do not correspond one-to-one with the facial features of all visitors before the actual control signal is output, the waiting area image is continuously acquired until the abnormal signal is output and transmitted to the network connection address after the permitted opening time;

[0052] If all the facial features of the visitors in the detection interval correspond one-to-one with all the facial features of the visitors before the actual control signal is output, the door lock usage status is obtained, and it is determined whether the door lock usage status is consistent with the preset closed state;

[0053] If the door lock usage state is consistent with the closed state, a normal signal is output and transmitted to the network connection address;

[0054] If the door lock usage status is inconsistent with the closed status, the waiting area image will continue to be acquired until the permitted opening time has passed and an abnormal signal will be output and transmitted to the network connection address.

[0055] In a second aspect, the present application provides a door-based remote control system, which adopts the following technical solution:

[0056] A door-based remote control system, comprising:

[0057] An acquisition module, used to acquire the area recognition status of a preset visit waiting area;

[0058] A processing module, connected to the acquisition module and the judgment module, for storing and processing information;

[0059] A judgment module, connected with the acquisition module and the processing module, for judging the information;

[0060] When the judging module judges that the area recognition state is consistent with the preset successful recognition state, the acquiring module acquires the waiting area image;

[0061] The processing module performs facial feature recognition in the waiting area image to determine the visitor's facial features;

[0062] The judgment module judges whether all the facial features of the visitors are within the preset no-request set;

[0063] If the judgment module determines that all the visitor's facial features are in the no-request set, the processing module takes no action;

[0064] If the judging module determines that all the facial features of the visitors are not in the set of no request, the processing module outputs a request processing signal and sends it to a preset network connection address, and controls the countdown of the preset reply time;

[0065] The processing module receives the actual control signal sent at the network connection address when the reply duration timer returns to zero, and controls the door according to the actual control signal.

[0066] In a third aspect, the present application provides a computer storage medium capable of storing corresponding programs, which has the characteristics of improving the overall experience of visitors when they arrive, and adopts the following technical solutions:

[0067] A computer-readable storage medium stores a computer program that can be loaded by a processor and execute any of the above-mentioned door-based remote control methods.

[0068] In summary, the present application includes at least one of the following beneficial technical effects:

[0069] 1. When a visitor arrives, the host can be automatically notified according to the visitor's situation, so that the visitor does not need to make an additional call to the host, thus improving the overall experience of the visitor's arrival;

[0070] 2. When a visitor is identified, the visitor can be automatically analyzed, so that people who do not need to be reminded do not need to remind the host, thus improving the intelligence of visit reminders;

[0071] 3. After remotely unlocking the door, personnel monitoring can be performed according to the time set by the homeowner to improve the safety of the house. BRIEF DESCRIPTION OF THE DRAWINGS

[0072] Figure 1 is a flow chart of a door-based remote control method.

[0073] Figure 2 It is a module flow chart of the door-based remote control method. DETAILED DESCRIPTION

[0074] In order to make the purpose, technical solutions and advantages of this application more clear, the following Figure 1-Figure 2 It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0075] The embodiments of the present application are further described in detail below in conjunction with the drawings in the specification.

[0076] The present application embodiment discloses a door-based remote control method, referring to Figure 1 , the method flow of the door-based remote control method includes the following steps:

[0077] Step S100: Acquire the area recognition status of a preset visit waiting area.

[0078] The visitor waiting area is the area where visitors need to enter and wait after arriving. Generally, this area is set in front of the door to facilitate the viewing of visitors. The area identification status is the status of whether there are visitors in the visitor waiting area, which can be obtained through infrared thermal sensing. When the presence of a person is detected by infrared thermal sensing and the presence time reaches the required length of time, it can be determined that there is a visitor in the area, otherwise there is no visitor.

[0079] Step S101: acquiring a waiting area image when the area recognition state is consistent with a preset successful recognition state.

[0080] The successful identification state is the area identification state when a visitor is detected in the visit waiting area. When the area identification state is consistent with the successful identification state, it means that a visitor has visited, and analysis is required at this time; the waiting area image is the acquired area image of the visit waiting area, which can be obtained through the image capture device installed behind the door.

[0081] Step S102: performing facial feature recognition in the waiting area image to determine the visitor's facial features.

[0082] The visitor's facial features are facial features of the person detected in the image obtained through face recognition.

[0083] Step S103: Determine whether all the facial features of the visitors are within the preset no-request set.

[0084] There is no need to request a set of facial features of persons identified as not being visitors set by the system or the user. The purpose of the judgment is to find out whether all persons currently detected are unlikely to be visitors.

[0085] Step S1031: If all visitor facial features are in the no-request set, no action is taken.

[0086] When all visitor facial features are in the no-request set, it means that all current personnel are not visitors and no additional operations are required.

[0087] Step S1032: If all the visitor's facial features are not in the set of no request required, a request processing signal is output and sent to a preset network connection address, and a preset response time countdown is controlled.

[0088] When the facial features of all visitors are not in the set where no request is required, it means that there is a visitor, and the situation needs to be handled at this time; the request processing signal is a signal that records the situation and can request the homeowner to handle the situation. The network connection address is the network address of the electronic device connected to the homeowner. The request processing signal is sent to the APP connected to the homeowner, so that the homeowner can respond to the situation in time; the response time is the time set by the staff for the homeowner to process the request processing signal.

[0089] Step S104: receiving the actual control signal sent at the network connection address when the reply duration timer returns to zero, and controlling the door according to the actual control signal.

[0090] The actual control signal is the signal output by the homeowner in response to the request processing signal, such as unlocking the door, ignoring it, etc. The actual control signal is transmitted to the control system corresponding to the door, thereby realizing the control of the door. When a visitor arrives, the homeowner can remotely control the door according to the actual situation, so that visitors who can enter the house in advance do not need to wait at the door, thereby improving the overall experience when the visitor arrives.

[0091] Also included is a step of determining that no request set is required, the step comprising:

[0092] Step S200: establishing a fixed interval on a preset time axis with the current time point as the end point and a width of a preset fixed time length.

[0093] The time axis is a coordinate axis formed by the combination of various time points. The time points that have passed in the coordinate axis are in the forward direction, and the time points that have not yet arrived are in the backward direction. The fixed duration is the duration set by the staff to explore the historical visitor situation, such as 5 years. By establishing a fixed interval, it is convenient to obtain and analyze the data within the fixed duration.

[0094] Step S201: Acquire facial features of each visitor and a corresponding actual control signal in a fixed interval, and define the facial features of the visitor in the fixed interval as historical facial features.

[0095] Define historical facial features to identify the facial features of each visitor obtained in historical situations for subsequent analysis.

[0096] Step S202: Counting actual control signals in each historical facial feature that are inconsistent with the preset door opening control signal to determine the number of reverse feedbacks.

[0097] The door opening control signal is the actual control signal output by the homeowner, which is the signal for controlling the door to open. The reverse feedback quantity is the total number of feedback signals that each person has obtained in historical situations and cannot directly open the door, that is, the total number of feedback signals that a single person has obtained in a fixed interval and cannot directly open the door.

[0098] Step S203: Determine whether the reverse feedback quantity is greater than a preset reference reverse quantity.

[0099] The baseline reverse number is the minimum number of reverse feedbacks set by the staff to determine that the person corresponding to the historical facial features is basically unlikely to be a visitor. The purpose of the judgment is to find out whether the person is likely to be a visitor.

[0100] Step S2031: If the reverse feedback quantity is not greater than the reference reverse quantity, no action is taken.

[0101] When the number of reverse feedback is not greater than the baseline reverse number, it means that the person may be a visitor, and additional operations are required.

[0102] Step S2032: If the reverse feedback quantity is greater than the reference reverse feedback quantity, the historical facial features corresponding to the reverse feedback quantity are summarized into an initially empty request-free set.

[0103] When the number of reverse feedbacks is greater than the baseline reverse number, it means that the person is basically unlikely to be a visitor, such as a courier, etc. At this time, the historical facial features of the person are summarized into an initially empty no-request set, thereby achieving effective construction of the no-request set.

[0104] If all the facial features of the visitors are not in the no-request set, the door-based remote control method further includes:

[0105] Step S300: defining the visitor facial features in the current visitor facial features that are in the unrequested set as stable facial features, and defining the remaining visitor facial features as requested facial features.

[0106] Define stable facial features and request facial features to distinguish different visitor facial features for subsequent analysis.

[0107] Step S301: Counting actual control signals whose single requested facial features are consistent with the door opening control signal in a fixed interval to determine the number of positive feedbacks.

[0108] The number of positive feedbacks is the total number of feedback signals for directly opening the door obtained by a single person in a fixed interval, which can be obtained by counting the actual control signals that are consistent with the door opening control signals one by one.

[0109] Step S302: Determine whether the number of positive feedback is greater than a preset reference positive number.

[0110] The benchmark positive number is the minimum number of positive feedbacks set by the staff to identify the person as a more important visitor. The purpose of the judgment is to find out whether there is a more important visitor at present.

[0111] Step S3021: If there is no situation where the number of positive feedback is greater than the reference number of positive feedback, the preset gentle request signal is output as the request processing signal.

[0112] When there is no situation where the number of positive feedbacks is greater than the benchmark positive number, it means that there are no important visitors at present. At this time, a smooth request signal can be output to prompt the user, wherein the smooth request signal can be a pop-up window prompt of the APP.

[0113] Step S3022: If the number of positive feedbacks is greater than the reference number of positive feedbacks, a preset urgent request signal is output as a request processing signal, wherein the urgent request signal has a more significant prompting effect than the gentle request signal.

[0114] When the number of positive feedbacks is greater than the benchmark positive number, it means that there is a more important visitor at present. At this time, an urgent request signal can be output to prompt the user, wherein the urgent request signal can be an alarm prompt. The specific conditions of the urgent request signal and the gentle request signal are set by the staff according to the actual situation. It only needs to ensure that the urgent request signal has a more significant prompting effect than the gentle request signal.

[0115] If there is no situation where the number of positive feedbacks is greater than the reference number of positive feedbacks, the door-based remote control method further includes:

[0116] Step S400: Determine whether there are stable facial features.

[0117] The purpose of the judgment is to find out whether there are people in the unnecessary request set at present, so as to judge whether other current people can be analyzed through the co-existing people.

[0118] Step S4001: If there is no stable facial feature, a smoothing request signal is output as a request processing signal.

[0119] When there are no stable facial features, it means that there is no situation where the persons in the unnecessary request set are analyzed to determine the current person. At this time, the smooth request signal can be output as the request processing signal.

[0120] Step S4002: If there are stable facial features, the current stable facial features are combined to construct a stable set.

[0121] When stable facial features exist, it means that the situation of other persons can be determined by analyzing the persons in the no-request set; the stable set is the set consisting of the currently detected stable facial features.

[0122] Step S401: determining a single visitor set according to facial features of visitors at a single time point in a fixed interval, defining the single visitor set including the stable set as a valid analysis set, and counting the valid analysis sets to determine the number of valid sets.

[0123] The single visitor set is a set consisting of visitor facial features detected at a single time point. The valid analysis set is defined to identify the situation where there is a current stable set, which is convenient for subsequent analysis; the number of valid sets is the total number of valid analysis sets determined in a fixed interval.

[0124] Step S402: define the valid analysis set when the actual control signal is consistent with the door opening control signal as the door opening processing set, and count the door opening processing sets to determine the number of door opening sets.

[0125] The door opening processing set is defined to record the situations where the homeowner performs door opening processing when the same person is present, so that the total number of determined door opening processing sets, i.e., the door opening set number, can be obtained by counting the door opening processing sets.

[0126] Step S403: Calculate the door opening ratio based on the number of valid sets and the number of door opening sets.

[0127] The open ratio is the ratio of the open processing set to all valid analysis sets, which is determined by dividing the number of open sets by the number of valid sets.

[0128] Step S404: Determine whether the door opening ratio is greater than a preset baseline demand ratio.

[0129] The benchmark demand ratio is the minimum door opening ratio set by the staff to determine whether the homeowner is likely to open the door when the stable set of people are present at the same time. The purpose of the judgment is to find out whether the current homeowner is likely to open the door.

[0130] Step S4041: If the door opening ratio is greater than the reference demand ratio, the smooth request signal is output as a request processing signal.

[0131] When the door opening ratio is greater than the baseline demand ratio, it means that the homeowner is likely to open the door, and the request processing signal can be output normally.

[0132] Step S4042: If the door opening ratio is not greater than the baseline demand ratio, no action is taken.

[0133] When the door opening ratio is not greater than the baseline demand ratio, it means that the current homeowner is less likely to open the door. At this time, there is no need to output a request processing signal to reduce the transmission of invalid signals, reduce the situation where the homeowner is disturbed by APP prompts, and improve the intelligence of use.

[0134] If there are no stable facial features, the door-based remote control method also includes:

[0135] Step S500: performing clothing feature recognition based on the current waiting area image to determine the visitor's clothing features.

[0136] The visitor clothing features are the features of the clothing worn by each person in the currently acquired waiting area image. Clothing feature recognition can be achieved by training the corresponding recognition database in advance through a neural network.

[0137] Step S501: determining clothing features of visitors in the unrequested set according to the waiting area image corresponding to the facial features of each visitor.

[0138] The clothing features of the personnel are the clothing features worn by the personnel in the determined no-request set each time they appear in the visitor waiting area, and can be obtained by analyzing the waiting area images at each time point.

[0139] Step S502: Count the clothing features of the same person under the facial features of a single visitor to determine the number of clothing appearances, and count the clothing features of the people under the facial features of a single visitor to determine the overall number of appearances.

[0140] The number of clothing appearances is the total number of appearances of the same type of clothing feature of a single person, and the overall number of appearances is the total number of clothing features obtained for the single person, that is, the total number of times the person appears.

[0141] Step S503: Calculate the clothing appearance ratio based on the clothing appearance number and the overall appearance number, and define the corresponding person clothing features when the clothing appearance ratio is greater than the preset upper limit appearance ratio as clothing features that do not require requesting.

[0142] The clothing appearance ratio is the ratio of the number of times a single type of clothing appears to the total number of times it appears, and is determined by dividing the number of clothing appearances by the total number of appearances; the upper limit appearance ratio is the minimum clothing appearance ratio set by the staff to determine that the clothing may be work clothes, such as courier work clothes. When the clothing appearance ratio is greater than the upper limit appearance ratio, it means that the clothing is likely to be work clothes. At this time, it is defined as not requiring clothing features to distinguish the clothing features of different people, which is convenient for subsequent analysis.

[0143] Step S504: construct an unnecessary clothing set according to all unnecessary clothing features, and determine whether all the current visitor clothing features are in the unnecessary clothing set.

[0144] The features constituted by the clothes that a person who is not a visitor would wear are determined without a set of clothes. The purpose of the judgment is to find out whether the current person is wearing clothes of this type, so as to judge whether the person is a courier or the like.

[0145] Step S5041: If the current visitor's clothing features are all in the unnecessary clothing set, no action is taken.

[0146] When the current visitor's clothing features are all in the unnecessary clothing set, it means that even if the currently detected person has not appeared before, there is a high probability that the homeowner will not open the door for him / her. At this time, there is no need to output a request processing signal to reduce the occurrence of invalid prompts.

[0147] Step S5042: If the current visitor's clothing features are not all in the unnecessary clothing set, the smooth request signal is output as a request processing signal.

[0148] When the clothing features of the current visitor are not all in the unnecessary clothing set, it means that there is a visitor who may be processed by the homeowner to open the door. At this time, the request processing signal can be output normally.

[0149] After the door is controlled according to the actual control signal, the door-based remote control method further includes:

[0150] Step S600: Determine whether the actual control signal is consistent with the door opening control signal.

[0151] The purpose of the judgment is to know whether the homeowner's input is to allow visitors to enter the room, so as to facilitate subsequent analysis.

[0152] Step S6001: If the actual control signal is inconsistent with the door opening control signal, no action is taken.

[0153] When the actual control signal is inconsistent with the door opening control signal, it means that the current homeowner does not allow visitors to enter the room, and no additional operation is required.

[0154] Step S6002: If the actual control signal is consistent with the door opening control signal, the permitted opening time is obtained according to the actual control signal, and the detection interval is constructed according to the permitted opening time.

[0155] When the actual control signal is consistent with the door opening control signal, it means that the current homeowner allows visitors to enter the room. However, at this time, the homeowner may allow couriers or cargo pickup personnel he knows to enter the room briefly, so further analysis is needed; the permitted opening duration is the duration of the visitor allowed to enter the room carried by the actual control signal input by the homeowner, such as 5 minutes, etc. The detection interval is a time interval with the width of the permitted opening duration extending backward from the time axis from the time point when the door is controlled according to the actual control signal as the starting point. By constructing the detection interval, data within the permitted opening duration after the door is opened can be acquired and analyzed.

[0156] Step S601: acquiring a waiting area image in real time during the construction of the detection interval, and determining the visitor's facial features based on the waiting area image.

[0157] Real-time image acquisition in the detection area can be used to analyze the specific situation during the period when the door is open.

[0158] Step S602: Determine whether all the facial features of the visitors in the detection interval correspond one-to-one to all the facial features of the visitors before the actual control signal is output.

[0159] The purpose of the judgment is to know whether all persons have come out of the room.

[0160] Step S6021: If the facial features of all visitors in the detection interval do not correspond one-to-one with the facial features of all visitors before the actual control signal is output, continue to obtain the waiting area image until the abnormal signal is output and transmitted to the network connection address after the permitted opening time.

[0161] When the facial features of all visitors in the detection interval do not correspond one-to-one with the facial features of all visitors before the actual control signal is output, it means that there are still people who have not come out of the room. At this time, you can continue to detect. When there are still people who have not come out after the permitted opening time, it means that there is an abnormal entry of people. At this time, an abnormal signal is output to record the situation and transmit it to the network connection address so that the homeowner can be informed of the situation in time.

[0162] Step S6022: If the facial features of all visitors in the detection interval correspond one-to-one with the facial features of all visitors before the actual control signal is output, the door lock usage status is obtained, and it is determined whether the door lock usage status is consistent with the preset closed state.

[0163] When the facial features of all visitors in the detection interval correspond one by one to the facial features of all visitors before the actual control signal is output, it means that all the people have come out of the room. At this time, it is necessary to determine whether the door is closed. The door lock usage status is the state in which the door lock is used, including the unlocked state and the closed state, among which the closed state is the state in which the door lock completes locking the door to prevent outsiders from entering. The purpose of the judgment is to know whether the door is closed after all the people have come out.

[0164] Step S60221: If the door lock usage state is consistent with the closed state, a normal signal is output and transmitted to the network connection address.

[0165] When the door lock usage state is consistent with the closed state, it means that the person has left and closed the door. At this time, a normal signal can be output to record the situation.

[0166] Step S60222: If the door lock usage state is inconsistent with the closed state, continue to obtain the waiting area image until the permitted opening time has passed and then output an abnormal signal and transmit it to the network connection address.

[0167] When the door lock usage status is inconsistent with the closed status, it means that the person has not closed the door, and there may be things that need to be dealt with that have not been completed. At this time, you can continue to monitor. When the door is still not closed after the permitted opening time, it means that there is an abnormal situation of someone entering the room. At this time, you can output an abnormal signal to mark the situation.

[0168] Reference Figure 2 Based on the same inventive concept, an embodiment of the present invention provides a door-based remote control system, including:

[0169] An acquisition module, used to acquire the area recognition status of a preset visit waiting area;

[0170] A processing module, connected to the acquisition module and the judgment module, for storing and processing information;

[0171] A judgment module, connected with the acquisition module and the processing module, for judging the information;

[0172] When the judging module judges that the area recognition state is consistent with the preset successful recognition state, the acquiring module acquires the waiting area image;

[0173] The processing module performs facial feature recognition in the waiting area image to determine the visitor's facial features;

[0174] The judgment module judges whether all the facial features of the visitors are within the preset no-request set;

[0175] If the judgment module determines that all the visitor's facial features are in the no-request set, the processing module takes no action;

[0176] If the judging module determines that all the facial features of the visitors are not in the set of no request, the processing module outputs a request processing signal and sends it to a preset network connection address, and controls the countdown of the preset reply time;

[0177] The processing module receives the actual control signal sent at the network connection address when the reply duration timer returns to zero, and controls the door according to the actual control signal;

[0178] A request-free set determination module is used to more accurately determine the request-free set;

[0179] The request signal control module controls the request signal to be output according to different visitor situations;

[0180] Visitor situation analysis module, which controls the request signal to be output according to the historical arrival situation of the current visitor;

[0181] Clothing recognition and analysis module, used to perform clothing recognition processing on some visitors to improve the overall intelligence of remote prompts;

[0182] The door opening monitoring module is used to monitor the situation after the door is opened remotely.

[0183] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0184] An embodiment of the present invention provides a computer-readable storage medium storing a computer program that can be loaded by a processor and execute a door-based remote control method.

[0185] Computer storage media include, for example, various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.

Claims

1. A door-based remote control method, characterized in that: include: Obtaining the area recognition status of the preset visit waiting area; When the area recognition state is consistent with the preset successful recognition state, an image of the waiting area is acquired; Perform facial feature recognition in the waiting area image to determine the visitor's facial features; Determine whether all visitors' facial features are within the preset no-request set; If all visitor facial features are in the no-request set, no action is taken; If all the facial features of the visitors are not in the set of no request, a request processing signal is output and sent to the preset network connection address, and the preset response time countdown is controlled; When the reply duration timer returns to zero, an actual control signal sent at the network connection address is received, and the door is controlled according to the actual control signal.

2. The door-based remote control method according to claim 1, characterized in that: Also included is a step of determining that no request set is required, the step comprising: Establishing a fixed interval with the current time point as the end point and a width of a preset fixed time length on the preset time axis; Acquire facial features of each visitor and a corresponding actual control signal in a fixed interval, and define the facial features of the visitor in the fixed interval as historical facial features; Counting the actual control signals that are inconsistent with the preset door opening control signals in each historical facial feature to determine the number of reverse feedbacks; Determine whether the reverse feedback quantity is greater than a preset reference reverse quantity; If the reverse feedback quantity is not greater than the reference reverse quantity, no action will be taken; If the reverse feedback quantity is greater than the reference reverse quantity, the historical facial features corresponding to the reverse feedback quantity are summarized into an initially empty request-free set.

3. The door-based remote control method according to claim 2, characterized in that: If all the facial features of the visitors are not in the no-request set, the door-based remote control method further includes: The facial features of the current visitors that are in the no-request set are defined as stable facial features, and the remaining facial features of the visitors are defined as request facial features; Counting the actual control signal that is consistent with the door opening control signal according to the single requested facial feature in a fixed interval to determine the number of positive feedbacks; Determine whether there is a situation where the number of positive feedbacks is greater than a preset reference positive number; If there is no situation where the number of positive feedbacks is greater than the reference number of positive feedbacks, the preset smooth request signal is output as the request processing signal; If there is a situation where the number of positive feedbacks is greater than the reference positive number, a preset urgent request signal is output as a request processing signal, wherein the urgent request signal has a more significant prompting effect than the gentle request signal.

4. The door-based remote control method according to claim 3, characterized in that: If there is no situation where the number of positive feedbacks is greater than the reference number of positive feedbacks, the door-based remote control method further includes: Determine whether there are stable facial features; If there is no stable facial feature, the flattening request signal is output as a request processing signal; If there are stable facial features, the current stable facial features are combined to construct a stable set; Determine a single visitor set according to the facial features of the visitor at a single time point in a fixed interval, define the single visitor set containing the stable set as a valid analysis set, and count the valid analysis sets to determine the number of valid sets; The effective analysis set when the actual control signal is consistent with the door opening control signal is defined as the door opening processing set, and the number of door opening sets is determined by counting the door opening processing sets; Calculate the door opening ratio based on the number of valid sets and the number of door opening sets; Determine whether the door opening ratio is greater than the preset benchmark demand ratio; If the door opening ratio is greater than the baseline demand ratio, the smooth request signal is output as a request processing signal; If the door opening ratio is not greater than the baseline demand ratio, no action will be taken.

5. The door-based remote control method according to claim 4, characterized in that: If there are no stable facial features, the door-based remote control method also includes: Perform clothing feature recognition based on the current waiting area image to determine the visitor's clothing features; Determine clothing features of visitors according to the waiting area image corresponding to the facial features of each visitor in the unrequested set; Counting the clothing features of the same person under the facial features of a single visitor to determine the number of clothing appearances, and counting the clothing features of the person under the facial features of a single visitor to determine the overall number of appearances; The clothing appearance ratio is determined by calculation based on the number of clothing appearances and the overall number of clothing appearances, and the corresponding clothing features of the person when the clothing appearance ratio is greater than the preset upper limit appearance ratio are defined as clothing features that do not require requesting; Construct an unnecessary clothing set according to all unnecessary clothing features, and determine whether all the current visitor's clothing features are in the unnecessary clothing set; If the current visitor's clothing features are all in the unnecessary clothing set, no action is taken; If the current visitor's clothing features are not all in the unnecessary clothing set, the smooth request signal is output as a request processing signal.

6. The door-based remote control method according to claim 1, characterized in that: After the door is controlled according to the actual control signal, the door-based remote control method further includes: Determine whether the actual control signal is consistent with the door opening control signal; If the actual control signal is inconsistent with the door opening control signal, no action will be taken; If the actual control signal is consistent with the door opening control signal, the permitted opening duration is obtained according to the actual control signal, and the detection interval is constructed according to the permitted opening duration; Acquire the waiting area image in real time in the detection interval, and determine the visitor's facial features based on the waiting area image; Determine whether all the facial features of the visitors in the detection interval correspond one-to-one with all the facial features of the visitors before the actual control signal is output; If the facial features of all visitors in the detection interval do not correspond one-to-one with the facial features of all visitors before the actual control signal is output, the waiting area image is continuously acquired until the abnormal signal is output and transmitted to the network connection address after the permitted opening time; If all the facial features of the visitors in the detection interval correspond one-to-one with all the facial features of the visitors before the actual control signal is output, the door lock usage status is obtained, and it is determined whether the door lock usage status is consistent with the preset closed state; If the door lock usage state is consistent with the closed state, a normal signal is output and transmitted to the network connection address; If the door lock usage status is inconsistent with the closed status, the waiting area image will continue to be acquired until the permitted opening time has passed and an abnormal signal will be output and transmitted to the network connection address.

7. A door-based remote control system, characterized in that: include: An acquisition module, used to acquire the area recognition status of a preset visit waiting area; A processing module, connected to the acquisition module and the judgment module, for storing and processing information; A judgment module, connected with the acquisition module and the processing module, for judging the information; When the judging module judges that the area recognition state is consistent with the preset successful recognition state, the acquiring module acquires the waiting area image; The processing module performs facial feature recognition in the waiting area image to determine the visitor's facial features; The judgment module judges whether all the facial features of the visitors are within the preset no-request set; If the judgment module determines that all the visitor's facial features are in the no-request set, the processing module takes no action; If the judging module determines that all the facial features of the visitors are not in the set that does not require a request, the processing module outputs a request processing signal and sends it to a preset network connection address, and controls the countdown of the preset reply time; The processing module receives the actual control signal sent at the network connection address when the reply duration timer returns to zero, and controls the door according to the actual control signal.

8. A computer-readable storage medium, characterized in that: A computer program is stored which can be loaded by a processor and execute the method according to any one of claims 1 to 6.

Images