Implementation method and device of privacy protection, electronic equipment and storage medium

Abstract

One or more embodiments of the invention provide a privacy protection implementation method and device, electronic equipment and a storage medium. The privacy protection implementation method is applied to the electronic equipment with a biological information acquisition module, and comprises the following steps: identifying whether a specific target object appears in a detection range of the electronic equipment or not; and under the condition that the specific target object appears, executing a privacy protection action for the specific target object.

Description

TECHNICAL FIELD

[0001] One or more embodiments of the present specification relate to the technical field of security, and in particular to a privacy protection implementation method and device, electronic equipment and storage medium. BACKGROUND

[0002] Electronic devices such as smart door locks and security monitoring devices generally integrate face recognition, wide-angle camera, remote monitoring, and human body sensing functions. Although these technologies have improved security efficiency, they may cover the access paths or indoor spaces of neighbors and other personnel, leading to privacy leakage risks. However, for community or family members, it is required that electronic security devices can monitor the movements of strangers, protect the biological information privacy of specific personnel such as residents and some neighbors, and avoid data leakage of their own devices.

[0003] At the same time, existing devices do not establish a timely exit privacy protection timing control logic, resulting in the privacy protection state continuing after the face has left the monitoring field of view (such as the lens remaining blocked and the angle continuously deviating), causing subsequent security incidents in the monitoring area (such as personnel re-entering and abnormal movement of objects), which cannot be effectively captured. SUMMARY

[0004] Therefore, one or more embodiments of the present specification provide technical solutions as follows: According to a first aspect of one or more embodiments of the present specification, a privacy protection implementation method is provided, which is applied to an electronic device with a biological information collection module, and includes: identifying whether a specific target object appears in a detection range of the electronic device; in the case where the specific target object appears, performing a privacy protection action on the specific target object.

[0005] Optionally, the determination process of the specific target object includes: acquiring a network device fingerprint in the detection range in a non-connected state to determine the identity of the target object; or determining the identity of the target object based on the network device fingerprint and in combination with biological behavior information; in response to the target object identity satisfying a first preset condition, determining that the target object is a specific target object; wherein the non-connected state is that no effective communication link is established between the electronic device and the network device.

[0006] Optionally, after performing the privacy protection action on the specific target object, the method further includes: in response to satisfying a switching condition, restoring the electronic device to a state before performing the privacy protection action; or stopping the privacy protection action for the specific target object.

[0007] Optionally, the switching condition comprises: a duration of performing the privacy protection action for the specific target object reaching a preset duration.

[0008] Optionally, the switching condition comprises: no specific target object being detected within the detection range.

[0009] Optionally, the switching condition comprises: sensing a state change of other electronic devices within a preset range. Optionally, the state change comprises: information interaction state change and / or running action state change. The information interaction state change comprises: disconnection of connection state, network signal strength change and then keeping stable, and / or switching of scheduling signal. The running action state change comprises: device shutdown, device moving away.

[0010] Optionally, the privacy protection action comprises one or more of the following: biological information collection module shutdown, adjusting an angle of the biological information collection module to misalign with the specific target object, reducing resolution of the biological information collection module, and performing blur processing on images collected by the biological information collection module.

[0011] According to a second aspect of one or more embodiments of the present specification, an implementation device for privacy protection is provided, which is applied to an electronic device with a biological information collection module, and comprises: a recognition unit configured to recognize whether a specific target object appears in a detection range of the electronic device; an execution unit configured to, in a case where the specific target object appears, perform a privacy protection action for the specific target object, and in a case where no specific target object is detected, return to a previous state or stop a current privacy protection action for the specific target object.

[0012] According to a third aspect of one or more embodiments of the present specification, an electronic device is provided, comprising: a processor; a memory for storing processor executable instructions; wherein the processor implements the steps of the foregoing method by running the executable instructions.

[0013] According to a fourth aspect of one or more embodiments of the present specification, a computer readable storage medium is provided, which stores computer instructions, and the instructions are executed by a processor to implement the steps of the foregoing method.

[0014] From the above embodiments, the present scheme determines the identity of the target object by detecting the device fingerprint in the network environment and combining the behavior analysis of the target object. The electronic device can identify whether a specific target object appears in the detection range, and can control the biological information collection module to perform a privacy protection action for the specific target object in the case where the specific target object appears, thereby avoiding collecting the biological information of the specific target object, or blurring the collected biological information to avoid collecting the private information of the specific target object, thereby avoiding the risk of privacy leakage. The present scheme can also trigger the instant exit of the privacy protection state, so that the device quickly returns to the ready monitoring state. This effectively eliminates unnecessary monitoring interruptions caused by the persistence of the privacy protection state, ensures that the monitoring area can be seamlessly covered after the target leaves, thereby significantly improving the system's ability to capture subsequent security events (such as secondary illegal intrusion of personnel, theft of goods, or abnormal movement), and enhancing the reliability and effectiveness of the overall security system. BRIEF DESCRIPTION OF DRAWINGS

[0015] Figure 1 FIG. 1 is a flowchart of an implementation method of privacy protection provided by an example embodiment.

[0016] Figure 2 FIG. 2 is a flowchart of a specific target object determination method provided by an example embodiment.

[0017] Figure 3 FIG. 3 is a flowchart of a privacy protection action closing method provided by an example embodiment.

[0018] Figure 4 FIG. 4 is a privacy protection scenario schematic diagram provided by an example embodiment.

[0019] Figure 5 FIG. 5 is a structural schematic diagram of a device provided by an example embodiment.

[0020] Figure 6 FIG. 6 is a block diagram of an implementation device of privacy protection provided by an example embodiment. DETAILED DESCRIPTION

[0021] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present specification are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation portal for user to choose authorization or refusal.

[0022] Electronic devices such as smart door locks, security monitoring devices, and smart doorbells generally integrate face recognition, wide-angle camera, remote monitoring, and human body sensing functions. Although these technologies improve security efficiency, they may cover the access paths or indoor spaces of neighbors, visitors, and other personnel, leading to privacy leakage risks.

[0023] For example, a smart door lock usually has an outward-facing camera that can capture images around the door to achieve security monitoring. In this process, the camera may capture the face image of a neighbor, and when the neighbor opens the door, it may also capture the indoor image of the neighbor's home, leading to privacy leakage risks.

[0024] For example, an indoor camera may capture the user's own private information, and the user may not want the camera to continue shooting when they come home.

[0025] The present specification provides a privacy protection implementation scheme that can perform privacy protection actions on specific target objects to avoid collecting private information of specific target objects and thus avoid privacy leakage risks.

[0026] Figure 1 FIG. 1 is a flowchart of a privacy protection implementation method according to an example embodiment.

[0027] In the present specification, the privacy protection implementation method can be applied to electronic devices with a biological information collection module. The electronic device can be a smart door lock or other monitoring devices such as a camera system.

[0028] The biological information collection module can include an image collection module, a biological behavior information collection module, a biological physiological information collection module, etc. The image collection module can be a camera module such as a camera. The biological behavior information collection module can be a speed sensor that can collect biological motion speed, a tracking module that can track biological information, etc. The biological physiological information collection module can be a palm print collection module, a human subcutaneous vein information collection module, a voiceprint collection module, a gait information collection module, etc. The present specification does not make special limitations on this.

[0029] Referring to Figure 1 , the privacy protection implementation method can include the following steps: Step 102, identifying whether a specific target object appears in the detection range of the electronic device.

[0030] In the present specification, the detection range can be understood as the range that the electronic device can actually detect, such as the range covered by the Bluetooth module in the electronic device, the range covered by the Wi-Fi module in the electronic device, etc.

[0031] The target object can be a biological object or a network device.

[0032] For example, the target object can be a person, such as a person appearing within the detection range of a smart door lock.

[0033] For example, the target object is a network device, such as a mobile phone or other terminal device carried by a person appearing within the detection range of a smart door lock.

[0034] In this specification, after the electronic device detects a target object, it can identify whether the target object is a specific target object. If it is a specific target object, step 104 can be executed. If it is not a specific target object, the detection and identification of other target objects can continue.

[0035] The specific target object mentioned above is usually the target object that needs to be protected by privacy.

[0036] For example, in a doorway monitoring scenario, the specific target object can be a neighbor, or a network device, smart wearable device, etc. carried by the neighbor.

[0037] For example, in a home indoor monitoring scenario, the specific target object is a family member, or it could be a network device carried by a family member, etc.

[0038] Step 104: When the specific target object appears, perform privacy protection actions for the specific target object.

[0039] Based on the aforementioned step 102, if the target object appearing in the detection range is identified as a specific target object, the biometric information acquisition module can be controlled to perform privacy protection actions for that specific target object.

[0040] The privacy protection actions include one or more of the following: The biological information acquisition module is turned off; the angle of the biological information acquisition module is adjusted so that it is not aligned with the specific target object; the resolution of the biological information acquisition module is reduced; and the image acquired by the biological information acquisition module is blurred.

[0041] For example, turning off the camera, adjusting the camera angle so it's not aimed at a specific target, reducing the resolution of the images captured by the camera, or blurring the images captured by the camera to obscure private information.

[0042] For example, turning off the audio acquisition module or the palmprint acquisition module.

[0043] In an exemplary door monitoring scenario, after detecting the appearance of a person in the detection range, the smart door lock can identify whether the detected person is a neighbor. If the detected person is a neighbor, the smart door lock can determine that the detected person is a specific target object, and then can close the external camera to avoid collecting images of the neighbor, thereby avoiding collecting private information such as the neighbor's face and indoor images of the neighbor.

[0044] In an exemplary indoor monitoring scenario, after detecting the appearance of a person in the detection range, the smart door lock can identify whether the detected person is a family member. If the detected person is a family member, the smart door lock can determine that the detected person is a specific target object, and then can close the internal camera to avoid collecting indoor images, thereby avoiding collecting private information such as the face image of the family member.

[0045] As can be seen from the above description, by using the above-mentioned scheme provided in the present specification, the electronic device can identify whether a specific target object appears in the detection range, and can control the biological information collection module to perform a privacy protection action for the specific target object in the case where the specific target object appears, thereby avoiding collecting biological information of the specific target object or blurring the collected biological information to avoid collecting private information of the specific target object, thereby avoiding the risk of privacy leakage.

[0046] The implementation process of the present specification will be described in detail below from three aspects of determination of the specific target object, execution of the privacy protection action, and closing of the privacy protection action.

[0047] I. Determination of the specific target object In the present specification, after detecting the appearance of a target object in the detection range, the electronic device can determine whether the target object is a specific target object, please refer to Figure 2 , comprising the following steps: Step 202, acquiring a network device fingerprint in the detection range in a non-connected state to determine the identity of the target object.

[0048] In the present specification, in the case where the target object is a person, the network device is usually carried by the target object, for example, it can be a mobile phone, a wearable device, a tablet computer, etc. carried by the target object. In the case where the target object is a network device, the network device is usually the target object.

[0049] In the present specification, the non-connected state means that the electronic device and the network device in the detection range do not establish any effective communication link. For example, the electronic device and the network device do not establish a Bluetooth communication link, do not establish a Wi-Fi communication link, etc.

[0050] The network device fingerprint can be information of a network device detected by the electronic device within a detection range of the electronic device, the information can identify an identity of the network device, the information can be actively sent by the network device and intercepted by the electronic device, or the information can be actively detected by the electronic device.

[0051] For example, the electronic device can capture a data packet transmitted by a network device through a BLE (Bluetooth Low Energy) sniffing function of a Bluetooth device to obtain the network device fingerprint. For example, the electronic device can capture a device identifier (Hashed MAC), a signal strength (RSSI, Received Signal Strength Indicator), a service UUID (Universally Unique Identifier), and a transmission power in a broadcast packet.

[0052] For example, the electronic device can analyze a Wi-Fi signal appearing nearby through a deep analysis function of a Wi-Fi module to obtain the network device fingerprint. For example, the electronic device can extract an SSID (Service Set Identifier), a Vendor OUI (Organizationally Unique Identifier), and a supported rate from a Probe Request frame.

[0053] In the present specification, the electronic device can obtain the network device fingerprint in the detection range through a non-connected manner, or can obtain the network device fingerprint in the detection range through multiple non-connected manners, and the present specification does not make special limitations.

[0054] In the present specification, the network device fingerprint is obtained through a non-connected manner to determine the identity of the target object, and the electronic device and the network device do not need to establish an effective connection in the whole process. On the one hand, the application range is wider, and the network device fingerprint can be obtained to determine the identity of a stranger. On the other hand, the risk of information leakage of the electronic device caused by establishing a connection with the network device can be effectively avoided.

[0055] In the present specification, after obtaining a network device fingerprint, a target object identity can be determined based on the network device fingerprint, or a target object identity can be determined based on the network device fingerprint in combination with biological behavior information. The biological behavior information can include a moving speed, a moving direction, a step length, a step frequency, a moving range, a stay duration in different spatial regions, etc., and can also be obtained in a detection range. Of course, in other examples, a target object identity can also be determined based only on biological behavior information, and the present specification does not make special limitations in this regard.

[0056] In an embodiment, when a device identity is identified based on a network device fingerprint, at least one feature index value of at least one dimension of device features can be extracted from the network device fingerprint, and a device identity of a corresponding network device is determined according to the at least one feature index value.

[0057] In an embodiment, the dimensions of the device features can be divided into a physical dimension, a protocol dimension, and a behavior dimension, wherein: the feature indexes of the physical features of the physical dimension include but are not limited to a carrier frequency offset, a modulation error, and a signal strength fluctuation standard deviation; the feature indexes of the protocol features of the protocol dimension include but are not limited to a BLE service and a Wi-Fi probe; and the feature indexes of the behavior features of the behavior dimension include but are not limited to a period activity, a stay duration, and a moving trajectory.

[0058] Wherein, the extraction methods of the carrier frequency offset, the modulation error, and the signal strength fluctuation standard deviation are not subject to any limitations, the BLE service can exemplarily extract a UUID, and the Wi-Fi probe can exemplarily extract a Wi-Fi channel width or an OUI.

[0059] And the period activity, the stay duration, and the moving trajectory can be indexes obtained by comprehensive calculation according to detection results, and are used for analyzing behavior information of a target object.

[0060] Exemplarily, the period activity can calculate an active interval of a target object within 24 hours through -∑(p*log2(p)), so as to capture a regularity of an appearance time of the target object. Wherein, P can be a probability of appearing in a specific time interval. Wherein, the smaller the period activity is, the more fixed the time period of the appearance of the target object is.

[0061] Exemplarily, a stay duration coefficient of variation can be represented by a ratio of a standard deviation and an average value of each stay duration of a same network device within a week. The index can be used for analyzing regularity of a stay duration of a target object.

[0062] Exemplarily, a moving trajectory smoothness can be measured by a ratio of a straight line distance and an actual path length of a target object. The closer the ratio is to 1, the closer the moving path of the target object is to a straight line, and the closer the ratio is to 0, the greater the degree of detour of the moving path of the target object is.

[0063] In an embodiment, when determining the device identity of the corresponding network device according to the feature index value, the at least one feature index value can be fused to obtain a first fused index value of the corresponding dimension, and the device identity of the corresponding network device is determined according to the first fused index value of the corresponding dimension.

[0064] For example, if the device features are divided into one dimension, and there is only one feature index value in the dimension, the device identity of the corresponding network device can be determined based on the feature index value.

[0065] For example, if the device features are divided into one dimension, and there are multiple feature index values in the dimension, the multiple feature index values can be fused to obtain a first fused index value, and the device identity of the corresponding network device is determined according to the first fused index value.

[0066] For example, if the device features are divided into multiple dimensions, and there is at least one feature index value in each dimension, at least part of the feature index values of at least part of the dimensions can be selected for fusion processing to obtain a first fused index value of the corresponding dimension, and the device identity of the corresponding network device is determined according to the first fused index value of the corresponding dimension.

[0067] For example, for dimension A, a1, a2 and a3 are included in the dimension; for dimension B, b1 and b2 are included in the dimension; and for dimension C, c1, c2 and c3 are included in the dimension. The first fused index value of dimension A can be determined according to a1 and a2; the first fused index value of dimension B can be determined according to b1 and b2; the first fused index value of dimension C can be determined according to c1, c2 and c3; and the device identity of the corresponding network device is determined according to the first fused index values of the respective dimensions.

[0068] In an embodiment, when determining the device identity of the corresponding network device according to the first fused index value of the corresponding dimension, the current environment scenario category can be determined, the first weight of each first fused index value corresponding to the current environment scenario category can be obtained, or the first weight of each first fused index value can be adaptively determined. The first fused index values are fused according to the first weights to obtain a second fused index value, and the device identity of the corresponding network device is determined according to the second fused index value.

[0069] For example, the environment scenario can be divided into a night mode, a strong interference environment mode and a long-term monitoring mode. For the night mode, the physical layer weight is greater than the behavior layer weight which is greater than the protocol layer weight; for the strong interference environment mode, the physical layer weight is greater than the protocol layer weight which is greater than the behavior layer weight; for the long-term monitoring mode, the physical layer weight is less than the protocol layer weight which is less than the behavior layer weight. Among them, the environment scenario category can be set by the user on the terminal, and the electronic device can use the weight corresponding to the environment scenario category to perform fusion processing on the first fusion indicator value of each dimension according to the environment scenario category set by the user to obtain the second fusion indicator value.

[0070] In an embodiment, when weighting, confidence can also be used for weighting, as shown in the following formula:

[0071] wherein Ω is the second fusion indicator value, is the weight of the kth layer dimension in the fusion processing, is the confidence of the first fusion indicator value of the kth layer dimension, is the first fusion indicator value of the kth layer dimension.

[0072] In an embodiment, when determining the device identity of the corresponding network device according to the feature indicator value, the recognition result can be generated according to the feature indicator value, and the device identity of the corresponding network device is determined according to the recognition result.

[0073] Among them, the recognition result can be represented by any feature indicator value. For example, the size of the feature indicator value of the device feature of any dimension can be used as the recognition result.

[0074] The recognition result can also be represented by the first fusion indicator value or the second fusion indicator value. For example, the first fusion indicator value obtained by fusion processing of multiple feature indicator values of any dimension can be used as the recognition result. For example, the second fusion indicator value obtained by fusion processing of the first fusion indicator values of different dimensions can be used as the recognition result.

[0075] For example, in the example of monitoring the scene of the home door, the recognition result can be normalized in [0, 1], assuming that [0, 0.3] corresponds to the identity of the household, (0.3, 0.6] corresponds to the identity of the neighbor, and (0.6, 1] corresponds to the identity of others. Then the identity of the target object corresponding to the interval where the recognition result is located can be determined. For example, if the recognition result is 0.45, the identity of the target object can be determined as a neighbor. The interval size of the value is closely related to the application scenario, and a person skilled in the art can reset the identity type corresponding to the numerical interval where different recognition results are located according to the actual demand.

[0076] Specifically, at least one feature index value of the physical dimension, the protocol dimension and the behavior dimension is extracted from the network device fingerprint. Any feature index value can be used as an identification result for identity recognition. For example, the feature index value 1 of the physical dimension is 0.45, and it can be determined that the target object identity is a neighbor.

[0077] The fusion processing of the multiple feature index values of any dimension can obtain a first fusion index value. Any fusion index value can be used as an identification result for identity recognition. For example, the first fusion index value corresponding to the physical dimension is 0.45, and it can be determined that the target object identity is a neighbor. Or, the first fusion index value corresponding to the protocol dimension is 0.45, and it can be determined that the target object identity is a neighbor. When performing fusion processing, the multiple feature index values can be weighted, and higher weights are given to feature index values with higher importance, and lower weights are given to feature index values with lower importance.

[0078] The fusion processing of the multiple first fusion index values can obtain a second fusion index value. The second fusion index value can be used as an identification result for identity recognition. For example, the second fusion index value is 0.45, and it can be determined that the target object identity is a neighbor. When performing fusion processing, the multiple first fusion index values can be weighted, and higher weights are given to first fusion index values with higher importance, and lower weights are given to first fusion index values with lower importance.

[0079] Optionally, in another embodiment of the present specification, after obtaining the network device fingerprint, the identity of the corresponding network device can also be found in the preset identity list. The identity list can be manually set in advance, or updated based on the device fingerprint of the network device that has appeared in history to determine the identity of the network device. The identity list can include a neighbor list, a family member list, etc. Of course, the neighbor list and the family member list can also be integrated into one identity list.

[0080] Optionally, in another embodiment of the present specification, after obtaining the network device fingerprint, historical detection information obtained by detecting the network device in history can also be obtained according to the network device fingerprint. The historical detection information can also include physical layer information, protocol layer information and behavior layer information, and then the network device identity is determined by comprehensively combining the historical detection information.

[0081] In step 204, in response to the target object identity satisfying the first preset condition, the target object is determined as a specific target object.

[0082] Based on the confirmation result of the target object identity in the foregoing step 202, in the case where the target object identity satisfies the first preset condition, it can be determined that the target object is an object that needs to be protected, and then it is determined as a specific target object.

[0083] The first preset condition can be preset, for example, a neighbor, a family member, and the like.

[0084] As can be seen from the above description, the present specification can acquire a network device within a detection range in a non-connected state to determine the identity of a target object, and can determine the target object as a specific target object when the identity of the target object meets a first preset condition, and then execute a privacy protection action. The privacy protection action is executed for the specific target object, which can effectively ensure the privacy security of the specific target object, and the privacy protection action is not executed for a non-specific target object, which can also ensure the monitoring effect, and a balance is achieved between security monitoring and privacy protection.

[0085] II. Execution of the privacy protection action In an embodiment, when a specific target object appears in the detection range of the electronic device, a privacy protection action can be executed for the specific target object immediately. For example, the camera is turned off, the resolution of the camera is reduced, and the like.

[0086] In another embodiment, when a specific target object appears in the detection range of the electronic device, it can be further determined whether an execution condition of the privacy protection action is met, and if the execution condition is met, the privacy protection action can be executed for the specific target object. If the execution condition is not met, the privacy protection action for the specific target object can not be executed temporarily.

[0087] For example, the execution condition can be that the actual distance between the specific target object and the electronic device is less than or equal to a first distance threshold value, and the first distance threshold value is preset. For example, after the electronic device determines that the target object is a specific target object, it can detect the actual distance between the electronic device and the specific target object, determine the size relationship between the actual distance and the first distance threshold value, and execute the privacy protection action for the specific target object when the actual distance is less than or equal to the first distance threshold value.

[0088] The actual distance can be detected by a distance sensor, or can be determined by the signal strength between the network device and the electronic device, and the present specification does not make special limitations thereon.

[0089] Optionally, when the actual distance between the specific target object and the electronic device is less than or equal to a second distance threshold value, the duration that the actual distance between the specific target object and the electronic device is less than or equal to the second distance threshold value can also be recorded, and if the duration is greater than a first time threshold value, it indicates that the specific target object stays near the electronic device for a relatively long time, and in order to ensure safety, it can be determined that a switching condition is met, and the electronic device can be restored to the state before the privacy protection action is executed, or the privacy protection action for the specific target object can be stopped.

[0090] The second distance threshold is less than or equal to the first distance threshold.

[0091] For example, assuming that the actual distance between the specific target object and the electronic device is less than or equal to the first distance threshold, the electronic device closes the camera to stop image acquisition, but the actual distance between the specific target object and the electronic device is less than or equal to the second distance threshold for a time period that is greater than or equal to the first time period threshold, the camera can be opened to restart image acquisition.

[0092] For example, the execution condition can be that the signal strength of the network device detected by the electronic device is greater than or equal to a first strength threshold, and the first strength threshold is pre-set. For example, after the electronic device determines that the target object is a specific target object, the electronic device can continue to detect the signal strength of the network device, determine the size relationship between the detected signal strength and the first strength threshold, and perform the privacy protection action for the specific target object when the detected signal strength is greater than or equal to the first strength threshold.

[0093] Optionally, when the signal strength of the network device is greater than or equal to a second strength threshold, the duration for which the signal strength is greater than or equal to the second strength threshold can also be recorded, and if the duration is greater than a second time period threshold, it indicates that the specific network device stays near the electronic device for a relatively long time, and in order to ensure safety, it can be determined that the switching condition is met, the electronic device can be restored to a state before the privacy protection action is performed, or the privacy protection action for the specific target object can be stopped.

[0094] The second strength threshold is greater than or equal to the first strength threshold. The second time period threshold can be equal to the first time period threshold, or can not be equal to the first time period threshold.

[0095] For example, assuming that the signal strength of the network device is greater than or equal to the first strength threshold, the electronic device closes the camera to stop image acquisition, but the signal strength of the network device is greater than or equal to the second distance threshold for a time period that is greater than or equal to the second time period threshold, the camera can be opened to restart image acquisition.

[0096] As can be seen from the above description, when the specific target object appears in the detection range, the embodiment determines whether the execution condition of the privacy protection action is met, and performs the privacy protection action for the specific target object when the execution condition is met, thereby more accurately controlling the execution time of the privacy protection action, avoiding the lack of monitoring caused by the privacy protection action being executed too early, and further ensuring the monitoring safety.

[0097] III. Closing of the privacy protection action In an embodiment, to ensure the effectiveness of the monitoring of the electronic device, after a specific target object appears in the detection range of the electronic device and a privacy protection action is performed on the specific target object, the privacy protection action needs to be closed, please refer to Figure 3 may comprise the following steps: Step 302, determine whether the switching condition is met.

[0098] In this specification, after the electronic device performs a privacy protection action on a specific target object, it can be determined whether the switching condition is met, which can be pre-set.

[0099] For example, the switching condition includes that the duration of performing the privacy protection action on the specific target object reaches a preset duration. The preset duration can represent the duration of the specific target object leaving the detection range, which can be pre-set based on experience, for example, 5 seconds, 10 seconds, etc.

[0100] Specifically, after performing the privacy protection action on the specific target object, a timer can be started to start timing, and when the timing reaches the preset duration, it can be determined that the switching condition is met.

[0101] For example, the switching condition includes that no specific target object is detected in the detection range. For the electronic device, the target object appearing in the detection range can be continuously detected, and when it is determined that no specific target object appears in the detection range, it can be determined that the switching condition is met.

[0102] Wherein, no specific target object appears in the detection range may be that no target object appears in the detection range, or that a target object appears in the detection range, but it is identified that the appearing target object is not a specific target object. These situations can all indicate that the specific target object that needs privacy protection has left the detection range.

[0103] For example, the switching condition includes that a state change of a preset range of other electronic devices is sensed. The type of the other electronic devices can be the same as or different from the electronic device. Assuming that the electronic device is a smart door lock, the other electronic devices can also be a smart door lock (such as a smart door lock of a neighbor's house), a door monitoring device (such as a smart cat eye), a corridor device, etc.

[0104] The state change can include an information interaction state change and / or a running action state change. In other words, the electronic device can determine that the switching condition is met when the information interaction state change of the other electronic device is sensed; the electronic device can determine that the switching condition is met when the running action state change of the other electronic device is sensed; and the electronic device can determine that the switching condition is met when the information interaction state change of the other electronic device is sensed and the running action state also changes.

[0105] The changes in information interaction status may include disconnection, stabilization after changes in network signal strength, and / or switching of scheduling signals.

[0106] The disconnection of a connection can occur when another electronic device loses its connection to a network device it was previously connected to. This disconnection indicates that the network device previously connected to that other electronic device has moved out of its coverage area. For example, if the other electronic device is a neighbor's door lock, the disconnection could mean that the neighbor's door lock has lost its connection to network devices such as mobile phones or computers previously connected to it. Again using a smart door lock as an example, the neighbor's door lock (the other electronic device) can establish a connection with the network devices (mobile phones, computers, wearable devices, etc.) of the neighbor's family members (i.e., the neighbor). For instance, after the neighbor returns home, their mobile phone can connect to the neighbor's door lock. When the neighbor's door lock and the neighbor's mobile phone disconnect, it usually indicates that the neighbor has left home. In this case, the neighbor has typically also left the detection range of the smart door lock, thus confirming that the switching conditions are met.

[0107] It's important to note that the aforementioned connection states typically refer to direct connections, such as the direct communication connection between the smart lock and the network device. The disconnection of this connection usually refers to the breakage of that direct communication connection; for example, the smart lock disconnecting its direct communication connection with the network device. Disconnections through indirect connections, such as those via a server, are not included in this definition. For instance, a neighbor's lock might connect to a server via their Wi-Fi network, and the server might connect to the neighbor's phone via a wireless network. The disconnection of such an indirect connection does not necessarily mean the neighbor has left the smart lock's detection range; it could be due to other reasons, such as a Wi-Fi network malfunction. Therefore, the disconnections used to indicate the fulfillment of switching conditions generally do not include disconnections of indirect connections.

[0108] The stabilization of network signal strength after fluctuations typically reflects changes in the network signal strength of other electronic devices detected by this electronic device. These fluctuations can represent changes in the distance between this and other electronic devices. A stable network signal after a fluctuation could indicate either a decrease in distance followed by a period of stabilization, or a decrease in distance followed by an increase in distance followed by a period of stabilization. This fluctuation in network signal strength can reflect the behavior of users of other electronic devices, thus establishing a stable network signal after a fluctuation as a switching condition.

[0109] Taking a neighbor's door lock as an example, the stability of the neighbor's door lock's network signal strength after fluctuations can indicate changes in the door's opening and closing. For instance, opening the neighbor's door outwards might cause the network signal to strengthen, while closing it might cause it to weaken. When the door remains closed, the network signal strength remains stable. In this example, the network signal strength changes as follows: stronger – weaker – stable. For the neighbor, possible actions include opening the door, entering the house, and closing the door. Therefore, by sensing these network signal changes, the neighbor can determine if the switching conditions are met.

[0110] The switching of the dispatch signal can be initiated by other electronic devices receiving a dispatch instruction. These other electronic devices can be elevators, unit access control systems, community access control systems, etc. The switching of the dispatch signal can indicate that a specific target object within the detection range is about to leave or has already left the detection range, thus confirming that the switching conditions are met.

[0111] Assuming the other electronic devices are elevators, the switching of dispatch signals could be the elevator receiving a dispatch request. Taking a neighbor as an example, it could be that the neighbor presses the elevator button to request the elevator to go to their current floor, or it could be that the neighbor has already entered the elevator and pressed the button to go to the floor they want to go to.

[0112] Furthermore, assuming other electronic devices are unit access control systems, the switching of dispatch signals could be due to the unit access control system receiving an opening request. Taking a neighbor as an example, it could be that the neighbor is opening the unit access control system to leave the building.

[0113] In this example, the change in the information interaction state of other electronic devices can be determined when one of the following three conditions is met: disconnection, stability after changes in network signal strength, or switching of scheduling signals. Alternatively, the change in the information interaction state of other electronic devices can be determined when two or all three conditions are met. This specification does not impose any special restrictions on this.

[0114] The changes in the operating status include: equipment shutdown and equipment moving away.

[0115] In this context, "device shutdown" can refer to the shutdown of other electronic devices, such as a neighbor's door lock, elevator shutdown, or hallway light shutdown. Taking a neighbor as an example, the shutdown of these devices indicates that the neighbor has left the detection range of this electronic device, thus confirming that the switching conditions have been met. Examples include a neighbor closing their door upon returning home, a neighbor leaving via elevator, or a neighbor walking away from the building and the hallway lights turning off.

[0116] The device far away can be that other electronic device is far away from the electronic device, for example, the neighbor door lock is far away, the elevator is far away, and the like. Still taking the specific target object as the neighbor as an example, the device far away can represent the detection range of the neighbor leaving the electronic device, and then the switching condition can be determined. For example, when the neighbor door lock is closed when the neighbor comes home, the neighbor door lock far away occurs, when the neighbor takes the elevator, the elevator car far away from the floor where the electronic device is located occurs, and the like.

[0117] In the example, the running action state change of the other electronic device can be determined when one of the device is closed and the device is far away is satisfied, or the running action state change of the other electronic device can be determined when both of the device is closed and the device is far away are satisfied, and the present specification does not specially limit this.

[0118] It should be noted that the state change of the other electronic device sensed by the electronic device has been authorized.

[0119] Step 304, in response to satisfying the switching condition, the electronic device is restored to the state before the privacy protection action is performed, or the privacy protection action for the specific target object is stopped.

[0120] In one example, in the case where it is determined that the switching condition is satisfied, the privacy protection action for the specific target object can be stopped, and the running state of the electronic device can be determined according to the actual situation subsequently. For example, the electronic device can be restored to the state before the privacy protection action is performed after the privacy protection action is stopped, or the electronic device can be switched to other states (such as dangerous target objects appearing in the network detection range, and the like) after the privacy protection action is stopped, and the specific selection can be made according to the actual situation.

[0121] In another example, in the case where it is determined that the switching condition is satisfied, the electronic device can be directly restored to the state before the privacy protection action is performed, for example, the closed camera is turned on to restore the normal monitoring state, and the like.

[0122] As can be seen from the above description, after the electronic device performs the privacy protection action for the specific target object, the privacy protection action for the specific target object can be stopped when the switching condition is satisfied, and the monitoring state is restored in time to prevent the security risks caused by the lack of monitoring due to the long-time execution of the privacy protection action.

[0123] Figure 4 is a schematic diagram of a privacy protection scene provided by an example embodiment.

[0124] Please refer to Figure 4In the privacy protection scenario, the electronic device performing the privacy protection logic is the smart door lock 40. When the person 41 appears in the detection range of the smart door lock 40, the smart door lock 40 can acquire the device fingerprint of the mobile phone (not shown) carried by the person 41 in the non-connected state, and then determine the identity of the person 41 based on the device fingerprint. Assuming that the identity of the person 41 is a neighbor, it can be determined that the person 41 is a specific target object, and then a privacy protection action is performed on the person 41, for example, the camera of the smart door lock is closed to avoid collecting images carrying the privacy of the neighbor, such as the face of the neighbor. When the time length of the camera being closed reaches a preset time length, it can be considered that the neighbor has returned home or left the detection range, and then the camera of the smart door lock is reopened to restore the monitoring state.

[0125] Figure 5 FIG. 1 is a schematic structural diagram of a device according to an example embodiment. Please refer to Figure 5 At the hardware level, the device includes a processor 502, an internal bus 504, a network interface 506, a memory 508, and a non-volatile memory 510, and of course can also include other hardware required for functions. One or more embodiments of the present specification can be implemented in a software manner, such as reading a corresponding computer program from the non-volatile memory 510 into the memory 508 by the processor 502 and then running. Of course, in addition to the software implementation, one or more embodiments of the present specification do not exclude other implementation manners, such as logic devices or a combination of software and hardware, and the like, that is, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or a logic device.

[0126] Please refer to Figure 6 The privacy protection implementation apparatus 600 can be applied to the device as shown in Figure 5 to implement the technical solutions of the present specification. Among them, the privacy protection implementation apparatus 600 can include: An identification unit 601 identifies whether a specific target object appears in the detection range of the electronic device; An execution unit 602, in the case where the specific target object appears, performs a privacy protection action on the specific target object; in the case where no specific target object is detected, returns to the previous state or stops the current privacy protection action on the specific target object.

[0127] Optionally, the determination process of the specific target object includes: acquiring a network device fingerprint in the detection range in a non-connected state to determine the identity of the target object; or determining the identity of the target object based on the network device fingerprint and in combination with biological behavior information; In response to the target object identity satisfying a first preset condition, the target object is determined as a specific target object. The non-connected state is that no valid communication link is established between the electronic device and the network device.

[0128] Optionally, the execution unit 602, after performing the privacy protection action on the specific target object, in response to the switching condition being met, restores the electronic device to a state before the privacy protection action is performed, or stops the privacy protection action on the specific target object.

[0129] Optionally, the switching condition includes that a duration of performing the privacy protection action on the specific target object reaches a preset duration.

[0130] Optionally, the switching condition includes that no specific target object is detected within the detection range.

[0131] Optionally, the switching condition includes that a state change of other electronic devices within a preset range is sensed. The state change includes an information interaction state change and / or a running action state change. The information interaction state change includes disconnection of a connection state, network signal strength change and then keeping stable, and / or switching of a scheduling signal. The running action state change includes device shutdown and device moving away.

[0132] Optionally, the privacy protection action includes one or more of the following: Turning off a biological information collection module, adjusting an angle of the biological information collection module to misalign with the specific target object, reducing resolution of the biological information collection module, and performing blur processing on an image collected by the biological information collection module.

[0133] Based on the same idea as the above method, the present specification also provides an electronic device, comprising: a processor; a memory for storing processor executable instructions; wherein the processor implements the steps of the method according to any one of the above embodiments by running the executable instructions.

[0134] Based on the same idea as the above method, the present specification also provides a computer readable storage medium having computer instructions stored thereon, which, when executed by a processor, implement the steps of the method according to any one of the above embodiments.

[0135] Based on the same idea as the above method, the present specification also provides a computer program product, comprising computer program / instructions, which, when executed by a processor, implement the steps of the method according to any one of the above embodiments.

Claims

1. A method for implementing privacy protection, characterized by, The method is applied to an electronic device with a biological information collection module, and comprises: identifying whether a specific target object appears in a detection range of the electronic device; in the case where the specific target object appears, performing a privacy protection action on the specific target object.

2. The method of claim 1, wherein, The determination process of the specific target object comprises: acquiring a network device fingerprint in the detection range in a non-connected state to determine a target object identity; or, determining a target object identity based on the network device fingerprint and in combination with biological behavior information; in response to the target object identity satisfying a first preset condition, determining that the target object is a specific target object; wherein the non-connected state is that no effective communication link is established between the electronic device and a network device.

3. The method of claim 1, wherein, After the privacy protection action is performed on the specific target object, the method further comprises: in response to a switching condition being satisfied, restoring the electronic device to a state before the privacy protection action is performed; or stopping the privacy protection action on the specific target object. The switching condition comprises:

4. The method of claim 3, wherein, a duration of the privacy protection action performed on the specific target object reaches a preset duration. The switching condition comprises:

5. The method of claim 3, wherein, no specific target object is detected in the detection range. The switching condition comprises:

6. The method of claim 3, wherein, a state change of another electronic device in a preset range is sensed; wherein the state change comprises an information interaction state change and / or a running action state change; the information interaction state change comprises disconnection of a connection state, network signal strength change and then keeping stable, and / or switching of a scheduling signal; the running action state change comprises device shutdown and device moving away.

7. The method of claim 1, wherein the privacy protection action comprises one or more of: turning off the biological information collection module, adjusting an angle of the biological information collection module to misalign with the specific target object, reducing a resolution of the biological information collection module, and performing blur processing on an image collected by the biological information collection module. The device is applied to an electronic device with a biological information collection module, and comprises:

8. An apparatus for privacy protection implementation, characterized by, an identification unit configured to identify whether a specific target object appears in a detection range of the electronic device; an execution unit configured to, in the case where the specific target object appears, perform a privacy protection action on the specific target object; and in the case where no specific target object is detected, restore to a previous state or stop the current privacy protection action on the specific target object. comprise:

9. An electronic device, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor implements the steps of the method of any one of claims 1-7 by running the executable instructions. a computer instruction is stored thereon, which, when executed by a processor, implements the steps of the method of any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, ​

Images