Mode switching method and device of electronic equipment

Abstract

One or more embodiments of the invention provide a mode switching method and device of electronic equipment. The method comprises the following steps: acquiring a network equipment fingerprint in a network detection range; determining the identity of a target object based on the network equipment fingerprint; and switching an operation mode based on the target object identity.

Description

TECHNICAL FIELD

[0001] One or more embodiments of the present specification relate to the technical field of security, and in particular, to a mode switching method and apparatus of an electronic device. BACKGROUND

[0002] Electronic devices used in daily scenarios are usually configured with multiple different running modes. For example, taking an electronic device such as a smart door lock as an example, its typical running modes include a regular running mode, a privacy protection running mode, and a tracking and monitoring running mode, etc. Taking an electronic device such as a mobile phone as an example, it covers typical running modes such as an airplane mode.

[0003] Currently, the process of implementing running mode switching of an electronic device often needs to rely on user manual setting operation. Specifically, in the application scenario of a smart door lock, the user needs to manually configure the trigger condition for the execution of the privacy protection running mode. In the application scenario of a mobile phone, the user needs to manually operate to adjust it to the airplane mode, and so on, which all belong to the switching mode relying on user manual setting. However, the above-mentioned running mode switching scheme relying on user manual setting has the technical problem of complicated operation process, which further leads to poor user experience in actual use.

[0004] And the general technology of identifying the identity of an object needs to establish a communication connection between the electronic device and the target object to obtain the related information of the target object, so as to determine the identity of the target object according to the related information. However, the way of establishing a communication connection with the target object has the risk of leaking the private information of the electronic device. SUMMARY

[0005] Therefore, one or more embodiments of the present specification provide technical solutions as follows: According to a first aspect of one or more embodiments of the present specification, a mode switching method of an electronic device is provided, comprising: obtaining a network device fingerprint within a network detection range; determining a target object identity based on the network device fingerprint; switching a running mode based on the target object identity.

[0006] Optionally, the obtaining a network device fingerprint within a network detection range comprises: obtaining the network device fingerprint in a non-connected state within the network detection range; wherein the non-connected state is that there is no any effective communication link established between the electronic device and the network device.

[0007] Optionally, the determining a target object identity based on the network device fingerprint comprises: determine the target object identity based on the network device fingerprint; or determine the target object identity based on the network device fingerprint and in combination with the biological behavior information.

[0008] Optionally, after determining the target object identity based on the network device fingerprint, the method further comprises: in a case where there is a management list having a mapping relationship with the target object identity, adding the network device to the corresponding management list; in a case where there is no management list having a mapping relationship with the target object identity, creating a management list having a mapping relationship with the target object identity and adding the network device to the corresponding management list.

[0009] Optionally, the electronic device further comprises a wireless communication module; before obtaining the network device fingerprint in the network detection range, the method further comprises: obtaining first historical detection information of a target object appearing in the network detection range obtained by the wireless communication module in a first historical time period; predicting a future appearing time of the target object in the network detection range based on the first historical detection information; in response to a current time being a time before the first preset time length of the future appearing time, waking up the wireless communication module.

[0010] Optionally, the method further comprises: obtaining second historical detection information of a target object appearing in the network detection range obtained by the electronic device in a second historical time period; determining a prediction result of a future behavior of the target object based on the second historical detection information; in response to a current time being a time before the second preset time length of the future behavior occurrence time determined based on the prediction result, switching the operation mode.

[0011] Optionally, after switching the operation mode based on the target object identity, the method further comprises: in response to satisfying a closing condition of the operation mode switching, restoring the operation mode of the electronic device to a state before the switching; or stopping the current operation mode.

[0012] Optionally, before obtaining the network device fingerprint in the network detection range, the method further comprises: obtaining linkage information about the target object sent by a linkage device linked with the electronic device; judging whether the target object identity can be confirmed based on the linkage information.

[0013] Optionally, the determining whether the target object identity can be confirmed based on the linkage information comprises: in response to the initial identity information of the target object being included in the linkage information, determining that the target object identity can be confirmed based on the linkage information, and the target object identity is confirmed based on the initial identity information; in response to the initial identity information not being included in the linkage information, determining that the target object identity cannot be confirmed based on the linkage information; The method further comprises: in a case where the target object identity cannot be confirmed based on the linkage information, acquiring a network device fingerprint within a network detection range, and determining the target object identity based on the network device fingerprint.

[0014] According to a second aspect of one or more embodiments of the present specification, a mode switching apparatus of an electronic device is provided, comprising: a fingerprint acquisition unit configured to acquire a network device fingerprint within a network detection range; an identity determination unit configured to determine a target object identity based on the network device fingerprint and / or device identity information sent by a linkage device; a mode switching unit configured to switch a running mode based on the target object identity.

[0015] As can be seen from the above embodiments, by using the above scheme provided by the present specification, the electronic device can acquire a network device fingerprint within a network detection range, determine the identity of a target object appearing within the network detection range based on the network device fingerprint, and switch the running mode of the electronic device based on the target object identity. On the one hand, it can avoid collecting biological information of a specific target object or blurring the collected biological information, so as to avoid collecting private information of the specific target object and thus avoid the risk of privacy leakage. On the other hand, it can also start a tracking and monitoring running mode for a dangerous target object, so as to improve the security. BRIEF DESCRIPTION OF DRAWINGS

[0016] Figure 1 FIG. 1 is a flowchart of a mode switching method of an electronic device according to an example embodiment.

[0017] Figure 2 FIG. 4 is a flowchart of a maintenance method of a management list according to an example embodiment.

[0018] Figure 3 FIG. 7 is a flowchart of a wake-up method of a wireless communication module according to an example embodiment.

[0019] Figure 4 FIG. 10 is a flowchart of another mode switching method of an electronic device according to an example embodiment.

[0020] Figure 5 FIG. 1 is a schematic diagram of a mode switching scenario of an electronic device according to an example embodiment.

[0021] Figure 6 FIG. 2 is a structural schematic diagram of an electronic device according to an example embodiment.

[0022] Figure 7 FIG. 3 is a block diagram of a mode switching apparatus of an electronic device according to an example embodiment. DETAILED DESCRIPTION

[0023] Electronic devices such as smart door locks, mobile phones, etc. usually have different operating modes. For example, a smart door lock has a regular operating mode, a privacy protection operating mode, a tracking and monitoring operating mode, etc., and a mobile phone has a flight mode, etc.

[0024] Currently, when an electronic device switches operating modes, it often relies on manual settings by a user, for example, the user manually sets the conditions for the smart door lock to execute the privacy protection operating mode, and the user manually adjusts the mobile phone to the flight mode, etc. However, such a manual setting method is tedious and the user experience is poor.

[0025] The present specification provides a mode switching scheme for an electronic device. An electronic device such as a smart door lock, a mobile phone, etc. can determine the identity of a target object based on a detected network device fingerprint, and can switch the operating mode of the electronic device based on the identity of the target object, thereby achieving automatic switching of different operating modes without the need for manual operation by the user, greatly improving the user's experience.

[0026] The implementation process of the present specification will be introduced below by taking an electronic device as a security monitoring device such as a smart door lock or a smart doorbell as an example.

[0027] These security monitoring devices generally integrate functions such as face recognition, wide-angle camera, remote monitoring, and human body sensing. Although these technologies have improved security efficiency, they may cover the access paths or indoor spaces of neighbors, visitors, etc., leading to a risk of privacy leakage.

[0028] Taking a smart door lock as an example, the smart door lock is usually provided with a camera for external shooting, which can capture images around the door to achieve security monitoring. In this process, the camera may capture the face image of a neighbor, and may also capture the indoor image of the neighbor's home when the neighbor opens the door, leading to a risk of privacy leakage.

[0029] In the present specification, the mode switching method of the electronic device can be applied to an electronic device with a biological information collection module. The electronic device can be a smart door lock or other monitoring devices such as a camera system or a smart doorbell, etc.

[0030] The biological information collection module can include an image collection module, a biological behavior information collection module, a biological physiological information collection module, etc. The image collection module can be a camera module such as a camera. The biological behavior information collection module can be a speed sensor capable of collecting biological motion speed, a tracking module capable of tracking a biological object, etc. The biological physiological information collection module can be a palm print collection module, a human subcutaneous vein information collection module, a voiceprint information collection module, a gait information collection module, etc. The present specification does not make special limitations on this.

[0031] Please refer to Figure 1 The mode switching method of the electronic device can include the following steps: Step 102, acquiring network device fingerprints in the network detection range.

[0032] In the present specification, the detection range can be understood as the range that the electronic device can actually detect, for example, the range covered by the Bluetooth module in the electronic device, the range covered by the Wi-Fi module in the electronic device, etc.

[0033] The network device fingerprint can be the information of the network device detected by the electronic device in its detection range, which can identify the identity of the network device. This information can be actively sent by the network device and intercepted by the electronic device, or actively obtained by the electronic device.

[0034] In the present specification, the electronic device can acquire the network device fingerprint in the network detection range in a non-connected state. The non-connected state means that the electronic device and the network device in the detection range do not establish any effective communication link. For example, the electronic device and the network device do not establish a Bluetooth communication link, do not establish a Wi-Fi communication link, etc.

[0035] For example, the electronic device can capture the data packets transmitted by the network device in the detection range through the BLE (Bluetooth Low Energy) sniffing function of the Bluetooth device to obtain the network device fingerprint. For example, capture the device identifier (Hashed MAC), signal strength (RSSI, Received Signal Strength Indicator), service UUID (Universally Unique Identifier), transmission power in the broadcast packet. Using random MAC tracking technology: establishing a radio frequency fingerprint for the broadcast packet length, carrier frequency offset (CFO, Carrier Frequency Offset) of the same device, etc.

[0036] For example, the electronic device can parse the Wi-Fi signal appearing nearby through the deep parsing function of the Wi-Fi module to obtain the network device fingerprint. For example, the SSID (Service Set Identifier), Vendor OUI (Organizationally Unique Identifier), supported rate, etc. are extracted from the Probe Request frame.

[0037] In the present specification, the electronic device can obtain the network device fingerprint in the detection range through a non-connected manner, and can also obtain the network device fingerprint in the detection range through multiple non-connected manners, which is not particularly limited in the present specification.

[0038] In the present specification, the network device fingerprint is obtained through a non-connected manner to determine the identity of the target object. During the entire process, the electronic device and the network device do not need to establish an effective connection. On the one hand, the scope of application is wider, and the network device fingerprint can also be obtained for the stranger to determine the identity. On the other hand, the risk of information leakage of the electronic device caused by establishing a connection with the network device can also be effectively avoided.

[0039] Step 104, determining the identity of the target object based on the network device fingerprint.

[0040] In the present specification, the target object can be a living being or a network device.

[0041] For example, the target object can be a person, for example, a person appearing in the detection range of the smart door lock. The network device is usually carried by the target object, for example, a device such as a mobile phone, a wearable device, a tablet computer, etc. carried by the target object.

[0042] For example, the target object is a network device, for example, a terminal device such as a mobile phone, a bracelet, a watch, etc. carried by a person appearing in the detection range of the smart door lock.

[0043] Based on the foregoing step 102, after obtaining the network device fingerprint, the device identity can be identified based on the network device fingerprint to determine the identity of the target object. The identity of the target object can also be determined by combining the network device fingerprint and the biological behavior information. The biological behavior information can include: moving speed, moving direction, step length, step frequency, moving range, and stay time in different space regions, etc. and can also be obtained in the detection range. Of course, in other examples, the identity of the target object can also be determined based on the biological behavior information only, which is not particularly limited in the present specification.

[0044] In an embodiment, in identifying the device identity based on the network device fingerprint, at least one feature indicator value of at least one dimension of the device feature can be extracted from the network device fingerprint, and the device identity of the corresponding network device can be determined according to the at least one feature indicator value.

[0045] In an embodiment, the dimensions of the device feature can be divided into a physical dimension, a protocol dimension, and a behavior dimension, wherein: the feature indicators of the physical features of the physical dimension include but are not limited to carrier frequency offset, modulation error, and signal strength fluctuation standard deviation; the feature indicators of the protocol features of the protocol dimension include but are not limited to BLE service and Wi-Fi probe; and the feature indicators of the behavior features of the behavior dimension include but are not limited to time period activity, stay duration, and movement trajectory.

[0046] Wherein, the extraction manner of the carrier frequency offset, the modulation error, and the signal strength fluctuation standard deviation is not subject to any limitation, the BLE service can exemplarily extract the UUID, and the Wi-Fi probe can exemplarily extract the Wi-Fi channel width or OUI.

[0047] And the time period activity, the stay duration, and the movement trajectory can be indicators calculated comprehensively according to the detection results, for analyzing the behavior information of the target object.

[0048] Exemplarily, the time period activity can calculate the active interval of the target object within 24 hours through -∑(p*log2(p)), so as to capture the regularity of the appearance time of the target object. Wherein, P can be the probability of appearing in a specific time interval. Wherein, the smaller the time period activity is, the more fixed the time period of the appearance of the target object is.

[0049] Exemplarily, the stay duration coefficient of variation can be represented by the ratio of the standard deviation and the average value of the stay duration of the same network device within a week. This indicator can be used to analyze the regularity of the stay duration of the target object.

[0050] Exemplarily, the movement trajectory smoothness can be measured by the ratio of the straight line distance and the actual path length of the target object. The closer the ratio is to 1, the closer the movement path of the target object is to a straight line, and the closer the ratio is to 0, the greater the degree of detour of the movement path of the target object is.

[0051] In an embodiment, in determining the device identity of the corresponding network device according to the feature indicator value, at least one feature indicator value can be fused to obtain a first fusion indicator value of the corresponding dimension, and the device identity of the corresponding network device can be determined according to the first fusion indicator value of the corresponding dimension.

[0052] Exemplarily, if the device features are divided into one dimension, and there is only one feature index value in the dimension, the device identity of the corresponding network device can be determined based on the feature index value.

[0053] Exemplarily, if the device features are divided into one dimension, and there are multiple feature index values in the dimension, the multiple feature index values can be fused to obtain a first fused index value, and the device identity of the corresponding network device can be determined according to the first fused index value.

[0054] Exemplarily, if the device features are divided into multiple dimensions, and there is at least one feature index value in each dimension, at least part of the feature index values of at least part of the dimensions can be selected for fusion processing to obtain a first fused index value of the corresponding dimension, and the device identity of the corresponding network device can be determined according to the first fused index value of the corresponding dimension.

[0055] For example, for the A dimension, a1, a2 and a3 are included in the dimension; for the B dimension, b1 and b2 are included in the dimension; and for the C dimension, c1, c2 and c3 are included in the dimension. The first fused index value of the A dimension can be determined according to a1 and a2; the first fused index value of the B dimension can be determined according to b1 and b2; the first fused index value of the C dimension can be determined according to c1, c2 and c3; and the device identity of the corresponding network device can be determined according to the first fused index values of the respective dimensions.

[0056] In an embodiment, when the device identity of the corresponding network device is determined according to the first fused index value of the corresponding dimension, the current environment scenario category can be determined, the first weight of each first fused index value corresponding to the current environment scenario category can be obtained, or the first weight of each first fused index value can be adaptively determined. The first fused index values are fused according to the first weight to obtain a second fused index value, and the device identity of the corresponding network device is determined according to the second fused index value.

[0057] For example, the environment scenario can be divided into a night mode, a strong interference environment mode and a long-term monitoring mode. For the night mode, the physical layer weight is greater than the behavior layer weight, which is greater than the protocol layer weight; for the strong interference environment mode, the physical layer weight is greater than or equal to the protocol layer weight, which is greater than the behavior layer weight; and for the long-term monitoring mode, the physical layer weight is less than the protocol layer weight, which is less than the behavior layer weight. The environment scenario category can be set by the user on the terminal, and the electronic device can fuse the first fused index values of the respective dimensions according to the weight corresponding to the environment scenario category set by the user to obtain a second fused index value.

[0058] In an embodiment, when weighting is performed, confidence can also be used for weighting, as shown in the following formula:

[0059] wherein Ω is a second fusion index value, is a weight of the kth layer dimension in the fusion process, is a confidence of the first fusion index value of the kth layer dimension, is a first fusion index value of the kth layer dimension.

[0060] In an embodiment, when determining the device identity of the corresponding network device according to the feature index value, the recognition result can be generated according to the feature index value, and the device identity of the corresponding network device is determined according to the recognition result.

[0061] The recognition result can be represented by any feature index value. For example, the size of the feature index value of the device feature of any dimension can be used as the recognition result.

[0062] The recognition result can also be represented by the first fusion index value or the second fusion index value. For example, the first fusion index value obtained by fusing a plurality of feature index values of any dimension can be used as the recognition result. For example, the second fusion index value obtained by fusing the first fusion index values of different dimensions can be used as the recognition result.

[0063] For example, in the exemplary monitoring scene of the home door, the recognition result can be normalized in [0, 1], assuming that [0, 0.3] corresponds to the identity of the household, (0.3, 0.6] corresponds to the identity of the neighbor, and (0.6, 1] corresponds to the identity of the other person. Then the identity of the corresponding target object can be determined according to the interval in which the recognition result is located. For example, if the recognition result is 0.45, the identity of the target object can be determined as a neighbor. The interval size of the value is closely related to the application scenario, and a person skilled in the art can reset the identity type corresponding to the numerical interval in which different recognition results are located according to actual needs.

[0064] Specifically, assuming that at least one feature index value of the physical dimension, the protocol dimension and the behavior dimension is extracted from the network device fingerprint. Any feature index value can be used as a recognition result for identity recognition. For example, the feature index value 1 of the physical dimension is 0.45, and the identity of the target object can be determined as a neighbor.

[0065] The plurality of characteristic indicator values in any dimension can be fused to obtain a first fused indicator value. Any fused indicator value can be used as a recognition result for identity recognition. For example, if the first fused indicator value corresponding to the physical dimension is 0.45, the identity of the target object can be determined as a neighbor. Or, if the first fused indicator value corresponding to the protocol dimension is 0.45, the identity of the target object can be determined as a neighbor. In the fusion process, the plurality of characteristic indicator values can be weighted, and higher weights are given to characteristic indicator values with higher importance, and lower weights are given to characteristic indicator values with lower importance.

[0066] The plurality of first fused indicator values can be fused to obtain a second fused indicator value. The second fused indicator value can be used as a recognition result for identity recognition. For example, if the second fused indicator value is 0.45, the identity of the target object can be determined as a neighbor. In the fusion process, the plurality of first fused indicator values can be weighted, and higher weights are given to first fused indicator values with higher importance, and lower weights are given to first fused indicator values with lower importance.

[0067] In an embodiment, for the recognition results determined at adjacent time instants in a continuous time period, if the difference between the recognition result at the current time instant and the recognition result at the previous time instant is greater than a preset threshold, the recognition result at the current time instant is adjusted according to a time decay strategy based on the recognition result at the previous time instant. The identity of the target object at the current time instant is determined according to the adjusted recognition result.

[0068] The recognition result at the current time instant can be adjusted based on the recognition result at the previous time instant by the following formula:

[0069] wherein, is the recognition result at time instant t, is the recognition result at time instant t-1, is the difference between t and t-1.

[0070] For example, if network device fingerprints are obtained based on a plurality of detection devices, and the recognition results of different devices conflict, time decay arbitration can be introduced to prevent errors caused by conflicts.

[0071] Table 1

[0072] ​​​​In Table 1, at the moment t = 0, the decision result based on BLE, at this moment, the decision state is to be confirmed, and the target object identity is not directly determined according to the current device fingerprint; at the moment t = 2, continuous monitoring can be performed, and the decision based on UWB, as time elapses, the weight of the decision result of BLE at the previous moment in the UWB decision is reduced, and through continuous adjustment, the conflict between each other can be prevented. At the moment t = 5, the response is terminated, and the monitoring is stopped.

[0073] In an embodiment, after obtaining the network device fingerprint in the network detection environment, the current connection state between the network device and the electronic device can also be determined based on the network device fingerprint. When the device identity of the corresponding network device is determined based on the network device fingerprint, in response to the current connection state being connected, the device identity of the network device is determined as a first type of device; and in response to the current connection state being unconnected, the device identity of the network device is determined as a second type of device.

[0074] In an exemplary home door monitoring scene, the first type of device is the device of the resident, and the second type of device is the device of other people.

[0075] In this embodiment, it is assumed that only the resident can establish a connection with the electronic device, and based on the current connection state between the network device and the electronic device, the device that establishes a connection with the electronic device can be accurately identified as the device of the resident.

[0076] In an embodiment, in response to the current connection state being unconnected, the historical activity of the network device can also be determined based on the network device fingerprint, and in the case where the historical activity is greater than a preset threshold, the network device is determined as a third type of device, wherein the third type of device is the device of the neighbor.

[0077] In combination with the above two embodiments, the device of the resident and the device of other people are distinguished by the connection state, and the neighbor device can be further identified from the device of other people by the historical activity. In this way, without establishing a connection with any network device, the device of the resident and the device of the neighbor can also be identified.

[0078] The historical activity can be measured by the period activity, the stay duration coefficient of variation and other characteristic indexes in the foregoing embodiments. If the period activity is used for measurement, the historical activity is the reciprocal of the period activity. For example, if the period activity is less than 1.5, it can be determined as the device of the neighbor. If the stay duration coefficient of variation is used for measurement, the historical activity can be the reciprocal of the stay duration coefficient of variation. For example, if the stay duration coefficient of variation is less than 0.1, it can be determined as the device of the neighbor.

[0079] Of course, the present solution is not limited to determining the identity of other objects based on the network device fingerprint. For example, the identity of a service personnel can also be determined based on the UUID in the network device fingerprint, etc.

[0080] At step 106, the running mode is switched based on the identity of the target object.

[0081] Based on the foregoing step 104, after the identity of the target object is determined, in response to the identity of the target object satisfying a first preset condition, it is determined that the target object is a specific target object that needs privacy protection, and the running mode is switched. For example, the running mode can be switched to a privacy protection running mode for the specific target object.

[0082] The privacy protection running mode includes one or more of the following: The biological information collection module is turned off, the angle of the biological information collection module is adjusted to misalign with the specific target object, the resolution of the biological information collection module is reduced, and the image collected by the biological information collection module is blurred.

[0083] For example, the camera is turned off, the angle of the camera is adjusted to misalign with the specific target object, the resolution of the image collected by the camera is reduced, and the image collected by the camera is blurred to blur the privacy information, etc.

[0084] For another example, the audio collection module is turned off, the palmprint collection module is turned off, etc.

[0085] In an exemplary door monitoring scenario, after the smart door lock detects the presence of a person in the detection range, it can identify whether the detected person is a neighbor. If it is a neighbor, it can be determined that the person present is a specific target object, and then the external camera can be turned off to not collect images of the neighbor, thereby avoiding the collection of privacy information such as the neighbor's face, indoor images of the neighbor, etc.

[0086] In an exemplary indoor monitoring scenario of a family, after the smart door lock detects the presence of a person in the detection range, it can identify whether the detected person is a family member. If it is a family member, it can be determined that the person present is a specific target object, and then the internal camera can be turned off to not collect indoor images, thereby avoiding the collection of privacy information such as the face image of the family member.

[0087] In other examples, after the identity of the target object is determined, in response to the identity of the target object satisfying a second preset condition, it is determined that the target object is a dangerous target object that needs enhanced monitoring, and the running mode is switched. For example, the running mode can be switched to a tracking and monitoring running mode for the dangerous target object. The tracking and monitoring running mode can include turning on all biological information collection modules, adjusting the angle of the biological information collection modules to track the dangerous target object, etc.

[0088] For example, adjusting the angle of the camera to track the dangerous target object in real time, increasing the resolution of the image collected by the camera, etc.

[0089] For another example, turning on the audio collection module, turning on the palm print collection module, etc.

[0090] In an exemplary door monitoring scenario, after the smart door lock detects the presence of a person in the detection range, if it is identified that the detected person is a dangerous person, for example, a suspicious person, the tracking monitoring operation mode can be started, and the camera can be controlled to track the dangerous person to collect relevant images.

[0091] In an exemplary door monitoring scenario, after the smart door lock detects the presence of a person in the detection range, if it is identified that the detected person is a dangerous person, for example, a suspicious person, the alarm mode can also be started to remind the target object that it has entered the monitoring range. For example, the loudspeaker can be controlled to broadcast a prompt message "You have entered the monitoring range". In addition, the smart door lock can also push a prompt to the family members that someone has entered the monitoring range, for example, the homeowner's mobile phone can be pushed a prompt message "There is a suspicious person".

[0092] It is worth noting that the above operation modes are not all mutually exclusive operation modes, and in some scenarios, multiple operation modes can be executed simultaneously, for example, when the smart door lock detects a dangerous person, the alarm mode can be started while switching to the tracking monitoring operation mode.

[0093] As can be seen from the above description, by using the above scheme provided in the specification, the electronic device can obtain the network device fingerprint in the network detection range, determine the identity of the target object appearing in the network detection range based on the network device fingerprint, and switch the operation mode of the electronic device based on the identity of the target object, thereby realizing automatic switching of the operation mode without the need for manual setting by the user, greatly improving the user experience. At the same time, by using the above scheme, the biological information of a specific target object can be avoided from being collected, or the collected biological information can be blurred, so as to avoid the collection of private information of a specific target object, thereby avoiding the risk of privacy leakage. Moreover, the tracking monitoring operation mode can be started for a dangerous target object to improve security.

[0094] Taking the privacy protection mode of security monitoring as an example, the implementation process of the specification will be described in detail from the following five aspects: maintenance of the management list, wake-up of the wireless communication module, start of the privacy protection operation mode, stop of the privacy protection operation mode, and cooperation with the linkage device.

[0095] I. Maintenance of the management list In the present specification, in an application scenario such as door monitoring, there are usually some fixed target objects. In order to improve the efficiency of target object identity confirmation, a management list having a mapping relationship with the target object identity can be maintained. After obtaining the network device fingerprint, the identity of the corresponding network device can be searched in the maintained management list. If the identity of the corresponding network device can be found in the management list, the identity of the target object can be determined based on the management list, so that the determination of the target object identity is not needed again, the identity confirmation efficiency can be improved, and the processing resources and power consumption of the device can be saved.

[0096] The management list having a mapping relationship with the target object identity can include a resident list, a neighbor list, etc. The resident list can be used to store the network device fingerprints of the members of the subject such as the family, enterprise, etc. to which the electronic device belongs. Taking the door monitoring application scenario of the smart door lock as an example, the resident list can save the device fingerprints of the network devices held by each family member of the resident, for example, the mobile phone identification of the family member, etc. The neighbor list can be used to store the network device fingerprints of the neighbors around the subject such as the family, enterprise, etc. to which the electronic device belongs. Still taking the door monitoring application scenario of the smart door lock as an example, the neighbor list can save the device fingerprints of the network devices held by each neighbor, for example, the mobile phone identification of the neighbor, etc.

[0097] Of course, the above-mentioned resident list and neighbor list are only exemplary descriptions. In other examples, a service personnel list, a service personnel list, etc. can also be set based on needs, and the present specification does not specially limit this.

[0098] In the present specification, the management list can be created and maintained by the user. For example, the user can manually add the network device fingerprints of the network devices held by the family members to the resident list, and can also delete the family members who do not live in the resident list, etc.

[0099] In the present specification, the management list can also be created and maintained by the electronic device. Please refer to Figure 2 The maintenance of the management list can include the following steps: Step 202, after determining the target object identity, if there is a management list having a mapping relationship with the target object identity, the network device is added to the corresponding management list.

[0100] In the present specification, after determining the target object identity based on the network device fingerprint, the electronic device can determine whether a management list corresponding to the target object identity has been created. If the management list corresponding to the target object identity has been created, the electronic device can further determine whether the network device has been stored in the management list. If not, the network device can be added to the corresponding management list. For example, the network device fingerprint can be added to the management list. Of course, in other examples, other information of the network device can also be added to the management list, which is not specially limited in the present specification.

[0101] For example, assuming that the electronic device determines that the target object identity is a neighbor based on the network device fingerprint, the electronic device can determine whether a neighbor list has been created. If the neighbor list has been created, the electronic device can determine whether the corresponding network device has been stored in the neighbor list. If not, the network device fingerprint can be added to the neighbor list.

[0102] In the present specification, the target object identity that needs to create a management list can be specified in advance. On the one hand, the creation of the management list can be performed for a specific target object that needs to be protected, such as a resident, a neighbor, a service personnel, etc. On the other hand, the creation of the management list can be performed for a dangerous target object, such as a suspicious person, etc. When the identity of the target object belongs to the above-mentioned pre-specified identity that needs to create a management list, the determination of whether the management list has been created is performed. If the identity of the target object does not belong to the above-mentioned pre-specified identity that needs to create a management list, the determination of whether the management list has been created is not needed, i.e., the management list maintenance logic provided in the present embodiment does not need to be executed.

[0103] Of course, the above-mentioned specified identity that needs to create a management list is only an example and does not limit the technical solutions of the present specification.

[0104] In step 204, if the management list corresponding to the target object identity does not exist, the management list corresponding to the target object identity is created, and the corresponding network device is added to the created management list.

[0105] In the present specification, after determining the target object identity based on the network device fingerprint, the electronic device can determine whether a management list corresponding to the target object identity has been created. If the management list corresponding to the target object identity has been created, the electronic device can further determine whether the network device has been stored in the management list. If not, the network device can be added to the corresponding management list. For example, the network device fingerprint can be added to the management list. Of course, in other examples, other information of the network device can also be added to the management list, which is not specially limited in the present specification.

[0106] In an optional embodiment of the present specification, for the case of automatically maintaining a management list for an electronic device, before adding a network device to the corresponding management list, the number of times the network device appears in the network detection range can be obtained, and when the number of times is greater than or equal to a number of times threshold, the network device is added to the corresponding management list, so as to improve the accuracy of management list maintenance.

[0107] Taking the target object 1 as an example, assuming that it has been determined that the identity of the target object 1 is a neighbor, the number of times counter corresponding to the target object 1 can be updated, specifically, the number of times counter can be incremented by 1 (the initial value of the counter is 0), and then it is determined whether the count value of the number of times counter is greater than or equal to the number of times threshold. If it is greater than or equal to the number of times threshold, the corresponding network device can be added to the corresponding management list, and if the count value is less than the number of times threshold, the network device is temporarily not added to the corresponding management list.

[0108] In an optional embodiment of the present specification, for the network device recorded in the created management list, the electronic device can also delete the network device from the management list when the network device has not appeared in the network detection range for a long time.

[0109] Still taking the target object 1 as an example, assuming that the network device corresponding to the target object 1 has been recorded in the neighbor list, if the target object 1 has not appeared in the network detection range for 3 months, the network device corresponding to the target object 1 can be deleted from the neighbor list.

[0110] In specific implementation, the last appearance time of each network device hitting the management list can be recorded, for each management list, the time length from the last appearance time of each network device recorded in the management list to the present can be determined periodically, if it exceeds a preset value, it can be determined that the corresponding target object has not appeared for a long time, and the corresponding network device in the management list can be deleted to update the management list in time.

[0111] II. Wake-up of wireless communication module In the present specification, in order to ensure the real-time of the electronic device detection, the wireless communication module such as Bluetooth and Wi-Fi is continuously in an open state, while in the scene where personnel activity is sparse, the wireless communication module is in an "idling" state most of the time, resulting in high energy consumption. For example, taking the application scene of monitoring the doorway of a home as an example, the number of times the target object appears near the doorway in a day is very limited, and the wireless communication module continuously detects, which will generate a large amount of unnecessary energy consumption.

[0112] In order to solve the problem, the present specification also provides a wake-up scheme of the wireless communication module to accurately grasp the wake-up opportunity on the basis of reducing the energy consumption of the wireless communication module.

[0113] Figure 3 FIG. 3 is a flowchart of a method for waking up a wireless communication module according to an example embodiment.

[0114] Referring to FIG. 3, the method for waking up a wireless communication module can include the following steps. Figure 3 At step 302, first historical detection information of a target object appearing in a network detection range is obtained in a first historical time period.

[0115] In this embodiment, the first historical time period can be pre-set, for example, a time period of one month back from the current day, a time period of six months back from the current time, etc. The first historical detection information can include network device fingerprints detected by the electronic device in the first historical time period, and can also include behavior information of the target object, which can include moving speed, moving direction, step length, step frequency, moving range, and duration of stay in different spatial regions, etc.

[0116] In actual implementation, the electronic device can store the detected detection information and the corresponding time stamp in association for subsequent use.

[0117] At step 304, a future appearing time of the target object in the network detection range is predicted based on the first historical detection information.

[0118] Based on step 302 described above, after obtaining the first historical detection information, the future appearing time of the target object can be predicted based on the first historical detection information.

[0119] For example, the first historical detection information and the corresponding time stamp can be input into a time prediction model, and the time prediction model can analyze the time sequence regularity of different detection information appearing on the time line to predict the appearing time of the next target object as the future appearing time.

[0120] For example, the first historical detection information includes detection information 1 detected at time A, detection information 2 detected at time B, and detection information 3 detected at time C. The time prediction model analyzes the correlation of different detection information in time sequence to predict the appearing time of the next new detection information, i.e., the future appearing time of the target object.

[0121] Of course, the time prediction model described above is only an example, and in other examples, other ways can be used to predict the future appearing time, which is not specially limited in this specification.

[0122] At step 306, the wireless communication module is woken up in response to the current time being a time point that is a first preset time length before the future appearing time. ​

[0123] In the present specification, the electronic device can wake up the wireless communication module in the sleep state at a time point that is a first preset time length before the future occurrence time point, to perform the detection of the network device fingerprint. The first preset time length is also preset, for example, 5 minutes, 10 minutes, etc.

[0124] For example, assuming that the future occurrence time point is 18:00 and the first preset time length is 5 minutes, the wireless network communication module in the sleep state can be woken up at 17:55 in advance.

[0125] Of course, the first preset time length can also be 0, that is, the electronic device wakes up the wireless communication module at the future predicted time point.

[0126] As can be seen from the above description, the present embodiment can predict the future occurrence time point of the target object within the network detection range based on the first type of historical detection information, and can wake up the wireless communication module at a time point that is a first preset time length before the current time point. In this way, the electronic device only wakes up the wireless communication module when necessary, and the wireless communication module can be in a sleep state at other times, which significantly reduces the energy consumption. In addition, the wake-up time is generated according to historical data prediction, which can effectively improve the prediction accuracy of the future occurrence time point of the target object and significantly reduce the invalid wake-up.

[0127] In an optional embodiment of the present specification, the woken-up wireless communication module can detect the network device fingerprint appearing in the network detection range to confirm the identity of the target object. Subsequently, the electronic device can put the wireless communication module into a sleep state after a certain period of time to save energy. For example, the electronic device can put the wireless communication module into a sleep state when the time length of the absence of any target object in the network detection range reaches a certain time length, and the present specification does not specially limit this.

[0128] In an optional embodiment of the present specification, the electronic device can also determine the wake-up time of the wireless communication module based on the linkage information sent by the linkage device, to realize the advance wake-up of the wireless communication module.

[0129] The linkage device is usually other smart devices in the environment where the electronic device is located. The linkage device can establish a communication link with the electronic device to communicate. For example, the electronic device is a smart door lock, and the linkage device includes smart elevators, smart access control, smart lights, and other smart devices in the surrounding environment of the smart door lock. The linkage device can also be a management device in the community / park where the smart door lock is located, which can manage smart elevators, smart access control, smart lights, and other smart devices in the public area of the corresponding community / park.

[0130] The linkage information can be a time point at which the target object is expected to appear in the network detection range, behavior data of the linkage device, and the like.

[0131] For example, assuming that the linkage device is a smart elevator and the target object is a person, the smart elevator can predict a time point of arrival at the floor pressed by the person as the time point at which the target object is expected to appear in the network detection range. Assuming that the linkage device is a smart access control and the target object is a person, the smart access control can predict a time point at which the person is expected to appear in the network detection range according to a time point at which the person opens the door, and the like.

[0132] The behavior data of the linkage device can include scheduling data, switch data, and the like of the linkage device. For example, assuming that the linkage device is a smart elevator, the behavior data can include scheduling data of the smart elevator, which is usually related to the target object, such as the target object scheduling the smart elevator to arrive at the floor where the target object is located and go to the designated floor, and the like. For example, assuming that the linkage device is a smart access control, the behavior data can include switch data of the smart access control, which is usually also related to the target object, such as the target object opening the smart access control, and the like.

[0133] It is worth noting that the linkage device sends the linkage information of the target object to the electronic device that will be able to detect the target object. For example, the smart elevator can send the linkage information related to the target object to the electronic device of the floor to which the target object is to arrive, instead of sending the linkage information to all electronic devices of the floors.

[0134] After receiving the linkage information sent by the linkage device, the electronic device can determine the wakeup time of the wireless communication module based on the linkage information.

[0135] For example, when the time point at which the target object is expected to appear in the network detection range is included in the linkage information, the electronic device can determine the time point as the wakeup time of the wireless communication module, or determine a time point of a first preset time length before the time point as the wakeup time, and the like. For example, the smart elevator sends the target object to the smart lock 14:30 to arrive at the relevant floor, and the smart lock can wake up the wireless communication module for detection at 14:30 or 14:25.

[0136] For example, when the behavior data of the linkage device is included in the linkage information, the electronic device can predict the time point at which the target object appears in the network detection range according to the behavior data, and then determine the wakeup time. For example, the smart elevator sends the scheduling data of the smart lock to the smart lock, and the smart lock further predicts the time point at which the smart elevator arrives at the floor, and then determines the wakeup time, and the like. Similarly, the wakeup time can be the predicted arrival time point, or a time point of a first preset time length before the time point, and the like, which is not specially limited in the present specification.

[0137] III. Turning on the privacy protection operation mode In an embodiment, when it is determined based on the identity of the target object that the target object is a specific target object that needs privacy protection, the privacy protection operation mode can be executed immediately for the specific target object. For example, the camera is turned off, the resolution of the camera is reduced, etc.

[0138] In another embodiment, when it is determined based on the identity of the target object that the target object is a specific target object, it can be further determined whether the execution condition of the privacy protection operation mode is met, and if the execution condition is met, the privacy protection operation mode can be executed for the specific target object, i.e. the operation mode is switched. If the execution condition is not met, the privacy protection operation mode for the specific target object can not be executed.

[0139] For example, the execution condition can be that the actual distance between the specific target object and the electronic device is less than or equal to a first distance threshold value, which is pre-set. For example, after the electronic device determines that the target object is a specific target object, it can detect the actual distance between the specific target object and the electronic device, determine the size relationship between the actual distance and the first distance threshold value, and execute the privacy protection operation mode for the specific target object when the actual distance is less than or equal to the first distance threshold value.

[0140] The actual distance can be detected by a distance sensor or determined by the signal strength between the network device and the electronic device, which is not limited in the present specification.

[0141] Optionally, when the actual distance between the specific target object and the electronic device is less than or equal to a second distance threshold value, the duration that the actual distance between the specific target object and the electronic device is less than or equal to the second distance threshold value can also be recorded, and if the duration is greater than a first duration threshold value, it means that the specific target object stays close to the electronic device for a long time, and in order to ensure safety, it can be determined that the switching condition is met, and the electronic device can be restored to the state before the privacy protection operation mode is executed, or the privacy protection operation mode for the specific target object can be stopped.

[0142] The second distance threshold value is less than or equal to the first distance threshold value.

[0143] For example, assuming that the actual distance between the specific target object and the electronic device is less than or equal to the first distance threshold value, the camera of the electronic device is turned off to stop image acquisition, but the duration that the actual distance between the specific target object and the electronic device is less than or equal to the second distance threshold value is too long, which is greater than or equal to the first duration threshold value, so the camera can be turned on to start image acquisition again.

[0144] For example, after the electronic device determines that the target object is a specific target object, the electronic device can continue to detect the signal strength of the network device, determine the size relationship between the detected signal strength and the first strength threshold, and execute the privacy protection operation mode for the specific target object when the detected signal strength is greater than or equal to the first strength threshold.

[0145] Optionally, when the signal strength of the network device is greater than or equal to a second strength threshold, the duration for which the signal strength is greater than or equal to the second strength threshold can also be recorded. If the duration is greater than a second duration threshold, it indicates that the specific network device stays near the electronic device for a relatively long time. To ensure safety, the switching condition can be determined, and the electronic device can be restored to a state before the privacy protection operation mode is executed, or the privacy protection operation mode for the specific target object can be stopped.

[0146] The second strength threshold is greater than or equal to the first strength threshold. The second duration threshold can be equal to or different from the first duration threshold.

[0147] For example, it is assumed that the signal strength of the network device is greater than or equal to the first strength threshold, and the electronic device closes the camera to stop image acquisition. However, the duration for which the signal strength of the network device is greater than or equal to the second distance threshold is too long, and is greater than or equal to the second duration threshold. Therefore, the camera can be turned on to restart image acquisition.

[0148] As can be seen from the above description, when the target object is determined to be a specific target object based on the identity of the target object, the embodiment determines whether the execution condition of the privacy protection operation mode is met, and executes the privacy protection operation mode for the specific target object when the execution condition is met. Therefore, the execution timing of the privacy protection operation mode can be more accurately controlled, the lack of monitoring caused by the early execution of the privacy protection operation mode can be avoided, and the monitoring safety can be ensured.

[0149] In an optional embodiment of the present specification, a scheme for automatically switching the privacy protection operation mode is also provided. Please refer to Figure 4 , which includes the following steps: Step 402: Obtain second type of historical detection information obtained by detecting a target object appearing in a network detection range of the electronic device in a second historical time period.

[0150] In this embodiment, similar to the first historical time period, the second historical time period can be pre-set, for example, a time period of 1 month back from the current day, a time period of 3 months back from the current time, etc. The second historical time period can be the same as the first historical time period, or different from the first historical time period.

[0151] In this embodiment, similar to the first type of historical detection information, the second type of historical detection information can include network device fingerprints detected by the electronic device in the first historical time period, and can also include behavior information of the target object, which can include moving speed, moving direction, step length, step frequency, moving range, stay duration in different spatial regions, etc., and can also include identity recognition results of the target object in history, etc. The second type of historical detection information can be the same as the first type of historical detection information, or different from the first type of historical detection information, or have an intersection with the first type of historical detection information, etc., which is not specially limited in the specification.

[0152] In step 404, a prediction result of future behavior of the target object is determined based on the second type of historical detection information.

[0153] In one example, when the identity recognition result of the target object appearing in the network detection range in history is included in the second type of historical detection information, it can be determined whether the corresponding historical target object is an object requiring privacy protection based on the identity recognition result, and if so, the prediction result of future behavior of the target object determined based on the second type of historical detection information can only include a future appearance time of the target object.

[0154] For example, when the historical detection information of the neighbor is included in the acquired second type of historical detection information, the future appearance time of the neighbor can be predicted based on the historical detection information of the neighbor as the prediction result.

[0155] Of course, in such an implementation manner, the second type of historical detection information of the object requiring privacy protection can also be directly acquired in the foregoing step 402, which is not specially limited in the specification.

[0156] In another example, when the identity recognition result of the historical target object is not included in the second type of historical detection information, the identity of each historical target object can be recognized based on the second type of historical detection information, and then the second type of historical detection information of the historical target object requiring privacy protection is extracted to predict the future appearance time of the target object as the prediction result.

[0157] In yet another example, when the prediction result prediction is performed, the identity of the historical target object can not be confirmed in advance, and the future appearing time and the action type of the target object can be directly predicted based on the obtained second type of historical detection information as the prediction result.

[0158] The action type in the prediction result can be a probability distribution of each action type. Different action types can be used to identify target objects with different identities. For example, if the action type indicates that the target object first approaches the electronic device and then moves away from the electronic device, it can be predicted that the target object is a neighbor. For another example, if the action type indicates that the target object is gradually approaching the electronic device, it can be predicted that the target object is a resident. By determining the action type with the highest probability according to the probability distribution of the action type, the identity of the target object can be further predicted according to the action type.

[0159] In this embodiment, the prediction result can be predicted based on a behavior analysis model. The behavior analysis model can extract the spatio-temporal features and behavior features in the second type of historical detection information, and then construct a multi-dimensional feature vector. The spatio-temporal features can include time and space features, and the behavior features can include the connection relationship between the target object and the electronic device determined according to the second type of historical detection information. Then, the aforementioned prediction result can be predicted based on the constructed multi-dimensional feature vector.

[0160] In step 406, in response to the current time being a time point that is a second preset time length before the future behavior occurrence time determined based on the prediction result, the running mode is switched.

[0161] In one example, when the prediction result only includes the future appearing time of the target object, the future appearing time is the future behavior occurrence time, and the running mode can be switched when the current time is a time point that is a second preset time length before the future appearing time. For example, the running mode of the electronic device is switched to the privacy protection running mode to start the privacy protection mode in advance.

[0162] In another example, when the prediction result includes the future appearing time of the target object and the action type, the identity of the target object can be predicted based on the action type first. When the identity of the target object is a specific target object that needs privacy protection, the running mode of the electronic device can be switched to the privacy protection running mode to start the privacy protection mode in advance when the current time is a time point that is a second preset time length before the future appearing time. If the identity of the target object is not a specific target object that needs privacy protection, the running mode does not need to be switched based on the future appearing time.

[0163] The second preset time length can be the same as or different from the aforementioned first preset time length.

[0164] As can be seen from the above description, the embodiment can determine the prediction result of the future behavior of the target object based on the second type of historical detection information, and can start the privacy protection operation mode in advance for the target object that needs privacy protection based on the prediction result, thereby realizing the paradigm upgrade of the privacy protection mechanism, and being able to trigger the corresponding privacy protection mechanism in advance, that is, evolving from passive response to active defense, significantly reducing the response delay of the traditional privacy protection operation mode that is started only when a specific target object is detected, and greatly improving the timeliness and reliability of privacy protection.

[0165] IV. Closing of the privacy protection operation mode In the present specification, in order to ensure the monitoring effectiveness of the electronic device, after a specific target object that needs privacy protection appears in the detection range of the electronic device and the privacy protection operation mode is executed for the specific target object, the privacy protection operation mode also needs to be closed. Specifically, the privacy protection operation mode can be closed when a closing condition of the operation mode switching is met, and the operation mode of the electronic device can be restored to the state before the switching; or the currently running privacy protection operation mode can be stopped.

[0166] Specifically, after the electronic device is switched to the privacy protection operation mode for the specific target object, it can be determined whether the closing condition is met. The closing condition can be preset in advance.

[0167] For example, the closing condition includes that the time length of executing the privacy protection operation mode for the specific target object reaches a preset time length. The preset time length can represent the time length of the specific target object leaving the detection range, and can be preset based on experience, for example, 5 seconds, 10 seconds, etc.

[0168] In actual implementation, after the privacy protection operation mode for the specific target object is executed, a timer can be started to start timing. When the timing reaches the preset time length, it can be determined that the closing condition is met.

[0169] For example, the closing condition includes that no specific target object is detected in the detection range. For the electronic device, the target object appearing in the detection range can be continuously detected. When it is determined that no specific target object appears in the detection range, it can be determined that the closing condition is met.

[0170] In this case, no specific target object appearing in the detection range can mean that no target object appears in the detection range, or that a target object appears in the detection range, but the identified target object is not a specific target object. These situations can all indicate that the specific target object that needs privacy protection has left the detection range.

[0171] For example, the closing condition includes sensing a state change of another electronic device within a preset range. The type of the other electronic device can be the same as or different from the electronic device. Assuming that the electronic device is a smart door lock, the other electronic device can also be a smart door lock (for example, a smart door lock of a neighbor's home) or a door monitoring device (for example, a smart cat eye), a corridor device, or the like.

[0172] The state change can include an information interaction state change and / or a running action state change. In other words, the electronic device can determine that the closing condition is met when the information interaction state change of the other electronic device is sensed; the closing condition is met when the running action state change of the other electronic device is sensed; and the closing condition is met when the information interaction state change of the other electronic device is sensed and the running action state also changes.

[0173] The information interaction state change can include disconnection of a connection state, network signal strength change and / or switching of a scheduling signal.

[0174] The disconnection of the connection state can be disconnection of a network device connected to the other electronic device, which can represent that the network device previously connected to the other electronic device is away from the coverage range of the other electronic device. Assuming that the other electronic device is a neighbor's door lock, the disconnection of the connection state can be disconnection of the neighbor's door lock and a network device (such as a mobile phone or a computer) previously connected thereto. Still taking the smart door lock as an example, the neighbor's door lock (other electronic device) can establish a connection with a network device (such as a mobile phone, a computer, or a wearable device) of a neighbor (i.e., a neighbor family member). For example, after the neighbor returns home, the neighbor's mobile phone can establish a connection with the neighbor's door lock. When the neighbor's door lock and the neighbor's mobile phone are disconnected, it usually indicates that the neighbor has left home. In this case, the neighbor has also usually left the detection range of the smart door lock, and thus it can be determined that the closing condition is met.

[0175] It is worth noting that the above connection state usually refers to a direct connection, such as a direct communication connection established between the smart door lock and a network device. The disconnection of the above connection state usually refers to disconnection of the direct communication connection, such as disconnection of the direct communication connection established between the smart door lock and the network device. Disconnection of an indirect connection state, such as connection of the neighbor's door lock to a server through the neighbor's Wi-Fi network and connection of the server to the neighbor's mobile phone through a wireless network, is not within the range of disconnection of the above connection state. Such disconnection of the indirect connection state does not necessarily mean that the neighbor has left the detection range of the smart door lock, but can be caused by other conditions, such as Wi-Fi network failure of the neighbor's home. Therefore, the disconnection of the connection state used to indicate that the closing condition is met usually does not include disconnection of the indirect connection state.

[0176] The network signal strength change and then keeping stable is usually the network signal strength change of other electronic device detected by the electronic device. The network signal strength change of other electronic device can represent the distance change between other electronic device and the electronic device, and the network signal strength change and then keeping stable can represent that the distance between other electronic device and the electronic device becomes larger and then smaller and keeps stable, or the distance between other electronic device and the electronic device becomes smaller and then larger and keeps stable. The network signal strength change can represent the behavior of the person using other electronic device, and then the network signal strength change and then keeping stable of other electronic device can be determined as the closing condition.

[0177] Taking the neighbor door lock as an example, the network signal strength change and then keeping stable of the neighbor door lock can represent the opening and closing change of the neighbor door. For example, the neighbor door opening outwards can cause the network signal of the neighbor door lock to become stronger, and if the door is closed after opening, the network signal of the neighbor door lock can become weaker, and when the neighbor door keeps closed, the network signal strength of the neighbor door lock keeps stable. In this example, the network signal strength change of the neighbor door lock is: becoming stronger-becoming weaker-keeping stable. For the neighbor, the possible behavior is opening the door, entering the house, and closing the door, and then the closing condition can be determined after sensing the above network signal change of the neighbor door lock.

[0178] The switching of the scheduling signal can be the device scheduling of other electronic device after receiving the scheduling instruction. The other electronic device can be an elevator, a unit access control, a community access control, etc. The switching of the scheduling signal can represent that the specific target object appearing in the detection range will leave or has left the detection range, and then the closing condition can be determined.

[0179] Suppose that the other electronic device is an elevator, and the switching of the scheduling signal can be that the elevator receives a scheduling request. Taking the neighbor as an example, the specific target object can be the neighbor pressing the elevator button to request the elevator to arrive at the floor where the neighbor is located, or the neighbor has entered the elevator and pressed the floor where the neighbor wants to arrive.

[0180] Suppose that the other electronic device is a unit access control, and the switching of the scheduling signal can be that the unit access control receives an opening request. Taking the neighbor as an example, the neighbor can open the unit access control to leave the unit building, etc.

[0181] In this example, the information interaction state change of other electronic device can be determined when one of the disconnection of the connection state, the network signal strength change and then keeping stable, and the switching of the scheduling signal is met, or when two of them are met, or when all of them are met, and the present specification does not specially limit this.

[0182] The running action state change includes: device closing, device moving away.

[0183] The device closing can be a closing of other electronic devices, such as closing of a neighbor's door lock, closing of an elevator, closing of a corridor light, and the like. Taking the neighbor as the specific target object, the device closing can represent that the neighbor leaves the detection range of the electronic device, and thus the closing condition can be determined to be met. For example, the neighbor closes the door when returning home, the neighbor takes the elevator to leave, the neighbor walks to leave the corridor smart light to be closed, and the like.

[0184] The device moving away can be that other electronic devices move away from the electronic device, such as a neighbor's door lock moving away, an elevator moving away, and the like. Taking the neighbor as the specific target object, the device moving away can represent that the neighbor leaves the detection range of the electronic device, and thus the closing condition can be determined to be met. For example, the neighbor's door lock moves away when the neighbor's door lock is closed when the neighbor returns home, the elevator car moves away from the floor where the electronic device is located when the neighbor takes the elevator, and the like.

[0185] In this example, the running action state change of the other electronic device can be determined when either the device closing or the device moving away is met, or the running action state change of the other electronic device can be determined when both the device closing and the device moving away are met, which is not specially limited in the present specification.

[0186] It should be noted that the state change of the other electronic device sensed by the electronic device is authorized.

[0187] In this embodiment, when the closing condition is determined to be met, the privacy protection running mode for the specific target object can be stopped, and the electronic device can be restored to the running mode before the privacy protection running mode is executed, such as turning on the closed camera to restore the normal monitoring state, and the like. Of course, if a dangerous target object appears in the network detection range, the running mode of the electronic device can be directly switched from the privacy protection running mode to the tracking monitoring running mode, and the like.

[0188] As can be seen from the above description, after the electronic device executes the privacy protection running mode for the specific target object, the privacy protection running mode for the specific target object can be stopped when the closing condition is met, so as to restore to the monitoring state in time, and prevent the security risks caused by the long-time execution of the privacy protection running mode leading to the lack of monitoring.

[0189] V. Cooperation with a linkage device In this embodiment, the electronic device can confirm the identity of the target object based on the linkage information about the target object sent by the linkage device, so as to subsequently switch the running mode.

[0190] The linkage information can include one or more of the following: a time point at which the target object is expected to appear within the network detection range, a network device fingerprint, initial identity information of the target object, behavior data of the linkage device, and abnormal floor access.

[0191] The network device fingerprint can be information of a network device obtained by the linkage device, which can identify the identity of the network device. The information can be actively sent by the network device to the linkage device and intercepted by the linkage device, or can be actively obtained by the linkage device through detection.

[0192] The initial identity information of the target object can be determined by the linkage device based on the obtained network device fingerprint, or can be determined based on the obtained network device fingerprint in combination with personnel biological behavior information, or can be obtained by the linkage device directly identifying the identity of the target object, and the present specification does not make special limitations thereon.

[0193] The abnormal floor access is usually an abnormal floor access behavior of the target object found by the linkage device. Taking the linkage device as an intelligent elevator for example, it is assumed that the target object has been identified as a resident on the 5th floor. If the target object dispatches the intelligent elevator to the 8th floor (for example, presses the 8th floor button), it can be considered as abnormal floor access. Taking the linkage device as an intelligent access control for example, it is assumed that the target object is not an authorized user of the intelligent access control, and it can be considered as abnormal floor access, and the like.

[0194] Other linkage information can refer to the foregoing embodiments, which will not be described here again.

[0195] In the present embodiment, before obtaining the network device fingerprint within the network detection range, the electronic device can first determine whether the identity of the target object can be confirmed based on the linkage information. If the identity of the target object can be confirmed based on the linkage information, the network device fingerprint can also not be obtained. If the identity of the target object cannot be confirmed based on the linkage information, the network device fingerprint needs to be obtained for identity confirmation.

[0196] In one example, if the initial identity information of the target object is included in the linkage information, it can be determined that the identity of the target object can be confirmed based on the linkage information, and the initial identity information can be directly used to determine the identity of the target object.

[0197] For example, if the initial identity information includes the identity of the target object determined by the linkage device, the identity of the target object in the initial identity information can be directly used, and the electronic device does not need to reconfirm the identity of the target object.

[0198] For another example, if the initial identity information includes the network device fingerprint, the electronic device can directly determine the identity of the target object based on the network device fingerprint, or jointly determine the identity of the target object in combination with biological behavior information.

[0199] In yet another example, if the initial identity information is not included in the linkage information, it can be determined that the target object identity cannot be confirmed based on the linkage information, and the network device fingerprint in the network detection range can be acquired based on the linkage information, and the target object identity can be determined based on the acquired network device fingerprint, or the target object identity can be determined in combination with the biological behavior information.

[0200] For example, the linkage information can carry an instruction for instructing the electronic device to perform target object identity confirmation. After receiving the linkage information, the electronic device can acquire the network device fingerprint in the network detection range in response to the instruction, and then determine the target object identity based on the network device fingerprint, or determine the target object identity in combination with the biological behavior information.

[0201] For another example, the linkage information can also not carry an instruction for instructing the electronic device to perform target object identity confirmation. After receiving the linkage information, if it is determined that the linkage information does not carry initial identity information, the electronic device can also acquire the network device fingerprint in the network detection range, and then determine the target object identity based on the network device fingerprint, or determine the target object identity in combination with the biological behavior information.

[0202] For example, the smart elevator can identify the identity of the person after the person enters the elevator, and send the identity identification result (i.e., initial identity information) as linkage information to the smart door lock of the floor to be reached by the person. The smart elevator can also predict the time point of reaching the corresponding floor after the person enters the elevator and presses the floor button, and then send the time point as linkage information to the smart door lock of the floor to be reached. The smart elevator can also acquire the network device fingerprint of the network device carried by the person after the person enters the elevator, and send the network device fingerprint to the smart door lock of the floor to be reached, etc.

[0203] For example, the smart access control of the building can identify the identity of the person when the person opens the door and enters, and send the identity identification result (i.e., initial identity information) as linkage information to the smart door lock of the floor to be reached by the person. The floor to be reached by the person can be determined based on the identity identification result, for example, the identity identification result is that the person is a resident of the 5th floor, and the linkage information can be sent to the smart door lock of the 5th floor. The smart access control can also predict the time point of the person reaching the corresponding floor when the person opens the door and enters, and then send the time point as linkage information to the smart door lock of the floor to be reached by the person. The time point can be predicted according to the floor to be reached by the person, or determined in combination with the smart elevator, etc., which is not specially limited in the present specification.

[0204] As can be seen from the above description, the electronic device of the embodiment can acquire the linkage information about the target object sent by the linkage device linked with the electronic device, and then confirm the identity of the target object based on the linkage information. In the case where it is determined that the target object is a specific target object based on the identity of the target object, the electronic device can execute the privacy protection running mode for the specific target object, thereby avoiding collecting the biological information of the specific target object or blurring the collected biological information to avoid collecting the privacy information of the specific target object, thereby avoiding the risk of privacy leakage. At the same time, the identity of the target object is confirmed based on the linkage information sent by the linkage device, that is, the detection of the specific target object is realized by means of the linkage device, which can save the processing resources and power consumption of the electronic device to a certain extent.

[0205] In an optional embodiment of the present specification, the electronic device can also execute the switching of the running mode in advance based on the linkage information.

[0206] For example, in the case where the initial identity information of the target object is included in the linkage information, the electronic device can determine whether the switching of the running mode is needed based on the initial identity information. If the switching of the running mode is needed, the electronic device can directly execute the switching of the running mode when the target object reaches the network detection range, or execute the switching of the running mode in advance before reaching the network detection range.

[0207] For example, in the case where the initial identity information of the target object is included in the linkage information, the electronic device can determine whether the switching of the running mode is needed based on the initial identity information. If the switching of the running mode is needed, the electronic device can directly execute the switching of the running mode when the target object reaches the network detection range, or execute the switching of the running mode in advance before reaching the network detection range.

[0208] For example, assuming that the linkage information is the initial identity information of the target object sent by the intelligent elevator, for example, neighbor, and the future appearing time is 18:30, the electronic device can switch the running mode to the privacy protection running mode at 18:30 or 18:25.

[0209] For example, assuming that the linkage information is the initial identity information of the target object sent by the intelligent elevator, for example, neighbor, and the future appearing time is 18:30, the electronic device can switch the running mode to the privacy protection running mode at 18:30 or 18:25.

[0210] For example, in the case where the initial identity information of the target object is included in the linkage information, the electronic device can determine whether the switching of the running mode is needed based on the initial identity information. If the switching of the running mode is needed, the electronic device can directly execute the switching of the running mode when the target object reaches the network detection range, or execute the switching of the running mode in advance before reaching the network detection range.

[0211] For example, in the case where the initial identity information of the target object is included in the linkage information, the electronic device can determine whether the switching of the running mode is needed based on the initial identity information. If the switching of the running mode is needed, the electronic device can directly execute the switching of the running mode when the target object reaches the network detection range, or execute the switching of the running mode in advance before reaching the network detection range.

[0212] As can be seen from the above description, the electronic device of the embodiment can acquire the linkage information about the target object sent by the linkage device linked with the electronic device, and then switch the running mode in advance based on the linkage information, thereby significantly reducing the response delay of the conventional running mode switching when the target object is detected, and greatly improving the timeliness and reliability of the running mode switching of the electronic device.

[0213] Of course, the above are exemplarily described taking the privacy protection mode of the security monitoring scene as an example, and in other examples, are also applicable to the opening logic, closing logic, linkage logic, etc. of other types of running modes such as the tracking monitoring running mode and the reminding mode, and the present specification does not specially limit this.

[0214] Figure 5 FIG. 1 is a schematic diagram of a mode switching scene of an electronic device provided by an exemplary embodiment.

[0215] Please refer to Figure 5 In this scene, the electronic device performing the running mode switching logic is a smart door lock 50, when a person 51 appears in the detection range of the smart door lock 50, the smart door lock 50 can acquire the device fingerprint of the mobile phone (not shown) carried by the person 51 in the non-connected state, and then determine the identity of the person 51 based on the device fingerprint.

[0216] Suppose the identity of the person 51 is a neighbor, then it can be determined that the person 51 is a specific target object that needs to be protected for privacy, and then the device is switched from the regular running mode to the privacy protection running mode for the person 51, for example, the camera of the smart door lock is closed to the outside, so as to avoid collecting images carrying the privacy of the neighbor, such as the face of the neighbor. When the time length of the camera being closed reaches the preset time length, it can be considered that the neighbor has returned home or left the detection range, and then the camera of the smart door lock is reopened to the outside, so as to restore the regular running mode.

[0217] Suppose the identity of the person 51 is a suspicious person, then it can be determined that the person 51 is a dangerous target object that needs to be tracked and monitored, and then the device is switched from the regular running mode to the tracking monitoring running mode for the person 51, for example, the camera is controlled to track the dangerous target object to collect relevant images. When the dangerous target object leaves the network detection range, the running mode of the device can be restored to the regular running mode.

[0218] Next, the implementation process of the present specification will be introduced taking the electronic device as a terminal device such as a mobile phone, a tablet computer, a notebook computer, a wearable device, etc.

[0219] The above electronic device usually has a flight mode, also called aviation mode or fly mode, which can cut off all communication signals after being turned on, so as to avoid the emission and reception of device signals affecting the flight of the aircraft.

[0220] With the technical solutions provided in the specification, taking a mobile phone as an example, a network device fingerprint in a network detection range of the mobile phone can be acquired, and then a target object identity is determined based on the network device fingerprint. When the target object identity indicates that the target object is a network device deployed on an airplane, it indicates that the mobile phone is located on the airplane, and a user can be about to take a flight on the airplane, and then the mobile phone can be automatically switched to a flight mode.

[0221] In the embodiment, the mobile phone can acquire the network device fingerprint in the network detection range in a non-connected state. The non-connected state refers to that no valid communication link is established between the mobile phone and the network device in the network detection range. For example, no Bluetooth communication link is established between the mobile phone and the network device, and no Wi-Fi communication link is established. In the embodiment, the network device fingerprint is acquired in the non-connected state. During the whole process, the mobile phone and the network device do not need to establish a valid connection, the application range is wider, and meanwhile, the information leakage risk of the mobile phone caused by establishing a connection with the network device can be effectively avoided.

[0222] In the embodiment, the network device fingerprint of the network device deployed on the airplane usually carries a specific identifier for representing the identity of the network device, for example, an airline identifier can be carried in an SSID. The mobile phone can identify the identity of the target object as the network device on the airplane by analyzing and identifying the detected network device fingerprint.

[0223] As can be seen from the above description, with the above technical solutions provided in the specification, the mobile phone and other terminal devices can acquire a network device fingerprint in a network detection range, and determine the identity of a target object appearing in the network detection range based on the network device fingerprint. When the target object is a network device on an airplane, the mobile phone can be automatically switched to a flight mode, without manual switching by the user, and the user experience is greatly improved.

[0224] The network detection range and the network device fingerprint can refer to the specific description of the foregoing embodiments, which will not be described herein.

[0225] Figure 6 FIG. 1 is a schematic structural diagram of a device provided in an example embodiment. Please refer to Figure 6At the hardware level, the device includes a processor 602, an internal bus 604, a network interface 606, a memory 608, and a non-volatile memory 610, and can also include other hardware required by functions. One or more embodiments of the present specification can be implemented in a software manner, such as reading a corresponding computer program from the non-volatile memory 610 into the memory 608 by the processor 602 and then running. Of course, in addition to the software implementation, one or more embodiments of the present specification do not exclude other implementation manners, such as logic devices or a combination of software and hardware, and the like, that is, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or a logic device.

[0226] Please refer to Figure 7 , the mode switching device 700 of the electronic device can be applied to the device as shown in Figure 6 to implement the technical solutions of the present specification. Among them, the mode switching device 700 of the electronic device can include: a fingerprint acquisition unit 701, acquiring a network device fingerprint within a network detection range; an identity determination unit 702, determining a target object identity based on the network device fingerprint and / or device identity information sent by a linkage device; a mode switching unit 703, switching an operating mode based on the target object identity.

[0227] Optionally, the fingerprint acquisition unit 701 acquires a network device fingerprint within a network detection range, including: acquiring the network device fingerprint in a non-connected state within the network detection range; Among them, the non-connected state is that there is no effective communication link between the electronic device and the network device.

[0228] Optionally, the identity determination unit 702 determines a target object identity based on the network device fingerprint, including: identifying device identity and determining a target object identity based on the network device fingerprint; or determining a target object identity based on the network device fingerprint and combining biological behavior information.

[0229] Optionally, after determining the target object identity based on the network device fingerprint, it further includes: In the case of having a management list having a mapping relationship with the target object identity, adding the network device to the corresponding management list; In the case of not having a management list having a mapping relationship with the target object identity, creating a management list having a mapping relationship with the target object identity, and adding the network device to the corresponding management list.

[0230] Optionally, the electronic device further comprises a wireless communication module; before the network device fingerprint in the network detection range is acquired, the method further comprises: acquiring first historical detection information of a target object appearing in the network detection range detected by the wireless communication module in a first historical time period; predicting a future appearing time of the target object in the network detection range based on the first historical detection information; in response to the current time being a time point that is a first preset time length before the future appearing time, waking up the wireless communication module.

[0231] Optionally, the method further comprises: acquiring second historical detection information of a target object appearing in the network detection range detected by the electronic device in a second historical time period; determining a prediction result of a future behavior of the target object based on the second historical detection information; in response to the current time being a time point that is a second preset time length before a time point of the future behavior determined based on the prediction result, switching the running mode.

[0232] Optionally, after the running mode is switched based on the target object identity, the method further comprises: in response to a closing condition of the running mode switching being met, restoring the running mode of the electronic device to a state before the switching; or stopping the current running mode.

[0233] Optionally, before the network device fingerprint in the network detection range is acquired, the method further comprises: acquiring linkage information about the target object sent by a linkage device linked with the electronic device; determining whether the target object identity can be confirmed based on the linkage information.

[0234] Optionally, the determining whether the target object identity can be confirmed based on the linkage information comprises: in response to the initial identity information of the target object being included in the linkage information, determining that the target object identity can be confirmed based on the linkage information, and the target object identity being confirmed based on the initial identity information; in response to the initial identity information not being included in the linkage information, determining that the target object identity cannot be confirmed based on the linkage information; The method further comprises: in a case where the target object identity cannot be confirmed based on the linkage information, acquiring the network device fingerprint in the network detection range, and determining the target object identity based on the network device fingerprint.

[0235] Based on the same idea as the above method, the specification also provides an electronic device, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor implements the steps of the method as described in any of the above embodiments by running the executable instructions.

[0236] Based on the same idea as the above method, the specification also provides a computer-readable storage medium having stored thereon computer instructions which, when executed by a processor, implement the steps of the method as described in any of the above embodiments.

[0237] Based on the same idea as the above method, the specification also provides a computer program product comprising computer programs / instructions which, when executed by a processor, implement the steps of the method as described in any of the above embodiments.

Claims

1. A mode switching method of an electronic device, the method comprising: The method comprises: acquiring a network device fingerprint within a network detection range; determining a target object identity based on the network device fingerprint; switching a running mode based on the target object identity.

2. The method of claim 1, wherein, The acquiring of the network device fingerprint within the network detection range comprises: acquiring the network device fingerprint in a non-connected state within the network detection range; wherein the non-connected state refers to that no effective communication link is established between the electronic device and the network device.

3. The method of claim 1, wherein, The determining of the target object identity based on the network device fingerprint comprises: identifying a device identity and determining the target object identity based on the network device fingerprint; or determining the target object identity based on the network device fingerprint and in combination with biological behavior information.

4. The method of claim 1, wherein, After the determining of the target object identity based on the network device fingerprint, the method further comprises: in a case where a management list having a mapping relationship with the target object identity exists, adding the network device to the corresponding management list; or in a case where no management list having a mapping relationship with the target object identity exists, creating a management list having a mapping relationship with the target object identity and adding the network device to the corresponding management list.

5. The method of claim 1, wherein, The electronic device further comprises a wireless communication module; before the acquiring of the network device fingerprint within the network detection range, the method further comprises: acquiring first historical detection information of a target object within the network detection range detected by the wireless communication module in a first historical time period; predicting a future occurrence time of the target object within the network detection range based on the first historical detection information; in response to a current time being a time point that is a first preset time length before the future occurrence time, waking up the wireless communication module.

6. The method of claim 1, wherein, The method further comprises: acquiring second historical detection information of a target object within the network detection range detected by the electronic device in a second historical time period; determining a prediction result of a future behavior of the target object based on the second historical detection information; in response to a current time being a second preset time length before a time point at which the future behavior occurs as determined based on the prediction result, switching the running mode.

7. The method of claim 1, wherein, After the switching of the running mode based on the target object identity, the method further comprises: in response to a closing condition of the running mode switching being met, restoring the running mode of the electronic device to a state before the switching; or stopping the current running mode.

8. The method of claim 1, wherein, Before the acquiring of the network device fingerprint within the network detection range, the method further comprises: acquiring linkage information about the target object sent by a linkage device linked with the electronic device; determining whether the target object identity can be confirmed based on the linkage information.

9. The method of claim 8, wherein, The determining of whether the target object identity can be confirmed based on the linkage information comprises: in response to the initial identity information of the target object being included in the linkage information, determining that the target object identity can be confirmed based on the linkage information, and the target object identity is confirmed based on the initial identity information; in response to the initial identity information not being included in the linkage information, determining that the target object identity cannot be confirmed based on the linkage information. The method further comprises: In a case where the target object identity cannot be confirmed based on the linkage information, a network device fingerprint within a network detection range is acquired, and the target object identity is determined based on the network device fingerprint.

10. A mode switching apparatus of an electronic device, characterized by comprising: The apparatus comprises: a fingerprint acquisition unit configured to acquire a network device fingerprint within a network detection range; an identity determination unit configured to determine a target object identity based on the network device fingerprint and / or device identity information sent by a linkage device; a mode switching unit configured to switch an operation mode based on the target object identity.

Images