Electronic device linkage method, apparatus, device, medium, and program product

Abstract

One or more embodiments of the present specification provide a linkage method, apparatus, device, medium and program product of an electronic device. The method comprises: obtaining linkage information about a target object sent by a linkage device linked with the electronic device; confirming the identity of the target object based on the linkage information; in response to determining that the target object is a specific target object based on the identity of the target object, performing a specific action for the specific target object.

Description

TECHNICAL FIELD

[0001] One or more embodiments of the present specification relate to the technical field of security, and in particular to a linkage method, device, equipment, medium and program product of an electronic device. BACKGROUND

[0002] Electronic devices such as smart door locks and security monitoring devices commonly integrate functions such as face recognition, wide-angle camera, remote monitoring, and human body sensing. These technologies can support electronic devices to perform different actions in different scenarios. However, the current action switching relies on manual user settings, which has technical problems such as complicated operation procedures. SUMMARY

[0003] Therefore, one or more embodiments of the present specification provide technical solutions as follows:

[0004] According to a first aspect of one or more embodiments of the present specification, a linkage method of an electronic device is provided, including:

[0005] obtaining linkage information about a target object sent by a linkage device linked with the electronic device;

[0006] confirming the identity of the target object based on the linkage information;

[0007] in response to determining that the target object is a specific target object based on the identity of the target object, performing a specific action for the specific target object.

[0008] Optionally, the confirming the identity of the target object based on the linkage information includes:

[0009] in response to the linkage information including initial identity information of the target object, determining the identity of the target object based on the initial identity information; or

[0010] in response to the linkage information not including the initial identity information, obtaining network device fingerprints within a network detection range based on the linkage information, and determining the identity of the target object based on the obtained network device fingerprints.

[0011] Optionally, the determining that the target object is a specific target object based on the identity of the target object includes:

[0012] in response to the identity of the target object satisfying a preset condition, determining that the target object is a specific target object.

[0013] Optionally, the obtaining network device fingerprints within a network detection range includes:

[0014] acquire the network device fingerprint in a non-connected state within the network detection range; the non-connected state is that no valid communication link is established between the electronic device and the network device.

[0015] Optionally, the linkage information includes one or more of: a time point at which the target object is expected to appear within the network detection range, the network device fingerprint, initial identity information, behavior data of the linkage device, and abnormal floor access.

[0016] Optionally, the specific action includes a privacy protection action, and the privacy protection action includes one or more of:

[0017] turning off the biological information collection module, adjusting an angle of the biological information collection module to misalign with the specific target object, reducing resolution of the biological information collection module, and performing blur processing on an image collected by the biological information collection module.

[0018] According to a second aspect of one or more embodiments of the present specification, a linkage device of an electronic device is provided, including:

[0019] an information acquisition unit configured to acquire linkage information about a target object sent by a linkage device linked with the electronic device;

[0020] an identity confirmation unit configured to confirm a target object identity based on the linkage information;

[0021] an action execution unit configured to, in response to determining that the target object is a specific target object based on the target object identity, perform a specific action for the specific target object.

[0022] According to a third aspect of one or more embodiments of the present specification, an electronic device is provided, including: a processor; a memory for storing processor-executable instructions; wherein the processor implements the steps of the foregoing method by running the executable instructions.

[0023] According to a fourth aspect of one or more embodiments of the present specification, a computer-readable storage medium is provided, having stored thereon computer instructions that, when executed by a processor, implement the steps of the foregoing method.

[0024] According to a fifth aspect of one or more embodiments of the present specification, a computer program product is provided, including computer programs / instructions that, when executed by a processor, implement the steps of the foregoing method.

[0025] It can be seen from the above description that the above scheme provided in the specification can automatically implement the execution of the specific action of the electronic device without manual operation, greatly simplifies the execution process of the specific action, and improves the user experience. Moreover, through the non-connection communication means, the device characteristic information of the target electronic device is collected without induction to generate the device fingerprint for identity recognition. This process avoids establishing a data connection channel with the target device, thereby reducing the risk of user privacy data leakage from the root. Through collaborative verification with one or more linkage devices, joint decision is made based on the auxiliary authentication information collected by the linkage device, and the identity of the person is determined together to overcome the limitations and unreliability of a single identification mode, and improve the accuracy and robustness of the authentication result. Based on the priority contact or early interaction with the linkage device, the privacy protection mode of the system is triggered before the target object is formally identified, thereby achieving earlier and more proactive protection of sensitive information. BRIEF DESCRIPTION OF DRAWINGS

[0026] Figure 1 FIG. 1 is a flowchart of a linkage method of an electronic device provided by an example embodiment.

[0027] Figure 2 FIG. 2 is a flowchart of a specific target object determination method provided by an example embodiment.

[0028] Figure 3 FIG. 3 is a privacy protection scene schematic diagram provided by an example embodiment.

[0029] Figure 4 FIG. 4 is a structural schematic diagram of a device provided by an example embodiment.

[0030] Figure 5 FIG. 5 is a block diagram of a linkage device of an electronic device provided by an example embodiment. DETAILED DESCRIPTION

[0031] Electronic devices such as smart door locks, security monitoring, etc. generally integrate face recognition, wide-angle camera, remote monitoring, human body sensing, etc. These technologies have improved security efficiency, but they may also cover the access path or indoor space of neighbors, visitors, etc., leading to privacy leakage risk.

[0032] Taking a smart door lock as an example, the smart door lock is usually provided with a camera for external shooting, which can collect images around the door to realize security monitoring. In this process, the camera may collect the face image of the neighbor, and when the neighbor opens the door, it may also collect the indoor image of the neighbor's house, leading to privacy leakage risk.

[0033] The present specification provides a privacy protection implementation scheme, which can be cooperated with a linkage device to perform a privacy protection action on a specific target object to avoid collecting privacy information of the specific target object and thus avoid the risk of privacy leakage.

[0034] Figure 1 is a flowchart of a privacy protection implementation method provided by an exemplary embodiment.

[0035] In the present specification, the privacy protection implementation method can be applied to an electronic device with a biological information collection module, which can be a smart door lock or other monitoring devices such as a camera system, a smart doorbell, etc.

[0036] The biological information collection module can include an image collection module, a biological behavior information collection module, a biological physiological information collection module, etc. Among them, the image collection module can be a camera module such as a camera; the biological behavior information collection module can be a speed sensor capable of collecting biological motion speed, a tracking module capable of tracking biological motion, etc.; the biological physiological information collection module can be a palm print collection module, a human subcutaneous vein information collection module, a voiceprint information collection module, a gait information collection module, etc., which are not specially limited in the present specification.

[0037] Please refer to Figure 1 The privacy protection implementation method can include the following steps:

[0038] Step 102, obtaining linkage information about a target object sent by a linkage device linked with an electronic device.

[0039] In the present specification, the linkage device linked with the electronic device is usually other smart devices in the environment where the electronic device is located, and the linkage device can establish a communication link with the electronic device for communication.

[0040] Taking the electronic device as a smart door lock, the linkage device includes smart elevators, smart access control, smart lights, and other smart devices in the surrounding environment of the smart door lock.

[0041] The target object can be a biological object or a network device.

[0042] For example, the target object can be a person, such as a person appearing in the detection range of the smart door lock.

[0043] For example, the target object is a network device, such as a terminal device such as a mobile phone carried by a person appearing in the detection range of the smart door lock.

[0044] The linkage information can include one or more of the following: a time point at which the target object is expected to appear in a network detection range, a network device fingerprint, initial identity information of the target object, behavior data of the linkage device, and an abnormal floor access.

[0045] The network detection range can be understood as a range that can be actually detected by the electronic device, for example, a range covered by a Bluetooth module in the electronic device, a range covered by a Wi-Fi module in the electronic device, and the like. The time point at which the target object is expected to appear in the network detection range can be determined by the linkage device, for example, the linkage device can predict the time point according to behavior information of the target object.

[0046] For example, assuming that the linkage device is a smart elevator and the target object is a person, the smart elevator can predict a time point of reaching a floor pressed by the person as the time point at which the target object is expected to appear in the network detection range. Assuming that the linkage device is a smart access control and the target object is a person, the smart access control can predict a time point at which the person is expected to appear in the network detection range according to a time point at which the person opens the door, and the like.

[0047] The network device fingerprint can be information of a network device obtained by the linkage device, which can identify the identity of the network device. The information can be actively sent by the network device to the linkage device and intercepted by the linkage device, or can be actively obtained by the linkage device through detection.

[0048] The initial identity information of the target object can be determined by the linkage device based on the obtained network device fingerprint, or can be determined based on the obtained network device fingerprint in combination with biological behavior information of the person, or can be obtained by the linkage device directly identifying the identity of the target object, and the like, which are not specially limited in the present specification.

[0049] The behavior data of the linkage device can include scheduling data and switch data of the linkage device. Taking the linkage device as a smart elevator as an example, the behavior data can include scheduling data of the smart elevator, which is usually related to the target object, for example, the target object schedules the smart elevator to reach a floor where the target object is located, and goes to a specified floor, and the like. Taking the linkage device as a smart access control as an example, the behavior data can include switch data of the smart access control, which is usually also related to the target object, for example, the target object opens the smart access control, and the like.

[0050] It is worth noting that the linkage device sends the linkage information of the target object to an electronic device that will be able to detect the target object. Taking the smart elevator as an example, the linkage information related to the target object can be sent to an electronic device of a floor to which the target object is to arrive, rather than being sent to electronic devices of all floors.

[0051] The abnormal floor access is usually an abnormal floor access behavior of the target object discovered by the linkage device. Taking the linkage device as a smart elevator for example, it is assumed that the target object is identified as a resident on the 5th floor. If the target object dispatches the smart elevator to the 8th floor (for example, presses the 8th floor button), it is considered as an abnormal floor access. Taking the linkage device as a smart access control for example, it is assumed that the target object is not an authorized user of the smart access control, and it is considered as an abnormal floor access.

[0052] In step 104, the identity of the target object is confirmed based on the linkage information.

[0053] Based on the foregoing step 102, after the linkage information is acquired, the electronic device can determine the identity of the target object based on the linkage information.

[0054] In one example, if the initial identity information of the target object is included in the linkage information, the initial identity information of the target object can be directly used to determine the identity of the target object.

[0055] For example, if the initial identity information of the target object is included in the initial identity information, the initial identity information of the target object can be directly used, and the electronic device does not need to reconfirm the identity of the target object.

[0056] For another example, if the network device fingerprint is included in the initial identity information, the electronic device can directly determine the identity of the target object based on the network device fingerprint, or jointly determine the identity of the target object in combination with the biological behavior information.

[0057] In yet another example, if the initial identity information is not included in the linkage information, the network device fingerprint in the network detection range can be acquired based on the linkage information, and the identity of the target object can be determined based on the acquired network device fingerprint, or jointly determined in combination with the biological behavior information.

[0058] For example, the linkage information can carry an instruction for instructing the electronic device to confirm the identity of the target object. After receiving the linkage information, the electronic device can acquire the network device fingerprint in the network detection range in response to the instruction, and then determine the identity of the target object based on the network device fingerprint, or jointly determine the identity of the target object in combination with the biological behavior information.

[0059] For another example, the linkage information can not carry an instruction for instructing the electronic device to confirm the identity of the target object. After receiving the linkage information, if it is determined that the initial identity information is not included in the linkage information, the electronic device can also acquire the network device fingerprint in the network detection range, and then determine the identity of the target object based on the network device fingerprint, or jointly determine the identity of the target object in combination with the biological behavior information.

[0060] The specific confirmation process of the target object identity will be described in detail in subsequent embodiments.

[0061] Step 106: In response to determining that the target object is a specific target object based on the target object identity, performing a specific action for the specific target object.

[0062] Based on the foregoing step 104, in the case of confirming that the target object is a specific target object, the biological information collection module can be controlled to perform a specific action for the specific target object. The specific action can include a privacy protection action, and can also include a tracking monitoring action, a reminding action, etc.

[0063] The privacy protection action includes one or more of the following:

[0064] Turning off the biological information collection module, adjusting the angle of the biological information collection module to misalign with the specific target object, reducing the resolution of the biological information collection module, and performing blur processing on the image collected by the biological information collection module.

[0065] For example, turning off the camera, adjusting the angle of the camera to misalign with the specific target object, reducing the resolution of the image collected by the camera, and performing blur processing on the image collected by the camera to blur the privacy information, etc.

[0066] For another example, turning off the audio collection module, turning off the palmprint collection module, etc.

[0067] In an exemplary door monitoring scenario, the smart door lock determines that the target object identity is a neighbor, and determines that the target object is a specific target object that needs privacy protection, and then turns off the external camera to not collect the neighbor image, thereby avoiding collecting the neighbor's face, the neighbor's indoor image, and other privacy information.

[0068] In an exemplary indoor monitoring scenario of a family, the smart door lock determines that the target object identity is a family member, and determines that the target object is a specific target object that needs privacy protection, and then turns off the internal camera to not collect the indoor image, thereby avoiding collecting the family member's face image and other privacy information.

[0069] In other examples, when the target object is determined to be a specific target object that needs to be monitored based on the target object identity, a tracking monitoring action can be performed, for example, a tracking monitoring action can be performed for the dangerous target object. The tracking monitoring action can include: turning on all biological information collection modules, adjusting the angle of the biological information collection module to track the dangerous target object, etc.

[0070] For example, adjusting the angle of the camera to track the dangerous target object in real time, increasing the resolution of the image collected by the camera, etc.

[0071] For another example, the audio collection module is started, the palm print collection module is started, and the like.

[0072] As can be seen from the above description, by using the above scheme provided in the specification, the electronic device can acquire linkage information about a target object sent by a linkage device linked with the electronic device, then confirm the identity of the target object based on the linkage information, and can execute a specific action for a specific target object in a case where it is determined that the target object is the specific target object based on the identity of the target object, thereby realizing automatic execution of the specific action without manual operation, greatly improving the user experience. At the same time, in a case where the specific action is a privacy protection action, the biological information of the specific target object can be avoided to be collected, or the biological information collected is blurred, so as to avoid the privacy information of the specific target object to be collected, thereby avoiding the risk of privacy leakage. At the same time, the identity of the target object is confirmed based on the linkage information sent by the linkage device, that is, the detection of the specific target object is realized by means of the linkage device, which can save the processing resources and power consumption of the electronic device to a certain extent.

[0073] The implementation process of the specification will be described in detail from the following three aspects of sending of linkage information, determination of a specific target object, execution of a specific action, and closing of a specific action.

[0074] I. Sending of Linkage Information

[0075] In the specification, the linkage device linked with the electronic device is usually other smart devices in the environment where the electronic device is located, and the linkage device can establish a communication link with the electronic device to communicate.

[0076] Taking the electronic device as a smart door lock, the linkage device includes smart elevators, smart access control, smart lights, and other smart devices in the surrounding environment of the smart door lock. The linkage device can also be a management device in the community / park where the smart door lock is located, which can manage smart elevators, smart access control, smart lights, and other smart devices in the public area of the corresponding community / park.

[0077] For example, the smart elevator can identify the identity of the person after the person enters the elevator, and send the identity recognition result (i.e., initial identity information) as linkage information to the smart door lock of the floor to be reached by the person. The smart elevator can also predict the time point of reaching the corresponding floor after the person enters the elevator and presses the floor button, and then send the time point as linkage information to the smart door lock of the floor to be reached. The smart elevator can also obtain the network device fingerprint of the network device carried by the person after the person enters the elevator, and send the network device fingerprint to the smart door lock of the floor to be reached, and the like.

[0078] For example, the intelligent access control of the building can identify the identity of the person when the person opens the door to enter, and send the identity recognition result (i.e., initial identity information) as linkage information to the intelligent door lock of the floor to be reached by the person. The floor to be reached by the person can be determined based on the identity recognition result. For example, the identity recognition result is that the person is a resident of the 5th floor, and the linkage information can be sent to the intelligent door lock of the 5th floor. The intelligent access control can also predict the time point at which the person reaches the corresponding floor when the person opens the door to enter, and then send the time point as linkage information to the intelligent door lock of the floor to be reached by the person. The time point can be predicted according to the floor to be reached by the person, or determined by the intelligent elevator, etc. The present specification does not make special limitations on this.

[0079] II. Determination of a specific target object

[0080] In the present specification, after receiving the linkage information sent by the linkage device, the electronic device can confirm the identity of the target object based on the linkage information.

[0081] In one example, if the initial identity information of the target object is included in the linkage information, the initial identity information can be directly used to determine the specific target object, without the need to re-identify the identity of the target object, thereby saving the processing resources and power consumption of the electronic device.

[0082] In another example, if the initial identity information is included in the linkage information, for example, the initial identity information is a network device fingerprint obtained by the linkage device, the electronic device can determine the identity of the target object based on the network device fingerprint, without the need to re-obtain the network device fingerprint, thereby saving the detection resources of the electronic device.

[0083] In yet another example, if the initial identity information is not included in the linkage information, the electronic device can itself obtain the network device fingerprint within the detection range and confirm the identity of the target object.

[0084] Suppose that the linkage information includes a time point at which the target object is expected to appear within the network detection range of the device, then the network device fingerprint can be obtained within the network detection range at the time point or at a preset time point before the time point, and the identity of the target object can be determined based on the obtained network device fingerprint.

[0085] For example, suppose that the linkage information includes that the target object is expected to arrive at 13:00, then the electronic device can start to obtain the network device fingerprint within the network detection range at 13:00 or 12:58.

[0086] It is assumed that the linkage information includes behavior data of the linkage device, such as the time point of opening the intelligent access control, and the electronic device can predict the time point at which the target object is expected to arrive in the network detection range according to the time point of opening the intelligent access control, and then perform acquisition of the network device fingerprint at or before the time point.

[0087] It is assumed that the linkage information includes instructions for instructing the electronic device to perform identity confirmation of the target object, and the electronic device can start to acquire the network device fingerprint in the network detection range and perform identity confirmation of the target object after receiving the linkage information.

[0088] The electronic device can acquire the network device fingerprint in the detection range in the non-connected state to determine the identity of the target object.

[0089] Specifically, in the case of a target object being a person, the network device is usually carried by the target object, such as a mobile phone, a wearable device, a tablet computer, etc. carried by the target object. In the case of a target object being a network device, the network device is usually the target object.

[0090] The non-connected state means that no effective communication link is established between the electronic device and the network device in the detection range. For example, no Bluetooth communication link is established between the electronic device and the network device, and no Wi-Fi communication link is established. The non-connected state is usually the state before the electronic device and the network device are paired to establish a communication link, in other words, the electronic device acquires the network device fingerprint and performs identity confirmation of the target object before establishing a connection between the electronic device and the network device.

[0091] The network device fingerprint can be information of the network device detected by the electronic device in its detection range, which can identify the identity of the network device. The information can be actively sent by the network device and intercepted by the electronic device, or actively detected and obtained by the electronic device.

[0092] Exemplarily, the electronic device can capture the data packet transmitted by the network device in the detection range through the BLE (Bluetooth Low Energy) sniffing function of the Bluetooth device to obtain the network device fingerprint. For example, the device identifier (Hashed MAC) in the broadcast packet, the signal strength (RSSI, Received Signal Strength Indicator), the service UUID (Universally Unique Identifier), and the transmission power are captured. The random MAC tracking technology is used: the broadcast packet length, the carrier frequency offset (CFO, Carrier Frequency Offset), and the radio frequency fingerprint of the same device are established.

[0093] Exemplarily, the electronic device can parse the Wi-Fi signal appearing nearby through the deep parsing function of the Wi-Fi module to obtain the network device fingerprint. For example, the SSID (Service Set Identifier), the Vendor OUI (Organizationally Unique Identifier), and the supported rate are extracted from the Probe Request frame.

[0094] In the present specification, the electronic device can obtain the network device fingerprint in the detection range in a non-connected manner, and can also obtain the network device fingerprint in the detection range in multiple non-connected manners, which is not specially limited in the present specification.

[0095] In the present specification, the network device fingerprint is obtained in a non-connected manner to determine the identity of the target object, and in the entire process, the electronic device and the network device do not need to establish an effective connection. On the one hand, the application range is wider, and the network device fingerprint of a stranger can also be obtained to determine the identity. On the other hand, the risk of information leakage of the electronic device caused by establishing a connection with the network device can also be effectively avoided.

[0096] After the electronic device obtains the network device fingerprint, the identity of the target object can be determined based on the network device fingerprint, or the identity of the target object can be determined based on the network device fingerprint and combined with the biological behavior information. The biological behavior information can include: moving speed, moving direction, step length, step frequency, moving range, and stay duration in different space regions, and can also be obtained in the detection range. Of course, in other examples, the identity of the target object can also be determined based on the biological behavior information only, which is not specially limited in the present specification.

[0097] In an embodiment, in identifying the device identity based on the network device fingerprint, at least one feature indicator value of at least one dimension of the device feature can be extracted from the network device fingerprint, and the device identity of the corresponding network device is determined according to the at least one feature indicator value.

[0098] In an embodiment, the dimensions of the device feature can be divided into a physical dimension, a protocol dimension, and a behavior dimension, wherein: the feature indicators of the physical features of the physical dimension include but are not limited to carrier frequency offset, modulation error, and signal strength fluctuation standard deviation; the feature indicators of the protocol features of the protocol dimension include but are not limited to BLE service and Wi-Fi probe; and the feature indicators of the behavior features of the behavior dimension include but are not limited to time period activity, stay duration, and movement trajectory.

[0099] Wherein, the extraction manner of the carrier frequency offset, the modulation error, and the signal strength fluctuation standard deviation is not limited in any way, the BLE service can exemplarily extract the UUID, and the Wi-Fi probe can exemplarily extract the Wi-Fi channel width or OUI.

[0100] And the time period activity, the stay duration, and the movement trajectory can be indicators calculated comprehensively according to the detection results, for analyzing the behavior information of the target object.

[0101] Exemplarily, the time period activity can calculate the active interval of the target object within 24 hours through -∑(p*log2(p)), so as to capture the regularity of the appearance time of the target object. Wherein, P can be the probability of appearing in a certain time interval. Wherein, the smaller the time period activity is, the more fixed the time period of the appearance of the target object is.

[0102] Exemplarily, the stay duration coefficient of variation can be represented by the ratio of the standard deviation and the average value of the stay duration of the same network device within a week. This indicator can be used to analyze the regularity of the stay duration of the target object.

[0103] Exemplarily, the movement trajectory smoothness can be measured by the ratio of the straight line distance and the actual path length of the target object. The closer the ratio is to 1, the closer the movement path of the target object is to a straight line, and the closer the ratio is to 0, the greater the degree of detour of the movement path of the target object is.

[0104] In an embodiment, in determining the device identity of the corresponding network device according to the feature indicator value, at least one feature indicator value can be fused to obtain a first fusion indicator value of the corresponding dimension, and the device identity of the corresponding network device is determined according to the first fusion indicator value of the corresponding dimension.

[0105] Exemplarily, if the device features are divided into one dimension, and there is only one feature index value in the dimension, the device identity of the corresponding network device can be determined based on the feature index value.

[0106] Exemplarily, if the device features are divided into one dimension, and there are multiple feature index values in the dimension, the multiple feature index values can be fused to obtain a first fused index value, and the device identity of the corresponding network device can be determined according to the first fused index value.

[0107] Exemplarily, if the device features are divided into multiple dimensions, and there is at least one feature index value in each dimension, at least part of the feature index values of at least part of the dimensions can be selected for fusion processing to obtain a first fused index value of the corresponding dimension, and the device identity of the corresponding network device can be determined according to the first fused index value of the corresponding dimension.

[0108] For example, for the A dimension, a1, a2 and a3 are included in the dimension; for the B dimension, b1 and b2 are included in the dimension; and for the C dimension, c1, c2 and c3 are included in the dimension. The first fused index value of the A dimension can be determined according to a1 and a2; the first fused index value of the B dimension can be determined according to b1 and b2; the first fused index value of the C dimension can be determined according to c1, c2 and c3; and the device identity of the corresponding network device can be determined according to the first fused index values of the respective dimensions.

[0109] In an embodiment, when the device identity of the corresponding network device is determined according to the first fused index value of the corresponding dimension, the current environment scenario category can be determined, the first weight of each first fused index value corresponding to the current environment scenario category can be obtained, or the first weight of each first fused index value can be adaptively determined. The first fused index values are fused according to the first weight to obtain a second fused index value, and the device identity of the corresponding network device is determined according to the second fused index value.

[0110] For example, the environment scenario can be divided into a night mode, a strong interference environment mode and a long-term monitoring mode. For the night mode, the physical layer weight is greater than the behavior layer weight, which is greater than the protocol layer weight; for the strong interference environment mode, the physical layer weight is greater than or equal to the protocol layer weight, which is greater than the behavior layer weight; and for the long-term monitoring mode, the physical layer weight is less than the protocol layer weight, which is less than the behavior layer weight. The environment scenario category can be set by the user on the terminal, and the electronic device can fuse the first fused index values of the respective dimensions according to the weight corresponding to the environment scenario category set by the user to obtain a second fused index value.

[0111] In an embodiment, when weighting is performed, the confidence can also be used for weighting, as shown in the following formula:

[0112]

[0113] Ω is a second fusion index value, is a weight of the kth layer dimension in the fusion processing, is a confidence of the first fusion index value of the kth layer dimension, is a first fusion index value of the kth layer dimension.

[0114] In an embodiment, when determining the device identity of the corresponding network device according to the feature index value, the recognition result can be generated according to the feature index value, and the device identity of the corresponding network device is determined according to the recognition result.

[0115] The recognition result can be represented by any feature index value. For example, the size of the feature index value of the device feature of any dimension can be used as the recognition result.

[0116] The recognition result can also be represented by the first fusion index value or the second fusion index value. For example, the first fusion index value obtained by fusing a plurality of feature index values of any dimension can be used as the recognition result. For example, the second fusion index value obtained by fusing the first fusion index values of different dimensions can be used as the recognition result.

[0117] For example, in the example of monitoring the scene of the home door, the recognition result can be normalized in [0, 1], assuming that [0, 0.3] corresponds to the identity of the household, (0.3, 0.6] corresponds to the identity of the neighbor, and (0.6, 1] corresponds to the identity of others. Then the identity of the corresponding target object can be determined according to the interval in which the recognition result is located. For example, if the recognition result is 0.45, the identity of the target object can be determined as a neighbor. The interval size of the value is closely related to the application scenario, and a person skilled in the art can reset the identity type corresponding to the numerical interval in which different recognition results are located according to actual needs.

[0118] Specifically, assuming that at least one feature index value of the physical dimension, the protocol dimension and the behavior dimension is extracted from the network device fingerprint. Any feature index value can be used as a recognition result for identity recognition. For example, the feature index value 1 of the physical dimension is 0.45, and the identity of the target object can be determined as a neighbor.

[0119] The plurality of characteristic index values in any dimension are fused to obtain a first fusion index value. Any fusion index value can be used alone as an identification result for identity identification. For example, the first fusion index value corresponding to the physical dimension is 0.45, and the identity of the target object can be determined as a neighbor. Or, the first fusion index corresponding to the protocol dimension is 0.45, and the identity of the target object can be determined as a neighbor. When performing fusion processing, the plurality of characteristic index values can be weighted, and higher weights are given to characteristic index values with high importance, and lower weights are given to characteristic index values with low importance.

[0120] The plurality of first fusion index values are fused to obtain a second fusion index value. The second fusion index value can be used as an identification result for identity identification. For example, the second fusion index value is 0.45, and the identity of the target object can be determined as a neighbor. When performing fusion processing, the plurality of first fusion index values can be weighted, and higher weights are given to first fusion index values with high importance, and lower weights are given to first fusion index values with low importance.

[0121] Optionally, in another embodiment of the present specification, after obtaining the network device fingerprint, the identity of the corresponding network device can also be found in a preset identity list. The identity list can be manually set in advance, or updated based on the network device identity determined based on the device fingerprint of the network device that appeared in the history. The identity list can include a neighbor list, a family member list, etc. Of course, the neighbor list, the family member list, etc. can also be integrated into one identity list.

[0122] Optionally, in another embodiment of the present specification, after obtaining the network device fingerprint, the historical detection information obtained by detecting the network device in the history can also be obtained according to the network device fingerprint. The historical detection information can also include physical layer information, protocol layer information and behavior layer information, and then the network device identity is determined by comprehensively combining the historical detection information.

[0123] After confirming the identity of the target object, if the identity of the target object meets a preset condition, the target object is determined to be a specific target object.

[0124] For example, when the identity of the target object meets a first preset condition, the target object is determined to be a specific target object that needs to be protected. The first preset condition can be set in advance, such as a neighbor, a family member, etc.

[0125] For another example, the target object can be determined as a specific target object that needs to be tracked and monitored when the target object identity meets a second preset condition, which can also be preset, such as a suspicious person. Of course, the specific target object described above is only an example, and other types of specific target objects can also be included in actual applications, which are not specially limited in the specification.

[0126] III. Execution of specific actions

[0127] In the specification, the specific action can include a privacy protection action, a tracking and monitoring action, and the like. The privacy protection action is taken as an example below.

[0128] In an embodiment, when the target object is determined as a specific target object that needs to be protected based on the target object identity, a privacy protection action can be executed for the specific target object immediately. For example, the camera can be turned off, the resolution of the camera can be reduced, and the like.

[0129] In another embodiment, when the target object is determined as a specific target object that needs to be protected based on the target object identity, it can be further determined whether an execution condition of the privacy protection action is met, and if the execution condition is met, the privacy protection action can be executed for the specific target object. If the execution condition is not met, the privacy protection action for the specific target object can not be executed temporarily.

[0130] For example, the execution condition can be that the actual distance between the specific target object and the electronic device is less than or equal to a first distance threshold, which is preset. For example, after the electronic device determines that the target object is a specific target object, the actual distance between the electronic device and the specific target object can be detected, and the size relationship between the actual distance and the first distance threshold can be determined, and the privacy protection action for the specific target object can be executed when the actual distance is less than or equal to the first distance threshold.

[0131] The actual distance can be detected by a distance sensor, or can be determined by the signal strength between the network device and the electronic device, which is not specially limited in the specification.

[0132] Optionally, when the actual distance between the specific target object and the electronic device is less than or equal to a second distance threshold, the duration that the actual distance between the specific target object and the electronic device is less than or equal to the second distance threshold can also be recorded, and if the duration is greater than a first time threshold, it means that the specific target object stays near the electronic device for a long time, and in order to ensure safety, it can be determined that the switching condition is met, and the electronic device can be restored to the state before the privacy protection action is executed, or the privacy protection action for the specific target object can be stopped.

[0133] The second distance threshold is less than or equal to the first distance threshold.

[0134] For example, assuming that the actual distance between the specific target object and the electronic device is less than or equal to the first distance threshold, the electronic device closes the camera to stop image acquisition, but the actual distance between the specific target object and the electronic device is less than or equal to the second distance threshold for too long, which is greater than or equal to the first time threshold, the camera can be opened to restart image acquisition.

[0135] For example, the electronic device can continue to detect the signal strength of the network device after determining that the target object is the specific target object, judge the size relationship between the signal strength and the first strength threshold, and can execute the privacy protection action for the specific target object when the detected signal strength is greater than or equal to the first strength threshold.

[0136] Optionally, when the signal strength of the network device is greater than or equal to the second strength threshold, the duration of the signal strength greater than or equal to the second strength threshold can also be recorded, and if the duration is greater than the second time threshold, it means that the specific network device stays near the electronic device for a long time, and in order to ensure safety, the switching condition can be determined, the electronic device can be restored to the state before the privacy protection action is executed, or the privacy protection action for the specific target object can be stopped.

[0137] The second strength threshold is greater than or equal to the first strength threshold. The second time threshold can be equal to the first time threshold, or can not be equal to the first time threshold.

[0138] For example, assuming that the signal strength of the network device is greater than or equal to the first strength threshold, the electronic device closes the camera to stop image acquisition, but the signal strength of the network device is greater than or equal to the second distance threshold for too long, which is greater than or equal to the second time threshold, the camera can be opened to restart image acquisition.

[0139] As can be seen from the above description, in the embodiment, when the target object is determined to be the specific target object based on the identity of the target object, it is judged whether the execution condition of the privacy protection action is met, and the privacy protection action is executed for the specific target object when the execution condition is met, so that the execution time of the privacy protection action is more accurately controlled, the monitoring deficiency caused by the too early execution of the privacy protection action is avoided, and the monitoring safety is ensured.

[0140] Of course, for other types of specific actions such as tracking and monitoring actions, corresponding execution conditions can also be set, which are not specially limited in the specification.

[0141] IV. Turning off of a specific action

[0142] In the present specification, the specific action can include a privacy protection action, a tracking monitoring action, etc. The following takes the privacy protection action as an example for illustration.

[0143] In an embodiment, to ensure the monitoring effectiveness of the electronic device, the electronic device needs to turn off the privacy protection action after performing the privacy protection action on the specific target object. Please refer to Figure 2 may include the following steps:

[0144] Step 202: Determine whether the switching condition is met.

[0145] In the present specification, the electronic device can determine whether the switching condition is met after performing the privacy protection action on the specific target object. The switching condition can be preset.

[0146] For example, the switching condition includes that the time length of performing the privacy protection action on the specific target object reaches a preset time length. The preset time length can represent the time length of the specific target object leaving the detection range, which can be preset based on experience, such as 5 seconds, 10 seconds, etc.

[0147] Specifically, after performing the privacy protection action on the specific target object, a timer can be started to start timing. When the timing reaches the preset time length, it can be determined that the switching condition is met.

[0148] For example, the switching condition includes that no specific target object is detected in the detection range. For the electronic device, the target object appearing in the detection range can be continuously detected. When it is determined that no specific target object appears in the detection range, it can be determined that the switching condition is met.

[0149] In this case, no specific target object appearing in the detection range can mean that no target object appears in the detection range, or that a target object appears in the detection range but the identified target object is not the specific target object. These situations can all indicate that the specific target object that needs to be protected by privacy has left the detection range.

[0150] For example, the switching condition includes that a state change of another electronic device in a preset range is sensed. The type of the other electronic device can be the same as or different from the electronic device. Assuming that the electronic device is a smart door lock, the other electronic device can also be a smart door lock (such as a smart door lock of a neighbor's house), a door monitoring device (such as a smart cat eye), a corridor device, etc.

[0151] The state change can include an information interaction state change and / or a running action state change. In other words, the electronic device can determine that the switching condition is met when the information interaction state change of the other electronic device is sensed; can determine that the switching condition is met when the running action state change of the other electronic device is sensed; and can determine that the switching condition is met when the information interaction state change of the other electronic device is sensed and the running action state also changes.

[0152] The information interaction state change can include disconnection of a connection state, network signal strength change and / or scheduling signal switching.

[0153] The disconnection of the connection state can be disconnection of a network device connected to the other electronic device, which can represent that the network device previously connected to the other electronic device is away from the coverage range of the other electronic device. Assuming that the other electronic device is a neighbor door lock, the disconnection of the connection state can be disconnection of the neighbor door lock and a network device such as a mobile phone or computer previously connected thereto. Still taking the smart door lock as an example, the neighbor door lock (other electronic device) can establish a connection with a network device (mobile phone, computer, wearable device, etc.) of a neighbor family member (i.e., neighbor), for example, the neighbor's mobile phone can establish a connection with the neighbor door lock after the neighbor comes home. When the neighbor door lock and the neighbor's mobile phone are disconnected, it usually indicates that the neighbor has left home, and in this case, the neighbor has also left the detection range of the smart door lock, and thus it can be determined that the switching condition is met.

[0154] It is worth noting that the above connection state usually refers to direct connection, for example, a communication connection directly established between the smart door lock and the network device, and the disconnection of the above connection state usually refers to disconnection of the direct communication connection, for example, disconnection of the communication connection directly established between the smart door lock and the network device. Disconnection of an indirect connection state through a server, for example, connection of the neighbor door lock to the server through the Wi-Fi network of the neighbor's home, and connection of the server to the neighbor's mobile phone through a wireless network, does not fall within the range of disconnection of the above connection state. Such disconnection of the indirect connection state does not necessarily mean that the neighbor has left the detection range of the smart door lock, and can be caused by other conditions, for example, Wi-Fi network failure of the neighbor's home. Therefore, the disconnection of the connection state used to indicate that the switching condition is met usually does not include disconnection of the indirect connection state.

[0155] The network signal strength change and then keeping stable is usually the network signal strength change of the other electronic device detected by the electronic device. The network signal strength change of the other electronic device can represent the distance change between the other electronic device and the electronic device, and the network signal strength change and then keeping stable can represent that the distance between the other electronic device and the electronic device becomes larger and then smaller and keeps stable, or the distance between the other electronic device and the electronic device becomes smaller and then larger and keeps stable. The network signal strength change can represent the behavior of the person using the other electronic device, and then the network signal strength change and then keeping stable of the other electronic device can be determined as the switching condition.

[0156] Taking the other electronic device as a neighbor door lock as an example, the network signal strength change and then keeping stable of the neighbor door lock can represent the opening and closing change of the neighbor door. For example, the neighbor door opening outwardly can cause the network signal of the neighbor door lock to become stronger, and if the neighbor door is closed after opening, the network signal of the neighbor door lock can become weaker, and when the neighbor door keeps closed, the network signal strength of the neighbor door lock keeps stable. In this example, the network signal strength change of the neighbor door lock is: becoming stronger-becoming weaker-keeping stable. For the neighbor, the possible behavior is opening the door, entering the house, and closing the door, and then the switching condition can be determined after sensing the above network signal change of the neighbor door lock.

[0157] The switching of the scheduling signal can be that the other electronic device receives a scheduling instruction and then schedules the device. The other electronic device can be an elevator, a unit access control, a community access control, etc. The switching of the scheduling signal can represent that a specific target object appearing in the detection range will leave or has left the detection range, and then the switching condition can be determined.

[0158] Suppose that the other electronic device is an elevator, and the switching of the scheduling signal can be that the elevator receives a scheduling request. Taking the neighbor as an example, the specific target object can be the neighbor, which can be that the neighbor presses the elevator button to request the elevator to arrive at the floor where the neighbor is located, or the neighbor has entered the elevator and pressed the floor where the neighbor wants to arrive.

[0159] Suppose that the other electronic device is a unit access control, and the switching of the scheduling signal can be that the unit access control receives an opening request. Taking the neighbor as an example, the neighbor can open the unit access control to leave the unit building, etc.

[0160] In this example, the information interaction state change of the other electronic device can be determined when one of the disconnection of the connection state, the network signal strength change and then keeping stable, and the switching of the scheduling signal is met, or when two of them are met, or when all of them are met, and the present specification does not specially limit this.

[0161] The running action state change includes: device closing, device moving away.

[0162] The device closing can be a closing of other electronic devices, such as closing of a neighbor's door lock, closing of an elevator, closing of a corridor light, and the like. Taking the neighbor as the specific target object, the device closing can represent that the neighbor leaves the detection range of the electronic device, and thus the switching condition can be determined to be met. For example, the neighbor returns home and closes the door, the neighbor takes the elevator to leave, the neighbor walks away and the corridor light is turned off, and the like.

[0163] The device moving away can be moving away of other electronic devices from the electronic device, such as moving away of a neighbor's door lock, moving away of an elevator, and the like. Taking the neighbor as the specific target object, the device moving away can represent that the neighbor leaves the detection range of the electronic device, and thus the switching condition can be determined to be met. For example, the neighbor's door lock moves away when the neighbor returns home and closes the door, the elevator car moves away from the floor where the electronic device is located when the neighbor takes the elevator to leave, and the like.

[0164] In this example, the running action state change of the other electronic device can be determined when either the device closing or the device moving away is met, or the running action state change of the other electronic device can be determined when both the device closing and the device moving away are met, which is not specially limited in the present specification.

[0165] It should be noted that the state change of the other electronic device sensed by the electronic device is authorized.

[0166] Step 204, in response to the switching condition being met, the electronic device is restored to a state before the privacy protection action is performed, or the privacy protection action for the specific target object is stopped.

[0167] In one example, in a case where it is determined that the switching condition is met, the privacy protection action for the specific target object can be stopped, and subsequently the action to be performed by the electronic device can be determined according to actual conditions. For example, the electronic device can be controlled to resume the action before the privacy protection action is performed after the privacy protection action is stopped, or the electronic device can be controlled to perform other actions (such as a tracking and monitoring action can also be performed after the privacy protection action is stopped when a dangerous target object appears in the network detection range) after the privacy protection action is stopped, which can be selected according to actual conditions.

[0168] In another example, in a case where it is determined that the switching condition is met, the electronic device can be directly restored to a state before the privacy protection action is performed, that is, the action of the actuator before the privacy protection action is performed, such as turning on a closed camera to restore a normal monitoring state, and the like.

[0169] As can be seen from the above description, after performing the privacy protection action for the specific target object, the electronic device can stop the privacy protection action for the specific target object when the switching condition is met, so as to timely recover to the monitoring state and prevent the security risks caused by the long-time execution of the privacy protection action leading to the lack of monitoring.

[0170] Of course, for other types of specific actions such as tracking and monitoring actions, corresponding switching conditions can also be set, and the present specification does not make special limitations thereon.

[0171] Figure 3 FIG. 1 is a schematic diagram of a privacy protection scene provided by an example embodiment.

[0172] Please refer to Figure 3 In the privacy protection scene, the electronic device performing the privacy protection logic is a smart door lock 31. When a person takes the smart elevator 32 and presses the floor to be reached, the smart elevator 32 can predict the time point at which the person reaches the corresponding floor, and then sends the time point to the smart door lock 31 installed at the corresponding floor. The smart door lock 31 then acquires the device fingerprint of the mobile phone (not shown) carried by the person in a non-connected state in the network detection range at the time point, and then determines the identity of the person based on the device fingerprint. Assuming that the identity of the person is a neighbor, it can be determined that the person is a specific target object, and then a privacy protection action is performed on the person, for example, the camera outside the smart door lock is closed to avoid collecting images carrying the privacy of the neighbor, such as the face of the neighbor. When the time length of the camera being closed reaches a preset time length, it can be considered that the neighbor has returned home or left the detection range, and then the camera outside the smart door lock is reopened to recover to the monitoring state.

[0173] Figure 4 FIG. 5 is a schematic structural diagram of a device provided by an example embodiment. Please refer to Figure 4 At the hardware level, the device includes a processor 402, an internal bus 404, a network interface 406, a memory 408, and a non-volatile memory 410, and of course, other hardware required by functions can also be included. One or more embodiments of the present specification can be implemented in a software manner, such as reading a corresponding computer program from the non-volatile memory 410 into the memory 408 by the processor 402 and then running. Of course, in addition to the software implementation manner, one or more embodiments of the present specification do not exclude other implementation manners, such as a logic device or a combination of software and hardware, and so on, that is, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or a logic device.

[0174] Please refer to Figure 5 The linkage device 500 of the electronic device can be applied to, for example, Figure 4The device shown in the embodiment of the present specification. Among them, the linkage device 500 of the electronic device can include:

[0175] An information acquisition unit 501 acquires linkage information about a target object sent by a linkage device linked with the electronic device;

[0176] An identity confirmation unit 502 confirms the identity of the target object based on the linkage information;

[0177] An action execution unit 503, in response to determining that the target object is a specific target object based on the identity of the target object, performs a specific action on the specific target object.

[0178] Optionally, the identity of the target object is confirmed based on the linkage information, comprising:

[0179] In response to the initial identity information of the target object being included in the linkage information, determining the identity of the target object based on the initial identity information; or,

[0180] In response to the initial identity information not being included in the linkage information, acquiring a network device fingerprint within a network detection range based on the linkage information, and determining the identity of the target object based on the acquired network device fingerprint.

[0181] Optionally, the identity of the target object is determined to be a specific target object based on the identity of the target object, comprising:

[0182] In response to the identity of the target object satisfying a preset condition, determining that the target object is a specific target object.

[0183] Optionally, the network device fingerprint is acquired within the network detection range, comprising:

[0184] The network device fingerprint is acquired in a non-connected state within the network detection range; the non-connected state is that no effective communication link is established between the electronic device and the network device.

[0185] Optionally, the linkage information includes one or more of the following: a time point at which the target object is expected to appear within the network detection range, a network device fingerprint, initial identity information, behavior data of the linkage device, and abnormal floor access.

[0186] Optionally, the specific action includes a privacy protection action, and the privacy protection action includes one or more of the following:

[0187] The biological information acquisition module is turned off, the angle of the biological information acquisition module is adjusted to be misaligned with the specific target object, the resolution of the biological information acquisition module is reduced, and the image collected by the biological information acquisition module is blurred.

[0188] Based on the same idea as the above method, the specification also provides an electronic device, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor implements the steps of the method as described in any of the above embodiments by running the executable instructions.

[0189] Based on the same idea as the above method, the specification also provides a computer-readable storage medium having stored thereon computer instructions which, when executed by a processor, implement the steps of the method as described in any of the above embodiments.

[0190] Based on the same idea as the above method, the specification also provides a computer program product comprising computer program / instructions which, when executed by a processor, implement the steps of the method as described in any of the above embodiments.

Claims

1. A linkage method for electronic devices, characterized in that, include: Obtain linkage information about the target object sent by the linkage device linked with the electronic device; The identity of the target object is confirmed based on the aforementioned linkage information; In response to determining that the target object is a specific target object based on the target object's identity, a specific action is performed on the specific target object; The step of confirming the identity of the target object based on the linkage information includes: In response to the linkage information including the initial identity information of the target object, the identity of the target object is determined based on the initial identity information; In response to the absence of the initial identity information in the linkage information, the network device fingerprint is obtained within the network detection range based on the linkage information, and the identity of the target object is determined based on the obtained network device fingerprint. The step of acquiring network device fingerprints within the network detection range includes: The fingerprint of the network device is acquired in a disconnected state within the network detection range; the disconnected state means that no effective communication link is established between the electronic device and the network device.

2. The method according to claim 1, characterized in that, The step of determining the target object as a specific target object based on the target object's identity includes: In response to the target object's identity meeting preset conditions, the target object is determined to be a specific target object.

3. The method according to claim 1, characterized in that, The linkage information includes one or more of the following: the time point at which the target object is expected to appear within the network detection range, the fingerprint of the network device, the initial identity information, the behavior data of the linkage device, and abnormal floor access.

4. The method according to claim 1, characterized in that, The specific actions include privacy protection actions, which include one or more of the following: The biological information acquisition module is turned off; the angle of the biological information acquisition module is adjusted so that it is not aligned with the specific target object; the resolution of the biological information acquisition module is reduced; and the image acquired by the biological information acquisition module is blurred.

5. A linkage device for an electronic device, characterized in that, include: The information acquisition unit acquires linkage information about the target object sent by the linkage device linked with the electronic device; The identity verification unit verifies the identity of the target object based on the linked information; An action execution unit, in response to determining that the target object is a specific target object based on the target object's identity, performs a specific action on the specific target object; The step of confirming the identity of the target object based on the linkage information includes: In response to the linkage information including the initial identity information of the target object, the identity of the target object is determined based on the initial identity information; In response to the absence of the initial identity information in the linkage information, the network device fingerprint is obtained within the network detection range based on the linkage information, and the identity of the target object is determined based on the obtained network device fingerprint. The step of acquiring network device fingerprints within the network detection range includes: The fingerprint of the network device is acquired in a disconnected state within the network detection range; the disconnected state means that no effective communication link is established between the electronic device and the network device.

6. An electronic device, characterized in that, include: processor; A memory for storing processor-executable instructions; wherein the processor implements the steps of the method as described in any one of claims 1-4 by executing the executable instructions.

7. A computer-readable storage medium, characterized in that, It stores computer instructions that, when executed by a processor, implement the steps of the method as described in any one of claims 1-4.

8. A computer program product, characterized in that, Includes a computer program / instructions that, when executed by a processor, implement the steps of the method as described in any one of claims 1-4.

Images