A method and system for bluetooth co-processing of a door lock

Abstract

The application discloses a door lock Bluetooth cooperative processing method and system, the method comprises the following steps: a door lock A detects a doorbell trigger signal, sorts and integrity checks encrypted fragmented data, and obtains face feature ciphertext data blocks; based on the face feature ciphertext data blocks, decryption processing is performed to obtain plaintext face feature vectors, similarity comparison is performed, and a dynamic pairing code is generated; according to the successful result of dynamic pairing code verification, a door lock B sends a substitute call confirmation request to the door lock A, and a cooperative authorization result between the door locks is obtained; based on the cooperative authorization result, a platform sends a navigation instruction to a robot, the robot generates a task summary after completing face recognition and unlocking operation, synchronously cleans up temporary data, and obtains closed-loop execution records of the substitute call process. By using the embodiment of the application, efficient, safe and intelligent cooperative door lock control can be realized.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of intelligent door locks, in particular to a door lock Bluetooth cooperative processing method and system. BACKGROUND

[0002] With the rapid development of smart home technology, the functional requirements of intelligent door locks, as the core equipment of home security, are increasingly complex. Traditional intelligent door locks usually adopt a single device independent working mode, which has the problems of insufficient cross-device collaboration capability, complicated remote proxy call authorization process, and difficulty in temporary visitor management. Especially in the scene of neighbor proxy delivery or temporary authorized visitor, the existing scheme relies on the central platform to transfer authorization information, which not only has high response delay, but also has the risk of privacy data leakage. Bluetooth technology is widely used in door lock devices due to its low power consumption and short distance communication characteristics, but the existing Bluetooth door lock still has the defects of low efficiency, insufficient security, etc. in the aspects of fragmented data transmission, dynamic authorization verification and multi-device collaboration. SUMMARY

[0003] The purpose of the present application is to provide a door lock Bluetooth cooperative processing method and system to solve the problems in the prior art and realize efficient, safe and intelligent collaborative door lock control.

[0004] One embodiment of the present application provides a door lock Bluetooth cooperative processing method, which comprises:

[0005] Bluetooth fragmented data acquisition and reorganization: according to the detection of doorbell trigger signal by door lock A for two times in succession, starting the Bluetooth scanning module to listen to the periodic broadcast packet, sorting and integrity checking the received encrypted fragmented data by the fragmentation reorganization algorithm, and obtaining the complete face feature ciphertext data block;

[0006] Face feature decryption and identity verification: based on the face feature ciphertext data block, using the AES-256-GCM decryption algorithm to combine the pre-shared key of door lock A and platform for decryption processing, obtaining the plaintext face feature vector, and comparing the similarity with the house owner feature library stored in door lock A, if the similarity exceeds the threshold, generating a dynamic pairing code;

[0007] Cross-door lock proxy call authorization verification: according to the result of successful verification of the dynamic pairing code, door lock A forwards the door lock ID, IP address and target user feature vector to door lock B through the neighbor's mobile phone, triggers door lock B to send a proxy call confirmation request carrying the mobile phone Bluetooth Tag-DID to door lock A, and obtains the cross-door lock collaborative authorization result;

[0008] Robot task dispatching and closed-loop management: based on the collaborative authorization result, the platform sends navigation instructions carrying the position of door lock A and user features to the robot, the robot generates a task summary after completing face recognition and unlocking operations, synchronously cleans up temporary data of door lock A, door lock B and the platform, and obtains closed-loop execution records of the proxy calling process.

[0009] Optionally, the Bluetooth fragmented data collection and reorganization includes:

[0010] Periodic broadcast packet listening: according to the detection of continuous two pressing signals by the physical button sensor of door lock A, the Bluetooth scanning module is activated to enter the ACTIVE scanning mode, and the scanning window is set to 100 ms;

[0011] Fragmented data caching and verification: CRC16 verification is performed on each received broadcast packet, and if the verification fails, the data packet is discarded; after the verification is passed, the fragmented data is stored in the cache queue according to the fragment number, until the total number of fragments reaches the value declared in the broadcast packet header;

[0012] Ciphertext data reorganization: the fragmented data is extracted from the cache queue according to the sequence number, the fragment header sequence number and the verification field are removed, and the complete ciphertext block is spliced to obtain an encrypted data block containing 2048 bytes of ciphertext and 12 bytes of authentication tag.

[0013] Optionally, the face feature decryption and identity verification includes:

[0014] Decryption and feature extraction: the AES-256-GCM algorithm is used to decrypt the ciphertext block, the pre-shared key of door lock A and the platform is used, and the first 512 bytes of the decrypted plaintext data are extracted as the face feature vector;

[0015] Dynamic pairing code generation: if the face feature similarity exceeds 85%, a 6-digit dynamic pairing code is randomly generated and displayed on the display screen of door lock A for 30 seconds;

[0016] Bluetooth interaction verification: receiving the pairing code sent by the neighbor's mobile phone through the BLE service, if the wrong input is continuous for 3 times, the Bluetooth connection is locked and the cache data is cleared.

[0017] Optionally, the cross-door lock proxy calling authorization verification includes:

[0018] Door lock information packaging: door lock A encapsulates the door lock ID and IP address into a binary data packet and transmits it to the neighbor's mobile phone through the established encrypted Bluetooth connection;

[0019] Cross-door lock data relay: after the neighbor's mobile phone returns to door lock B, door lock B identifies the mobile phone tag DID through the BLE protocol, establishes a secure connection and receives the data packet;

[0020] Proxy call confirmation request construction: door lock B sends a proxy call confirmation request to door lock A, the proxy call confirmation request contains the door lock ID, the mobile phone label DID and the request timestamp, and door lock A matches the mobile phone label DID with the pre-stored call event record in the local cache;

[0021] Coordinated authorization response: if the matching is successful, door lock A replies with a confirmation message, otherwise a rejection code is replied.

[0022] Optionally, the robot task dispatching and closed-loop management comprises:

[0023] After the platform receives the proxy call request, a navigation instruction is generated, containing the room ID of door lock A and the face feature vector;

[0024] Autonomous navigation and biometric identification: the robot moves to door lock A according to the navigation instruction, collects the user's face image through the camera, and performs real-time comparison with the received face feature vector;

[0025] Task summary generation and cleaning: if the identification is successful, the robot performs unlocking and door opening, and sends a task summary to the platform, and the platform deletes the temporary data in door lock A and door lock B after the task is completed, and marks the task state as completed.

[0026] Another embodiment of the application provides a system for door lock Bluetooth cooperative processing, the system comprising:

[0027] The acquisition module is configured to collect and reorganize Bluetooth fragmented data: according to the detection of doorbell trigger signals by door lock A for two consecutive times, a Bluetooth scanning module is started to listen to periodic broadcast packets, and the received encrypted fragmented data is sorted and integrity checked through a fragmentation reorganization algorithm to obtain a complete face feature ciphertext data block;

[0028] The decryption module is configured to decrypt the face feature and verify the identity: based on the face feature ciphertext data block, an AES-256-GCM decryption algorithm is used to decrypt the face feature ciphertext data block in combination with the pre-shared secret key of door lock A and the platform to obtain a plaintext face feature vector, and similarity comparison is performed with the house owner feature library stored in door lock A, and if the similarity exceeds a threshold, a dynamic pairing code is generated;

[0029] The authorization module is configured to verify the cross-door lock proxy call authorization: according to the result of successful verification of the dynamic pairing code, door lock A forwards the door lock ID, IP address and target user feature vector to door lock B through a neighbor mobile phone, triggers door lock B to send a proxy call confirmation request to door lock A carrying the mobile phone Bluetooth Tag-DID, and obtains the inter-door lock cooperative authorization result;

[0030] A dispatch module is used for robot task dispatching and closed loop management: based on the collaborative authorization result, the platform sends a navigation instruction carrying the position of door lock A and user features to the robot, the robot generates a task summary after completing face recognition and unlocking operation, synchronously cleans up temporary data of door lock A, door lock B and the platform, and obtains closed loop execution record of the proxy calling process.

[0031] A further embodiment of the present application provides a storage medium having a computer program stored therein, wherein the computer program is configured to execute the method described in any one of the preceding embodiments when executed.

[0032] A further embodiment of the present application provides an electronic device comprising a memory having a computer program stored therein and a processor configured to execute the computer program to execute the method described in any one of the preceding embodiments.

[0033] Compared with the prior art, the method for door lock Bluetooth collaborative processing provided by the present application can realize efficient, safe and intelligent collaborative door lock control. BRIEF DESCRIPTION OF DRAWINGS

[0034] Figure 1 A hardware structure block diagram of a computer terminal for the method for door lock Bluetooth collaborative processing provided by the embodiment of the present application is provided.

[0035] Figure 2 A flowchart of the method for door lock Bluetooth collaborative processing provided by the embodiment of the present application is provided.

[0036] Figure 3 A structure diagram of a system for door lock Bluetooth collaborative processing provided by the embodiment of the present application is provided. DETAILED DESCRIPTION

[0037] The embodiments described below with reference to the drawings are exemplary and are only used to explain the present application, and cannot be explained as a limitation of the present application.

[0038] The embodiment of the present application first provides a method for door lock Bluetooth collaborative processing, which can be applied to an electronic device, such as a computer terminal, specifically, a general computer, etc.

[0039] The following will be described in detail taking the computer terminal as an example. Figure 1 A hardware structure block diagram of a computer terminal of a door lock Bluetooth cooperative processing method provided by an embodiment of the present application is shown in FIG. 1. Figure 1 As shown in the figure, the computer device includes a processor, a memory and a network interface connected through a system bus, wherein the memory can include a non-volatile storage medium and an internal memory.

[0040] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions which, when executed, can cause the processor to execute any door lock Bluetooth cooperative processing method.

[0041] The processor is used to provide computing and control capabilities to support the operation of the entire computer device.

[0042] The internal memory provides an environment for the execution of the computer program in the non-volatile storage medium, which, when executed by the processor, can cause the processor to execute any door lock Bluetooth cooperative processing method.

[0043] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that Figure 1 The structure shown in FIG. 1 is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0044] It should be understood that the processor can be a central processing unit (CPU), and the processor can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0045] Referring to Figure 2 , the embodiment of the present application provides a door lock Bluetooth cooperative processing method, which can include the following steps:

[0046] S201, Bluetooth fragment data collection and reorganization: according to the detection of doorbell trigger signal for two times in succession, the Bluetooth scanning module is started to listen to the periodic broadcast packet, the received encrypted fragment data is sorted and integrity checked by the fragmentation reorganization algorithm, and the complete face feature ciphertext data block is obtained; specifically, the Bluetooth fragment data collection and reorganization comprises:

[0047] Periodic broadcast packet listening: according to the detection of two times of press signals in succession by the physical button sensor of door lock A, the Bluetooth scanning module is activated to enter the ACTIVE scanning mode, and the scanning window is set to 100 ms;

[0048] Fragment data buffering and checking: CRC16 checking is performed on each received broadcast packet, if the checking fails, the data packet is discarded, and if the checking passes, the fragment data is stored in the cache queue according to the fragment number, until the total number of fragments reaches the value declared in the broadcast packet header;

[0049] Ciphertext data reorganization: the fragment data is extracted from the cache queue according to the number, the fragment header number and the check field are removed, and the complete ciphertext block is spliced to obtain the encrypted data block containing 2048 bytes of ciphertext and 12 bytes of authentication tag.

[0050] S202, face feature decryption and identity verification: based on the face feature ciphertext data block, the AES-256-GCM decryption algorithm is used to decrypt the data with the pre-shared key of door lock A and platform, to obtain the plaintext face feature vector, and to compare it with the house owner feature library stored in door lock A, if the similarity exceeds the threshold, a dynamic pairing code is generated; specifically, the face feature decryption and identity verification comprises:

[0051] Decryption and feature extraction: the ciphertext block is decrypted using the AES-256-GCM algorithm, the pre-shared key of door lock A and platform is used, and the first 512 bytes of the decrypted plaintext data are extracted as the face feature vector;

[0052] Dynamic pairing code generation: if the face feature similarity exceeds 85%, a 6-digit dynamic pairing code is randomly generated and displayed on the display screen of door lock A for 30 seconds;

[0053] Bluetooth interaction verification: receiving the pairing code sent by the neighbor's mobile phone through BLE service, if the wrong input is continuous for 3 times, the Bluetooth connection is locked and the cache data is cleared.

[0054] S203, cross-door lock authorization verification: according to the result of dynamic pairing code verification success, door lock A forwards the door lock ID, IP address and target user feature vector to door lock B through the neighbor's mobile phone, triggers door lock B to send a summons confirmation request carrying the mobile phone Bluetooth Tag-DID to door lock A, and obtains the cross-door lock authorization result; specifically, the cross-door lock authorization verification comprises:

[0055] Door lock information package: the door lock A encapsulates the door lock ID and IP address into a binary data packet, and transmits the data packet to the neighbor mobile phone through the established encrypted Bluetooth connection;

[0056] Cross-door lock data relay: after the neighbor mobile phone returns to the door lock B, the door lock B identifies the mobile phone tag DID through the BLE protocol, establishes a secure connection and receives the data packet;

[0057] Proxy call confirmation request construction: the door lock B sends a proxy call confirmation request to the door lock A, and the proxy call confirmation request contains the door lock ID, the mobile phone tag DID and the request timestamp. The door lock A matches the mobile phone tag DID with the pre-stored call event record in the local cache;

[0058] Coordinated authorization response: if the matching is successful, the door lock A replies with a confirmation message, otherwise a denial code is replied.

[0059] S204, robot task dispatching and closed loop management: based on the coordinated authorization result, the platform sends a navigation instruction carrying the door lock A position and user features to the robot. The robot generates a task summary after completing face recognition and unlocking operation, synchronously cleans up the temporary data of the door lock A, the door lock B and the platform, and obtains the closed loop execution record of the proxy call process. Specifically, the robot task dispatching and closed loop management includes:

[0060] The platform generates a navigation instruction after receiving the proxy call request, which contains the room ID of the door lock A and the face feature vector;

[0061] Autonomous navigation and biometric identification: the robot moves to the door lock A according to the navigation instruction, collects the user face image through the camera, and performs real-time comparison with the received face feature vector;

[0062] Task summary generation and cleaning: if the identification is successful, the robot unlocks and opens the door, and sends a task summary to the platform. The platform deletes the temporary data in the door lock A and the door lock B after the task is completed, and marks the task status as completed.

[0063] In actual application, when the owner of the intelligent door lock forgets to carry the door card, the owner can call the robot to help open the door by pressing the "doorbell" button of the door lock. However, if a stranger presses the "doorbell" button of the door lock, the robot will also be called. If the identity verification of the person pressing the "doorbell" button is not increased when the robot is called, the robot will respond invalidly, causing additional workload of the robot, and even seriously affecting the normal calling of the robot by the owner.

[0064] Bluetooth tag: It is a kind of wireless short-distance communication equipment based on Bluetooth technology, and its implementation principle is based on Bluetooth Low Energy (BLE) technology. BLE can transmit data in low-power mode, thereby prolonging the battery life of the device. Bluetooth tags will be assigned a unique DID (Bluetooth-Tag Declaration ID, Tag-DID for short) when they leave the factory. This Tag-DID is the identity of the Bluetooth tag, similar to the MAC address of a WiFi device. This unique ID ensures that the Bluetooth tag can be accurately identified and tracked.

[0065] The application proposes a kind of Bluetooth tag of seeking neighbor mobile phone to help the owner without mobile phone to call robot to carry out face recognition for owner, and be unlocked by robot to open door, so it can also exclude the behavior of stranger calling robot. A kind of technical scheme specifically includes:

[0066] 1. Core idea: In order to prevent non-owner from calling robot invalidly by pressing door lock, it is judged by Bluetooth of mobile phone that it is indeed the owner, and then the robot is called. Further improvement, if the owner a does not carry mobile phone, then it is authorized by neighbor b mobile phone. Therefore, the owner b obtains the face feature vector of the owner a by mobile phone, establishes Bluetooth connection with door lock A based on the feature vector, and calls the robot.

[0067] 2. The complete process of technical implementation is as follows:

[0068] Preset condition:

[0069] The owner's entry door is installed with intelligent door lock, which supports RFID card reading and unlocking to open door. The door lock stores the information of house owner, including name, face image / feature vector, RFID-ID number, etc. The door lock supports and opens Bluetooth communication, and Bluetooth is in central mode by default. The door lock can extract the Tag-DID of mobile phone tag by listening to the advertising data packet of mobile phone Bluetooth tag. The door lock records the Tag-DID of mobile phone tag that is successfully paired in advance with the support of manual. The door lock is connected with platform, and reports the room ID number, door lock ID number, door lock IP, paired mobile phone Tag-DID, etc. of door lock. The platform receives and saves the Bluetooth tag list issued by platform, including room ID number, name, mobile phone Tag-DID, pairing record, etc.

[0070] Explanation: The room ID number, name, mobile phone Tag-DID and pairing record in the Bluetooth tag list issued by platform include the name, mobile phone Tag-DID and pairing record of all members of the lock, and also include the room ID number, name and mobile phone Tag-DID of other door locks, but do not include pairing record.

[0071] The owner installs an APP of the smart door lock on the mobile phone, and the APP has an independent APP-ID; the mobile phone supports Bluetooth communication, and has an independent mobile phone Tag-DID; the mobile phone Bluetooth tag is in a default peripheral mode; the mobile phone Bluetooth tag and the door lock have been pre-paired, and support connectable broadcast.

[0072] The robot presets a robot walking map, and can autonomously walk to a specified door lock according to a pre-set room ID number; the robot is installed with a camera with face recognition and a display screen with face recognition display screen, and can perform face recognition comparison; the robot is connected with the door lock, supports doorbell calling and unlocking authorization of the specified door lock. The robot is connected with the platform, and receives tasks (such as delivering goods for the owner, providing face recognition and unlocking door on site for the owner) issued by the platform.

[0073] Under normal circumstances, the owner uses an RFID card to unlock the door: the owner holds the RFID card and swipes the card on the door lock, the door lock reads the ID number of the RFID card, and compares it with the ID number in the stored house owner information, if the comparison is correct, the owner is unlocked, and the process is ended.

[0074] The owner forgets to take the RFID card when going out, and after ensuring that the Bluetooth communication function of the mobile phone is turned on, the doorbell button is pressed twice to trigger the Bluetooth verification of the mobile phone carried by the owner, and then the robot is called.

[0075] The owner a comes to the door lock A of his own house (at this time, a may have just gone out, or may have returned from outside without carrying an RFID card), opens the Bluetooth APP on the mobile phone, sets the Bluetooth of the mobile phone (assuming that the Bluetooth tag ID number of the mobile phone of the owner a is Tag-DID(a)) to be in an enabled state, and presses the doorbell button on the door lock A twice.

[0076] The door lock A receives the button signal, listens to the advertising data packet of the peripheral Bluetooth tag, extracts the Tag-DID of the tag (at this time, the Tag-DIDs of multiple Bluetooth tags may be sensed), compares with the Bluetooth tag list saved by the lock, finds that the Tag-DID (a) is owned by the master of the door lock A (at this time, the Tag-DID (a) recorded in the Bluetooth tag list is paired with the door lock A), and directly enters the back connection process which needs to be confirmed by the mobile phone APP (at this time, since the Tag-DID (a) has been successfully paired with the door lock A, and the door lock A saves the pairing record, the process of directly automatically restoring the connection can be directly performed, and the user APP is intervened to confirm the connection), the APP listens to the back connection event (such as an Android system mobile phone, which listens to the BluetoothDevice.ACTION_ACL_CONNECTED / back connection event through BluetoothDeviceAPI), and sends a back connection request, when the APP detects the door lock back connection request (the long-term key / LTK generated by the door lock during the first pairing), a dialog box (such as "Do you want to connect

door lock A

[0077] After the door lock A completes the Bluetooth connection with the master a mobile phone (at this time, the door lock has completed the Bluetooth connection with the master a mobile phone through the intervention of the master a, which means that the master a holds the registered mobile phone near the door lock A), it sends a "summon robot" message to the platform, which includes the room ID (A) number, the door lock ID (A), the door lock IP (A), the master name (master a), the face image / feature vector (master a), etc. The platform receives the "summon robot" message sent by the door lock A, sends the room ID (A) number, the door lock ID (A), the door lock IP (A), the master name (master a), the face image / feature vector (master a), etc. to the robot, and sends the robot to the door lock A, the robot room ID (A) number (the robot has a built-in navigation map, which is generally realized through autonomous navigation, autonomous obstacle avoidance, and autonomous walking) reaches the door lock A, performs face recognition for the master a, and after the face recognition is successful, it is connected to the door lock A and unlocks the door for the master a.

[0078] The robot sends a "task summary" message to the platform, containing the door lock ID (A), the owner's name (owner a), the face image / feature vector (owner a), whether face recognition is better than the middle / is or not, whether to unlock / is or not, the timestamp (current clock), etc., and then clears the cached "go to [door lock A]" instruction message, and walks to the preset default address autonomously. The platform receives the "task summary" message sent by the robot, saves it for 3 months and then automatically deletes it (the retention period can generally be set to 3 months for query), and the process ends.

[0079] Further improvement: The owner b of door lock B uses the mobile phone APP to take the face image / feature vector of owner a, and uses the owner b's mobile phone Bluetooth to request door lock A to establish Bluetooth connection with the face image / feature vector of owner a, and obtains the door lock information of door lock A after successful connection. After returning to door lock B, the owner b's mobile phone Bluetooth establishes Bluetooth connection with door lock B, sends the door lock information of door lock A to door lock B, and door lock B initiates a "substitute calling confirmation request" to request confirmation message and obtains the reply confirmation of A. After the reply confirmation of A, door lock B sends a "substitute calling robot" request carrying the information of door lock A to the platform, and the platform dispatches a robot to door lock A according to the information in the "substitute calling robot" request to perform face recognition comparison and unlock the door for owner a.

[0080] In step (3), if the owner does not carry an RFID card or a mobile phone, the door lock cannot verify whether the person who presses the "doorbell" button twice is the owner by identifying the mobile phone Bluetooth tag, and cannot call the robot to perform face recognition and unlock the door. In order to solve this problem, the optimization is as follows:

[0081] 1) Precondition supplement:

[0082] The mobile phone Bluetooth supports BLE periodic broadcast (Periodic Advertising) + data synchronization, which can be configured by calling BLE API to configure periodic broadcast parameters, such as broadcast interval of 100ms, synchronization timeout of 5 seconds, etc.

[0083] The door lock Bluetooth supports BLE periodic broadcast (Periodic Advertising) + data synchronization, which can be configured by calling BLE API to configure scanning parameters, such as enabling ACTIVE scanning, scanning window 100ms, etc.

[0084] 2) The owner b of the door lock B opens the door lock APP of the mobile phone, scans the face of the owner a of the door lock A with the APP, the mobile phone APP extracts the face image / feature vector of the owner a, the mobile phone Bluetooth tag fragments the face image / feature vector data of a (for example, the feature vector data can be first encrypted by AES-256-GCM to generate ciphertext (2048 bytes) and authentication tag (12 bytes), then the ciphertext is split into several packets (for example, each packet is 224 bytes), and then each packet is added with packet number, total number of fragments, user data length and CRC16 checksum, etc., so as to form multiple fragments), and then sends the fragments through BLE periodic broadcast, including fragment number, total number of fragments, fragment data, CRC16 checksum, etc.

[0085] 3) The owner b presses the "doorbell" button on the door lock A for 2 times and then puts the mobile phone close to the door lock A (at this time, the process of calling the robot is started). The door lock A receives the signal of pressing the doorbell button for 2 times, starts BLE scanning, identifies the periodic broadcast packet, and initiates a periodic broadcast synchronization request (such as calling syncAdvertiser to negotiate the broadcast interval, clock offset, etc.). After successful synchronization, the door lock A receives and caches the broadcast fragments according to the interval and the sequence number, and when all fragments are received (by checking the fragment number and the total number of fragments), the decrypted AES-256 encrypted data is reorganized according to the fragment number to restore the face image / feature vector of the owner a.

[0086] 4) The door lock A compares the face image / feature vector of the master a received by Bluetooth with the face image / feature vector in the master information stored in the door lock one by one. If it is not successful, it displays "Bluetooth connection failure" on the door lock screen, and the process ends. If it is successful, it displays the pairing code (such as "123456") on the door lock A display screen. The mobile phone sends the pairing code (the master b inputs the pairing code displayed on the door lock A display screen in the mobile phone APP) to the door lock A through BLE broadcast. The door lock A receives the pairing code sent by the mobile phone and compares it with the pairing code generated by itself. If the pairing codes match (the door lock displays the pairing code on the door lock A display screen), the door lock responds to the pairing success signal (such as sending GATT notification, etc.) through BLE. If the door lock A fails to match, it can issue a "didi" prompt sound on the door lock A. The master b re-enters the pairing code displayed on the door lock A display screen in the mobile phone APP, and then broadcasts it to the door lock A for matching. If the matching fails for 3 times, the door lock will no longer receive the mobile phone Bluetooth pairing, and the door lock A display screen will display "Bluetooth has been locked", and the process ends. After the door lock A and the mobile phone Bluetooth pairing is successful, it can establish a BLE connection (such as communication through GATT service), the door lock A prepares the door lock information and sends it to the master b in the mobile phone through the BLE connection, including door lock ID (A), door lock IP (A), etc. The mobile phone receives and caches the door lock information of A through the BLE connection. After the sending is successful, the door lock A records the calling robot event information, including calling event ID (which can be door lock ID (A) + time stamp), face image / feature vector of master a, master b mobile phone Bluetooth Tag-DID (b), whether to call / pending, and the calling robot event information is automatically deleted after 15 minutes to reduce storage overhead.

[0087] 5) The master b returns to the door lock B and presses the "doorbell" button twice on the door lock B, and then places the mobile phone close to the door lock B. The door lock B receives the 2-doorbell button signal and establishes a connection with the b's mobile phone Bluetooth through BLE (at this time, b is the master of the door lock B, and b's mobile phone Bluetooth has successfully paired). The mobile phone sends the door lock information of A, the face image / feature vector of master a collected by the mobile phone APP, etc. to B through BLE, including door lock ID (A), door lock IP (A), face image / feature vector of master a, etc. The door lock B receives and caches the door lock information of A.

[0088] 6) The door lock B sends a "substitute call confirmation request" message to the door lock A according to the door lock IP (A) address in the door lock information of the door lock A, containing the door lock ID (B), the master b mobile phone Bluetooth Tag-DID (b), etc. The door lock A receives the "substitute call confirmation request" request message, matches the mobile phone Bluetooth Tag-DID in the cached call event information with the master b mobile phone Bluetooth Tag-DID (b), and if the matching is successful, the door lock A replies with a "substitute call confirmation" reply message, containing the call event ID, the door lock ID (A), whether to confirm the substitute call / is, etc. If the Tag-DID (b) is not successfully matched (at this time, b may have taken other mobile phones), the door lock A replies with a "substitute call confirmation" reply message, containing the call event ID, the door lock ID (A), whether to confirm the substitute call / no, etc.

[0089] 7) The door lock B receives the "substitute call confirmation" reply message and checks the result of "whether to confirm the substitute call". If it is "yes", the door lock B sends a "substitute call robot" message to the platform, containing the call event ID, the room ID (A) number, the door lock ID (A), the door lock IP (A), the master name (master a), the face image / feature vector (master a), the door lock ID (B) of the substitute call door lock, the door lock IP (B), etc. The platform receives the "call robot" message sent by the door lock A, sends a "robot departure" notification message to the robot by sending the call event ID, the room ID (A) number, the door lock ID (A), the door lock IP (A), the master name (master a), the face image / feature vector (master a), etc. to the robot, and dispatches the robot to the door lock A. At the same time, the platform sends a "robot has been dispatched" message according to the door lock IP (A) and the door lock IP (B) in the "substitute call robot" message, containing the door lock ID (A) / door lock ID (B), whether to dispatch the robot / yes, etc. The door lock A receives the "robot has been dispatched" message and displays "the robot has departed, please wait" on the door lock until the robot arrives and establishes a connection, and then stops displaying; the door lock B receives the "robot has been dispatched" message and displays "successfully substitute called the robot" on the door lock, and stops displaying after 30 seconds. The door lock B process ends.

[0090] The robot receives and caches the "robot departure" notification message, and arrives at the door lock A according to the room ID (A) number in the message (the robot has a built-in navigation map, which is generally achieved through autonomous navigation, autonomous obstacle avoidance and autonomous walking, etc.). After establishing a network connection with the door lock A, the robot performs face recognition for the master a, and unlocks the door for a after successful face recognition comparison.

[0091] The robot sends a "task summary" message to the platform, containing a calling event ID, a door lock ID (A), a master name (master a), a face image / feature vector (master a), whether face recognition is better than the middle / is or not, whether to unlock / is or not, a timestamp (current clock), etc., and then clears the cached "robot departure" notification message, and autonomously walks to the preset default address. The platform receives the "task summary" message sent by the robot, saves it for 3 months and then automatically deletes it (the retention period can generally be set to 3 months for query), and the process ends.

[0092] The door lock helps the master without a mobile phone to call the robot to perform face recognition and unlock the door by verifying the Bluetooth tag of the neighbor's mobile phone in the trusted whitelist, and can also prevent strangers from calling the robot invalidly.

[0093] As can be seen, the door lock A detects the doorbell trigger signal, sorts and integrity checks the encrypted fragmented data to obtain the face feature ciphertext data block, decrypts based on the face feature ciphertext data block to obtain the plaintext face feature vector, and performs similarity comparison to generate a dynamic pairing code; according to the successful result of dynamic pairing code verification, the door lock B sends a proxy calling confirmation request to the door lock A to obtain the inter-door lock cooperative authorization result; based on the cooperative authorization result, the platform sends a navigation instruction to the robot, and the robot generates a task summary after completing face recognition and unlocking operation, synchronously cleans up temporary data, and obtains the closed-loop execution record of the proxy calling process, so that efficient, safe and intelligent cooperative door lock control can be realized.

[0094] Another embodiment of the present application provides a door lock Bluetooth cooperative processing system, as shown in Figure 3 , which can include:

[0095] The acquisition module 301 is configured to collect and reorganize Bluetooth fragmented data: according to the fact that the door lock A detects two consecutive doorbell trigger signals, a Bluetooth scanning module is started to listen to periodic broadcast packets, and the received encrypted fragmented data is sorted and integrity checked by a fragmentation reorganization algorithm to obtain a complete face feature ciphertext data block;

[0096] The decryption module 302 is configured to decrypt face features and verify identity: based on the face feature ciphertext data block, an AES-256-GCM decryption algorithm is used to decrypt the plaintext face feature vector in combination with the pre-shared key of the door lock A and the platform, and similarity comparison is performed with the house owner feature library stored in the door lock A, and if the similarity exceeds a threshold, a dynamic pairing code is generated;

[0097] The authorization module 303 is used for cross-door lock authorization verification: according to the result of successful verification of the dynamic pairing code, the door lock A forwards the door lock ID, the IP address and the target user feature vector to the door lock B through a neighbor mobile phone, triggers the door lock B to send a call-for-service confirmation request carrying a mobile phone Bluetooth Tag-DID to the door lock A, and obtains the inter-door lock cooperative authorization result;

[0098] The dispatch module 304 is used for robot task dispatching and closed-loop management: based on the cooperative authorization result, the platform sends a navigation instruction carrying the door lock A position and the user feature to the robot, the robot generates a task summary after completing face recognition and unlocking operation, synchronously cleans up the temporary data of the door lock A, the door lock B and the platform, and obtains the closed-loop execution record of the call-for-service process.

[0099] It can be seen that the door lock A detects the doorbell trigger signal, sorts and integrity checks the encrypted fragmented data, obtains the face feature ciphertext data block, performs decryption processing based on the face feature ciphertext data block, obtains the plaintext face feature vector, and performs similarity comparison to generate a dynamic pairing code; according to the result of successful verification of the dynamic pairing code, the door lock B is triggered to send a call-for-service confirmation request to the door lock A, and the inter-door lock cooperative authorization result is obtained; based on the cooperative authorization result, the platform sends a navigation instruction to the robot, the robot generates a task summary after completing face recognition and unlocking operation, synchronously cleans up the temporary data, and obtains the closed-loop execution record of the call-for-service process, so that efficient, safe and intelligent cooperative door lock control can be realized.

[0100] The embodiment of the application also provides a storage medium, wherein the storage medium stores a computer program, and the computer program is set to execute the steps in any one of the method embodiments.

[0101] Specifically, in the embodiment, the storage medium can be set to store a computer program for executing the following steps:

[0102] S201, Bluetooth fragmented data acquisition and reorganization: according to the fact that the door lock A detects two continuous doorbell trigger signals, a Bluetooth scanning module is started to listen to a periodic broadcast packet, and the received encrypted fragmented data is sorted and integrity checked through a fragmentation reorganization algorithm to obtain a complete face feature ciphertext data block;

[0103] S202, face feature decryption and identity verification: based on the face feature ciphertext data block, an AES-256-GCM decryption algorithm is used to perform decryption processing in combination with the pre-shared secret key of the door lock A and the platform to obtain a plaintext face feature vector, and similarity comparison is performed with the house owner feature library stored in the door lock A, and if the similarity exceeds a threshold value, a dynamic pairing code is generated;

[0104] S203, cross-door lock authorized verification: according to the result of dynamic pairing code verification success, the door lock A forwards the door lock ID, IP address and target user feature vector to the door lock B through the neighbor mobile phone, triggers the door lock B to send the call confirmation request carrying the mobile phone Bluetooth Tag-DID to the door lock A, and obtains the inter-door lock cooperative authorization result;

[0105] S204, robot task dispatching and closed loop management: based on the cooperative authorization result, the platform sends the navigation instruction carrying the door lock A position and user feature to the robot, the robot generates the task summary after completing the face recognition and unlocking operation, synchronously cleans up the temporary data of the door lock A, the door lock B and the platform, and obtains the closed loop execution record of the call process.

[0106] It can be seen that the door lock A detects the doorbell trigger signal, sorts and integrity checks the encrypted fragmented data, obtains the face feature ciphertext data block, performs decryption processing based on the face feature ciphertext data block, obtains the plaintext face feature vector, and performs similarity comparison to generate a dynamic pairing code, according to the result of dynamic pairing code verification success, triggers the door lock B to send the call confirmation request to the door lock A, and obtains the inter-door lock cooperative authorization result, based on the cooperative authorization result, the platform sends the navigation instruction to the robot, the robot generates the task summary after completing the face recognition and unlocking operation, synchronously cleans up the temporary data, and obtains the closed loop execution record of the call process, so that efficient, safe and intelligent cooperative door lock control can be realized.

[0107] The embodiment of the application also provides an electronic device, including a memory and a processor, the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in any one of the method embodiments.

[0108] Specifically, the above electronic device can further include a transmission device and an input-output device, wherein the transmission device is connected with the above processor, and the input-output device is connected with the above processor.

[0109] Specifically, in the embodiment, the processor can be configured to execute the following steps through the computer program:

[0110] S201, Bluetooth fragmented data acquisition and reorganization: according to the fact that the door lock A detects two continuous doorbell trigger signals, the Bluetooth scanning module is started to listen to the periodic broadcast packet, the received encrypted fragmented data is sorted and integrity checked through the fragmentation reorganization algorithm, and the complete face feature ciphertext data block is obtained;

[0111] S202, face feature decryption and identity verification: based on the face feature ciphertext data block, an AES-256-GCM decryption algorithm is used to decrypt in combination with the door lock A and the platform pre-shared key to obtain the plaintext face feature vector, and similarity comparison is performed with the house owner feature library stored in the door lock A, and if the similarity exceeds the threshold, a dynamic pairing code is generated;

[0112] S203, cross-door lock authorization verification: according to the result of dynamic pairing code verification success, the door lock A forwards the door lock ID, IP address and target user feature vector to the door lock B through the neighbor mobile phone, triggers the door lock B to send a proxy call confirmation request carrying the mobile phone Bluetooth Tag-DID to the door lock A, and obtains the inter-door lock collaborative authorization result;

[0113] S204, robot task dispatching and closed loop management: based on the collaborative authorization result, the platform sends a navigation instruction carrying the door lock A position and user feature to the robot, the robot generates a task summary after completing face recognition and unlocking operation, synchronously cleans up the temporary data of the door lock A, the door lock B and the platform, and obtains the closed loop execution record of the proxy call process.

[0114] As can be seen, the door lock A detects the doorbell trigger signal, sorts and integrity checks the encrypted fragment data, obtains the face feature ciphertext data block, performs decryption processing based on the face feature ciphertext data block, obtains the plaintext face feature vector, and performs similarity comparison to generate a dynamic pairing code, according to the result of dynamic pairing code verification success, triggers the door lock B to send a proxy call confirmation request to the door lock A, and obtains the inter-door lock collaborative authorization result, based on the collaborative authorization result, the platform sends a navigation instruction to the robot, the robot generates a task summary after completing face recognition and unlocking operation, synchronously cleans up the temporary data, and obtains the closed loop execution record of the proxy call process, so as to realize efficient, safe and intelligent collaborative door lock control.

[0115] The above-described embodiments illustrate the structure, features and effects of the present application, and the above-described are only the preferred embodiments of the present application, but the present application is not limited to the drawings shown, any changes or modifications made in accordance with the concept of the present application, or equivalent embodiments with equivalent changes, shall be within the scope of the present application.

Claims

1. A method for door lock Bluetooth co-processing, characterized in that, The method comprises: Bluetooth fragmented data collection and reorganization: according to the detection of two consecutive doorbell trigger signals by door lock A, start the Bluetooth scanning module to listen to the periodic broadcast packet, sort and integrity check the received encrypted fragmented data through the fragmentation reorganization algorithm, and obtain the complete face feature ciphertext data block; Face feature decryption and identity verification: based on the face feature ciphertext data block, use the AES-256-GCM decryption algorithm to decrypt the plaintext face feature vector in combination with the pre-shared key of door lock A and the platform, and compare it with the house owner feature library stored in door lock A, if the similarity exceeds the threshold, generate a dynamic pairing code; Cross-door lock authorization verification: according to the successful result of dynamic pairing code verification, door lock A transmits the door lock ID, IP address and target user feature vector to door lock B through the neighbor's mobile phone, triggers door lock B to send a proxy call confirmation request carrying the mobile phone Bluetooth Tag-DID to door lock A, and obtains the inter-door lock collaborative authorization result; Robot task assignment and closed-loop management: based on the collaborative authorization result, the platform sends a navigation instruction carrying the door lock A position and user feature to the robot, and the robot generates a task summary after completing face recognition and unlocking operation, synchronously cleans up the temporary data of door lock A, door lock B and the platform, and obtains the closed-loop execution record of the proxy call process.

2. The method of claim 1, wherein, The Bluetooth fragmented data collection and reorganization comprises: Periodic broadcast packet listening: according to the detection of two consecutive press signals by the physical button sensor of door lock A, activate the Bluetooth scanning module to enter the ACTIVE scanning mode, and set the scanning window to 100 ms; Fragmented data buffering and checking: perform CRC16 checking on each received broadcast packet, discard the data packet if the checking fails, and store it in the buffer queue according to the fragment number after the checking is passed, until the total number of fragments reaches the value declared in the broadcast packet header; Ciphertext data reorganization: extract the fragmented data from the buffer queue according to the serial number, remove the fragment header serial number and the checking field, and splice them into a complete ciphertext block to obtain an encrypted data block containing 2048 bytes of ciphertext and 12 bytes of authentication tag.

3. The method of claim 2, wherein, The face feature decryption and identity verification comprises: Decryption and feature extraction: use the AES-256-GCM algorithm to decrypt the ciphertext block, use the pre-shared key of door lock A and the platform, and extract the first 512 bytes of the decrypted plaintext data as the face feature vector; Dynamic pairing code generation: if the face feature similarity exceeds 85%, generate a 6-digit pairing code, and display it dynamically on the display screen of door lock A for 30 seconds; Bluetooth interaction verification: receive the pairing code sent by the neighbor's mobile phone through the BLE service, and if the same code is input for three consecutive times, lock the Bluetooth connection and clear the buffer data.

4. The method of claim 3, wherein, The cross-door lock authorization verification comprises: Door lock information packaging: door lock A packages the door lock ID and IP address into a binary data packet, and transmits it to the neighbor's mobile phone through the established encrypted Bluetooth connection; Cross-door lock data relay: after the neighbor's mobile phone returns to door lock B, door lock B identifies the mobile phone tag DID through the BLE protocol, establishes a secure connection and receives the data packet; Proxy confirmation request construction: door lock B sends a proxy confirmation request to door lock A, which contains door lock ID, mobile phone label DID and request timestamp. Door lock A matches mobile phone label DID with pre-stored summon event record in local cache; Coordinated authorization response: if the matching is successful, door lock A replies with a confirmation message, otherwise it replies with a rejection code.

5. The method of claim 4, wherein, The robot task dispatching and closed loop management includes: After the platform receives the proxy request, it generates a navigation instruction containing the room ID of door lock A and the face feature vector; Autonomous navigation and biometric identification: the robot moves to door lock A according to the navigation instruction, collects the user's face image through the camera, and compares it with the received face feature vector in real time; Task summary generation and cleaning: if the identification is successful, the robot unlocks and opens the door, and sends a task summary to the platform. After the task is completed, the platform deletes the temporary data in door lock A and door lock B, and marks the task status as completed.

6. A system for door lock Bluetooth co-processing, characterized in that, The system includes: The acquisition module is used for Bluetooth slice data acquisition and reorganization: according to the detection of two continuous doorbell trigger signals by door lock A, the Bluetooth scanning module is started to listen to periodic broadcast packets. The received encrypted slice data is sorted and integrity checked by slice reorganization algorithm to obtain complete face feature ciphertext data block; The decryption module is used for face feature decryption and identity verification: based on the face feature ciphertext data block, the AES-256-GCM decryption algorithm is used to decrypt the data combined with the pre-shared key of door lock A and the platform to obtain the plaintext face feature vector, and the similarity comparison is performed with the house owner feature library stored in door lock A. If the similarity exceeds the threshold, a dynamic pairing code is generated; The authorization module is used for cross-door lock proxy authorization verification: according to the successful result of dynamic pairing code verification, door lock A forwards the door lock ID, IP address and target user feature vector to door lock B through the neighbor mobile phone, triggers door lock B to send a proxy confirmation request to door lock A carrying the mobile phone Bluetooth Tag-DID, and obtains the inter-door lock coordinated authorization result; The dispatch module is used for robot task dispatching and closed loop management: based on the coordinated authorization result, the platform sends a navigation instruction carrying the door lock A position and user feature to the robot. The robot generates a task summary after completing face recognition and unlocking operation, synchronously cleans up the temporary data of door lock A, door lock B and the platform, and obtains the closed loop execution record of the proxy process.

7. The system of claim 6, wherein, The Bluetooth slice data acquisition and reorganization includes: Periodic broadcast packet listening: according to the detection of two continuous pressing signals by the physical button sensor of door lock A, the Bluetooth scanning module is activated to enter ACTIVE scanning mode, and the scanning window is set to 100ms; Slice data caching and verification: CRC16 verification is performed on each received broadcast packet. If the verification fails, the data packet is discarded. If the verification is passed, the slice data is stored in the cache queue according to the slice number, and the total slice number reaches the value declared in the broadcast packet header; Ciphertext data reorganization: slice data is extracted from the cache queue according to the serial number, the slice header serial number and the verification field are removed, and the complete ciphertext block is spliced to obtain an encrypted data block containing 2048 bytes of ciphertext and 12 bytes of authentication tag.

8. The system of claim 7, wherein, The face feature decryption and identity verification includes: Decryption and feature extraction: the AES-256-GCM algorithm is used to decrypt the ciphertext block, and the first 512 bytes of the decrypted plaintext data are extracted as the face feature vector using the door lock A and the platform pre-shared key; Dynamic pairing code generation: if the face feature similarity exceeds 85%, a 6-digit pairing code is randomly generated and dynamically displayed on the display screen of door lock A for 30 seconds; Bluetooth interaction verification: receive the pairing code sent by the neighbor's mobile phone through the BLE service, and if the wrong input is continuous for 3 times, lock the Bluetooth connection and clear the cache data.

9. A storage medium, characterized by The storage medium stores a computer program, wherein the computer program is configured to execute the method of any one of claims 1-4 when running.

10. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to execute the computer program to execute the method of any one of claims 1-4.

Images