A method, device, equipment and storage medium for unlocking a smart door lock
By using camera components in the smart door lock to collect user image information in real time, determine the location of the user pointing to the interface, and realize the air-to-air operation unlocking, solving the security risk of malicious intercepting of user input information in the prior art, and improving the security of the unlocking process.
Patent Information
- Application Number
- CN202111348594.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-15
- Publication Date
- 2025-04-25
- Estimated Expiration
- 2041-11-15
AI Technical Summary
When the existing smart door lock is unlocked through a mobile terminal, the user's touch operation information is easily intercepted or recorded maliciously, which poses a security risk.
When establishing a connection between the smart door lock and the mobile terminal, a preset interface is generated and the user's image information is collected in real time through the camera component to determine the position of the user pointing to the interface, thereby pointing to the unlocking information through space operation, avoiding direct input at the terminal.
By pointing information at a distance, the security of the unlocking process is improved, and the risk of user input information being maliciously intercepted or recorded.
Smart Images

Figure CN116129554B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of door lock unlocking technology, and in particular to intelligent access control methods, devices, equipment and storage media. Background Art
[0002] Smart access control is used more and more widely in our lives today. Unlike previous mechanical access control, smart door locks have a variety of unlocking methods. You can use passwords for physical input, magnetic cards for induction recognition, fingerprints, faces and other biometric features for recognition and unlocking, and you can also use mobile phones, tablets, smart watches and other mobile terminals to establish communication with smart door locks to complete the unlocking. These methods do not require users to use keys to complete the unlocking, avoiding the situation where the key is lost or forgotten and caused by the inability to unlock.
[0003] At present, the method of using a mobile terminal to open a smart door lock often requires the user to perform a touch operation on the unlocking interface displayed on the mobile terminal, such as writing a specific pattern on the unlocking interface or moving a specific pattern to a preset area. However, the user's touch operation information can be easily intercepted or recorded maliciously, so this existing unlocking method has security risks. Summary of the invention
[0004] The embodiments of the present application provide a method, device, equipment and computer storage medium for unlocking a smart door lock, which can avoid the risk of user input information being intercepted by a terminal.
[0005] In a first aspect, an embodiment of the present application provides an unlocking method for a smart door lock, which is applied to a smart door lock, wherein a camera assembly is provided in the smart door lock, and the method comprises:
[0006] When the smart door lock is connected to the mobile terminal, a preset interface is generated, and the preset interface is used for the user to enter the unlocking password;
[0007] Sending a preset interface to the mobile terminal so that the mobile terminal displays the preset interface at a preset position;
[0008] Determine a first position of a preset interface pointed to by a user according to a first image captured in real time by the camera assembly;
[0009] Determine target information of the preset interface at the first position according to the relative position relationship between the preset position and the first position, where the target information includes character or graphic information;
[0010] Control the unlocking of the smart door lock according to the target information.
[0011] In a possible implementation manner, before sending the preset interface to the mobile terminal, the method further includes:
[0012] Determining, based on the second image captured in real time by the camera assembly, that the user is pointing to a second position in the third image, where the third image is the image currently displayed on the mobile terminal;
[0013] determining a preset position according to the second position;
[0014] Send the preset location to the mobile terminal.
[0015] In a possible implementation, before determining that the user is pointing to the second position in the third image according to the second image captured in real time by the camera assembly, the method further includes:
[0016] First information sent by a mobile terminal is received, where the first information is sent by the mobile terminal in response to a first input of a user.
[0017] In a possible implementation, before determining the first position where the user points to the preset interface according to the first image captured by the camera assembly, the method further includes:
[0018] Second information sent by the mobile terminal is received, where the second information is sent by the mobile terminal in response to a second input of the user.
[0019] In a possible implementation, the smart door lock is controlled to be unlocked according to the target information, and the method further includes:
[0020] Match the target information with the preset unlock password;
[0021] When the target information matches the unlocking password, the smart door lock is controlled to unlock.
[0022] In a possible implementation, the method further includes:
[0023] The preset interface is an interface including a virtual keyboard or an interface including preset graphics.
[0024] In a second aspect, a method for unlocking a smart door lock is provided, which is applied to a mobile terminal, wherein a camera assembly is provided in the smart door lock, and the method further comprises:
[0025] When the mobile terminal and the smart door lock establish a communication connection, a preset interface sent by the smart door lock is received, and the preset interface is used for the user to enter the unlocking password;
[0026] A preset interface is displayed at a preset position of the mobile terminal, so that the smart door lock determines the first position where the user points to the preset interface based on the first image captured in real time by the camera component; determines the target information of the preset interface at the first position based on the relative position relationship between the preset position and the first position; and controls the smart door lock to unlock based on the target information.
[0027] In a possible implementation, before receiving the preset interface sent by the smart door lock, the method further includes:
[0028] Display the third image so that the camera assembly determines the second position in the third image that the user is pointing to based on the captured second image, and determines the preset position based on the second position;
[0029] Receive the preset position sent by the smart door lock.
[0030] In a possible implementation manner, before displaying the third image, the method further includes:
[0031] In response to a first input from a user, a first message is sent to the smart door lock.
[0032] In a possible implementation, before displaying the preset interface, the method further includes:
[0033] In response to the user's second input, second information is sent to the smart door lock.
[0034] In a third aspect, an embodiment of the present application provides an unlocking device for a smart door lock, which is applied to a smart door lock, wherein a camera assembly is provided in the smart door lock, and the device comprises:
[0035] A generation module, used to generate a preset interface when the smart door lock establishes a communication connection with the mobile terminal, and the preset interface is used for the user to input the unlocking password;
[0036] A sending module, used for sending the preset interface to the mobile terminal, so that the mobile terminal displays the preset interface at a preset position;
[0037] A first determination module, used to determine a first position of a preset interface pointed to by a user according to a first image captured in real time by the camera assembly;
[0038] A second determining module, used to determine target information of a preset interface at the first position according to a relative position relationship between the preset position and the first position;
[0039] The control module is used to control the unlocking of the smart door lock according to the target information.
[0040] In a fourth aspect, an embodiment of the present application provides an unlocking device for a smart door lock, which is applied to a mobile terminal. A camera assembly is provided in the smart door lock, and the device includes:
[0041] A receiving module, used to receive a preset interface sent by the smart door lock when a communication connection is established between the mobile terminal and the smart door lock, and the preset interface is used for the user to input an unlocking password;
[0042] The display module is used to display a preset interface at a preset position on the mobile terminal, so that the smart door lock can determine the first position where the user points to the preset interface based on the first image captured in real time by the camera component; determine the target information of the preset interface at the first position based on the relative position relationship between the preset position and the first position; and control the unlocking of the smart door lock based on the target information.
[0043] In a fifth aspect, an embodiment of the present application provides an unlocking device for a smart door lock, the device comprising:
[0044] a processor and a memory storing computer program instructions;
[0045] When the processor executes the computer program instructions, it implements the unlocking method of the smart door lock provided in the embodiment of the present application.
[0046] In a sixth aspect, an embodiment of the present application provides a computer storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, a method for unlocking a smart door lock as provided in an embodiment of the present application is implemented.
[0047] In an embodiment of the present application, the smart door lock sends a preset interface for the user to input an unlock password to the mobile terminal and displays it on the mobile terminal. Then, the camera component provided on the smart door lock will capture images in real time. Therefore, after the smart door lock determines the first position where the user points to the preset interface based on the first image captured in real time by the camera component, it can determine the target information of the preset interface at the first position, and finally control the smart door lock to unlock according to the target information. Therefore, in an embodiment of the present application, the user does not need to input the unlock information through touch operation on the unlock interface displayed on the mobile terminal, but can point to the unlock information through air operation. The air pointing information is difficult to be maliciously intercepted or recorded, so the embodiment of the present application avoids the possibility of malicious interception or recording of the user's operation information when unlocking, thereby improving the security of unlocking. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] In order to more clearly illustrate the technical solution of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0049] Figure 1 This is a schematic diagram of an unlocking system architecture of a smart door lock provided in one embodiment of the present application.
[0050] Figure 2 It is a flowchart of an unlocking method of a smart door lock provided in an embodiment of the present application.
[0051] Figure 3It is a schematic diagram of a mobile terminal display interface showing a preset interface provided in an embodiment of the present application.
[0052] Figure 4 This is a flowchart of another method for unlocking a smart door lock provided in an embodiment of the present application.
[0053] Figure 5 It is a schematic diagram of a mobile terminal display interface displaying a second image provided in an embodiment of the present application.
[0054] Figure 6 This is a flowchart of another method for unlocking a smart door lock provided in an embodiment of the present application.
[0055] Figure 7 This is a flowchart of another method for unlocking a smart door lock provided in an embodiment of the present application.
[0056] Figure 8 This is a flowchart of another method for unlocking a smart door lock provided in an embodiment of the present application.
[0057] Fig. 9 It is a flow chart of a smart door lock unlocking method provided in an embodiment of the present application.
[0058] Fig.10 It is a structural schematic diagram of an unlocking device of a smart door lock provided in an embodiment of the present application.
[0059] Fig.11 It is a structural schematic diagram of an unlocking device of a smart door lock provided in yet another embodiment of the present application.
[0060] Fig.12 It is a structural schematic diagram of an unlocking device of a smart door lock provided in yet another embodiment of the present application. DETAILED DESCRIPTION
[0061] The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.
[0062] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.
[0063] In order to solve the problems of the prior art, the embodiments of the present application provide a method, device, equipment and computer storage medium for unlocking a smart door lock. The unlocking method of the smart door lock provided by the embodiments of the present application is first introduced below.
[0064] First combine Figure 1 The unlocking system architecture provided by the embodiment of the present application is introduced.
[0065] Figure 1 A schematic diagram of the architecture of a smart door lock unlocking system provided by an embodiment of the present application is shown.
[0066] like Figure 1 As shown, the unlocking system architecture 100 may include: a smart door lock 110 and a mobile terminal 120. The smart door lock 110 is provided with a camera component 111. The mobile terminal 120 is connected to the smart access control 110 via a communication line 130 to realize information interaction between the smart access control 110 and the mobile terminal 120.
[0067] In some embodiments, the mobile terminal 120 may be a mobile phone, a tablet computer, or smart glasses, which is not limited here.
[0068] In some embodiments, the communication line 130 may be of a wireless communication type, which is not limited thereto.
[0069] In some embodiments, the camera component is a camera structure with an augmented reality (AR) function.
[0070] Based on the above architecture, an embodiment of the present application provides a method for unlocking a smart door lock.
[0071] The unlocking method of the smart door lock provided in the embodiment of the present application is described in detail below.
[0072] Figure 22 is a flow chart of a method 200 for unlocking a smart door lock provided in an embodiment of the present application. The execution subject of the unlocking method may be a smart door lock. It should be noted that the above execution subject does not constitute a limitation on the present application.
[0073] like Figure 2 As shown, the smart door lock unlocking method may include the following steps.
[0074] Step 210, when the smart door lock establishes a connection with the mobile terminal, a preset interface is generated.
[0075] In step 210, after establishing a connection with the mobile terminal, the smart door lock generates a preset interface for the user to input a preset unlocking password.
[0076] In some embodiments, the mobile terminal may be a mobile phone, a tablet computer, smart glasses, etc. The mobile terminal may establish a connection with the smart door lock via communication methods such as Bluetooth and WiFi.
[0077] In some embodiments, the preset interface generated by the smart door lock may be an interface including a virtual keyboard or an interface including preset graphics.
[0078] Step 220: Send a preset interface to the mobile terminal so that the mobile terminal displays the preset interface at a preset position.
[0079] In step 220, the smart door lock sends a preset interface to the mobile terminal, and the mobile terminal receives the preset interface and displays the preset interface at a preset position.
[0080] In some embodiments, the preset position is a position that has been determined by the mobile terminal. Specifically, the preset position can be a dot-shaped image, which is not limited here. The smart door lock establishes a connection through the above steps and sends a preset interface to the mobile terminal so that the mobile terminal can display the preset interface at the preset position.
[0081] For example, Figure 3 is a schematic diagram of a mobile terminal display interface showing a preset interface provided in an embodiment of the present application, such as Figure 3 As shown, the smart door lock sends a preset position 311 to the mobile terminal 120. The preset position 311 can be displayed as a dot image at the center of the mobile terminal 120. Then the smart door lock sends a preset interface 312 to the mobile terminal 120. The preset interface 312 can be a virtual keyboard. According to the position of the preset position 311 displayed at the center of the mobile terminal 120, the smart door lock can correspond the number 5 in the center of the virtual keyboard of the preset interface 312 to the preset position 311, and then display the preset interface 312 on the mobile terminal 120. The user enters the preset unlock password according to the preset interface 312 displayed on the mobile terminal 120.
[0082] Step 230: Determine a first position of a preset interface pointed to by a user based on a first image captured in real time by the camera assembly.
[0083] In some embodiments, the camera component is built into the smart door lock and can be a camera component with the function of capturing real-time images. The opening of the camera component is controlled by the smart door lock, and the first position is the position of the first image in the preset interface.
[0084] In some embodiments, the smart door lock controls the camera component to turn on the camera function, and the camera component captures the first image based on the user's unlocking input. The user's unlocking input can be the user knocking, double-clicking, or sliding along a preset trajectory, which is not limited here.
[0085] For example, Figure 3 As shown, the user can enter a preset unlocking password in the preset interface, the camera component captures a first image based on the user's unlocking input, the smart door lock sends the first image to the mobile terminal 120, the mobile terminal 120 displays the first image, and the smart door lock determines the user's unlocking input in the first image as the first position 313 at the position displayed on the mobile terminal.
[0086] Step 240, determining target information of the preset interface at the first position according to the relative position relationship between the preset position and the first position, the target information including character or graphic information.
[0087] In some embodiments, the relative position relationship between the preset position and the first position may be the relative distance relationship between the preset position and the first position, which may be determined by the smart door lock based on the relative distance between the preset position and the first position displayed on the mobile terminal. The target information may be characters or image information. Specifically, the characters may be the string "1234".
[0088] For example, Figure 3 As shown, the smart door lock determines that the first position 313 can be in the upper left of the preset position 311. According to the preset position 311, the upper left of the preset interface 312 corresponds to the number "1234" on the virtual keyboard. The smart door lock determines the target information "1234" at the number "1234" in the preset interface 312 based on the first position 313, that is, the password entered by the user is "1234".
[0089] Step 250, controlling the smart door lock to unlock according to the target information.
[0090] In some embodiments, step 250 may be specifically as follows: the smart door lock matches the target information with a preset unlocking password, and when the target information and the preset unlocking password match, controls the smart door lock to unlock.
[0091] In some embodiments, the preset unlock password may be a password pre-entered by the user in the smart door lock, which is used to match the smart door lock with the preset unlock password, and the preset unlock password may be characters or image information, specifically a string of "1234", which is not limited here.
[0092] In some embodiments, when the preset unlocking password is characters or image information, step 250 may be specifically as follows: the smart door lock compares the characters or image information in the target information with the characters or image information in the preset unlocking password. If the characters or image information in the target information are consistent with the characters or image information in the preset unlocking password, the smart door lock can be used to unlock the door. If they are inconsistent, the unlocking fails, and the smart door lock needs to re-determine the target information.
[0093] The above is a method for unlocking a smart door lock provided in an embodiment of the present application. In an embodiment of the present application, the smart door lock sends a preset interface for the user to input an unlock password to a mobile terminal and displays it on the mobile terminal. Then, the camera component provided on the smart door lock will capture images in real time. Therefore, after the smart door lock determines the first position of the preset interface pointed by the user according to the first image captured in real time by the camera component, it can determine the target information of the preset interface at the first position, and finally control the smart door lock to unlock according to the target information. Therefore, in an embodiment of the present application, the user does not need to input the unlock information through touch operation on the unlock interface displayed on the mobile terminal, but can point to the unlock information through air operation. The air pointing information is difficult to be maliciously intercepted or recorded, so the embodiment of the present application avoids the possibility of malicious interception or recording of the user's operation information when unlocking, and improves the security of unlocking.
[0094] In order to better increase the security of the smart door lock unlocking method, this application also provides the following Figure 4 A flowchart of another unlocking method 400 of a smart door lock is shown.
[0095] like Figure 4 As shown, the smart door lock unlocking method is described above. Figure 2 Before step 220, the following steps may be further included:
[0096] Step 410: Determine the second position in the third image that the user is pointing to based on the second image captured in real time by the camera assembly, where the third image is the image currently displayed on the mobile terminal.
[0097] In some embodiments, the second image may be an image captured in real time by the camera component, specifically an image captured by the camera component based on input made by the user to determine the second position. The user's input may be tapping, double-clicking, or sliding along a preset trajectory, and there is no limitation here.
[0098] In some embodiments, the third image is an image captured by the camera component in real time. The smart door lock sends the third image to the mobile terminal, and the mobile terminal displays the third image.
[0099] Step 420: Determine a preset position according to the second position.
[0100] In some embodiments, the second position is determined by the above step 410, and the smart door lock determines the preset position based on the second position.
[0101] Step 430: Send the preset location to the mobile terminal.
[0102] In some embodiments, the smart door lock sends a preset position to the mobile terminal so that the preset position is displayed on the mobile terminal.
[0103] For example, Figure 5 1 is a schematic diagram of a mobile terminal display interface showing a second image provided by an embodiment of the present application. The camera component captures the third image 511 of the current real-time image, and the smart door lock sends the third image 511 to the mobile terminal 120, which displays the third image 511. The camera component can capture the second image according to the user's input, and the user's input can be a tap, a double-click, or a sliding action along a preset trajectory. The smart door lock sends the second image to the mobile terminal 120, and the mobile terminal 120 displays the second image. The user's input can be displayed at the center position of the third image, and the smart door lock determines this position as the second position. Then the smart door lock determines the preset position 311 according to the second position, and sends the preset position 311 to the mobile terminal 120, and the mobile terminal 120 displays the preset position 311.
[0104] Specifically, other related technical solutions in the above steps can refer to the relevant descriptions of steps 210 to 250 above, and will not be elaborated here.
[0105] In order to better increase the security of the smart door lock unlocking method, this application also provides the following Figure 6 A flow chart of another unlocking method 600 of a smart door lock is shown.
[0106] like Figure 6 As shown, the unlocking method of the smart door lock is as follows Figure 4 Before step 410, the following steps may be further included:
[0107] Step 610: Receive first information sent by a mobile terminal.
[0108] In some embodiments, the mobile terminal sends a first message to the smart door lock in response to a first input from the user, and the smart door lock receives the first message sent by the mobile terminal.
[0109] In some embodiments, the first input is the user input when the camera assembly captures the second image. Specifically, the user input can be a tap, a double-click, or a sliding action along a preset trajectory, which is not limited here. After receiving the user's first input, the mobile terminal sends the first information to the smart door lock, and the smart door lock determines the second position after receiving the first information.
[0110] Specifically, other related technical solutions in the above steps can refer to the relevant descriptions of steps 210 to 250 above, and will not be elaborated here.
[0111] In order to better increase the security of the smart door lock unlocking method, this application also provides the following Figure 7 A flow chart of another unlocking method 700 of a smart door lock is shown.
[0112] like Figure 7 The unlocking method of the smart door lock is shown in the above Figure 2 Before step 230, the following steps may be further included:
[0113] Step 710: Receive second information sent by a mobile terminal.
[0114] Specifically, the mobile terminal responds to the user's second input and sends the second information to the smart door lock, and the smart door lock receives the second information sent by the mobile terminal.
[0115] In some embodiments, the second input is a user's unlocking input, specifically, it can be a tap, a double-click, or a sliding action along a preset trajectory, which is not limited here. The mobile terminal sends the second information to the smart door lock, and the smart door lock determines the first position after receiving the second information.
[0116] Figure 8 This is a flow chart of another unlocking method 800 of a smart door lock provided in an embodiment of the present application, and the execution subject of the unlocking method may be a mobile terminal. It should be noted that the above execution subject does not constitute a limitation on the present application.
[0117] like Figure 8 As shown, the smart door lock unlocking method may include the following steps:
[0118] Step 810, when a communication connection is established between the mobile terminal and the smart door lock, a preset interface sent by the smart door lock is received, where the preset interface is used for the user to input an unlock password.
[0119] In some embodiments, the preset interface may be an interface including a virtual keyboard or an interface including preset graphics.
[0120] Step 820, displaying the preset interface at the preset position of the mobile terminal, so that the smart door lock determines the first position where the user points to the preset interface according to the first image captured in real time by the camera component; determines the target information of the preset interface at the first position according to the relative position relationship between the preset position and the first position; and controls the unlocking of the smart door lock according to the target information.
[0121] In some embodiments, the first image is an image captured in real time by the camera assembly based on the user's unlocking input, and the preset position is a position sent by the smart door lock to the mobile terminal based on the user's unlocking input and displayed on the mobile terminal.
[0122] In some embodiments, before step 810, the following steps are further included:
[0123] The third image is displayed so that the camera assembly determines that the user is pointing to the second position in the third image based on the captured second image, and determines the preset position based on the second position.
[0124] Receive the preset position sent by the smart door lock.
[0125] In some embodiments, the second image may be an image captured by the camera assembly in real time, specifically an image captured by the camera assembly based on an input made by a user to determine the second position, and the user input may be a tap, double-click, or a sliding action along a preset trajectory, which is not limited here. The third image is an image captured by the camera assembly in real time, and the second position is a position determined by the smart door lock based on the position of the user input in the third image.
[0126] In some embodiments, before displaying the third image, the method further includes the following steps:
[0127] In response to a first input from a user, a first message is sent to the smart door lock.
[0128] In some embodiments, the first input is a user input when the camera assembly captures the second image. Specifically, the user input can be a tap, a double-click, or a sliding action along a preset trajectory, which is not limited here. The first information is sent by the mobile terminal to the smart door lock so that the smart door lock determines the second position.
[0129] In some embodiments of the present application, before step 820, the following steps are also included:
[0130] In response to the user's second input, second information is sent to the smart door lock.
[0131] In some embodiments, the second input is an unlocking input by the user, specifically, it can be an action of tapping, double-clicking, or sliding along a preset trajectory.
[0132] In some embodiments, when the unlock password is a string of "1234", the user can input the character "1", and the mobile terminal responds to the user's first input of the character "1" in the preset interface, and sends a second message to the smart door lock. The smart door lock determines that the user's first input is at the character "1" position in the first image, and then the user continues to input the character "2". The mobile terminal responds to the user's first input of the character "2" in the preset interface, and sends a second message to the smart door lock. The smart door lock determines that the user's first input is at the character "2" position in the first image. The steps for "3" and "4" characters are similar and are not repeated here. After the user completes the tapping action of all characters, the smart door lock determines the target information at the first position in the first image, and the target information is the string of "1234". Then the smart door lock matches the string 1234 of the target information with the string "1234" of the preset unlock password. If the match is consistent, the smart door lock will unlock.
[0133] It should be noted that the application scenarios described in the above-mentioned embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Ordinary technicians in this field can know that with the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0134] The above embodiments are all described by taking the execution subject as a mobile terminal or a smart door lock as an example. In order to more clearly understand the unlocking method of the smart door lock in the embodiment of the present application, the complete interaction embodiment between the mobile terminal and the smart door lock is introduced below. Fig. 9 , Fig. 9 It is a flow chart of a smart door lock unlocking method provided in an embodiment of the present application.
[0135] like Fig. 9 As shown, the smart door lock unlocking method provided in the embodiment of the present application may include steps 910 to 980.
[0136] Step 910: The mobile terminal establishes a connection with the smart door lock.
[0137] Step 920: The smart door lock generates a preset interface, which is used for the user to enter an unlocking password.
[0138] Step 930: The smart door lock sends a preset interface to the mobile terminal.
[0139] Step 940: The mobile terminal receives a preset interface sent by the smart door lock.
[0140] Step 950: Display a preset interface at a preset position of the mobile terminal.
[0141] Step 960: The smart door lock determines the first position of the preset interface pointed to by the user based on the first image captured in real time by the camera component.
[0142] Step 970: The smart door lock determines target information of the preset interface at the first position based on the relative position relationship between the preset position and the first position.
[0143] Step 980, control the smart door lock to unlock according to the target information.
[0144] Based on the above Figure 2 The unlocking method of the smart door lock provided by the present application also provides an unlocking device for the smart door lock. Fig.10 , Fig.10 The schematic diagram of the structure of the unlocking device 1000 of the smart door lock is shown. The unlocking device can be applied to the smart door lock.
[0145] like Fig.10 As shown, the device specifically includes:
[0146] The generation module 1010 is used to generate a preset interface when the smart door lock establishes a communication connection with the mobile terminal. The preset interface is used for the user to input the unlocking password.
[0147] The sending module 1020 is used to send the preset interface to the mobile terminal, so that the mobile terminal displays the preset interface at a preset position.
[0148] The first determination module 1030 is used to determine a first position of a preset interface pointed to by a user according to a first image captured in real time by the camera assembly.
[0149] The second determining module 1040 is used to determine the target information of the preset interface at the first position according to the relative position relationship between the preset position and the first position.
[0150] The control module 1050 is used to control the unlocking of the smart door lock according to the target information.
[0151] The above is an unlocking device for a smart door lock provided in an embodiment of the present application. In an embodiment of the present application, the smart door lock sends a preset interface for the user to input an unlocking password to a mobile terminal and displays it on the mobile terminal. Then, the camera component provided on the smart door lock will capture images in real time. Therefore, after the smart door lock determines the first position of the preset interface pointed by the user according to the first image captured in real time by the camera component, it can determine the target information of the preset interface at the first position, and finally control the unlocking of the smart door lock according to the target information. Therefore, in an embodiment of the present application, the user does not need to input the unlocking information through touch operation on the unlocking interface displayed on the mobile terminal, but can point to the unlocking information through air operation. The air pointing information is difficult to be maliciously intercepted or recorded, so the embodiment of the present application avoids the possibility of malicious interception or recording of the operation information of the user when unlocking, and improves the security of unlocking.
[0152] Based on the above Figure 7 The unlocking method of the smart door lock provided by the present application also provides an unlocking device for the smart door lock. Fig.11 , Fig.11 The schematic diagram of the structure of the unlocking device 1100 of the smart door lock is shown. The unlocking device can be applied to a mobile terminal.
[0153] like Fig.11 As shown, the device specifically includes:
[0154] The receiving module 1110 is used to receive a preset interface sent by the smart door lock when a communication connection is established between the mobile terminal and the smart door lock. The preset interface is used for the user to input an unlocking password.
[0155] The display module 1120 is used to display a preset interface at a preset position on the mobile terminal, so that the smart door lock can determine the first position where the user points to the preset interface based on the first image captured in real time by the camera component; determine the target information of the preset interface at the first position based on the relative position relationship between the preset position and the first position; and control the unlocking of the smart door lock based on the target information.
[0156] Based on the method provided in the above embodiment, the embodiment of the present application also provides a specific implementation of the unlocking device of the smart door lock. Fig.12 A schematic structural diagram of an unlocking device for a smart door lock is shown.
[0157] like Fig.12 As shown, the unlocking device of the smart door lock may include a processor 1210 and a memory 1220 storing computer program instructions.
[0158] Specifically, the processor 1210 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.
[0159] The memory 1220 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 1220 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In appropriate cases, the memory 1220 may include a removable or non-removable (or fixed) medium. In appropriate cases, the memory 1220 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 1220 is a non-volatile solid-state memory.
[0160] The memory may include read-only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical or other physical / tangible memory storage devices. Thus, typically, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to an aspect of the present disclosure.
[0161] The processor 1210 implements any one of the smart door lock unlocking methods in the above embodiments by reading and executing computer program instructions stored in the memory 1220.
[0162] In one example, the unlocking device of the smart door lock may further include a communication interface 1230 and a bus 1240. Fig.12 As shown, the processor 1210, the memory 1220, and the communication interface 1230 are connected via a bus 1240 and communicate with each other.
[0163] The communication interface 1230 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.
[0164] Bus 1240 includes hardware, software or both, and the parts of online data flow billing equipment are coupled to each other. For example, but not limitation, bus may include accelerated graphics port (AGP) or other graphics bus, enhanced industrial standard architecture (EISA) bus, front-end bus (FSB), hypertransport (HT) interconnection, industrial standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 1040 may include one or more buses. Although the present application embodiment describes and shows a specific bus, the present application considers any suitable bus or interconnection.
[0165] In addition, in combination with the smart door lock unlocking method in the above embodiment, the embodiment of the present application can provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when the computer program instructions are executed by the processor, any one of the smart door lock unlocking methods in the above embodiment is implemented.
[0166] It should be clear that the present application is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present application is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present application.
[0167] The functional blocks shown in the above-described block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present application are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.
[0168] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiment, or in a different order from the embodiment, or several steps can be performed simultaneously.
[0169] The above reference is according to the method of the embodiment of the present application, the flow chart of the device (system) and the computer program product and / or the block diagram described various aspects of the present application.It should be understood that each square box in the flow chart and / or the block diagram and the combination of each square box in the flow chart and / or the block diagram can be realized by computer program instructions.These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer or other programmable data processing device to produce a machine so that these instructions executed by the processor of the computer or other programmable data processing device enable the realization of the function / action specified in one or more square boxes of the flow chart and / or the block diagram.Such a processor can be but is not limited to a general-purpose processor, a special-purpose processor, a special application processor or a field programmable logic circuit.It can also be understood that each square box in the block diagram and / or the flow chart and the combination of the square boxes in the block diagram and / or the flow chart can also be realized by the dedicated hardware that performs the specified function or action, or can be realized by the combination of dedicated hardware and computer instructions.
[0170] The above is only a specific implementation of the present application. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the protection scope of the present application is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the protection scope of this application.
Claims
1. A method for unlocking a smart door lock, characterized in that: Applied to a smart door lock, wherein a camera assembly is provided in the smart door lock, the method comprises: When the smart door lock establishes a communication connection with the mobile terminal, a preset interface is generated, and the preset interface is used for the user to input the unlocking password; Sending the preset interface to the mobile terminal so that the mobile terminal displays the preset interface at a preset position; Determine a first position of a preset interface pointed to by the user according to a first image captured in real time by the camera assembly; Determining target information of the preset interface at the first position according to a relative position relationship between the preset position and the first position; The smart door lock is controlled to unlock according to the target information.
2. The unlocking method according to claim 1, characterized in that: Before sending the preset interface to the mobile terminal, the method further includes: Determining a second position in a third image pointed to by the user according to the second image captured in real time by the camera assembly; the third image is an image currently displayed on the mobile terminal; determining the preset position according to the second position; The preset location is sent to the mobile terminal.
3. The unlocking method according to claim 2, characterized in that: Before determining, based on the second image captured in real time by the camera assembly, that the user is pointing to a second position in the third image, the method further includes: First information sent by the mobile terminal is received, where the first information is sent by the mobile terminal in response to a first input by the user.
4. The unlocking method according to any one of claims 1 to 3, characterized in that: Before determining the first position of the preset interface pointed to by the user according to the first image captured by the camera assembly, the method further includes: Second information sent by the mobile terminal is received, where the second information is sent by the mobile terminal in response to a second input by the user.
5. The unlocking method according to any one of claims 1 to 3, characterized in that: Controlling the smart door lock to unlock according to the target information, the method specifically includes: Matching the target information with a preset unlock password; When the target information matches the preset unlocking password, the smart door lock is controlled to unlock.
6. The unlocking method according to any one of claims 1 to 3, characterized in that: The preset interface is an interface including a virtual keyboard or an interface including preset graphics.
7. A method for unlocking a smart door lock, characterized in that: Applied to a mobile terminal, the smart door lock is provided with a camera assembly, and the method comprises: When the mobile terminal and the smart door lock establish a communication connection, receiving a preset interface sent by the smart door lock, wherein the preset interface is used for a user to input an unlocking password; The preset interface is displayed at the preset position of the mobile terminal, so that the smart door lock determines the first position where the user points to the preset interface according to the first image captured in real time by the camera component; determines the target information of the preset interface at the first position according to the relative position relationship between the preset position and the first position; and controls the unlocking of the smart door lock according to the target information.
8. The unlocking method according to claim 7, characterized in that: Before receiving the preset interface sent by the smart door lock, the method further includes: Displaying a third image so that the camera assembly determines the second position in the third image pointed to by the user according to the captured second image, and determines the preset position according to the second position; Receive the preset position sent by the smart door lock.
9. The unlocking method according to claim 8, characterized in that: Before displaying the third image, the method further includes: In response to the first input of the user, first information is sent to the smart door lock.
10. The unlocking method according to any one of claims 7 to 9, characterized in that: Before displaying the preset interface, the method further includes: In response to the user's second input, second information is sent to the smart door lock.
11. An unlocking device for a smart door lock, characterized in that: Applied to a smart door lock, the smart door lock is provided with a camera assembly, and the device comprises: A generating module, used to generate a preset interface when the smart door lock establishes a communication connection with the mobile terminal, and the preset interface is used for the user to input the unlocking password; A sending module, used for sending the preset interface to the mobile terminal, so that the mobile terminal displays the preset interface at a preset position; A first determining module, configured to determine a first position of the preset interface pointed to by the user according to a first image captured in real time by the camera assembly; A second determining module, configured to determine target information of the preset interface at the first position according to a relative position relationship between the preset position and the first position; A control module is used to control the unlocking of the smart door lock according to the target information.
12. An unlocking device for a smart door lock, characterized in that: Applied to a mobile terminal, the smart door lock is provided with a camera assembly, and the device comprises: A receiving module, used to receive a preset interface sent by the smart door lock when the mobile terminal and the smart door lock establish a communication connection, wherein the preset interface is used for a user to input an unlocking password; The display module is used to display the preset interface at a preset position on the mobile terminal, so that the smart door lock can determine the first position where the user points to the preset interface according to the first image captured in real time by the camera component; determine the target information of the preset interface at the first position according to the relative position relationship between the preset position and the first position; and control the unlocking of the smart door lock according to the target information.
13. An unlocking device for a smart door lock, characterized in that: The device comprises: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, it implements the unlocking method of the smart door lock as described in any one of claims 1-10.
14. A computer storage medium, characterized in that: The computer storage medium stores computer program instructions, and when the computer program instructions are executed by the processor, the unlocking method of the smart door lock as described in any one of claims 1-10 is implemented.
Citation Information
Patent Citations
Door lock device and method of operating thereof
KR1020170047797A