Expansion screen, client and intelligent lock system

Abstract

The invention discloses an expansion screen capable of being applied to an intelligent lock system, a client side and the intelligent lock system comprising the expansion screen and the client side. The expansion screen comprises a display panel, a networking module and a control module which is respectively connected with the display panel and the control module. The control module can execute a method for safely binding the extension screen to the account bound to the intelligent lock, so that the intelligent lock and the extension screen are bound to the same account. By the adoption of the scheme, a user can remotely operate the intelligent lock through a client such as a mobile phone APP and the like and can also remotely operate the intelligent lock through the expansion screen, the intelligent lock is more convenient and friendly to the user, and therefore the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of smart lock technology, and in particular to an extended screen and a client that can be applied to a smart lock system, and a smart lock system including the aforementioned extended screen and the client. Background Art

[0002] At present, the development of smart locks has entered the stage of video intercom, and many smart locks support video intercom between the owner and the visitor at the door. The owner can see the visitor at the door in the mobile phone APP of the smart lock, conduct video intercom with him, and unlock the door for the visitor through the APP when necessary.

[0003] However, in some cases, using a mobile phone APP for video intercom and / or remote unlocking is still not convenient enough, and there is room for improvement. Summary of the invention

[0004] One of the purposes of this application is to introduce an extended screen into the smart lock system, and with the help of the client, the extended screen is also securely bound to the account bound to the smart lock. In this way, the user can not only perform visual intercom and / or remote unlocking operations on the smart lock through the client, but also through the extended screen, which is more convenient and user-friendly for users and can enhance the user experience.

[0005] A first aspect of the present application provides an extended screen for a smart lock system, the extended screen comprising: a display panel, a networking module, and a control module connected to the display panel and the networking module respectively; wherein the control module is used to: generate a temporary encryption key and a temporary signature key for binding; control the display panel to display a graphic code, wherein the graphic code carries at least the following information: the device ID of the extended screen, the temporary encryption key and the temporary signature key; the graphic code can be scanned by a client to obtain the information carried therein; the binding information is received from the server through the networking module, the binding information is obtained by the client of the logged-in account using the temporary encryption key and the temporary signature key to encrypt and sign at least the device ID of the extended screen and the account ID of the account; the temporary encryption key is used to generate a temporary encryption key and a temporary signature key for binding .... The binding information is decrypted using the temporary encryption key and the temporary signature key, and a first signature verification is performed; if the first signature verification passes, a binding instruction including the device ID of the extended screen and the account ID is sent to the server through the networking module, so that the server stores the binding relationship between the account ID and the device ID of the extended screen; a remote operation key package is received from the server through the networking module, and the remote operation key package is generated by the client of the logged-in account using the temporary encryption key and the temporary signature key to encrypt and sign at least the device ID of the extended screen and the remote operation key; the remote operation key package is decrypted using the temporary encryption key and the temporary signature key, and a second signature verification is performed; if the second signature verification passes, the remote operation key is stored.

[0006] In combination with the first aspect, in a possible implementation, the generating of a temporary encryption key and a temporary signature key for binding includes: entering a binding mode in response to a first instruction input by a user; and generating the temporary encryption key and the temporary signature key in the binding mode.

[0007] In combination with the first aspect, in a possible implementation, the control module is also used to: in response to the first instruction, send a binding task creation request to the server through the networking module, and receive a task identifier, wherein the task identifier is a unique identifier assigned by the server to the created binding task in response to the binding task creation request, and the task identifier can be carried in the graphic code.

[0008] In combination with the first aspect, in a possible implementation method, the server stores a remote operation key ciphertext. After the server stores the binding relationship between the account ID and the device ID of the extended screen, the remote operation key ciphertext is sent to the client and is decrypted by the client using a locally stored first key to generate a remote operation key package.

[0009] In combination with the first aspect, in a possible implementation method, the remote operation key package includes device IDs of at least two smart locks bound to the account and corresponding remote operation keys; storing the remote operation keys includes: respectively associating and storing the device IDs of the smart locks and the corresponding remote operation keys.

[0010] In combination with the first aspect, in a possible implementation method, the control module is also used to: if the first signature verification / the second signature verification fails, instruct the client to resend the binding information / the remote operation key package through the networking module and the server; if the first signature verification and / or the second signature verification fails more than a preset number of times, exit the binding mode.

[0011] In combination with the first aspect, in a possible implementation method, the control module is also used to: receive a second remote unlocking request from the server, the second remote unlocking request including at least: the device ID of the smart lock and a random number generated by the smart lock; in response to a fifth instruction input by a user in the control area, generate a remote unlocking response package, the remote unlocking response package including: the random number encrypted using the remote operation key and the device ID of the smart lock; the remote unlocking response package can be used by the smart lock to decrypt and verify and perform unlocking if the verification passes.

[0012] In combination with the first aspect, in a possible implementation method, before generating a remote unlocking response package in response to a fifth instruction input by a user in a controlled area, it also includes: receiving room connection information of a video intercom room from the server, wherein the video intercom room is created by the server in response to a remote call request sent by the smart lock; joining the video intercom room using the room connection information; receiving real-time video stream data published by the smart lock in the video intercom room, and displaying it through the display panel; in response to a fourth instruction input by a user in the controlled area corresponding to the smart lock, opening an audio stream so that the extended screen and the smart lock can perform two-way voice interaction based on the video intercom room; wherein an unlocking control is also displayed on the display panel, and the fifth instruction is input by a user in the controlled area by operating the unlocking control.

[0013] The second aspect of the present application provides a client for a smart lock system, wherein the client is bound to the smart lock and has negotiated a remote operation key, and the client is further used to: obtain information carried in the graphic code by scanning the graphic code displayed on the extended screen, including: the device ID of the extended screen, a temporary encryption key and a temporary signature key generated by the extended screen for binding; in the case of a logged-in account, encrypt and sign at least the device ID of the extended screen and the account ID of the account using the temporary encryption key and the temporary signature key to obtain binding information; send the binding information to a server so that the server sends the binding information to the extended screen; and respond to the binding instruction sent by the extended screen at the server. When storing the binding relationship between the account ID and the device ID of the extended screen, use the temporary encryption key and the temporary signature key to encrypt and sign at least the device ID of the extended screen and the remote operation key to generate a remote operation key package; wherein, the binding instruction is sent to the server by the extended screen after the binding information is decrypted using the temporary encryption key and the temporary signature key and a first signature verification is passed; the remote operation key package is sent to the server so that the extended screen stores the decrypted remote operation key after decrypting the remote operation key package received from the server using the temporary encryption key and the temporary signature key and a second signature verification is passed.

[0014] The third aspect of the present application provides a smart lock system, including a smart lock, a server, any possible expansion screen as described above, and any possible client as described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is a schematic diagram of the architecture of an exemplary smart lock system including an extended screen of the present application.

[0016] Figure 2 This is a schematic diagram of an exemplary process of binding an extended screen in an embodiment of the present application.

[0017] Figure 3 A schematic diagram of a client user interface in an exemplary binding process in an embodiment of the present application.

[0018] Figure 4 This is another schematic diagram of a client user interface in an exemplary binding process in an embodiment of the present application.

[0019] Figure 5 This is another schematic diagram of a client user interface in an exemplary binding process in an embodiment of the present application.

[0020] Figure 6This is an exemplary flow chart of using an extended screen and a smart lock for visual intercom and remote unlocking in an embodiment of the present application. DETAILED DESCRIPTION

[0021] In order to clearly and completely describe the technical solution of the present application, further explanation will be given below in conjunction with embodiments and drawings.

[0022] The smart lock system used to achieve visual intercom and / or remote unlocking generally includes a smart lock, a mobile phone APP and a cloud platform (with a server deployed). The smart lock is configured with a cloud platform address when it leaves the factory. After the user configures the network for the smart lock, the smart lock can establish a communication connection with the cloud platform through the cloud platform address configured at the factory. The user can use the mobile phone APP to register an account on the cloud platform, log in to the account, and then bind the smart lock to the account logged in by the mobile phone APP. On this basis, the user can conduct visual intercom and / or remote unlocking with the visitor in front of the smart lock through the mobile phone APP.

[0023] However, in some cases, it is still not convenient enough to use mobile phone APP for video intercom and / or remote unlocking. For example, for some elderly users, there are many steps to operate on the mobile phone APP. It is necessary to open the self-powered mobile phone to find a specific APP, and then operate in the specific interface of the APP, which is still cumbersome. When the elderly user is indoors (such as a bedroom) and not near the smart lock, if a visitor outside the door presses the doorbell on the smart lock at this time, it is necessary to move from the room to the door to operate the smart lock to talk to the visitor, which is certainly not convenient for him, and if he needs to perform complex operations on the mobile phone APP, it is also not convenient and friendly for some elderly users. For another example, when the user is using the video conferencing or voice call functions of the mobile phone, if a visitor outside the door presses the doorbell on the smart lock at this time, the user may not be able to pay attention to the push information of the mobile phone APP in time, or, even if the user pays attention to the message of the APP, he has to interrupt the current video conference or voice call to connect the video intercom with the visitor.

[0024] The present application proposes a solution to introduce an extended screen into the smart lock system. The extended screen is a dedicated hardware device that is different from mobile terminals such as mobile phones and tablets. It is also bound to the account that the smart lock has been bound to, that is, the smart lock and the extended screen are bound to the same account, so that users can not only remotely operate the smart lock through clients such as mobile phone APP (for example, video intercom and / or remote unlocking), but also through the extended screen, which is more convenient and user-friendly, thereby improving the user experience. Based on this solution, the embodiment of the present application provides a method for securely binding the above-mentioned extended screen to an account, and a method for remotely operating the smart lock using the bound extended screen.

[0025] The following will first introduce an exemplary architecture of the extended screen of the present application when applied to a smart lock system, and then introduce the aforementioned binding and remote operation methods in turn.

[0026] See also Figure 1 , Figure 1 This is an exemplary system diagram of the extended screen of the present application and the smart lock system to which it is applied. The system includes a smart lock, a client, a server and an extended screen.

[0027] The smart lock in the embodiment of the present application can be an independent single smart lock product, or a smart lock component integrated in a smart door, which is not limited in the present application. The smart lock can include components such as a camera, a networking module (hereinafter referred to as a first networking module for ease of distinction), a microphone, and a speaker.

[0028] The camera is used to collect image information of the environment in which the smart lock is located. The image may be, for example, an image in front of the smart lock, smart door, etc., which may include living things (such as people, animals, etc.) or non-living things (such as walls, floors, lamps, etc.).

[0029] The first networking module is used to establish a communication connection with the server. The first networking module in the embodiment of the present application includes but is not limited to: a WiFi module, a NBIoT module, a 4G / 5G module, etc.

[0030] The microphone is used to collect sound information in the environment where the smart lock is located.

[0031] The speaker is used to play sound information, which can be sound information preset in the smart lock, or sound information received from the outside (for example, from the server or client, extended screen, etc.).

[0032] When functions such as video intercom are required between the smart lock and the client, extended screen, etc., the above components can be called to implement it.

[0033] It is understandable that the smart lock may also include other necessary or possible components or functional modules, such as a lock body, a display screen, a sensor, a control unit, etc. These components or functional modules may be implemented in the form of hardware, computer software, a combination of hardware and computer software, etc., which is not limited in this application. The inner panel of the smart lock may be provided with a display screen, or may not be provided with a display screen, which is not limited in this application. For a smart lock without a display screen on the inner panel, the user cannot directly view the image information collected by the camera, etc. through the smart lock inside the door, and naturally does not support direct video intercom with visitors through the smart lock (rather than through the client on the mobile terminal). Regardless of whether a display screen is provided on the inner panel, the extended screen of the present application can be introduced to realize functions such as video intercom and / or remote unlocking.

[0034] The client in the embodiment of the present application is on a mobile terminal, which can be exemplarily an APP, a mini-program, a WEB application, etc., and the present application does not limit its specific product form. The client is used to interact with the server for data, and in some cases the client can also interact with the smart lock and the expansion screen for data. The mobile terminal here may include but is not limited to mobile terminals such as mobile phones, tablet computers, wearable devices, augmented reality (AR) / virtual reality (VR) devices, personal digital assistants (PDAs), etc., which are used by users. The present application does not limit the specific product form / type of the user device, but it must at least have the function of scanning graphic codes.

[0035] The server in the embodiments of the present application may be located on an independent physical server, or on a server cluster or distributed system consisting of multiple physical servers, or on a cloud server or cloud computing service center that provides cloud services, cloud databases, cloud computing, cloud storage, network services, cloud communications, middleware services, security services, content distribution services, big data and artificial intelligence platforms, etc. The present application does not limit the specific product form and deployment method of the server. The server can establish a communication connection with the smart lock to provide services for the smart lock, and can also establish a communication connection with the user's mobile terminal such as a mobile phone, and the newly introduced extended screen in the embodiments of the present application and provide a service screen.

[0036] The user can register an account on the server through the client on the mobile terminal, log in to the account, and then bind the smart lock to the account logged in by the client. During the binding process, the smart lock can generate a remote operation key, which is a key specifically used for specific remote operations (such as remote unlocking, etc.) and needs to be distinguished from other possible keys. The remote operation key ciphertext obtained after the remote operation key is encrypted can be stored on the server and stored in association with the account logged in by the client. The key required to decrypt the remote operation key ciphertext can be stored by the client, and the server cannot obtain the decryption key, thereby improving the security of the remote operation key.

[0037] Exemplarily, in an implementation method of binding a smart lock to an account logged in by a client, a local communication connection can be first established between the smart lock L1 and the client of the logged-in account SU1 through a short-range communication method such as NFC and Bluetooth, and then the local communication connection is used to negotiate a / pair of storage keys SK1 (for ease of distinction, the key is referred to as the first key in the embodiment of the present application). The first key can be a symmetric key or an asymmetric key, which is not limited in the present application. The following is an example of using a symmetric key (i.e., encryption and decryption both use the first key). The smart lock L1 can generate a remote operation key RKey1, and use the first key SK1 to encrypt the remote operation key RKey1 to obtain a remote operation key ciphertext. The remote operation key ciphertext is associated with the aforementioned account SU1 and stored on the server, for example in the form of {SU1, L1, RKey1} or similar. The client stores the first key SK1 locally on the mobile terminal, but the server cannot obtain the first key SK1, and therefore cannot decrypt and obtain the remote operation key.

[0038] It should be noted that, for different smart locks bound to the same account, their associated remote operation keys can usually be different, such as {SU1, L1, RKey1}, {SU1, L2, RKey2}... For the same smart lock bound to different accounts, their associated remote operation keys can usually be different, such as {SU2, L1, RKey3}, {SU3, L1, RKey4}... It should also be noted that the first key used for encrypting and decrypting the remote operation key can also be different accordingly, such as SK1, SK2, SK3, SK4...

[0039] After binding, when the client needs to use the remote operation key, for example, when a visitor presses the doorbell on the smart lock to trigger a remote unlocking request, the client can obtain the remote operation key ciphertext from the server, decrypt it, and then use the remote operation key to remotely instruct the smart lock to unlock.

[0040] The extended screen in the embodiment of the present application is a dedicated hardware device, which can be set in the control area corresponding to the smart lock, for example, it can be set in the same physical space or building space as the smart lock. For example, in a home environment, the smart lock is usually located at the entrance, and the extended screen can be placed on the wall of the home, on the desktop in the room, etc. It can be detachable or movable, and this application does not limit this.

[0041] In some implementations, the extended screen includes a housing, and a display panel, a networking module (also referred to as a second networking module hereinafter for ease of distinction), and a control module in the housing.

[0042] The display panel is used to display images, and may be a panel in the prior art, such as an LCD, OLED, or LED panel.

[0043] The second networking module generally refers to a hardware or software component that enables a device to connect to the Internet. The second networking module in the embodiment of the present application mainly refers to a long-distance wireless communication module, such as a Wi-Fi module. Such a module enables the extended screen to access network resources, thereby enabling data to be sent and received with the server. Optionally, the first networking module of the smart lock and the second networking module of the extended screen can be connected to the same local area network after both are configured.

[0044] The control module is directly or indirectly connected to the display panel and the second networking module, and is used to drive the display panel to display, control the second networking module to connect to the network, and realize other possible functions. Some functions realized by the control module will be further described in the subsequent method.

[0045] In some implementations, the control module may include a single-chip microcomputer, which may be disposed on a single-chip microcomputer circuit board. It is understandable that other possible components may also be disposed on the single-chip microcomputer circuit board, such as a power supply, a sensor, a driver, etc., which is not limited in this application.

[0046] In some implementations, the extended screen does not include a short-range communication module such as an NFC module or a Bluetooth module, thereby streamlining the structure of the extended screen and reducing the cost of the extended screen.

[0047] In the embodiment of the present application, the extended screen is introduced into the smart lock system as a dedicated device for expansion, and the binding of the extended screen to a certain account is performed through the client, which means that before binding the extended screen, the client has logged into the account and has bound one or more specific smart locks to the account. The method of binding the smart lock to a certain account can adopt the method mentioned above or other possible implementation methods, which will not be repeated here. The following takes the binding of an extended screen to an account as an example to illustrate the secure binding method of the present application. The method mainly involves the interaction between the extended screen, the server, and the client. See Figure 2 , Figure 2 The figure is a schematic diagram of an exemplary process of binding an extended screen.

[0048] S110, the control module of the extended screen generates a temporary encryption key and a temporary signature key for binding.

[0049] The temporary encryption key and temporary signature key here are temporary keys generated by the extended screen to bind the extended screen to a certain account. In different binding processes, the temporary encryption key and temporary signature key generated by the extended screen can be different.

[0050] The temporary encryption key may exemplarily use a symmetric algorithm such as AES, and the temporary signature key may exemplarily use a signature algorithm such as HMAC.

[0051] Optionally, in some implementations, the temporary encryption key and the temporary signature key can be set with a validity period, such as 10 minutes. The time starts from the generation of the two temporary keys. If the validity period is exceeded, the two temporary keys will be invalidated. It is understandable that if the binding of the extended screen is not completed within the validity period, the two temporary keys cannot be used to complete the binding, and the user needs to re-trigger the binding process.

[0052] Optionally, in some implementations, the control module may enter a binding mode in response to a preset first instruction input by a user. The first instruction can be input in a variety of ways, which is not limited in this application. For example, a user can long press a mechanical button on the extended screen for a specific duration to input a first instruction. For example, when the display panel of the extended screen is a touch panel, the user can operate a specific control on the graphical user interface displayed by the extended screen (for example, click on the binding control on the settings interface) to input the first instruction. In binding mode, the control module generates the aforementioned temporary encryption key and temporary signature key.

[0053] Binding the extended screen to a certain account requires going through the server, and the binding relationship also needs to be stored on the server. As a server, it may receive a lot of information at the same time. In order to facilitate the distinction and efficient management of tasks, optionally, in some implementations, the server can assign binding task identifiers to different binding tasks, and carry the binding task identifiers in the information exchanged between the extended screen, the client, and the server.

[0054] Exemplarily, before S110, the following steps may also be included:

[0055] S101, the control module sends a binding task creation request to the server through the second networking module in response to the first instruction;

[0056] S301, the server creates a new binding task in response to the binding task creation request, and allocates a corresponding binding task identifier to the binding task;

[0057] S302, the server returns the bound task identifier to the extended screen.

[0058] It should be noted that when a binding task identifier is allocated, each end can carry it during interaction, such as in steps S121, S231, S311 described later, and steps such as S140, S241, S250, S330, etc. This application does not limit the specific method of carrying.

[0059] Optionally, the binding task identifier may have a state attribute, and when a binding task ends (regardless of whether the binding succeeds or fails), the binding task identifier may be invalidated.

[0060] S120, the control module controls the display panel to display a graphic code, where the graphic code carries at least the following information: a device ID of the extended screen, a temporary encryption key, and a temporary signature key.

[0061] The device ID of the extended screen is used to uniquely identify the extended screen within a certain range.

[0062] The graphic code may be in the form of a QR code, a barcode, etc. The coding algorithm for converting the information to be carried into the graphic code may adopt an existing algorithm or a modified algorithm, etc., which is not limited in this application. The coding algorithm may be preset in the control module when the expansion screen leaves the factory.

[0063] Optionally, when the server assigns a binding task identifier to this binding task, the control module can also carry the binding task identifier in the graphic code so that it can be obtained by the client scanning the code. That is, step S120 can also be replaced by: S121, the control module controls the display panel to display the graphic code, and the graphic code carries at least the following information: binding task identifier, device ID of the extended screen, temporary encryption key and temporary signature key.

[0064] S210, the client obtains information carried in the graphic code by scanning.

[0065] The mobile terminal can obtain information including the device ID of the extended screen, temporary encryption key, and temporary decryption key by scanning the graphic code displayed on the extended screen. Since the client and the extended screen need to be in the same physical space when scanning the code, this is equivalent to establishing a relatively secure channel between the extended screen and the client, which can reduce the chances of attackers to attack to a certain extent and effectively prevent the temporary encryption key and temporary decryption key from being intercepted by attackers.

[0066] Since the mobile terminal on which the client is installed, such as a mobile phone, usually has strong computing and processing capabilities and is installed with multiple applications, if any application with code scanning capability can scan and read the information carried in the graphic code on the extended screen, the temporary encryption key and temporary signature key can be improperly disclosed to other applications, thereby providing an opportunity for attackers to exploit.

[0067] To solve this problem, in some implementations, one or several specific encoding algorithms can be used, and the corresponding decoding algorithms can be configured in the client, so that only the mobile terminal installed with the client in the embodiment of the present application can scan the code and successfully obtain the information therein. It is understandable that the information obtained by scanning the code by the client is usually not displayed on the mobile terminal.

[0068] In other implementations, the client can also be configured to allow the decoding algorithm to be called only when the account is logged in. In this way, only the client that has legally logged in to the account can obtain the temporary encryption key and temporary signature key, thereby further improving the security of the binding process.

[0069] Optionally, when the client has logged into the account, a code scanning control is displayed on the user interface of the client, as shown in the example below: Figure 3 As shown, the client's user interface shows that the currently logged-in account is SU1, and the code scanning control "[-]". The user interface can also display the smart locks L1, L2 and L3 that have been bound to the currently logged-in account SU1. The user clicks the code scanning control to enable the client to call the necessary components such as the camera of the mobile terminal to scan, and call the decoding algorithm to decode and obtain information.

[0070] S220, the client uses the temporary encryption key and the temporary signature key to encrypt and sign at least the device ID of the extended screen and the account ID of the account to obtain binding information.

[0071] The encryption and signature here can adopt the encryption and signature methods commonly used in the prior art. For example, in some implementations, the client can use a temporary encryption key to encrypt the device ID and account ID to obtain encrypted data; the client uses a temporary signature key to sign the device ID and account ID to obtain signature data; and then the encrypted data and signature data are combined and spliced ​​to obtain binding information.

[0072] For ease of distinction, in the embodiment of the present application, the signature data obtained by the client using a temporary signature key to sign at least the device ID and the account ID is referred to as the first signature; the signature data obtained by the client using a temporary signature key to sign at least the device ID and the remote operation key in the subsequent steps is referred to as the second signature.

[0073] It is understandable that the encrypted and signed objects may include other possible information in addition to the aforementioned device ID and account ID, such as the device ID of the smart lock.

[0074] In some cases, the account logged in by the client may have been bound to multiple smart locks before. The user can operate the client to enter an instruction (for easy distinction, referred to as the second instruction) to instruct the client which smart lock or locks under the account the user wants to bind the extended screen to in this binding task.

[0075] In some implementations, the client can display multiple smart locks that have been bound to the account on the user interface. After the client scans the code to obtain the information in the graphic code, the user can click to select the control corresponding to a smart lock, for example Figure 3 As shown, the user clicks the control corresponding to the smart lock L1. After receiving the second instruction entered by the user, the client can encrypt the device ID of the smart lock L1 together with the device ID and account ID of the extended screen using a temporary encryption key, and sign it using a temporary signature key to obtain the binding information.

[0076] In other implementations, the client may display multiple smart locks that have been bound to the account and corresponding code scanning controls on the user interface, for example Figure 4 The "Scan" control below the smart lock diagram shown. The user clicks the "Scan" control below the smart lock that the user wants to bind. In response to the user's operation, the client obtains the device ID of the smart lock that the user wants to bind, for example Figure 5 The device ID of the smart lock L2 shown in the figure, that is, the first instruction is obtained, and on the other hand, the necessary components such as the camera of the mobile terminal are called to scan, and the decoding algorithm is called to decode and obtain information. Then the device ID of the smart lock L2 is encrypted together with the device ID and account ID of the extended screen using a temporary encryption key, and signed with a temporary signature key to obtain binding information. Compared with the previous implementation method, when using this method, the user only needs to perform one step on the client to bind the extended screen, which is more convenient.

[0077] In some other implementations, the client can be configured to support the user to select multiple smart locks, so that the extended screen can be bound to multiple smart locks bound to the same account in one binding task. Figure 5As shown, the user can click to select the controls corresponding to the smart locks L1 and L2, and then click the "Bind" control to enter the second instruction. This operation can be performed after the client scans the code, or it can be performed before scanning the code, that is, after the user selects multiple smart locks and clicks the "Bind" control, the client calls the camera of the mobile terminal and other necessary components to scan, and calls the decoding algorithm to decode and obtain information. Then, the client can encrypt the device ID of the smart lock L1 and L2 together with the device ID and account ID of the extended screen using a temporary encryption key, and sign it with a temporary signature key to obtain the binding information. This method can quickly and conveniently bind the extended screen to multiple smart locks that have been bound to the same account, which is suitable for scenarios where multiple smart locks are set up, such as a residence with smart locks installed on both the front and back doors.

[0078] S230, the client sends the binding information to the server.

[0079] S310, the server sends the binding information to the extended screen.

[0080] It should be noted that, in addition to the device ID and account ID, the client may also send other possible information together with the binding information to the server, which is used by the server and / or forwarded by the server to the extended screen.

[0081] In some implementations, when the account logged in by the client has been bound to multiple smart locks, and the client has obtained the device ID of the smart lock that the user wants to bind in this binding task, the client can send the device ID of the smart lock selected by the aforementioned user together with the binding information to the server.

[0082] In some other implementations, when the client obtains the binding task identifier of the current binding task from the graphic code, the binding task identifier can be sent to the server together with the binding information.

[0083] That is, the aforementioned step S230 can be replaced by: S231, the client sends the binding information together with the binding task identifier and / or the device ID of the smart lock selected by the user to the server.

[0084] The aforementioned step S310 can be replaced by: S311, the server sends the binding information, or the binding information and the device ID of the smart lock selected by the user, to the extended screen that initiates the binding task creation request based on the binding task identifier.

[0085] S130, after receiving the binding information from the server through the second networking module, the control module uses the temporary encryption key and the temporary signature key to decrypt the binding information and performs the first signature verification.

[0086] For ease of distinction, in the embodiment of the present application, the step of verifying the first signature in the binding information is referred to as the first signature verification, and the step of verifying the second signature in the remote operation key package is referred to as the second signature verification.

[0087] Decryption and execution of the first signature verification may adopt a decryption and signature verification method commonly used in the prior art. For example, in some implementations, the control module may use the previously generated temporary encryption key to decrypt the encrypted data in the binding information, and then use the previously generated temporary signature key to decrypt the data signature obtained by decryption, and compare the signature result with the first signature in the binding information. If the two are consistent, the verification is passed, and if the two are inconsistent, the verification fails.

[0088] S140, when the first signature verification is passed, the control module sends a binding instruction including the device ID and account ID of the extended screen to the server through the second networking module.

[0089] S320, the server stores the binding relationship between the account ID and the device ID of the extended screen in response to the binding instruction.

[0090] Optionally, after storing the aforementioned binding relationship, the server returns the intermediate result to the client, so that the client can timely understand the progress of the binding task and execute subsequent steps.

[0091] S240: The client uses the temporary encryption key and the temporary signature key to encrypt and sign at least the device ID of the extended screen and the remote operation key to generate a remote operation key package.

[0092] The encryption and signature here can also adopt the encryption and signature methods commonly used in the prior art, which will not be described here. For the sake of distinction, the signature data obtained by the client using the temporary signature key to sign at least the device ID and the remote operation key is called the second signature.

[0093] In some implementations, the remote operation key is stored locally on the client or in the mobile terminal, for example, in a secure container of the client or the mobile terminal. In this case, the client can directly obtain the remote operation key locally and generate a remote operation key package.

[0094] In other implementations, the client stores the first key. To further improve the security of the remote operation key, the remote operation key ciphertext is stored on the server, and the remote operation key is obtained from the server only when it is needed. After use, the client can delete the plain text of the remote operation key from the local as soon as possible.

[0095] Exemplarily, before step S240, the following steps S241 to S242 may also be included.

[0096] S241, the client obtains the remote operation key ciphertext of the smart lock bound to the logged-in account from the server.

[0097] S242: The client uses the locally stored first key to decrypt and obtain a remote operation key.

[0098] During the binding process, the control module of the extended screen needs to first verify the binding information generated by the client. Only after the verification is passed can the client obtain the ciphertext of the remote operation key from the server, and then decrypt and generate a remote operation key package. The remote operation key ciphertext will not be sent to the client too early without determining whether the client is legitimate. This will to a certain extent avoid the situation where attackers obtain the remote operation key ciphertext through illegal clients and slowly crack it.

[0099] Optionally, the remote operation key package generated in this step may also include other possible information, such as the device ID of the smart lock, attribute information of the remote operation key, etc. This information can be encrypted and signed together with the device ID of the extended screen and the remote operation key, or it can be simply carried in the package without being encrypted or signed, and this application does not limit this.

[0100] Exemplarily, when the account has been bound to multiple smart locks, the server can send the remote operation key ciphertext associated with the device ID of the smart lock required for this binding task to the client based on the device ID of the smart lock received from the client and sent together with the binding information. The client uses the corresponding first key to decrypt them respectively to obtain the corresponding multiple remote operation keys. Then, the client can use a temporary encryption key and a temporary signature key to encrypt and sign the multiple remote operation keys, the device ID of the extended screen, the attribute information of the remote operation key, etc., to obtain the corresponding multiple encrypted data and signature data. Each corresponding encrypted data and signature data and its corresponding smart lock device ID form a sub-package. The remote operation key package generated by the client may include multiple such sub-packages, and in some cases may also include other possible information.

[0101] S250, the client sends the remote operation key package to the server.

[0102] S330, the server sends the remote operation key package to the extended screen.

[0103] It is understandable that the client and the server may also carry the aforementioned binding task identifier when sending the remote operation key package.

[0104] S150, after receiving the remote operation key package from the server through the second networking module, the control module uses the temporary encryption key and the temporary signature key to decrypt the remote operation key package and performs a second signature verification.

[0105] Decryption and execution of the second signature verification may adopt a decryption and signature verification method commonly used in the prior art, such as a method similar to the aforementioned first signature verification, which will not be described in detail here.

[0106] S160: When the second signature verification passes, the control module stores the remote operation key.

[0107] Exemplarily, the control module can store the remote operation key in a secure container of the extended screen or the like to ensure the security of the remote operation key stored on the extended screen. When multiple remote operation keys are decrypted from the remote operation key package, the device ID of the smart lock and the corresponding remote operation key can be stored in correspondence. In some cases, the account number, the device ID of the smart lock, and the remote operation key can be stored in association, and data with different associations can be stored separately in the extended screen so that they can be used separately in subsequent use.

[0108] With the solution of the embodiment of the present application, after the expansion screen is bound, the expansion screen, smart lock, and client are all associated with the same account, and for the same smart lock, the expansion screen and the client share the same remote operation key. If a common mobile terminal is added, the client is installed and bound to the smart lock, then the newly added mobile terminal device and the existing mobile terminals in the system each have their own remote operation keys, and do not share the same remote operation key.

[0109] For users, the extended screen and the client are both in their own hands, while the server is usually controlled by service providers, door lock manufacturers, etc., and users cannot control it. In the entire process of binding the extended screen to the account bound to the smart lock, the temporary encryption key and temporary signature key are generated by the extended screen and obtained by the client by scanning the code. These two temporary keys are only known to the extended screen and the client, and the server cannot obtain them. During the binding process, the extended screen needs to first verify the binding information generated by the client. After the verification is passed, the client will use the temporary encryption key and temporary signature key to generate a remote operation key package, and securely pass the remote operation key to the extended screen through the server, so that the extended screen has the ability to operate remotely securely.

[0110] Optionally, when the second signature verification passes and the extended screen has stored the remote operation key, the extended screen returns a binding result indicating successful binding to the server, and the server returns the binding result to the client so that the client can prompt the user.

[0111] Optionally, when the first signature verification fails or the second signature verification fails, the binding mode may be exited and a binding result indicating a binding failure is returned to the server.

[0112] Optionally, when the first signature verification fails or the second signature verification fails, the control module may also send the verification result to the server through the second networking module, thereby instructing the client to resend the corresponding binding information or remote operation key package. In the same binding task, if the number of times the first signature and / or the second signature verification fails exceeds a preset number, for example, 3 times, the binding mode may be exited, and the binding result returned to the server is a binding failure.

[0113] After the expansion screen is bound, it can be used to perform specific remote operations on the smart lock. The following uses video intercom and remote unlocking during video intercom as examples to illustrate the expansion screen-based remote operation method of the present application. The method mainly involves the interaction between the expansion screen, the server, and the smart lock. Figure 6 , Figure 6 FIG. 4 is a schematic diagram of an exemplary remote operation process.

[0114] S410, the smart lock sends a remote call request to the server in response to a third instruction input by a user outside the control area.

[0115] The third instruction here can be a preset instruction for triggering the smart lock to initiate a remote call request. Users outside the control area can enter the third instruction in the smart lock in a variety of possible forms, such as pressing the doorbell, or clicking the "Call" control on the touch screen of the front panel of the smart lock.

[0116] S610: The server creates a video intercom room in response to the remote call request.

[0117] In some implementations, the server creates a video intercom task in response to a remote call request, assigns a corresponding intercom task identifier to it, and calls a third-party service (such as SoundNet) to create a video intercom room.

[0118] S620: The server sends the room connection information of the video intercom room to the smart lock and the extended screen respectively.

[0119] For example, the remote call request may carry the device ID of the smart lock. Based on the device ID of the smart lock, the server finds the extended screen bound to the same account and sends the room connection information to the extended screen.

[0120] S420, the smart lock uses the room connection information to join the video intercom room.

[0121] S510, the extended screen uses the room connection information to join the video intercom room.

[0122] S520, the extended screen receives the real-time video stream data published by the smart lock in the video intercom room and displays it through the display panel.

[0123] The real-time video stream of the smart lock here is the image information collected by the smart lock through its camera. After being encoded, this image information can be published in the video intercom room to which the smart lock has joined, and received by other devices in the same video intercom room.

[0124] Optionally, the display panel also displays an answer control, and the real-time video stream and the answer control can be displayed in the same user interface. It is understandable that other content, such as a reject control, etc., can also be displayed in the user interface.

[0125] S530, the extended screen responds to the fourth instruction input by the user in the control area, and opens the audio stream to enable the extended screen and the smart lock to perform two-way voice interaction based on the visual intercom room.

[0126] The fourth instruction here is an instruction to connect the video intercom, such as an instruction input by the user operating the answering control. It can be understood that the audio stream between the smart lock and the extended screen is also interacted by publishing in the video intercom room. While performing two-way voice interaction, the extended screen also continues to receive and display the real-time video stream of the smart lock, that is, the video stream interaction is actually one-way. The user on the extended screen side can view the image on the smart lock side, while the user on the smart lock side cannot view the image on the extended screen side.

[0127] S430, the smart lock sends a first remote unlocking request to the server, and the first remote unlocking request includes: the device ID of the smart lock and a random number generated by the smart lock.

[0128] S630, the server sends a second remote unlocking request to the extended screen in response to the first remote unlocking request, and the second remote unlocking request includes at least: the device ID of the smart lock and a random number.

[0129] Optionally, the server can also create a remote unlocking task in response to the first remote unlocking request, assign a corresponding remote unlocking task identifier, and send the remote unlocking task identifier to the extended screen in the second remote unlocking request. The remote unlocking task identifier can also be carried in the subsequent interactive information between the extended screen and the server and the smart lock until the remote unlocking task is completed.

[0130] S540, the extended screen generates a remote unlocking response package in response to the fifth instruction input by the user in the control area, and the remote unlocking response package at least includes: a random number encrypted by the remote operation key and the device ID of the smart lock.

[0131] The fifth instruction here is an instruction for remote unlocking. For example, the display panel of the extended screen can display a real-time video stream and an unlocking control. When a user in the controlled area decides to unlock the door during a video intercom with a user outside the controlled area, the user in the controlled area can click the unlocking control on the display panel to enter the fifth instruction.

[0132] S550: The extended screen sends a remote unlocking response packet to the server.

[0133] S440, the smart lock obtains a remote unlocking response package from the server, and uses the remote operation key to decrypt the remote unlocking response package to obtain a random number and the device ID of the smart lock.

[0134] S450: If the decrypted random number and the device ID of the smart lock match the local random number and the device ID of the smart lock, the smart lock executes the unlocking action.

[0135] It is understandable that if there is no match, the smart lock will not perform the unlocking action and the remote unlocking will fail. Regardless of whether the remote unlocking is successful or failed, the smart lock can send the remote unlocking result to the server, and forward it to the extended screen through the server so that it can be displayed on the extended screen, so that the user on the extended screen side can understand the result of the remote unlocking. After that, the extended screen and the smart lock can exit the video intercom room and end this video intercom.

[0136] The expansion screen and smart lock have been bound to the same account, which has improved the security of video intercom to a certain extent and increased the difficulty for attackers to intercept video and audio streams. On this basis, the security of remote unlocking is further increased by setting remote operation keys and random numbers, making it more difficult for attackers to remotely unlock the door and effectively preventing attackers from performing replay attacks.

[0137] It can be understood that, in addition to controlling the smart lock bound to the same account, the extended screen in the embodiment of the present application may also be configured to control other possible smart home devices in the room that are bound to the same account, and the present application does not limit this.

[0138] Those skilled in the art should understand that the embodiments of the present application can be provided as a product form of an extended screen, a client, and a smart lock system, and can also be partially provided as a computer-readable storage medium or a computer program product. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware.

[0139] The present application may also be in the form of a computer program product implemented on one or more computer-readable storage media containing computer-usable program codes. That is, a computer-readable storage medium is also provided in an embodiment of the present application, storing a computer program, and when the computer program is executed by a processor, the processor executes some or all of the steps in any implementation of the aforementioned display method.

[0140] When implemented by software, the functions may be stored in or transmitted as one or more instructions or codes on a computer-readable medium.

[0141] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0142] It should be understood that in various embodiments of the present application, the execution order of each step should be determined by its function and internal logic, and the size of the step number does not mean the order of execution and does not constitute any limitation on the implementation process of the embodiment.

[0143] It should also be understood that, in order to facilitate the clear description of the technical solutions of the embodiments of the present application, the words "first", "second", etc. are used in the embodiments of the present application to distinguish between the same items or similar items with substantially the same functions and effects, or concepts with certain differences. Those skilled in the art can understand that the words "first", "second", etc. do not limit the quantity and execution order, and the words "first", "second", etc. do not necessarily limit the difference.

[0144] It should be understood that in the structural description of the present application, the terms "upper", "lower", "front", "back", "left", "right", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships that are generally based on the positions or positional relationships shown in the drawings. These positions or positional relationships are for the convenience of description, and do not indicate or imply that the devices or components referred to must have specific positions or positional relationships, or must be constructed and operated in specific positions or positional relationships, and therefore cannot be understood as limiting the present application.

[0145] The same or similar parts between the various embodiments in this specification can be referred to each other. As long as there is no logical contradiction, different embodiments can be combined with each other.

Claims

1. An extended screen applied to a smart lock system, characterized in that: The extended screen includes: a display panel, a networking module, and a control module connected to the display panel and the networking module respectively; wherein the control module is used to: Generate a temporary encryption key and a temporary signing key for binding; Controlling the display panel to display a graphic code, wherein the graphic code carries at least the following information: the device ID of the extended screen, the temporary encryption key, and the temporary signature key; the graphic code can be scanned by a client to obtain the information carried therein; Receiving binding information from the server through the networking module, the binding information is obtained by encrypting and signing at least the device ID of the extended screen and the account ID of the account by the client of the logged-in account using the temporary encryption key and the temporary signature key; Decrypting the binding information using the temporary encryption key and the temporary signature key, and performing a first signature verification; When the first signature verification is passed, a binding instruction including the device ID of the extended screen and the account ID is sent to the server through the networking module, so that the server stores the binding relationship between the account ID and the device ID of the extended screen; Receiving a remote operation key package from the server through the networking module, wherein the remote operation key package is generated by the client with the logged-in account using the temporary encryption key and the temporary signature key to encrypt and sign at least the device ID of the extended screen and the remote operation key; Decrypting the remote operation key package using the temporary encryption key and the temporary signature key, and performing a second signature verification; When the second signature verification is successful, the remote operation key is stored.

2. The extended screen according to claim 1, characterized in that: The generating of a temporary encryption key and a temporary signature key for binding includes: In response to a first instruction input by a user, entering a binding mode; The temporary encryption key and the temporary signature key are generated in a binding mode.

3. The extended screen according to claim 2, characterized in that: The control module is also used for: In response to the first instruction, sending a binding task creation request to the server through the networking module, A task identifier is received, where the task identifier is a unique identifier assigned by the server to the created binding task in response to the binding task creation request, and the task identifier can be carried in the graphic code.

4. The extended screen according to any one of claims 1 to 3, characterized in that: The server stores a remote operation key ciphertext. After the server stores the binding relationship between the account ID and the device ID of the extended screen, the remote operation key ciphertext is sent to the client and decrypted by the client using a locally stored first key to generate a remote operation key package.

5. The extended screen according to any one of claims 1 to 4, characterized in that: The remote operation key package includes the device IDs of at least two smart locks bound to the account and the corresponding remote operation keys; Storing the remote operation key includes: respectively associating and storing the device ID of the smart lock and the corresponding remote operation key.

6. The extended screen according to any one of claims 1 to 5, characterized in that: The control module is also used for: In case the first signature verification / the second signature verification fails, instructing the client to resend the binding information / the remote operation key package through the networking module and the server; When the number of times that the first signature verification and / or the second signature verification fails exceeds a preset number, the binding mode is exited.

7. The extended screen according to claim 1, characterized in that: The control module is also used for: Receive a second remote unlocking request from the server, wherein the second remote unlocking request includes at least: a device ID of the smart lock and a random number generated by the smart lock; In response to the fifth instruction input by the user in the control area, a remote unlocking response package is generated, and the remote unlocking response package includes: the random number encrypted using the remote operation key and the device ID of the smart lock; the remote unlocking response package can be used by the smart lock to decrypt and verify and perform unlocking if the verification passes.

8. The extended screen according to claim 7, characterized in that: In response to the fifth instruction input by the user in the control area, before generating the remote unlocking response packet, the method further includes: Receiving room connection information of a video intercom room from the server, where the video intercom room is created by the server in response to a remote call request sent by the smart lock; Join the video intercom room using the room connection information; Receiving real-time video stream data published by the smart lock in the video intercom room, and displaying it through the display panel; In response to a fourth instruction input by a user in the control area corresponding to the smart lock, an audio stream is turned on to enable the extended screen and the smart lock to perform two-way voice interaction based on the visual intercom room; Among them, the display panel also displays an unlocking control, and the fifth instruction is input by the user in the control area by operating the unlocking control.

9. A client for a smart lock system, wherein the client is bound to the smart lock and has negotiated a remote operation key, characterized in that: The client is also used to: By scanning the graphic code displayed on the extended screen, the information carried in the graphic code is obtained, including: the device ID of the extended screen, the temporary encryption key and the temporary signature key generated by the extended screen for binding; In the case of a logged-in account, encrypt and sign at least the device ID of the extended screen and the account ID of the account using the temporary encryption key and the temporary signature key to obtain binding information; Sending the binding information to a server, so that the server sends the binding information to an extended screen; In the case where the server stores the binding relationship between the account ID and the device ID of the extended screen in response to the binding instruction sent by the extended screen, the temporary encryption key and the temporary signature key are used to encrypt and sign at least the device ID of the extended screen and the remote operation key to generate a remote operation key package; wherein the binding instruction is sent to the server by the extended screen after the temporary encryption key and the temporary signature key are used to decrypt the binding information and perform the first signature verification; The remote operation key package is sent to the server, so that the extended screen stores the decrypted remote operation key after decrypting the remote operation key package received from the server using the temporary encryption key and the temporary signature key and performing a second signature verification.

10. A smart lock system, characterized in that: It includes a smart lock, a server, the extended screen described in any one of claims 1 to 8, and the client described in claim 9.

Images