Locking / unlocking system and locking / unlocking device

A biometric-based locking/unlocking system with a facial image capture terminal and thumb turn operation allows secure door access without a smartphone, addressing the inconvenience of smartphone-dependent systems.

JP7576860B2Active Publication Date: 2024-11-01ASTERISK INC
View PDF 14 Cites 0 Cited by

Patent Information

Application Number
JP2022545449
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-07-23
Publication Date
2024-11-01
Estimated Expiration
2042-07-23

AI Technical Summary

Technical Problem

Existing locking/unlocking systems that rely on smartphones for authentication are inconvenient as users must carry their smartphones and cannot unlock doors if they are lost or do not own one.

Method used

A biometric-based locking/unlocking system that uses an acquisition terminal to capture facial images and authenticate users, operating a thumb turn mechanism without a physical key, utilizing Bluetooth Low Energy communication.

Benefits of technology

Enables secure locking and unlocking of doors without a smartphone, ensuring accessibility for users who do not own one and preventing information leakage.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007576860000001
    Figure 0007576860000001
  • Figure 0007576860000002
    Figure 0007576860000002
  • Figure 0007576860000003
    Figure 0007576860000003
Patent Text Reader

Abstract

[Problem] To remove the need for a physical lock for an already installed door, and enable locking / unlocking even by a user not in possession of a smartphone. [Solution] This locking / unlocking system 100 is characterized by comprising: an acquisition terminal 10 installed so as to acquire biometric information of a person located in front of a door D; a locking / unlocking device 20 attached to a thumb turn S that is provided on the indoor-side of the door D; and a server 30 for authenticating the exit / entry qualification for said person with respect to the door on the basis of the biometric information of the person. The locking / unlocking system 100 is also characterized in that the locking / unlocking device 20 operates the thumb turn S in accordance with the authentication result.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a locking / unlocking system and a locking / unlocking device for locking and unlocking a door via a thumb turn. [Background technology]

[0002] Electric locks that electrically lock or unlock (hereinafter referred to as "locking and unlocking") locks on doors of homes and offices without using a physical key have been increasingly used. For example, the locking and unlocking system described in Patent Document 1 comprises an external housing attached to the exterior surface of the door and a key case embedded in the door, and is configured so that the deadbolt of the key case opens and closes electrically based on key information input to the external housing.

[0003] According to the locking / unlocking system described above, people entering or leaving a home or office can lock or unlock the door by inputting key information into an external housing, eliminating the need to carry a physical key. However, existing doors are equipped with components such as key cases and thumb turns that are compatible with locking and unlocking using physical keys, so installing the locking / unlocking system of Patent Document 1 requires work to remove the existing components.

[0004] Meanwhile, a locking / unlocking control device for use with existing doors is described in Patent Document 2. This locking / unlocking control device is a device that is attached to the inside surface of the door so as to cover the thumb turn, and is equipped with a clamping structure that clamps the thumb turn knob, and a control unit that rotates and drives the clamping structure in response to remote operation by the user via a smartphone. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 6935965 [Patent Document 2] Patent No. 7071017 Summary of the Invention [Problem to be solved by the invention]

[0006] In recent years, locking / unlocking control devices such as those described in Patent Document 2 have appeared, and these locking / unlocking control devices control locking / unlocking by linking with the user's smartphone. Specifically, an application for linking with the locking / unlocking control device is installed in advance on the user's smartphone, and key information is sent to the locking / unlocking control device through the application. The locking / unlocking control device rotates the thumb turn if it successfully authenticates the received key information.

[0007] In this system where the locking / unlocking control device and the user's smartphone are linked, the smartphone is used instead of a physical key, so the user must always carry the smartphone with them when going out. If the smartphone is left behind in the room or if the user does not have a smartphone at all, it becomes impossible to lock or unlock the door using the locking / unlocking device.

[0008] Therefore, the present invention aims to provide a locking / unlocking system and a locking / unlocking device that do not require a physical key for existing doors and that can be locked and unlocked even by users who do not own a smartphone. [Means for solving the problem]

[0009] In order to achieve the above-mentioned object, the locking / unlocking system of the present invention comprises an acquisition terminal installed to acquire biometric information of a person positioned in front of a door, a locking / unlocking device attached to a thumb turn provided on the inside of the door, and a server that authenticates the person's eligibility to enter and exit the door based on the person's biometric information, and is characterized in that the locking / unlocking device operates the thumb turn in accordance with the authentication result.

[0010] Furthermore, the present invention is characterized in that the acquisition terminal has an input receiving unit that receives touch input from the person, and acquires the biometric information when there is touch input to the input receiving unit.

[0011] The present invention is also characterized in that the acquisition terminal has an imaging unit that captures an image of the area in front of the door and generates an image, and acquires the biometric information when a person is detected in the generated image.

[0012] Furthermore, the present invention is characterized in that the acquisition terminal returns from a power saving mode when acquiring the biometric information.

[0013] The present invention is also characterized in that the acquisition terminal has an attitude detection unit that detects the installation attitude and an alarm generation unit that generates an alarm, and the alarm generation unit generates the alarm when the installation attitude changes.

[0014] The present invention is also characterized in that the locking / unlocking device and the acquiring terminal transmit and receive operation information of the thumb turn based on the authentication result using a Bluetooth Low Energy communication method.

[0015] Furthermore, the present invention is characterized in that the biometric information is generated based on a facial image of the person captured by the imaging section.

[0016] The acquisition terminal is characterized in that it is a smart device. [Effects of the Invention]

[0017] According to the present invention, a physical key is not required for an existing door, and even a user who does not own a smartphone can lock and unlock the door. [Brief explanation of the drawings]

[0018] [Figure 1] FIG. 1 is a view of a door installed with a locking / unlocking system according to an embodiment of the present invention, viewed from outside the room. [Figure 2] View of a door with a locking / unlocking system installed from inside the room [Figure 3] Overall diagram of the hardware that makes up the locking / unlocking system [Figure 4] (a) Hardware configuration diagram of a smart device equipped in the locking / unlocking system, (b) Hardware configuration diagram of a locking / unlocking device equipped in the locking / unlocking system, (c) Hardware configuration diagram of a server equipped in the locking / unlocking system [Figure 5] Side view of a door with a locking / unlocking system installed [Figure 6] (a) a user table held by the server; (b) a verification list held by the server; and (c) an installation information table held by the server. [Figure 7] Diagram showing the main flow of the locking / unlocking system [Figure 8] A diagram showing the registration process for the locking / unlocking system [Figure 9] A diagram showing the locking / unlocking process of the locking / unlocking system [Figure 10] Diagram showing the tracking process of the locking / unlocking system DETAILED DESCRIPTION OF THE INVENTION

[0019] [First embodiment]

[0020] A locking / unlocking system according to a first embodiment of the present invention will be described below with reference to the drawings.

[0021] 1 to 3, a locking / unlocking system 100 according to a first embodiment is a system that locks and / or unlocks a door D of a house or an office building based on biometric information of a person entering or exiting the door D. The locking / unlocking system 100 includes a plurality of smart devices 10a, 10b, and 10c that are outdoor terminals installed outside the doors Da, Db, and Dc, a server 30 that is capable of communicating with each of the smart devices 10a, 10b, and 10c via a network such as an internet communication line, and a plurality of locking / unlocking devices 20a, 20b, and 20c installed on thumb turns S inside the doors Da, Db, and Dc. Installing the smart devices 10 outdoors means that all or part of the smart devices 10 are exposed to the outside of the door D.

[0022] <Smart device configuration>

[0023] The smart device 10 functions as an acquisition terminal for acquiring biometric information and is a known smartphone or tablet terminal installed outside the door D. The installation manner of the smart device 10 is not particularly limited. For example, as shown in FIG. 1, the smart device 10a is attached to the outer surface of the door Da with double-sided tape on its back surface. The smart device 10b is attached to the wall surface near the door Db with double-sided tape on its back surface. The smart device 10c is held in a holder (not shown) provided on the top of a support pillar installed in front of the door Dc. The smart devices 10a and 10b may be embedded inside the walls near the door Da or the door Db so that their front surfaces are exposed to the outside.

[0024] 4(a), the smart device 10 includes a touch panel display 11, a camera module 12, a short-range wireless communication module 13, a network communication module 14, and a GPS module 17. These are electrically connected to and controlled by a CPU 15 included in the smart device 10.

[0025] The touch panel display 11 is disposed on substantially the entire front surface of the smart device 10, and functions as a display unit that displays information generated by the CPU 15 to a person standing in front of the door D. The touch panel display 11 also functions as an input receiving unit that receives touch input from a person standing in front of the door D and inputs the input to the CPU 15.

[0026] The camera module 12 is disposed on the front side of the smart device 10 and includes an image sensor that captures an image in front of the door D through a lens unit. The camera module 12 functions as an imaging unit that captures an image of a person in front of the door D and generates an image. The generated image is input to the CPU 15.

[0027] The network communication module 14 is a module that connects to a network such as an Internet communication line and functions as a network communication unit that transmits and receives information to and from the server 30 via the network. The network communication module is a Wi-Fi module that wirelessly connects to a LAN installed in the room, or a communication module that connects to a mobile communication network provided by a telecommunications carrier based on subscriber information recorded in a SIM card. In this embodiment, the network communication module preferentially connects to the indoor LAN, and connects to the mobile communication network when it cannot connect to the indoor LAN.

[0028] The short-range wireless communication module 13 is a module that functions as a short-range wireless communication unit that performs short-range wireless communication using radio waves, and transmits operation commands to the locking / unlocking device 20. The operation command is a command that indicates that the thumb turn S should be rotated in the unlocking direction, or a command that indicates that the thumb turn S should be rotated in the locking direction. In this embodiment, from the perspective of reducing energy consumption, a Bluetooth (registered trademark) module that performs wireless communication according to the Bluetooth Low Energy standard is used as the short-range wireless communication module 13.

[0029] The GPS module 17 is a module that functions as a position detection unit that detects the position of the smart device 10 and inputs the detected position information to the CPU 15.

[0030] The CPU 15 is electrically connected to the memory 16, and by executing application programs stored in the memory 16, functions as a processing unit that processes images acquired from the camera module 12, information transmitted and received via the network communication module 14, information transmitted and received via the short-range communication module 13, and location information received from the GPS. The application programs stored in the memory 16 also contain identification information (hereinafter referred to as a "device code") that is uniquely assigned to the smart device 10 in order to distinguish the smart device 10 from other smart devices.

[0031] <Configuration of the locking / unlocking device>

[0032] 2 and 5, the locking / unlocking device 20 is installed on the inside surface of the door D so as to cover the thumb turn S. The locking / unlocking device 20 includes a housing 21 installed on the door D and a clamping portion 22 that clamps the thumb turn S. The housing 21 includes a base 23 that is attached to the inside surface of the door D with double-sided tape, and an extension portion 24 that extends from the tip of the base 23 toward the thumb turn S. As shown in FIG. 4, the housing 21 contains a board on which a near-field wireless communication module 25, a microcomputer 26 (MCU 26), a drive circuit 27, and a power supply circuit that supplies power to these components are mounted, a motor 28, and a power transmission mechanism (not shown) that transmits the rotational power of the motor 28 to the clamping portion 22.

[0033] The short-range wireless communication module 25 of the locking / unlocking device 20 is a module that functions as a short-range wireless communication unit that performs wireless radio wave communication with the corresponding smart device 10, receives operation commands from the smart device 10, and inputs the received operation commands to the microcomputer 26. Note that in this embodiment, a Bluetooth module that performs wireless communication according to the Bluetooth Low Energy standard is used, similar to the short-range wireless communication device 13 of the smart device 10.

[0034] The microcomputer 26 has a built-in CPU (not shown) and memory (not shown), and the CPU executes a program stored in the memory, which outputs a control signal to the drive circuit 27 to control the rotation direction and rotation step of the motor 28 based on the input operation command. In this way, the microcomputer 26 functions as a control unit that controls the motor 28. The drive circuit 27 is a circuit that drives the motor 28, and outputs power to the motor 28 to drive the motor 28 based on the control signal input from the microcomputer 26.

[0035] Motor 28 rotates based on the power input from drive circuit 27. The shaft of motor 28 is connected to a power transmission mechanism composed of multiple gears, and the output shaft of the power transmission mechanism is connected to clamping unit 22. As a result, clamping unit 22 rotates in response to the rotation of motor 28.

[0036] <Server configuration>

[0037] As shown in FIG. 4(c), the server 30 includes a network communication module 31 for communicating with the smart device 10 via a network such as an Internet communication line, a CPU 32, and a memory 33.

[0038] The memory 33 of the server 30 functions as a storage unit that stores information used in the locking / unlocking process, information provision process, and tracking process, which will be described later, and includes a user table, a verification list, and an installation information table, as shown in Fig. 6. Each table and list will be explained below.

[0039] 6(a), the user table functions as a user information storage unit that stores information about people (hereinafter referred to as "users") who are authorized to enter and exit door D, and a record is provided for each user. The user table has a user ID field, a biometric information field, and a personal information field. The user ID field stores a user ID, which is a character string uniquely assigned to each user and is issued by the server 30 in the registration process described below. The biometric information field is where the biometric information of the user is registered. The biometric information in this embodiment is a feature amount calculated by analyzing a facial image of the user, and is acquired by the smart device 10 in a registration process described later. The personal information field is used to register personal information about the user other than biometric information. The personal information may be, for example, private information such as name, address, telephone number, and email address, or business information such as department, position, and employment status. When the smart device 10 is installed in a residential building, private information is registered, and when the smart device 10 is installed in an office building, business information is registered. Such personal information is acquired by the smart device 10 in a registration process (s10) described later.

[0040] 6(b), the verification list stores the user IDs of users who are authorized to enter and exit the door, and multiple verification lists (three verification lists in this embodiment) are provided to correspond to each smart device 10 (device code). User IDs are registered in the verification lists in the registration process (s10) described later.

[0041] As shown in FIG. 6(c), the installation information table functions as an installation information storage unit that stores installation information (device code, installation location, and GPS value) related to the installation of the smart device 10, and a record is provided for each smart device 10. The installation information table has a device code field in which the device code of the smart device 10 is registered, an installation location field, and a GPS field. The installation location field registers the address of the building in which the smart device 10 is installed. The GPS field registers the GPS value acquired by the GPS module 17 of the smart device 10. The installation information is registered in the installation information table in a registration process (s10) and a tracking process (s30) described below.

[0042] As described above, the locking / unlocking system 100 of this embodiment is configured with multiple smart devices 10, multiple locking / unlocking devices 20, and a server 30. The locking / unlocking device 20 operates the thumb turn S based on an operation command received from the corresponding smart device 10. In the locking / unlocking system 100 of this embodiment, the smart device 10 acquires biometric information of a person standing in front of the door D, the server 30 identifies the user based on the biometric information, and the smart device 10 transmits an operation command to the locking / unlocking device 20 based on the authentication result of the user's access qualification. The server 30 also provides the information registered in the memory 33 to the administrator computer 40 (FIG. 3) via an Internet communication line. Furthermore, the server 30 is capable of tracking the location of the installed smart device 10. The processing flow of the locking / unlocking system 100 will be described below with reference to FIGS. 7 to 10.

[0043] <Registration process>

[0044] Fig. 7 shows a main flow of the locking / unlocking system 100, in which a registration process (s10) is executed first. The registration process (s10) is a process for registering information in a user table, a verification list, and an installation information table stored in the memory 33 of the server 30, and is executed when the smart device 10 is installed. In the registration process (s10), as shown in Fig. 8, the smart device 10 executes an input process (s11), an image capture process (s12), a biometric information acquisition process (s13), and a transmission process (s14) in this order, and the server executes a reception process (s15) and a registration process (s16) in this order.

[0045] The input process (s11) includes an installation information input process and a user information input process. The installation information input process is a process in which the user or installer of each smart device 10 inputs installation information, and the CPU 15 of the smart device 10 displays an input form on the touch panel display 11 for inputting the installation location. The user or installer operates the touch panel display 11 to input the installation location in the input form. When the CPU 15 acquires the installation location from the touch panel display 11, it reads out the device code stored in the memory 16 and acquires the GPS value from the GPS module 17. The CPU 15 stores the installation location, device code, and GPS value in the memory 16 in association with each other. The user information input process is a process for prompting a user to input personal information. Specifically, the CPU 15 of the smart device 10 displays an input form for prompting a user to input personal information on the touch panel display 11. The user operates the touch panel display 11 to input the personal information into the input form. When the CPU 15 acquires the personal information from the touch panel display 11, the CPU 15 stores the personal information in the memory 16.

[0046] The imaging process (s12) is a process of capturing an image of the user's face, for example, by taking a selfie. Specifically, the CPU 15 of the smart device 10 inputs an imaging command to the camera module 12. The camera module 12 captures an image at a predetermined frame rate in accordance with the input imaging command and generates an image. The image generated by the camera module 12 is input to the CPU 15. Every time the CPU 15 acquires an image from the camera module 12, the CPU 15 displays the acquired image on the touch panel display 11. The CPU 15 also displays a confirmation button on the touch panel display 11 along with the display. The confirmation button is a GUI, and when the user presses the confirmation button, the CPU 15 stores the displayed image in the memory 16 as an image for biometric information.

[0047] The biometric information acquisition process (s13) is a process for acquiring biometric information of the user based on the image stored in memory 16 in the imaging process (s12). The CPU 15 performs an extraction process for extracting an image of the face portion included in the image (hereinafter referred to as a "face image") and a calculation process for calculating feature amounts based on the extracted face image. The method for calculating the feature amounts is not particularly limited, but for example, the feature amounts can be calculated by quantifying the positions, sizes, and areas of facial elements such as the eyes, nose, and mouth based on certain rules. The feature points calculated in this manner are stored in memory 16 as the biometric information of the user.

[0048] The transmission process (s14) is a process in which the CPU 15 of the smart device 10 transmits the information (installation information, personal information, and biological information) acquired in the above processes to the server 30 via the network communication module 14.

[0049] The reception process (s15) is a process in which the CPU 32 of the server 30 receives the installation information, personal information, and biological information via the network communication module 31.

[0050] In the registration process (s16), the CPU 32 of the server 30 issues a new user ID and adds the user ID, the received personal information, and the biometric information to the user table. The CPU 32 also adds the received installation information to the installation information table. Furthermore, the CPU 32 identifies a verification list corresponding to the device code included in the installation information, and adds the user ID to the identified verification list.

[0051] The above registration process (s10) is carried out for all users who are authorized to enter and exit door D.

[0052] <Locking / unlocking process>

[0053] Returning to FIG. 7, the detection process (s2) is executed after the registration process (s10). The detection process (s2) is a process for detecting a person located in front of door D. Specifically, the CPU 15 of the smart device 10 monitors input from the touch panel display 11. In this state, if the user performs a touch input on the touch panel display 11, information about the touch input is input from the touch panel display 11 to the CPU 15. If the input is received, the CPU 15 determines that a person is present in front of door D. As another example of the detection process (s2), the CPU 15 of the smart device 10 inputs an image capture command to the camera module 12 at predetermined intervals. Based on the image capture command, the camera module 12 captures an image of the area in front of door D and inputs the generated image to the CPU 15. The CPU 15 analyzes the acquired image and, if a person is detected in the image, determines that a person is present in front of door D. The smart device 10 performs one or both of the detection process using the touch panel display 11 and the detection process using the camera module 12.

[0054] If the result of the detection process (s2) is that no person is detected (No), the request confirmation process (s3) described below is executed. On the other hand, if a person is detected (Yes), the locking / unlocking process (s20) is executed.

[0055] The locking / unlocking process (s20) is a process that authenticates the entry / exit qualifications of a person based on the detected biometric information of the person, and operates the thumb turn S if the authentication is successful.As shown in Figure 9, it includes an acquisition process (s21), an identification process (s22), a matching process (s23), a selection process (s25), and an operation process (s26).

[0056] The acquisition process (s21) is a process for acquiring biometric information of a person in front of the door D. In this embodiment, the CPU 15 of the smart device 10 inputs an image capturing command to the camera module 12. The camera module 12 captures an image in accordance with the input image capturing command, generates an image, and inputs the generated image to the CPU 15. The CPU 15 detects the person's face in the image acquired from the camera module 12 and calculates feature amounts of the face. The method for calculating the feature amounts is the same as the calculation method in the above-mentioned registration process (s10). The biometric information acquired by the acquisition process (s21) is transmitted to the server 30.

[0057] When the server 30 receives the biometric information, it executes an identification process (s22). In the identification process (s22), the CPU 32 of the server 30 identifies the user corresponding to the received biometric information. Specifically, the CPU 32 searches the user table for biometric information that most closely resembles the received biometric information (feature amount). If there is no similar biometric information (No), the CPU 32 transmits to the smart device 10 a message indicating that the authentication of the entry / exit qualification has failed. On the other hand, if there is similar biometric information (Yes), the CPU 32 extracts a user ID corresponding to the biometric information from the user table. In this way, the CPU 32 of the server 30 functions as an identification unit that identifies a user based on the biometric information.

[0058] When the server 30 identifies the user, it executes a matching process (s23). In the matching process (s23), the CPU 32 of the server 30 matches the identified user ID with a matching list corresponding to the received device code. If the matching result shows that the user ID is included in the matching list, a message indicating that the authentication of the access qualification has been successful is sent to the smart device 10. On the other hand, if the user ID is not included in the matching list, a message indicating that the authentication of the access qualification has failed is sent to the smart device 10. In this way, the CPU 32 of the server 30 functions as a matching unit that matches the identified user with the matching list. The identifying unit and the matching unit constitute a qualification authentication unit that authenticates the access qualification of the person at the door.

[0059] The smart device 10 receives the authentication result from the server 30. If the received authentication result is a failure (s24: No), the locking / unlocking process (s20) is terminated. On the other hand, if the authentication result is a success (s24: Yes), the smart device 10 executes the selection process (s25).

[0060] The selection process (s25) is a process for prompting the user to select either unlocking or locking, and the CPU 15 of the smart device 10 displays a selection screen having a GUI for prompting the user to select either unlocking or locking on the touch panel display 11, and accepts the user's selection. Here, if "lock" is selected, the CPU 15 of the smart device 10 transmits a lock command to the locking / unlocking device 20 via the short-range wireless communication module 13. On the other hand, if "unlock" is selected, the CPU 15 of the smart device 10 transmits an unlock command to the locking / unlocking device 20 via the short-range wireless communication module 13.

[0061] The near-field wireless communication module 25 of the locking / unlocking device 20 receives the command transmitted from the smart device 10 and inputs the received command to the microcomputer 26. The microcomputer 26 inputs a control signal for controlling the motor 28 to the drive circuit 27 in accordance with the command input from the near-field wireless communication module 25. The drive circuit 27 outputs power to the motor 28 for driving the motor 28 based on the control signal input from the microcomputer 26. As described above, the rotational power of the motor 28 is transmitted to the clamping portion 22 via the power transmission mechanism, and the knob of the thumb turn S rotates as the clamping portion 22 rotates.

[0062] As described above, according to the locking / unlocking system 100 of this embodiment, the locking / unlocking device 20 is installed so as to cover the thumb turn S, and the locking / unlocking device 20 operates the thumb turn S based on the authentication result from the smart device 10, so that it is possible to lock and unlock an existing door D without using a physical key. In addition, because the smart device 10 is installed on the door D, even users who do not own a smartphone can use it.

[0063] Furthermore, according to the locking / unlocking system 100 of this embodiment, the user's personal information and biometric information are registered in the server, so even if the smart device 10 is lost or stolen, the personal information and biometric information will not be leaked.

[0064] Returning to FIG. 7, when the locking / unlocking process (s20) is executed, the server 30 checks whether there is a request from the administrator computer 40 (s3). The request is for transmission of installation information, and if there is no request, the next time confirmation process (s4) is executed. On the other hand, if there is a request, the information provision process (s30) is executed. In the information provision process (s30), the CPU 32 of the server 30 extracts installation information from the installation information table and transmits the extracted installation information to the administrator computer 40. The administrator computer 40 displays the received installation information on a display unit such as a monitor, allowing the administrator to check the installation information.

[0065] When the information provision process (s30) is executed, a time confirmation process (s4) is executed. In the time confirmation process (s4), the CPU 15 of the smart device 10 checks whether a predetermined time has elapsed. If the predetermined time has not elapsed, a person detection process (s2) is executed. If the predetermined time has elapsed, the following tracking process (s40) is executed.

[0066] The tracking process (s40) is a process for tracking the position of the smart device 10 installed on the door D, and as shown in FIG. 10, executes a GPS acquisition process (s41), a comparison process (s42), a map information generation process (s43), and a display process (s44).

[0067] The GPS acquisition process (s41) is a process in which the smart device 10 acquires GPS values ​​from the GPS module 17. The CPU 15 of the smart device 10 associates the acquired GPS values ​​with the device code stored in the memory 16 and transmits them to the server 30.

[0068] The CPU 32 of the server 30 receives the GPS value and the device code from the smart device 10 and executes a comparison process (s42). In the comparison process (s42), the server 30 extracts the GPS value corresponding to the received device code from the installation information table and compares the extracted GPS value with the received GPS value. As a result of the comparison, if the GPS values ​​are within the tolerance range, the server 30 determines that the GPS values ​​are normal. If the difference exceeds the tolerance range, the server 30 determines that the GPS values ​​are abnormal. If an abnormality is determined, the server 30 transmits information indicating the abnormality and the device code of the smart device 10 determined to be abnormal to the administrator computer 40 in a transmission process described below. After performing the comparison, the server 30 identifies a record in the installation information table based on the received device code and registers the received GPS value in the GPS field of the identified record.

[0069] Next, the CPU 32 of the server 30 executes a map information generation process (s43). The map information generation process (s43) is a process for generating a map in which the locations of the installed smart devices 10 are indicated by markers. The CPU 32 of the server 30 extracts GPS values ​​from the installation information table and generates map information in which the extracted GPS values ​​are reflected in the marker coordinates on the map. The CPU 32 of the server 30 transmits the generated map information and the comparison results to the administrator computer 40.

[0070] The administrator computer 40 receives the map information and the comparison result from the server 30 and executes a display process (s44). The display process (s44) is a process for displaying the information received from the server 30. When a comparison result indicating an abnormality is received, the administrator computer 40 displays a screen on the monitor instructing the administrator to check the installation status of the smart device 10. The administrator computer 40 also displays the map information on the monitor. This allows the administrator to check the location of the smart device 10.

[0071] The locking / unlocking system 100 of this embodiment may further have the following functions.

[0072] <Anti-theft feature>

[0073] In addition to the tracking function described in the above embodiment, the locking / unlocking system 100 may also have a theft prevention function for the smart device 10. As the theft prevention function, the smart device 10 generates an alarm when its installation orientation changes. Specifically, as shown in FIG. 4 , the smart device 10 includes an angular velocity sensor 18 that functions as a detector for detecting the installation orientation and a speaker 19 that functions as an alarm generator for generating an alarm sound when the installation orientation changes. The angular velocity sensor 18 detects changes in the rotation and orientation of the smart device 10 as angular velocity, and the signal is input to the CPU 15. The CPU 15 determines a change in the installation orientation of the smart device 10 based on the change in the signal input from the angular velocity sensor 18. In this way, the CPU 15 functions as an orientation change determination unit. If it is determined that the installation orientation has changed, the CPU 15 plays an alarm sound source pre-stored in the memory 16. The alarm sound signal output by the playback of the alarm sound source is amplified by an amplifier circuit (not shown) and input to the speaker 19. According to this configuration, an alarm sound is output when the attitude of the installed smart device 10 changes, thereby preventing theft.

[0074] Furthermore, when the CPU 15 of the smart device 10 detects a change in the installation posture, it inputs an image capturing command to the camera module 12. Then, the CPU 15 may acquire an image generated by the camera module 12 and transmit it to the server 30. When the server 30 receives an image from the smart device 10, it stores the image in the memory 33 and transmits the image to the administrator computer 40 in response to a request from the administrator computer 40.

[0075] <Intercom function>

[0076] The locking / unlocking system 100 may have an intercom function. The intercom function is a function for communicating with a person in front of the door D. Specifically, the locking / unlocking system 100 is equipped with a network telephone that can communicate with the smart device 10. The network telephone is a known IP telephone or Internet telephone installed in the room and connected to an Internet communication line. The smart device is equipped with a speaker 19 and a microphone (not shown), and the CPU 15 converts a voice signal input from the microphone into voice information and transmits it to the network telephone. The CPU 15 also generates the voice information received from the network telephone from the speaker. With this configuration, a person in front of the door D can use the smart device 10 to communicate with a person in the room.

[0077] Furthermore, when making the call, the CPU 15 of the smart device 10 may display a GUI for "ringing the intercom" or a GUI for "ringing the doorbell" on the touch panel display 11, and start the call when the GUI is operated. It is preferable to display the GUI when the person's entry / exit qualification is not authenticated (s24: No), for example.

[0078] Furthermore, when the GUI is operated, the CPU 15 of the smart device 10 may input an image capture command to the camera module 12 and acquire an image generated by the camera module. In this embodiment, the CPU 15 transmits the acquired image and device code to the server 30. The server 30 stores the received image and device code in the memory 33 in association with each other. According to this embodiment, an image of a person to be called can be saved in the server 30. To view the image, a user transmits a view request to the server 30 from a user terminal connectable to an Internet communication line. When the CPU 32 of the server 30 receives the view request, it identifies the device code corresponding to the received user based on the comparison list, and transmits the image stored in association with the identified device code to the user terminal.

[0079] Although the embodiment of the present invention has been described above, the present invention is not limited to the embodiment and may be modified as follows, for example.

[0080] [Variation 1] In the above embodiment, the smart device 10 calculates facial feature points of a person based on an image and transmits the feature points to the server 30 as biometric information. However, an image acquired by the smart device 10 may be transmitted to the server 30 as biometric information, and the CPU 32 of the server 30 may calculate the feature points. The server 30 may also identify a user through machine learning. For example, in the registration process (s10), the server 30 acquires an image of the user from the smart device 10 and generates a trained model using the image of the user as training data. Then, in the identification process (s22), the CPU 32 of the server 30 can identify the user by inputting the image acquired from the smart device 10 into the trained model.

[0081] [Variation 2] In the above embodiment, feature points calculated from a person's facial image and a facial image are used as biometric information, but a user may also be identified based on biometric information such as a fingerprint, palm print, veins, iris, auricle, or voiceprint.

[0082] For example, when using biometric information such as a fingerprint, palm print, or vein pattern, a scanner that scans the fingerprint, palm print, vein pattern, etc. to generate a biometric image is communicatively connected to the smart device 10, and the biometric image generated by the scanner is input into the smart device 10.

[0083] Also, for example, when using biometric information such as the iris or auricle, a camera that generates biometric images of the iris or auricle is communicatively connected to the smart device 10, and the biometric images generated by the camera are input into the smart device 10.

[0084] Furthermore, for example, when a voiceprint is used as biometric information, the biometric information is acquired by a microphone provided in the smart device 10, and the acquired biometric information is input to the CPU 15 of the smart device 10. Alternatively, an external microphone may be connected to the smart device 10.

[0085] [Variation 3] In the above embodiment, the user is identified based on only the face image, but the user may be identified by combining the face image with other biometric information as listed in the second modification example.

[0086] [Variation 4] In the locking / unlocking process (s20) of the above embodiment, an authentication process may be executed to authenticate the user identified in the identification process (s22). In this modified embodiment, a password field is provided in the user table provided in the memory 33 of the server 30. The password field is a field in which a password designated by the user is registered, and is registered together with the user's personal information in the registration process (s10). The password may be an alphanumeric string or an answer to a question. In the locking / unlocking process (s20), an input process for the password is executed after the acquisition process (s21), and the password is transmitted to the server 30 together with the biometric information in a transmission process. In a reception process, the server 30 receives the password together with the biometric information, and then an authentication process is executed after the identification process (s22). In the authentication process, the password corresponding to the user ID identified in the identification process (s22) is first extracted from the user table, and the received password is compared with the extracted password. If the result of the comparison shows a match, it is authenticated that the user (user ID) identified in the identification process (s22) is valid, that is, the user identified in the identification process (s22) is a user of this system. Note that personal authentication using the password does not necessarily have to be performed on all users, and may be performed only on users who are identical twins. It may also be performed only when entering a room with a high security level.

[0087] [Variation 5] In the registration process (s10) of the above embodiment, the smart device 10 transmits the information to be registered to the server 30, but the present invention is not limited to this. For example, the locking / unlocking system 100 may be provided with a user terminal (hereinafter referred to as "user terminal") that can communicate with the server 30 via an internet communication line, and the user terminal may transmit biometric information and personal information to the server 30. By enabling the user terminal to transmit biometric information and personal information to the server 30 in this manner, the user can re-register the information if the personal information is subsequently changed or if identification of the user based on the biometric information becomes unstable.

[0088] [Variation 6] In the above embodiment, the smart device 10 may operate in a power-saving mode such as a sleep mode when no person is detected (No) in the detection process (s2), and may operate in a normal mode when a person is detected in the detection process (s2).

[0089] [Variation 7] In the above embodiment, communication between the smart device 10 and the locking / unlocking device 20 is performed based on the Bluetooth Low Energy standard, but other wireless communication standards or wired communication standards may also be used.

[0090] [Variation 8] The memory 33 of the server 30 in the above embodiment may function as a history storage unit that stores authentication history. Specifically, a history table is provided in the memory 33 of the server 30. A record is added to the history table each time a user's entry / exit qualification is successfully authenticated. The history table includes a user code field in which the authenticated user's user code is registered, a date and time field in which the date and time of authentication is registered, a device code field in which the device code of the smart device 10 used for authentication is registered, and a biometric information field in which the biometric information used for authentication is registered. The information registered in the history table is sent to the administrator computer 40 in response to a request from the administrator computer 40. The administrator computer 40 displays the received information on a monitor. According to this embodiment, the administrator can grasp the user's entry and exit status.

[0091] [Variation 9] In the above embodiment, the smart device 10 is installed outside the room as an acquisition terminal that acquires facial images, which are biometric information. However, it may also be installed, for example, inside (inside) a glass door D and capture facial images of people outside the room through the glass door D. [Explanation of symbols]

[0092] 10 Smart devices (acquiring devices) 11 Touch panel display (input reception section) 12 Camera module (imaging unit) 13. Short-range wireless communication module 17 GPS module (position detection unit) 18 Angular velocity sensor (attitude detection part) 20 Locking / unlocking device 30 servers 100 Locking and unlocking system D-door S thumb turn

Claims

1. A locking / unlocking device is disposed on the interior side of the door and attached to a thumb turn provided on the interior side of the door to operate the thumb turn; an acquisition terminal that is installed in association with the locking / unlocking device, is capable of communicating with the locking / unlocking device, and acquires biometric information of a person positioned in front of the door; a server capable of communicating with the acquisition terminal, identifying the person based on the biometric information received from the acquisition terminal, verifying the person's eligibility to enter and exit the door by comparing the identified person with a person list managed in association with the acquisition terminal, and transmitting an authentication result to the acquisition terminal; Equipped with The locking / unlocking device operates the thumb turn based on information for operating the thumb turn from the acquisition terminal that receives the authentication result, in a locking / unlocking system.

2. the acquisition terminal has an input receiving unit that receives a touch input from the person; The locking / unlocking system according to claim 1 , wherein the biometric information is acquired when a touch input is made to the input receiving unit.

3. The acquisition terminal has an imaging unit that captures an image of the area in front of the door and generates an image, The locking / unlocking system according to claim 1 , wherein the biometric information is acquired when a person is detected in the generated image.

4. 4. The locking / unlocking system according to claim 2, wherein the acquiring terminal returns from a power saving mode when acquiring the biometric information.

5. The acquisition terminal, An orientation detection unit that detects an installation orientation; an alarm generating unit that generates an alarm; having The locking / unlocking system according to claim 1 , wherein the alarm generating unit generates the alarm when the installation attitude is changed.

6. 2. The locking / unlocking system according to claim 1, wherein the locking / unlocking device and the acquiring terminal transmit and receive information for operating the thumb turn using a Bluetooth Low Energy communication method.

7. The locking / unlocking system according to claim 3 , wherein the biometric information is generated based on a facial image of the person captured by the imaging unit.

8. The locking / unlocking system according to claim 1 , wherein the acquisition terminal is a smart device.

9. A locking / unlocking device included in the locking / unlocking system of claim 1.

Citation Information

Patent Citations

  • Oxygen capturing composition

    JP1980020660A

  • Control apparatus of paper making machine

    JP1980084495A

  • Liquid pressure changeeover valve

    JP1981086269A

  • Portable information display device

    JP2001350424A

  • Keyless system

    JP2002288750A