Storage system and storage management method

The storage system addresses usability and security issues in facial matching by incorporating face and QR code authentication, ensuring successful retrieval even if face matching fails, thereby enhancing user convenience and security.

JP7727914B2Active Publication Date: 2025-08-22PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2021163357
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-10-04
Publication Date
2025-08-22
Estimated Expiration
2041-10-04

AI Technical Summary

Technical Problem

Conventional facial matching systems in storage lockers can lead to erroneous matches, causing inconvenience and security risks, especially when users are unable to retrieve their luggage due to mismatches, and there is a need for improved usability and security in personal authentication.

Method used

A storage system that performs both face matching and code matching, such as QR code matching, to authenticate users, ensuring successful authentication if either method matches, thereby improving usability and security by allowing retrieval even if face matching fails.

Benefits of technology

The system ensures high security by requiring multiple authentication methods, enhancing user convenience by allowing retrieval if QR code matching succeeds, even if face matching fails, thus reducing wait times and improving overall user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007727914000001
    Figure 0007727914000001
  • Figure 0007727914000002
    Figure 0007727914000002
  • Figure 0007727914000003
    Figure 0007727914000003
Patent Text Reader

Abstract

To make it easy for a user to take out an article deposited in a depository, and to ensure high security in personal authentication.SOLUTION: At the time of a user registration, a management server 2 acquires a face image for registration obtained by photographing the user's face via a security locker 1 (registration device), and issues a two-dimensional code to be delivered to the user. Then, when the luggage is taken out, the management server acquires the face image for authentication obtained by photographing the user's face and a two-dimensional code presented by the user through the security locker (authentication device). The management server performs, as personal authentication, at least one of face matching, which compares the face image for registration and face image for authentication, and code matching, which compares the two-dimensional code issued to the user with the two-dimensional code presented by the user, and determines whether or not the security locker can be unlocked based on the collation result.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a storage system and a storage management method in which, when removing items from a storage unit locked with an electronic lock, personal authentication is performed to confirm that the user is the same person as a registered person, and the electronic lock of the storage unit is unlocked if the personal authentication is successful. [Background technology]

[0002] At facilities such as train stations, coin lockers are installed, where users can temporarily store their luggage by inserting coins. To enhance user convenience, keyless lockers using IC cards are also becoming popular. In such keyless lockers, personal authentication is performed based on information stored on the IC card, which verifies that the user is the same person who left their luggage when they retrieve it.

[0003] Meanwhile, there is also known a technology that performs identity authentication when collecting luggage by facial matching without using an IC card (see Patent Document 1). With this technology, a facial image of the user is obtained by photographing the user's face when depositing the luggage (when locking), and the facial image is registered, and a facial image of the user is also obtained by photographing the user's face when collecting the luggage (when unlocking), and the facial image at the time of depositing the luggage is compared with the facial image at the time of collecting. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-070899 Summary of the Invention [Problem to be solved by the invention]

[0005] In facial matching, erroneous matching may occur, resulting in a mismatch even for the same person. If such a erroneous match occurs in a keyless storage locker, the user will be unable to retrieve their luggage. Therefore, in conventional technology, an attendant visually compares the facial image of the target person with the facial image of a registered person, confirms that they are the same person, and then performs an unlocking operation. This allows the user to retrieve their luggage even if a erroneous match occurs in facial matching. However, this method in which an attendant handles the situation has the problem of causing inconvenience to the user, such as making the user wait for a long time, making it difficult for the user to use. For this reason, it is desirable to improve the ease of use for users when retrieving items deposited in a storage locker. Furthermore, there are cases in which high security is required for identity authentication, and it is desirable to meet such demands.

[0006] Therefore, the main object of the present invention is to provide a storage system and a storage management method that are easy for users to use when retrieving items deposited in a storage facility and that can ensure high security in personal authentication. [Means for solving the problem]

[0007] The storage system of the present invention comprises a storage device that is locked and unlocked by an electronic lock, a registration device that performs processing related to user registration to register user information required for identity authentication, a server device that, during user registration, acquires a facial image for registration by photographing the user's face via the registration device and issues a code image to be issued to the user, and an authentication device that acquires at least one of a facial image for authentication by photographing the user's face and the code image presented by the user, and when unlocking the storage device, the matching unit performs at least one of face matching, which compares the facial image for registration with the facial image for authentication, and code matching, which compares the code image issued to the user with the code image presented by the user, as the identity authentication, and based on the matching result, it is determined whether or not the storage device can be unlocked.

[0008] In addition, the storage management method of the present invention is a storage system comprising a storage device that is locked and unlocked by an electronic lock, a registration device that performs processing related to user registration to register user information necessary for identity authentication, a server device that, during user registration, acquires a facial image for registration by photographing the user's face via the registration device and issues a code image to be issued to the user, and an authentication device that acquires at least one of a facial image for authentication by photographing the user's face and the code image presented by the user, in which, when unlocking the storage device, the identity authentication is performed by at least one of face matching that compares the facial image for registration with the facial image for authentication, and code matching that compares the code image issued to the user with the code image presented by the user, and based on the matching result, it is determined whether or not the storage device can be unlocked. [Effects of the Invention]

[0009] According to the present invention, face matching and code matching are performed for personal authentication. Therefore, even if a mismatch occurs in face matching, for example, the system can be operated so that personal authentication is successful if a match is obtained in code matching. This can improve usability for users when retrieving items deposited in a storage unit. On the other hand, the system can be operated so that personal authentication is not successful if a match is not obtained in both face matching and code matching. This can ensure high security in personal authentication. [Brief explanation of the drawings]

[0010] [Figure 1] Overall configuration diagram of the security locker system according to the first embodiment [Figure 2] Front view showing the exterior of the security locker [Figure 3] Block diagram showing the general configuration of a security locker [Figure 4] Block diagram showing the general configuration of the management server [Figure 5] An explanatory diagram showing an overview of the processing that takes place in the security locker and management server when luggage is deposited. [Figure 6] An explanatory diagram showing the screen displayed on the security locker display when depositing luggage [Figure 7] Flow diagram showing the operation procedure for user registration in the security locker and management server [Figure 8] An explanatory diagram showing an overview of the processing that takes place at the security locker and management server when a package is picked up. [Figure 9] An explanatory diagram showing the screen displayed on the security locker display when collecting luggage [Figure 10] Flow diagram showing the operation procedure for picking up luggage at the security locker and management server [Figure 11] Flow diagram showing the procedure for determining whether or not to unlock the door, which is performed by the management server [Figure 12] Flow diagram showing the procedure for determining whether or not to unlock the door, which is performed by the management server [Figure 13] An explanatory diagram showing the outline of the processes that are carried out on the security locker and management server when unlocking [Figure 14] An explanatory diagram showing the settings screen displayed on the management terminal [Figure 15] Overall configuration diagram of a security locker system according to a second embodiment [Figure 16] FIG. 10 is a block diagram showing a schematic configuration of a register according to a second embodiment. [Figure 17] A block diagram showing the schematic configuration of a security locker according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] The first invention made to solve the above problem comprises a storage device that is locked and unlocked by an electronic lock, a registration device that performs processing related to user registration to register user information necessary for identity authentication, a server device that, during the user registration, acquires a facial image for registration by photographing the user's face via the registration device and issues a code image to be issued to the user, and an authentication device that acquires at least one of a facial image for authentication by photographing the user's face and the code image presented by the user, and when unlocking the storage device, a matching unit performs at least one of face matching, which compares the facial image for registration with the facial image for authentication, and code matching, which compares the code image issued to the user with the code image presented by the user, as the identity authentication, and based on the matching result, it is determined whether the storage device can be unlocked.

[0012] According to this, face matching and code matching are performed for personal authentication. Therefore, even if a mismatch occurs in face matching, for example, the system can be operated so that personal authentication is successful if a match is obtained in code matching. This can improve usability for users when retrieving items deposited in the storage. On the other hand, the system can be operated so that personal authentication is not successful if a match is not obtained in both face matching and code matching. This can ensure high security in personal authentication.

[0013] In addition, in a second invention, the matching unit is configured to manage the identification information of the storage unit of the storage device, the facial image for registration, and the code image issued to the user in association with each other.

[0014] This allows efficient management of information required for personal authentication to unlock the storage device.

[0015] In addition, in a third invention, the matching unit is configured to manage settings for the method of determining whether to unlock the door based on the results of the facial matching and the code matching, selecting either AND authentication, which determines that authentication is successful when a match is obtained in both the facial matching and the code matching, or OR authentication, which determines that authentication is successful when a match is obtained in either the facial matching or the code matching.

[0016] According to this, AND authentication can improve security. On the other hand, OR authentication can improve user convenience. Furthermore, OR authentication can reduce the processing load by omitting one check if a match is obtained in the other check.

[0017] In addition, a fourth invention is configured such that the storage device includes the registration device and the authentication device, and the server device, when registering the user, acquires the facial image for registration via the storage device that also serves as the registration device, and when removing items from the storage device, acquires the facial image for authentication and the code image presented by the user via the storage device that also serves as the authentication device.

[0018] In this way, the storage device serves as both the registration device and the authentication device, thereby simplifying the system configuration. Note that the storage device may also serve as the authentication device, and the registration device may be provided separately from the storage device.

[0019] In addition, a fifth invention is configured such that the server device transmits the issued code image to a mobile terminal carried by the user in order to deliver the code image to the user.

[0020] This allows a user to easily receive authentication by presenting the screen of a mobile terminal on which a code image is displayed to an authentication device.

[0021] In a sixth aspect of the present invention, the registration device is configured to output a sheet on which the code image is printed by a printing device in order to deliver the issued code image to the user.

[0022] This allows a user to easily receive personal authentication by presenting a sheet on which a code image is printed to an authentication device.

[0023] In addition, a seventh aspect of the present invention is configured such that the code image is a two-dimensional code or a one-dimensional code.

[0024] This allows the code image to be read with high accuracy.

[0025] In addition, an eighth invention is a storage system comprising a storage device that is locked and unlocked by an electronic lock, a registration device that performs processing related to user registration to register user information necessary for personal authentication, a server device that, during the user registration, acquires a facial image for registration by photographing the user's face via the registration device and issues a code image to be issued to the user, and an authentication device that acquires at least one of a facial image for authentication by photographing the user's face and the code image presented by the user, wherein, when the storage device is unlocked, the personal authentication is performed by at least one of face matching that compares the facial image for registration with the facial image for authentication, and code matching that compares the code image issued to the user with the code image presented by the user, and whether or not the storage device can be unlocked is determined based on the matching result.

[0026] This, like the first invention, provides ease of use for the user when retrieving items deposited in the storage unit, and also ensures high security in personal authentication.

[0027] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0028] (First embodiment) FIG. 1 is a diagram showing the overall configuration of a security locker system according to the first embodiment.

[0029] This security locker system (storage system) comprises a security locker 1 (storage device, registration device, authentication device), a management server 2 (server device), a management terminal 3, and a mobile terminal 4. The security locker 1, management server 2, management terminal 3, and mobile terminal 4 are connected via a network.

[0030] In this security locker system, when a user collects their luggage, they undergo identity authentication to confirm that they are the person who deposited the luggage. If identity authentication is successful, the security locker 1 is unlocked and the user can collect their luggage.

[0031] In this embodiment, face matching and two-dimensional code matching are performed for identity authentication. In face matching, a face image of the user taken when depositing luggage (a face image for registration) is compared with a face image of the user taken when collecting the luggage (a face image for authentication). In two-dimensional code matching, a two-dimensional code issued to the user when depositing luggage is compared with a two-dimensional code presented by the user when collecting the luggage. The two-dimensional code is, for example, a QR code (registered trademark), and certifies that the person who presented it is the person who deposited the luggage. The two-dimensional code is issued by the management server 2 when the user registers.

[0032] The security locker 1 functions as a register (registration device) that processes user registration, registering user information necessary for identity authentication, and transmits a facial image of the user (facial image for registration) obtained by photographing the user's face when depositing luggage to the management server 2.

[0033] Security locker 1 also functions as a checker (authentication device) that performs processes related to personal authentication, and when collecting luggage, it photographs the user's face and transmits the acquired facial image (facial image for authentication) to management server 2. Security locker 1 also transmits the two-dimensional code presented by the user to management server 2 when collecting luggage.

[0034] When depositing luggage, the management server 2 acquires the user's facial image (a facial image for registration) from the security locker 1 and performs user registration processing. At this time, the management server 2 issues a two-dimensional code to be given to the user. Specifically, the management server 2 causes the security locker 1 to output a sheet on which the two-dimensional code is printed. The management server 2 also sends an email to the user's mobile device 4, which includes link information (e.g., a webpage URL) for accessing a website that distributes the two-dimensional code. The sheet on which the two-dimensional code is printed or the mobile device 4 serves as a medium for the two-dimensional code, and the user presents this medium for the two-dimensional code to the security locker 1 when collecting the luggage. The website that distributes the two-dimensional code is constructed by the management server 2, but it may also be constructed by a server device other than the management server 2.

[0035] Furthermore, when the user collects their luggage, the management server 2 acquires the user's facial image (facial image for authentication) and two-dimensional code from the security locker 1, and performs facial matching and two-dimensional code matching processes for personal authentication. If the personal authentication is successful and a decision is made to permit unlocking, an unlocking permission notice is sent from the management server 2 to the security locker 1, and the security locker 1 unlocks. On the other hand, if the personal authentication fails and a decision is made to prohibit unlocking, an unlocking denial notice is sent from the management server 2 to the security locker 1, and the security locker 1 remains locked.

[0036] The management terminal 3 is operated by an administrator and is configured with a PC, etc. On the management terminal 3, the administrator performs operations to set conditions related to the processing performed by the management server 2, etc.

[0037] The mobile terminal 4 is a smartphone or the like carried by the user. The mobile terminal 4 functions as a medium for a two-dimensional code issued to the user at the time of user registration. Specifically, the mobile terminal 4 accesses a website using a web browser based on link information distributed from the management server 2, and the two-dimensional code is displayed on the screen.

[0038] In this embodiment, a code image, specifically a two-dimensional code such as a QR code (registered trademark), is issued to the user when collecting the luggage as a means of proving that the user is the person who left the luggage, but the code image is not limited to a two-dimensional code and may be a one-dimensional code such as a barcode.

[0039] Next, we will explain the security locker 1. Figure 2 is a front view showing the appearance of the security locker 1.

[0040] The security locker 1 is equipped with a plurality of locker boxes 5 (storage units) for storing the user's belongings. The security locker 1 also includes a camera 11, a motion sensor 12, displays 13 and 14, a printer 15 (printing device), and an electronic lock 16.

[0041] Camera 11 photographs the face of the user when depositing the baggage. Camera 11 also photographs the face of the user when collecting the baggage. Furthermore, camera 11 photographs the two-dimensional code presented by the user when collecting the baggage, specifically, the sheet on which the two-dimensional code is printed or the screen of mobile terminal 4 on which the two-dimensional code is displayed, along with the user's face.

[0042] The human sensor 12 detects that a person has approached the security locker 1. When the human sensor 12 detects a person, the displays 13 and 14 start displaying the screens.

[0043] Display 13 displays a screen related to user registration when depositing luggage. Display 13 also displays a screen related to personal authentication (face matching and two-dimensional code matching) when collecting luggage. Display 13 is configured as a touch panel, and users can operate the screen.

[0044] The display 14 normally operates as a digital signage displaying content such as advertisements and weather forecasts. However, when a person using the security locker 1 is detected, a guidance screen related to the security locker 1 is displayed, such as a screen that guides the user to the location of the locker box 5 selected by the user when depositing their luggage, or a screen that guides the user to the location of the locker box 5 currently in use when collecting their luggage.

[0045] When the user deposits the baggage, the printer 15 outputs a sheet on which a two-dimensional code is printed. When the user collects the baggage, the user presents the sheet on which the two-dimensional code is printed in front of the camera 11, and the two-dimensional code is verified by the management server 2.

[0046] The electronic lock 16 locks and unlocks the door of the locker box 5.

[0047] In this embodiment, the security locker 1 (storage device) is provided with multiple locker boxes 5 (storage units), but the storage device is not limited to a configuration with multiple storage units, and a configuration with only one storage unit is also possible. For example, if the storage device is a key box that stores keys to rooms or vehicles in a building at a business or the like, it may have only one storage unit. In this case, one or more users use the key box, and information about these users is registered in advance.

[0048] Next, we will explain the general configuration of the security locker 1. Figure 3 is a block diagram showing the general configuration of the security locker 1.

[0049] The security locker 1 includes a camera 11, a motion sensor 12, displays 13 and 14, a printer 15, an electronic lock 16, a communication unit 17, a memory unit 18, and a processor 19.

[0050] The communication unit 17 communicates with the management server 2 via the network.

[0051] The storage unit 18 stores programs executed by the processor 19 and the like.

[0052] The processor 19 performs various processes by executing programs stored in the storage unit 18. In this embodiment, the processor 19 performs a facial image acquisition process, a user registration request process, a two-dimensional code issuance process, a two-dimensional code acquisition process, a personal authentication request process, a door opening / closing control process, a GUI control process, and the like.

[0053] In the facial image acquisition process, when depositing luggage, processor 19 detects a person's face from the image captured by camera 11, cuts out a facial area from the captured image, and acquires a facial image of the user (a facial image for registration). When collecting luggage, processor 19 detects a person's face from the image captured by camera 11, cuts out a facial area from the captured image, and acquires a facial image of the user (a facial image for authentication).

[0054] In the user registration request process, the processor 19 sends a user registration request from the communication unit 17 to the management server 2. The user registration request includes the box ID of the locker box 5 that the user wishes to use and a facial image of the user. In response to receiving the user registration request, the management server 2 performs a process related to user registration, which registers information about the user. The management server 2 also performs a process to issue a two-dimensional code to be issued to the user.

[0055] In the two-dimensional code issuing process, the processor 19 issues a two-dimensional code issued by the management server 2 to the user when the baggage is checked in. Specifically, as a first method, the printer 15 is controlled to output a sheet on which a two-dimensional code is printed. As a second method, the management server 2 can send an email containing link information for accessing a website displaying the two-dimensional code to the mobile terminal 4 as the two-dimensional code issuing process. As a method for issuing the two-dimensional code to the user, a screen is displayed on the display that accepts a user's operation to select at least one of printing the two-dimensional code using a printing device or transmitting the two-dimensional code to the user's mobile terminal. The user can select the method of issuing the two-dimensional code (printing or transmitting). Alternatively, the two-dimensional code may be transmitted from the security locker 1 to the mobile terminal 4 using short-range wireless communication such as Bluetooth (registered trademark).

[0056] In the two-dimensional code acquisition process, processor 19 acquires the two-dimensional code presented by the user using the two-dimensional code medium when picking up the luggage. Specifically, the area of ​​the two-dimensional code is detected from the image captured by camera 11, the area of ​​the two-dimensional code is cut out from the captured image, an image of the two-dimensional code is acquired, and the two-dimensional code information (information stored in the image of the two-dimensional code) is acquired by reading the image of the two-dimensional code. Note that the image of the two-dimensional code may be read by management server 2.

[0057] In the personal authentication request process, the processor 19 sends a personal authentication request from the communication unit 17 to the management server 2. In response to receiving the personal authentication request, the management server 2 performs personal authentication (face matching and two-dimensional code matching), and depending on whether the personal authentication is successful, the management server 2 sends an unlock permission notice (authentication successful) or an unlock denial notice (authentication failed) to the security locker 1.

[0058] In the door opening / closing control process, processor 19 controls the opening and closing of the door of locker box 5 in response to instructions from management server 2. Specifically, when an unlocking permission notice is received from management server 2, processor 19 controls electronic lock 16 to unlock locker box 5, and when an unlocking denial notice is received, processor 19 keeps locker box 5 locked.

[0059] In the GUI control process, the processor 19 displays on the display 13 a screen relating to user registration and personal authentication, which is delivered from the management server 2. The processor 19 also acquires input information and controls the screen in response to the user's input operation using the input function of the display 13 (here, a touch panel).

[0060] Next, a description will be given of the general configuration of the management server 2. FIG.

[0061] The management server 2 includes a communication unit 21, a storage unit 22, and a processor 23.

[0062] The communication unit 21 communicates with the security lockers 1, the management terminal 3, and the mobile terminal 4 via the network.

[0063] The storage unit 22 stores programs executed by the processor 23. The storage unit 22 also stores registration information (user management information) of a user management table. User information required for personal authentication is registered in the user management table (see FIG. 5).

[0064] The processor 23 performs various processes by executing programs stored in the storage unit 22. In this embodiment, the processor 23 performs facial feature extraction processing, two-dimensional code generation processing, information management processing, two-dimensional code issuance processing, face matching processing, two-dimensional code matching processing, unlocking possibility determination processing, unlocking control processing, etc. The facial feature extraction processing, two-dimensional code generation processing, and information management processing are processes related to user registration. The facial feature extraction processing, face matching processing, two-dimensional code matching processing, and unlocking possibility determination processing are processes related to personal authentication.

[0065] In the facial feature extraction process, the processor 23 extracts facial feature information from the facial image of the user acquired from the security locker 1 when depositing and collecting luggage.

[0066] In the two-dimensional code issuing process, the processor 23 issues (generates) a two-dimensional code to be issued to the user when the user deposits the baggage. The two-dimensional code stores specific information that proves that the user is the person who deposited the baggage. The specific information is information that does not actually overlap with two-dimensional codes issued to other people, such as a random number.

[0067] In the information management process, when depositing luggage, the processor 23 registers the box ID (number) of the locker box 5 that the user wishes to use, the facial feature information of the user acquired in the facial feature extraction process, and the two-dimensional code issued in the two-dimensional code issuance process in the user management table. In addition, the user management table also registers information about the user, such as an email address.

[0068] In the two-dimensional code issuance process, the processor 23 sends an email containing link information for accessing a website that displays the two-dimensional code issued to the user from the communication unit 21 to the mobile terminal 4. Note that an email containing the two-dimensional code itself may also be sent to the mobile terminal 4.

[0069] In the face matching process, the processor 23 matches the facial feature information of the user acquired in the facial feature extraction process with the facial feature information registered in the user management table when the user collects the package.

[0070] In the two-dimensional code matching process, the processor 23 matches the two-dimensional code acquired from the security locker 1 when the user picks up the baggage with the two-dimensional code registered in the user management table.

[0071] In the unlocking determination process, the processor 23 determines whether the personal authentication has been successful based on the results of the face matching process and the two-dimensional code matching process, and determines whether the locker box 5 being used by the user can be unlocked, i.e., whether unlocking is permitted, based on the success or failure of the personal authentication. In this embodiment, the administrator can select either AND authentication or OR authentication as the authentication method. In AND authentication, personal authentication is determined to be successful if a match is obtained in both face matching and two-dimensional code matching. In OR authentication, personal authentication is determined to be successful if a match is obtained in either face matching or two-dimensional code matching.

[0072] In the unlocking control process, the processor 23 controls the unlocking of the electronic lock 16 in the security locker 1. Specifically, when the luggage is picked up, depending on the result of the unlocking permission determination process, i.e., whether or not unlocking is permitted, an unlocking permission notice or unlocking denial notice is sent from the communication unit 21 to the security locker 1.

[0073] In this embodiment, the management server 2 (server device) is the matching unit that performs the face matching process and the two-dimensional code matching process, but the security locker 1 as an authentication device may also be the matching unit that performs the face matching process and the two-dimensional code matching process. Also, in this embodiment, the management server 2 performs the unlocking possibility determination process, but a server other than the management server 2 may perform the unlocking possibility determination process, and further, the security locker 1 as an authentication device may perform the unlocking possibility determination process.

[0074] Next, we will explain the processing that is carried out when depositing luggage in the security locker 1 and management server 2. Figure 5 is an explanatory diagram showing an overview of the processing that is carried out in the security locker 1 and management server 2 when depositing luggage.

[0075] When depositing luggage, the security locker 1 and management server 2 carry out a process related to user registration to use the security locker 1. The security locker 1 and management server 2 also carry out a process to issue a two-dimensional code and deliver it to the user. Note that the process related to user registration may be carried out in advance at a location other than the location where the security locker 1 will be used, using an application or the like installed on the user's mobile terminal 4.

[0076] Specifically, first, security locker 1 acquires a facial image of the user from the image captured by camera 11 (facial image acquisition process) and transmits the facial image of the user to management server 2. Security locker 1 then prompts the user to use display 13 to select the locker box 5 they wish to use, acquires the box ID of the locker box 5 in response to the user's screen operation, and transmits the box ID to management server 2.

[0077] The management server 2 extracts facial feature information from the user's facial image received from the security locker 1 (facial feature extraction process). The management server 2 also issues a two-dimensional code to be issued to the user (two-dimensional code issuance process). The management server 2 then associates the box ID (identification information of the storage unit) of the locker box 5 received from the security locker 1, the user's facial feature information, and the two-dimensional code to be issued to the user, and registers them in a user management table (information management process). Note that the information about the facial image registered in the user management table may be the facial feature information or the facial image itself.

[0078] Furthermore, in the management server 2, if the user selects transmission as the method for issuing the two-dimensional code, the communication unit 21 sends an email to the mobile terminal 4 containing link information (e.g., a web page URL) for accessing a website that distributes the two-dimensional code (two-dimensional code issuance process). The mobile terminal 4 uses a web browser to access the website based on the link information, and the two-dimensional code is displayed on the screen. When registering the user, the security locker 1 may display an email address input screen so that the user can obtain the email address of the mobile terminal 4.

[0079] In addition, in the security locker 1, if the user selects printing as the method of issuing the two-dimensional code, the two-dimensional code is obtained from the management server 2 and a sheet with the two-dimensional code printed on it is output by the printer 15 (two-dimensional code issuance process).

[0080] Next, we will explain the operations that a user performs when depositing luggage at security locker 1. Figure 6 is an explanatory diagram showing the screen that is displayed on display 13 of security locker 1 when depositing luggage.

[0081] First, the display 13 of the security locker 1 displays a screen 101 shown in FIG. 6(A). This screen 101 (initial screen, menu screen) allows the user to select either a baggage deposit mode or a baggage pickup mode. This screen 101 has a baggage deposit button 102 and a baggage pickup button 103. When the user operates the baggage deposit button 102, the screen transitions to a screen 111 shown in FIG. 6(B).

[0082] Screen 111 (locker box selection screen) shown in Fig. 6(B) is used by the user to select the locker box 5 they wish to use. This screen 111 has a locker box selection button 112. When the user operates the locker box selection button 112, the screen transitions to screen 121 shown in Fig. 6(C). Note that a locker box selection button 112 that is being used by another person is in an unselectable state.

[0083] Screen 121 (personal information handling regulations confirmation screen) shown in FIG. 6(C) prompts the user to confirm the personal information handling regulations, specifically notifying the user about the acquisition of a facial image for identity authentication and obtaining the user's consent. This screen 121 displays text 122 indicating the personal information handling regulations in the identity authentication system. The personal information handling regulations state that a facial image will be acquired by photographing the user's face when depositing and picking up luggage. This screen 121 also has an agree button 123 and a cancel button 124. The user operates either the agree button 123 or the cancel button 124 depending on whether or not they agree to the personal information handling regulations. When the user operates the agree button 123, the screen transitions to the screen shown in FIG. 6(D). When the user operates the cancel button 124, user registration is canceled.

[0084] Screen 131 (face image capturing screen) shown in FIG. 6(D) guides the user through capturing an image to acquire the user's face image. This screen 131 displays text 132 explaining how to capture a face image, an image 133 captured by camera 11, and a capturing frame 134. The user adjusts the position and orientation of their face so that their face fits properly within capturing frame 134. This screen 131 also has a capture button 135 and a cancel button 136. When the user operates capture button 135, an image of the user is captured by camera 11. When the user operates cancel button 136, user registration is canceled. When capturing of the face image by camera 11 is successfully completed, the screen transitions to screen 141 shown in FIG. 6(E).

[0085] Screen 141 (face image confirmation screen) shown in FIG. 6(E) is used by the user to confirm that the face image has been properly captured. This screen 141 displays text 142 prompting the user to confirm whether the face image has been properly captured, and a captured image (face image) 143. This screen 141 also has a registration button 144, a re-capture button 145, and a cancel button 146. If the user's face has been properly captured, the user operates the registration button 144. In this case, the screen transitions to screen 151 shown in FIG. 6(F). If the user's face has not been properly captured, the user operates the re-capture button 145. In this case, the screen returns to screen 131 shown in FIG. 6(D). If the user operates the cancel button 146, the user registration is canceled.

[0086] A screen 151 (two-dimensional code issuance screen) shown in FIG. 6(F) is used by a user to instruct the issuance and delivery of a two-dimensional code. This screen 151 is provided with an issue button 152, a print button 153, and a send button 154. When a user operates the issue button 152, the management server 2 issues (generates) a two-dimensional code to be delivered to the user. When a user operates the print button 153, the printer 15 outputs a sheet on which the two-dimensional code is printed. When a user operates the send button 154, an email containing link information for accessing a website that displays the two-dimensional code is sent from the management server 2 to the mobile terminal 4. When the printing or transmission of the two-dimensional code is successfully completed, the screen transitions to a screen 161 shown in FIG. 6(G). Note that when a user operates the send button 154, the screen transitions to an email address input screen (not shown) before transitioning to the screen 161 shown in FIG. 6(G), where the user inputs an email address.

[0087] Screen 161 (registration completion screen) shown in Figure 6(G) notifies the user that user registration has been completed. This screen 161 displays text 162 indicating that user registration has been completed and that the locker box 5 selected by the user can now be used. This allows the user to use the locker box 5 they have selected. At this time, when the user opens the door of the selected locker box 5, stores their luggage in the locker box 5, and then closes the door, the electronic lock 16 of the locker box 5 will be locked.

[0088] Next, we will explain the operational procedures for depositing luggage in the security locker 1 and the management server 2. Figure 7 is a flow diagram showing the operational procedures for registering a user in the security locker 1 and the management server 2.

[0089] First, the security locker 1 acquires the box ID of the locker box 5 that the user wishes to use in response to the user's selection operation (ST101). The security locker 1 also acquires the user's facial image from an image captured by the camera 11 (facial image acquisition process) (ST102). Next, a user registration request is sent to the management server 2 (user registration request process) (ST103). The user registration request includes the box ID of the locker box 5 selected by the user and the user's facial image.

[0090] When the management server 2 receives a user registration request from the security locker 1 (Yes in ST201), it extracts facial feature information of the user from the facial image included in the received user registration request (facial feature extraction process) (ST202). The management server 2 also issues (generates) a two-dimensional code to be issued to the user (two-dimensional code issuance process) (ST203). Next, the management server 2 registers the box ID included in the received user registration instruction, the extracted facial feature information of the target person, and the generated two-dimensional code in the user management table (information management process) (ST204). The management server 2 then sends a user registration completion report to the security locker 1 (ST205). The user registration completion report includes the two-dimensional code to be issued to the user.

[0091] The management server 2 also sends an email containing link information for accessing a website that distributes the two-dimensional code to the mobile terminal 4 (two-dimensional code issuing process) (ST206). Note that this process is performed when the user selects sending as the method for issuing the two-dimensional code.

[0092] When the security locker 1 receives a user registration completion report from the management server 2 (ST104), it outputs a sheet on which a two-dimensional code is printed by the printer 15 based on the two-dimensional code included in the received user registration completion report (two-dimensional code issuing process) (ST105). Note that this process is performed when the user selects printing as the method for issuing the two-dimensional code.

[0093] Based on the received user registration completion report, the security locker 1 notifies the user that user registration has been completed and that the locker box 5 selected by the user can be used (ST106). In response, when the user opens the door of the selected locker box 5, stores their luggage in the locker box 5, and then closes the door, the electronic lock 16 of the locker box 5 is locked.

[0094] Furthermore, the security locker 1 deletes the user's face image (face image for registration) stored in the storage unit 18 of the security locker 1 (ST107). This makes it possible to improve the security of the personal authentication system based on face matching.

[0095] Next, a description will be given of the processing carried out when a package is picked up in the security locker 1 and the management server 2. Fig. 8 is an explanatory diagram showing an overview of the processing carried out in the security locker 1 and the management server 2 when a package is picked up.

[0096] When collecting luggage, personal authentication (face matching and two-dimensional code matching) is performed in the security locker 1 and management server 2. If personal authentication is successful, the security locker 1 and management server 2 unlock the locker box 5 of the security locker 1.

[0097] Specifically, first, the security locker 1 acquires the user's facial image from the image captured by the camera 11 (facial image acquisition process). It also acquires the two-dimensional code presented by the user from the image captured by the camera 11 (two-dimensional code acquisition process). Then, it transmits the user's facial image and two-dimensional code to the management server 2.

[0098] The management server 2 extracts facial feature information from the user's facial image received from the security locker 1 (facial feature extraction process) and compares the user's facial feature information with the facial feature information registered in the user management table (facial matching process). It also compares the two-dimensional code obtained from the security locker 1 with the two-dimensional code information registered in the user management table (two-dimensional code matching process).

[0099] Next, the management server 2 determines whether or not the locker box 5 being used by the user can be unlocked, i.e., whether or not unlocking is permitted, based on the results of the face matching process and the two-dimensional code matching process (unlocking permission determination process). Then, depending on the determination result, i.e., whether or not unlocking is permitted, an unlocking permission notice or an unlocking denial notice is sent from the communication unit 21 to the security locker 1 (unlocking control process).

[0100] In the security locker 1, the electronic lock 16 provided in each locker box 5 is controlled in response to the unlocking permission notification or unlocking denial notification from the management server 2 (door opening / closing control process).

[0101] The management server 2 may perform the matching-related processes, i.e., facial feature extraction process, facial matching process, and two-dimensional code matching process, while the unlocking possibility determination process and unlocking control process may be performed by the security locker 1. In this case, the management server 2 may assign a user ID to each user and manage user information (facial feature information, two-dimensional code information), and the security locker 1 may manage the box ID of the locker box in association with the user ID.

[0102] Here, when the user holds the medium of the two-dimensional code, specifically a sheet on which the two-dimensional code is printed or a mobile terminal 4 on which the two-dimensional code is displayed, in front of their chest, the user's face and the two-dimensional code are photographed simultaneously. This allows the user's face image and the two-dimensional code to be acquired simultaneously with a single photograph, thereby reducing the user's effort during identity authentication. Note that the user's face and the two-dimensional code may be photographed sequentially.

[0103] Furthermore, when OR authentication is set, if the user wishes to complete identity authentication only by face matching, the user need only make sure that only their own face is captured by camera 11, without presenting the two-dimensional code in front of camera 11. Conversely, if the user wishes to complete identity authentication only by two-dimensional code matching, the user need only present the two-dimensional code in front of camera 11 so that the two-dimensional code can be reliably acquired.

[0104] Next, we will explain the operations that a user performs when picking up luggage from security locker 1. Figure 9 is an explanatory diagram showing the screen that is displayed on display 13 of security locker 1 when picking up luggage.

[0105] First, the screen 101 shown in Fig. 9(A) is displayed on the display 13 of the security locker 1. This screen 101 (initial screen, menu screen) is the same as the screen shown in Fig. 6(A). When the user operates the baggage collection button 103, the screen transitions to the screen shown in Fig. 9(B). At this time, the security locker 1 and management server 2 start processing related to personal authentication (face matching and two-dimensional code matching).

[0106] Screen 201 (face authentication in progress screen) shown in FIG. 9(B) notifies the user that personal authentication (face matching and two-dimensional code matching) for the user is in progress. This screen 201 displays an image 202 captured by camera 11. At this time, the user holds a medium for the two-dimensional code (a sheet on which the two-dimensional code is printed, or a mobile terminal 4 with the two-dimensional code displayed on the screen) in front of their chest so that the two-dimensional code is captured together with their face. Also displayed on this screen 201 are text 203 and a graphic 204 indicating that personal authentication is in progress. When personal authentication is completed (successful), the screen transitions to screen 211 shown in FIG. 9(C).

[0107] Screen 211 (face authentication completion screen) shown in Fig. 9(C) notifies the user that personal authentication of the user has been completed (successful). This screen 211 displays text 212 and a figure 213 indicating that personal authentication has been completed. Next, the screen transitions to screen 221 shown in Fig. 9(D).

[0108] 9(D) (unlock notification screen) notifies the user that the locker box 5 in use has been unlocked. This screen 221 displays text 222 informing the user that the locker box 5 in use has been unlocked, and text 223 urging the user to remove their belongings. The number and location of the unlocked locker box 5 may also be displayed.

[0109] Once the locker box 5 is unlocked, the user can open the door of the locker box 5 and remove their luggage from the locker box 5. Once the luggage has been removed from the locker box 5, the screen will transition to screen 231 (usage completion screen) shown in FIG. 9(E). Note that a sensor (not shown) may be provided inside the locker box 5, and the removal of luggage from the locker box 5 may be detected based on the detection result of this sensor.

[0110] 9(D) also has a continued use button 224. The security locker 1 allows a user to continue using the locker box 5 even after unlocking the locker box 5 that the user is currently using, and can unlock the locker to take out or put in luggage within a specified usage time (for example, 12 hours). When the user operates the continued use button 224, the system transitions to a continued use mode, and when the user opens the door of the locker box 5, takes out or puts in luggage, and then closes the door, the electronic lock 16 of the locker box 5 is locked. Note that if the usage time has expired, the continued use button 224 is not displayed.

[0111] Next, we will explain the operational procedures when picking up luggage in the security locker 1 and the management server 2. Figure 10 is a flow diagram showing the operational procedures when picking up luggage in the security locker 1 and the management server 2.

[0112] The security locker 1 first acquires the user's facial image from the image captured by the camera 11 (facial image acquisition process) (ST301). It also acquires the user's two-dimensional code from the image captured by the camera 11 (two-dimensional code acquisition process) (ST302). Next, it sends an identity authentication request to the management server 2 (identity authentication request process) (ST303). The identity authentication request includes the user's facial image and two-dimensional code.

[0113] When the management server 2 receives an authentication request from the security locker 1 (Yes in ST401), it extracts the user's facial feature information from the facial image included in the received authentication request (facial feature extraction process) (ST402). Next, it compares the user's facial feature information with the facial feature information registered in the user management table (facial matching process) (ST403). It also compares the two-dimensional code included in the received authentication request with the two-dimensional code registered in the user management table (two-dimensional code matching process) (ST404).

[0114] Next, the management server 2 determines whether or not the locker box 5 being used by the user can be unlocked based on the results of the face matching process and the two-dimensional code matching process, and notifies the security locker 1 of the determination result, i.e., whether or not unlocking is permitted (unlocking control process). At this time, if unlocking is permitted (Yes in ST405), an unlocking permission notification is sent to the security locker 1 (ST406). On the other hand, if unlocking is not permitted (No in ST405), an unlocking denial notification is sent to the security locker 1 (ST407).

[0115] When the security locker 1 receives an unlock permission notification from the management server 2 (Yes in ST304), it controls the electronic lock 16 to unlock the locker box 5 being used by the user (ST305). This allows the user to open the door of the locker box 5 and retrieve their belongings.

[0116] On the other hand, when the security locker 1 receives a notification from the management server 2 that unlocking is not permitted (Yes in ST306), it displays an error screen on the display 13 informing the user that personal authentication has failed and the locker box 5 cannot be unlocked (ST307).

[0117] Next, the security locker 1 deletes the user's face image (face image for authentication) stored in the storage unit 18 of the device itself (ST308).

[0118] Next, a description will be given of the unlocking possibility determination process (ST405 in FIG. 10) performed by the management server 2. FIGS.

[0119] In personal authentication, the management server 2 determines whether or not the locker box 5 being used by the user can be unlocked, i.e., whether or not to allow unlocking, based on the results of the face matching process and the code matching process (unlocking possibility determination process).

[0120] In this embodiment, the administrator can select either AND authentication or OR authentication. With AND authentication, if a matching result is obtained in both the face matching process and the code matching process, it is determined that personal authentication has been successful and unlocking is permitted. With OR authentication, if a matching result is obtained in either the face matching process or the code matching process, it is determined that personal authentication has been successful and unlocking is permitted.

[0121] The example shown in Figure 11(A) is a case where code matching is prioritized in OR authentication. In this case, when a two-dimensional code is presented, two-dimensional code matching is performed, and if a match is obtained in the two-dimensional code matching, face matching is omitted, and the person is determined to have been authenticated successfully and the door is allowed to unlock. On the other hand, when a two-dimensional code is not presented, face matching is performed, and if a match is obtained in the face matching, the person is determined to have been authenticated successfully and the door is allowed to unlock.

[0122] Specifically, first, it is determined whether the reading (acquisition) of the two-dimensional code was successful (ST501). If the reading of the two-dimensional code was successful (Yes in ST501), it is then determined whether a match was obtained by comparing the two-dimensional code (ST502). If a match was obtained by comparing the two-dimensional code (Yes in ST502), unlocking is permitted (ST505).

[0123] On the other hand, if reading of the two-dimensional code fails (No in ST501) or if a match is not obtained in the two-dimensional code verification (No in ST502), it is next determined whether face detection was successful (ST503). If face detection is successful (Yes in ST503), it is next determined whether a match is obtained in the face verification (ST504). If a match is obtained in the face verification (Yes in ST504), unlocking is permitted (ST505).

[0124] If no match is obtained in the face matching (No in ST504), unlocking is not permitted (ST506). If face detection fails (No in ST503), the current process ends.

[0125] The example shown in Figure 11(B) is a case where face matching is prioritized in OR authentication. In this case, if the user's face is detected, face matching is performed, and if a match is obtained in face matching, code matching is omitted, and the user is determined to have been authenticated successfully and allowed to unlock. On the other hand, if the user's face is not detected, two-dimensional code matching is performed, and if a match is obtained in two-dimensional code matching, the user is determined to have been authenticated successfully and allowed to unlock.

[0126] Specifically, first, it is determined whether face detection has been successful (ST601). If face detection is successful (Yes in ST601), it is then determined whether a match has been obtained in face matching (ST602). If a match has been obtained in face matching (Yes in ST602), unlocking is permitted (ST605).

[0127] On the other hand, if face detection fails (No in ST601) or if no match is obtained in face verification (No in ST602), it is next determined whether reading of the two-dimensional code was successful (ST603). If reading of the two-dimensional code is successful (Yes in ST603), it is next determined whether a match is obtained in two-dimensional code verification (ST604). If a match is obtained in two-dimensional code verification (Yes in ST604), unlocking is permitted (ST605).

[0128] If the two-dimensional code verification does not result in a match (No in ST604), unlocking is not permitted (ST606). If the reading of the two-dimensional code has failed (No in ST603), the current process ends.

[0129] The example shown in Fig. 12 is the case of AND authentication. In this case, face matching and two-dimensional code matching are performed sequentially, and if a match is obtained in both face matching and two-dimensional code matching, it is determined that personal authentication has been successful and unlocking is permitted.

[0130] Specifically, first, it is determined whether face detection was successful (ST701). If face detection is successful (Yes in ST701), it is then determined whether a match has been obtained in face matching (ST702). If a match has been obtained in face matching (Yes in ST702), it is then determined whether reading of the two-dimensional code was successful (ST703). If reading of the two-dimensional code is successful (Yes in ST703), it is then determined whether a match has been obtained in two-dimensional code matching (ST704). If a match has been obtained in two-dimensional code matching (Yes in ST704), unlocking is permitted (ST705).

[0131] On the other hand, if a match is not obtained in face matching (No in ST702) or if a match is not obtained in two-dimensional code matching (No in ST704), unlocking is not permitted (ST703). Also, if face detection fails (No in ST701) or reading of the two-dimensional code fails (No in ST703), the current process ends.

[0132] In the example shown in FIG. 12, the processing is performed in the order of face matching and two-dimensional code matching, but the processing may be performed in the reverse order of two-dimensional code matching and face processing.

[0133] In OR authentication such as the example shown in FIGS. 11A and 11B, if a match is obtained in only one of face matching and two-dimensional code matching, the personal authentication is determined to be successful and unlocking is permitted. This prevents a situation in which a user is unable to retrieve their luggage because unlocking is not permitted even though they are the person who deposited the luggage, thereby improving user convenience. Furthermore, if a match is obtained in one matching process, the other matching process is omitted, thereby reducing the processing load. On the other hand, in AND authentication such as the example shown in FIG. 12, if a match is not obtained in both face matching and two-dimensional code matching, personal authentication fails and unlocking is not permitted, thereby improving security.

[0134] Next, we will explain the processing that is carried out by the security locker 1 and management server 2 when unlocking the locker. Figure 13 is an explanatory diagram showing an overview of the processing that is carried out by the security locker 1 and management server 2 when unlocking the locker.

[0135] As an unlocking possibility determination process, the management server 2 determines whether personal authentication has been successful or not based on the results of the face matching process and the two-dimensional code matching process (authentication success / failure determination process), and determines whether the locker box 5 being used by the user can be unlocked, i.e., whether to allow unlocking, depending on the success or failure of the personal authentication.

[0136] At this time, if the management server 2 determines that the personal authentication has been successful based on the results of the face matching process and the two-dimensional code matching process, it sends a command to the security locker 1 inquiring whether it has the authority to unlock the locker.

[0137] When the security locker 1 receives a command from the management server 2 inquiring about the presence or absence of unlocking authority, it determines whether the user has the authority to unlock the locker as part of key management processing, and sends a response including the determination result to the management server 2. At this time, if there is no locker box 5 corresponding to the user whose identity has been successfully authenticated, it is determined that the user does not have the authority to unlock the locker.

[0138] When the management server 2 receives a response from the security locker 1 including the result of the determination as to whether or not the user has the authority to unlock, it performs a key determination process to determine whether or not the locker box 5 can be unlocked, i.e., whether or not to allow unlocking, based on the success or failure of personal authentication and the existence of the authority to unlock.

[0139] Next, as an unlocking control process, the management server 2 sends an unlocking permission notice or an unlocking denial notice to the security locker 1 based on the result of the determination regarding whether or not the lock can be unlocked. At this time, if the personal authentication fails and the user does not have the authority to unlock, an unlocking denial notice including the authentication result of failure is sent. On the other hand, if the personal authentication is successful and the user does not have the authority to unlock, an unlocking denial notice including the authentication result of success is sent. On the other hand, if the personal authentication is successful and the user has the authority to unlock, an unlocking permission notice including the authentication result of success is sent.

[0140] When the security locker 1 receives an unlocking permission notice or an unlocking denial notice from the management server 2 as part of the door opening / closing control process, it controls the opening and closing of the door of the locker box 5 according to the content of the notice. That is, when an unlocking permission notice is received, the security locker 1 controls the electronic lock 16 to unlock the locker box 5, and when an unlocking denial notice is received, the locker box 5 remains locked.

[0141] Furthermore, as a GUI control process, the security locker 1 displays on the display 13 an image indicating the result of personal authentication and the status of the electronic lock 16 in accordance with the content of the notification received from the management server 2. Specifically, when an unlocking denial notification including an authentication result of failure is received, an image 251 indicating authentication failure and unlocking denial is displayed. When an unlocking denial notification including an authentication result of success is received, an image 252 indicating authentication success and unlocking denial is displayed. When an unlocking permission notification including an authentication result of success is received, an image 253 indicating authentication success and unlocking permission is displayed. Note that images 251, 252, and 253 are displayed on the display 13 at the same time as screen 221 (unlocking notification screen) shown in FIG. 9(D) is displayed, for example.

[0142] Next, a description will be given of the setting operation relating to personal authentication performed on the management terminal 3. FIG.

[0143] On the management terminal 3, by accessing the management server 2 and logging in in administrator mode, various management screens are displayed, and the administrator can perform various setting operations on those management screens. On screen 301 shown in Figure 13, the administrator can perform setting operations related to personal authentication (face matching and two-dimensional code matching) for each security locker 1.

[0144] This screen 301 (authentication setting screen) has a security locker selection section 302 and a two-dimensional code matching selection section 303. In the security locker selection section 302, the administrator can select the target security locker 1 (device ID) by selecting from a pull-down menu. In the two-dimensional code matching selection section 303, the administrator can select by operating a radio button whether or not to perform two-dimensional code matching in addition to face matching during personal authentication.

[0145] This screen 301 also has an authentication type selection section 304 and a setting period input section 305 as detailed setting items.

[0146] In the authentication type selection unit 304, the administrator can select either AND authentication or OR authentication as the authentication type by selecting a radio button. With AND authentication, if a match is obtained in both face matching and two-dimensional code matching, it is determined that personal authentication has been successful and unlocking is permitted. With OR authentication, if a match is obtained in either face matching or two-dimensional code matching, it is determined that personal authentication has been successful and unlocking is permitted.

[0147] In the set period input section 305, the administrator can input the target period (start date and end date) for the settings related to personal authentication (face matching and two-dimensional code matching) by inputting information into the input box. This allows personal authentication that meets the required conditions to be performed for a limited period of time. For example, AND authentication can be used for a specific period of time, such as when an event is being held, to increase the security of personal authentication.

[0148] This screen 301 also has a registration button 306. When the administrator operates the registration button 306 after making the necessary selections and inputs in each section of the setting screen, the management server 2 performs a process of registering information based on the selections and inputs.

[0149] (Second embodiment) Next, a second embodiment will be described. Note that the points not specifically mentioned here are the same as those of the previous embodiment. Fig. 15 is a diagram showing the overall configuration of a security locker system according to the second embodiment.

[0150] In the first embodiment, the security locker 1 (storage device, registration device, authentication device) functions as a register (registration device) that processes user registration, and also functions as a checker (authentication device) that processes personal authentication. When used by an unspecified number of people in a facility such as a train station, if the security locker 1 has the functions of both a register and a checker, user registration is performed when depositing luggage, and personal authentication is performed when collecting luggage, improving convenience for users.

[0151] On the other hand, in this embodiment, in addition to the security locker 7 (storage device, authentication device), a cash register 8 (registration device) is also provided. The security locker 7 has the function of a checker but does not have the function of a cash register. The cash register 8 is made up of a tablet terminal or the like, and is installed in a location separate from the security locker 7. For example, the cash register 8 may be placed in a hotel lobby, an office, or the reception area of ​​a sports facility, and by registering a user using the cash register 8, the user can use the security locker 7 installed in the facility. Furthermore, by providing the cash register 8 separately from the security locker 7, the user registration information acquired using the cash register 8 can be shared with other systems that use personal authentication (for example, entry / exit management), simplifying the system configuration.

[0152] Next, a schematic configuration of the register 8 according to the second embodiment will be described below.

[0153] The register 8 includes a camera 81 , a display 82 , a printer 83 , a communication unit 84 , a storage unit 85 , and a processor 86 .

[0154] The camera 81 captures the face of the user who is the subject of user registration. The display 82 displays a screen related to user registration. This display 82 is composed of a touch panel, and the user can operate the screen. The printer 83 outputs a sheet on which a two-dimensional code is printed. The communication unit 84 communicates with the management server 2 via the network. The memory unit 85 stores programs to be executed by the processor 86, etc.

[0155] The processor 86 performs various processes by executing programs stored in the storage unit 85. In this embodiment, the processor 86 performs face image acquisition processing, user registration request processing, two-dimensional code issuance processing, GUI control processing, etc. Each process is the same as that of the security locker 1 in the first embodiment.

[0156] Next, the general configuration of the security locker 7 according to the second embodiment will be described. Figure 17 is a block diagram showing the general configuration of the security locker 7.

[0157] Like the security locker 1 of the first embodiment, the security locker 7 is equipped with a camera 11, a human presence sensor 12, displays 13 and 14, an electronic lock 16, a communication unit 17, a memory unit 18, and a processor 19, but does not have a printer 15.

[0158] Similar to the security locker 1 of the first embodiment, the processor 19 performs facial image acquisition processing, two-dimensional code acquisition processing, personal authentication request processing, door opening / closing control processing, and GUI control processing, but does not perform user registration request processing or two-dimensional code issuance processing.

[0159] While the use of the security locker 1 can be free of charge, if a fee is charged for the use of the security locker 1, a payment process is performed for the user to pay the usage fee. In this case, the usage fee may be paid using a payment system linked to facial recognition. The usage fee may also be paid using a credit card, IC card, or electronic money using a smartphone. Specifically, the management server 2 is connected to a payment server (not shown) that processes the payment based on the user's electronic payment information (information regarding credit cards, electronic money, etc.), and the management server 2 notifies the payment server of the authentication results, in which an individual is identified by personal authentication, particularly facial recognition, thereby completing the payment process. This allows the user to complete the payment of the usage fee without performing any special operations when collecting their luggage. The user's electronic payment information may also be registered in advance, specifically, when registering the user using the cash register 8.

[0160] As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. Furthermore, it is also possible to combine the components described in the above embodiments to create new embodiments. [Industrial Applicability]

[0161] The storage system and storage management method of the present invention are easy for users to use when retrieving items deposited in the storage, and have the effect of ensuring high security in identity authentication.When retrieving items from a storage lock that is locked with an electronic lock, identity authentication is performed to confirm that the user is the same person as the registered person, and if the identity authentication is successful, the electronic lock of the storage lock is unlocked.This is useful as a storage system and storage management method. [Explanation of symbols]

[0162] 1. Security locker (storage device, registration device, authentication device) 2 Management Server (Server Device) 3 Management terminal 4. Mobile devices 5 Locker box (storage area) 7 Security lockers (storage devices, authentication devices) 8. Register (Registration Device) 11 Camera 12 Human Sensor 13. Display 14 Display 15 Printer (printing device) 16 Electronic Lock 17 Communications Department 18 Memory section 19 processors 21 Communications Department 22 Memory section 23 processors

Claims

1. a storage device that is locked and unlocked by an electronic lock; a registration device that performs processing related to user registration for registering user information necessary for personal authentication; a server device that acquires a facial image for registration by photographing the face of the user via the registration device when the user is registered, and issues a code image to be issued to the user; an authentication device that acquires at least one of a face image for authentication obtained by photographing the face of a user and the code image presented by the user; When unlocking the storage device, a matching unit performs at least one of the following for the personal authentication: face matching, which compares the face image for registration with the face image for authentication, and code matching, which compares the code image issued to the user with the code image presented by the user; and based on the matching result, it is determined whether or not the storage device can be unlocked.

2. The collation unit 2. The storage system according to claim 1, wherein the identification information of the storage unit of the storage device, the facial image for registration, and the code image issued to the user are managed in association with each other.

3. The collation unit The storage system of claim 1, characterized in that the setting regarding the determination method for determining whether to unlock the lock based on the results of the facial matching and the code matching is managed by selecting either AND authentication, which determines that authentication is successful if a match is obtained in both the facial matching and the code matching, or OR authentication, which determines that authentication is successful if a match is obtained in either the facial matching or the code matching.

4. The storage device is the registration device and the authentication device; The server device When registering the user, the facial image for registration is acquired via the storage device that also serves as the registration device; The storage system described in claim 1, characterized in that when an item contained in the storage device is removed, the authentication facial image and the code image presented by the user are obtained via the storage device that also serves as the authentication device.

5. The server device 2. The storage system according to claim 1, wherein the issued code image is sent to a mobile terminal carried by the user in order to deliver the code image to the user.

6. The registration device 2. The storage system according to claim 1, wherein a sheet on which the code image is printed is output by a printing device in order to deliver the issued code image to the user.

7. The storage system according to claim 1 , wherein the code image is a two-dimensional code or a one-dimensional code.

8. a storage device that is locked and unlocked by an electronic lock; a registration device that performs processing related to user registration for registering user information necessary for personal authentication; a server device that acquires a facial image for registration by photographing the face of the user via the registration device when the user is registered, and issues a code image to be issued to the user; A storage system including an authentication device that acquires at least one of a facial image for authentication obtained by photographing a user's face and the code image presented by the user, A storage management method characterized in that, when unlocking the storage device, at least one of face matching, which compares the registration face image with the authentication face image, and code matching, which compares the code image issued to the user with the code image presented by the user, is performed as the personal authentication, and whether or not the storage device can be unlocked is determined based on the matching result.

Citation Information

Patent Citations

  • Intelligent article storage cabinet for performing face recognition by using mobile phone terminal

    CN109671202A

  • Proxy service management method and system, program, recording medium, and proxy service providing device

    JP2004123272A

  • Locker system using bar code or two-dimensional code

    JP2007016423A

  • Cabinet system and storage method

    JP2007070899A

  • Article-storage device

    JP2010112091A