Processing device, control method for processing device, and program

Abstract

To provide a gate device that achieves automation of emigration and immigration examination with one device, regardless of the nationality of a person to be examined.SOLUTION: A gate device includes an identification unit, a fingerprint authentication unit, and a gate control unit. The identification unit identifies nationality of a person to be examined. The fingerprint authentication unit acquires fingerprints of the person to be examined when the nationality of the person to be examined is a first country, and performs fingerprint authentication using the acquired fingerprints. The gate control unit controls a gate so that the person to be examined having the nationality of the first country can pass when the fingerprint authentication of the person to be examined is successful.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a gate device, a control method for the gate device, and a storage medium.

Background Art

[0002] Immigration inspection is carried out at airports. The immigration inspector compares the face photo attached to the passport with the face of the person in front, and does not permit the person to enter or leave the country if the face image in the passport does not match the face of the person in front.

[0003] In recent years, devices for automatically performing the above immigration inspection have been introduced. For example, the gate device disclosed in Patent Document 1 examines the entry and exit of a person based on the collation result of the face image attached to the passport and the face image of the person standing in front of the gate device.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In immigration inspection in Japan, the inspection content varies depending on the nationality of the person being inspected. Specifically, fingerprint collection is not required for the immigration inspection of a person with Japanese nationality (Japanese). In contrast, fingerprint collection is required for the immigration inspection of a person with foreign nationality (foreigner).

[0006] Thus, the content of the immigration inspection varies depending on the nationality of the person being inspected. Naturally, a device that automatically conducts the immigration inspection (hereinafter referred to as an automatic immigration inspection device) must also be able to handle such differences in the inspection content. Therefore, an automatic immigration inspection device for Japanese people and an automatic immigration inspection device for foreigners need to be installed in the immigration inspection area. However, such a solution is not acceptable in the limited space of the immigration inspection area.

[0007] The main object of the present invention is to provide a gate device, a control method for the gate device, and a storage medium that contribute to realizing the automation of immigration inspection with a single device regardless of the nationality of the person being inspected.

Means for Solving the Problem

[0008] According to a first aspect of the present invention, there is provided a gate device including: an identifying unit that identifies the nationality of a person being inspected; a fingerprint authentication unit that, when the nationality of the person being inspected is a first country, acquires the fingerprint of the person being inspected and performs fingerprint authentication using the acquired fingerprint; and a gate control unit that controls the gate so that the person being inspected whose nationality is the first country can pass when the fingerprint authentication of the person being inspected is successful.

[0009] According to a second aspect of the present invention, there is provided a control method for a gate device, the method including: identifying the nationality of a person being inspected in the gate device; when the nationality of the person being inspected is a first country, acquiring the fingerprint of the person being inspected and performing fingerprint authentication using the acquired fingerprint; and controlling the gate so that the person being inspected whose nationality is the first country can pass when the fingerprint authentication of the person being inspected is successful.

[0010] According to a third aspect of the present invention, a computer mounted on a gate device is caused to execute a process of identifying the nationality of a person subject to inspection, a process of acquiring the fingerprint of the person subject to inspection when the nationality of the person subject to inspection is a first country, a process of performing fingerprint authentication using the acquired fingerprint, and a process of controlling the gate so that the person subject to inspection whose nationality is the first country can pass when the fingerprint authentication of the person subject to inspection is successful. A computer-readable storage medium storing a program is provided.

Advantages of the Invention

[0011] According to each aspect of the present invention, there are provided a gate device, a control method for the gate device, and a storage medium that contribute to realizing the automation of immigration inspection with a single device regardless of the nationality of the person subject to inspection. Note that the effects of the present invention are not limited to the above. Instead of or together with the above effects, other effects may be achieved by the present invention.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Embodiments for Carrying Out the Invention

[0013] First, an overview of an embodiment will be described. Note that the reference numerals in the drawings appended to this overview are for convenience and are appended to each element as an example to assist understanding, and the description of this overview is not intended to be limiting in any way. Also, unless otherwise specified, the blocks described in each drawing represent a configuration of functional units, not a configuration of hardware units. The connection lines between the blocks in each figure include both bidirectional and unidirectional ones. The one-way arrow schematically shows the flow of the main signal (data) and does not exclude bidirectionality. In this specification and the drawings, elements that can be similarly described may be given the same reference numerals so that duplicate description can be omitted.

[0014] The gate device 100 according to an embodiment includes a specifying unit 101, a fingerprint authentication unit 102, and a gate control unit 103 (see FIG. 1). The specifying unit 101 specifies the nationality of the person subject to examination. The fingerprint authentication unit 102 acquires the fingerprint of the person subject to examination when the nationality of the person subject to examination is a first country (for example, a country other than Japan), and performs fingerprint authentication using the acquired fingerprint. The gate control unit 103 controls the gate so that a person subject to examination whose nationality is the first country can pass when the fingerprint authentication of the person subject to examination is successful.

[0015] The gate device 100 identifies the nationality of a user based on, for example, the MRZ information of a pre-registered user. For example, if the person under examination is a foreigner with a valid passport, the gate device 100 will end the immigration inspection and open the gate after successful fingerprint authentication of the user. On the other hand, for example, if the nationality of the person under examination is a second country (e.g., Japan), the gate device 100 will end the immigration inspection and open the gate on the condition that it has confirmed that the person has a valid passport. In this way, a single gate device 100 can complete the immigration inspection of a user regardless of the user's nationality.

[0016] Specific embodiments will be described in more detail below with reference to the drawings.

[0017] [First Embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0018] FIG. 2 is a diagram showing an example of the schematic configuration of an immigration inspection system according to the first embodiment. Referring to FIG. 2, the immigration inspection system includes a plurality of gate devices 10-1 to 10-3 and a server device 20. In the following description, when there is no particular reason to distinguish between the gate devices 10-1 to 10-3, they are simply referred to as "gate device 10". Also, although FIG. 2 shows three gate devices 10, it is of course not intended to limit the number of gate devices 10 included in the system. The immigration inspection system only needs to include at least one or more gate devices 10.

[0019] The gate device 10 is a device that automatically performs the inspection procedures related to the entry and exit of users. The gate device 10 is provided with a gate that can be opened and closed. When the gate device 10 determines that a person located in front of itself has passed the immigration inspection, it opens the gate and permits the user to pass. In this way, the gate device 10 controls the gate according to the result of the immigration inspection of the user.

[0020] The server device 20 is a device for realizing the immigration inspection by the gate device 10. For example, the server device 20 stores information about users who can use the gate device 10 (hereinafter referred to as gate user information). Specifically, the server device 20 stores the biometric information of the user in association with the information described in the Machine Readable Zone (MRZ) of the passport issued to the user (hereinafter referred to as MRZ information).

[0021] Examples of the biometric information of the user include data (feature amounts) calculated from personal and unique physical characteristics such as face, fingerprint, voiceprint, vein, retina, and iris pattern of the pupil. Alternatively, the biometric information of the user may be image data such as a face image or a fingerprint image. The biometric information of the user may be anything as long as it includes the physical characteristics of the user as information.

[0022] The information (MRZ information) described in the MRZ of the passport includes the user's name, nationality, gender, date of birth, passport number, expiration date, etc.

[0023] The gate device 10 and the server device 20 are configured to be able to communicate with each other by wired or wireless communication means. The server device 20 may be installed in the same airport as the gate device 10, or may be installed on a network (cloud).

[0024] [Overview of the Immigration Inspection System Operation] Subsequently, with reference to FIG. 2, the overview of the operation of the immigration inspection system according to the first embodiment will be described.

[0025] Gate user information regarding users of the immigration inspection system is registered in the server device 20, for example, before the users leave the country. That is, the gate user information is registered in the server device 20 before the boarding date of the users or before departure on the boarding date. The server device 20 is provided with a database for storing the gate user information, and when user registration is performed, an entry for each user is added to the database. In the following description, the database for storing the gate user information is referred to as the "gate user database". In the gate user database, at least the biometric information of one or more users and the MRZ information described in the machine-readable area of the passport issued to the at least one or more users are stored in association with each other.

[0026] The user visits the departure airport on the boarding date. After procedures for boarding such as check-in and security check are completed, the user boards the aircraft. When the aircraft carrying the user arrives at the arrival airport (the airport where the gate device 10 is installed), the user moves to the area (immigration inspection area) where the gate device 10 is installed.

[0027] When the user arrives at the immigration inspection area, the user moves towards the gate device 10.

[0028] When the user approaches the gate device 10 (when the distance between the user and the gate device 10 becomes equal to or less than a predetermined distance), the gate device 10 acquires (generates) biometric information from the user. The biometric information acquired by the gate device 10 is the same type of information as the biometric information registered as gate user information in the server device 20.

[0029] The gate device 10 transmits the acquired biometric information to the server device 20. More specifically, the gate device 10 transmits a "verification request" including the acquired biometric information to the server device 20.

[0030] The server device 20 searches the gate user database using the received biometric information as a key, and identifies the MRZ information corresponding to the received biometric information. The server device 20 transmits a response (response to the verification request) including the identified MRZ information to the gate device 10.

[0031] The gate device 10 identifies the nationality of the person subject to examination based on the acquired MRZ information. As described above, since the MRZ information includes the nationality of the passport holder, the gate device 10 can know the nationality of the user from the MRZ information.

[0032] When the user arrives at the gate device 10, the user holds the passport over the reader (reader 316 described later) provided in the gate device 10 (touches the passport to the reader). That is, the user touches the passport to the reader of the gate device 10 in the same way as touching a transportation IC (Integrated Circuit) card to a card reader at a station ticket gate.

[0033] The gate device 10 attempts to read the information described on the IC chip of the passport via the reader. When the gate device 10 succeeds in reading the information stored in the IC chip, it determines that the user has a valid passport.

[0034] When the user is Japanese (the nationality of the user is Japan) and the user has a valid passport, the gate device 10 opens the gate.

[0035] When the user is a foreigner (the nationality of the user is other than Japan), the gate device 10 instructs the user to place both hands on the fingerprint scanner. For example, the gate device 10 may display the above instruction on a liquid crystal monitor or the like, or may notify the above instruction by voice.

[0036] The gate device 10 attempts to collect fingerprints using a fingerprint scanner. The gate device 10 performs a verification process using the collected fingerprints. The gate device 10 opens the gate when the fingerprint verification is successful and the user (a foreign user) has a valid passport.

[0037] The user passes through the gate and the immigration inspection is completed.

[0038] Thus, in the immigration inspection system according to the first embodiment, the gate user information is registered in the server device 20 in advance, and the nationality of the user is specified using the MRZ information of the registered gate user information. The gate device 10 determines whether to collect fingerprints according to the nationality of the user.

[0039] Subsequently, the details of each device included in the immigration inspection system according to the first embodiment will be described. In the following description, information related to a person's "face" will be taken as an example of the biometric information registered in the server device 20 for explanation.

[0040] [Server device] FIG. 3 is a diagram showing an example of the processing configuration (processing modules) of the server device 20 according to the first embodiment. Referring to FIG. 3, the server device 20 includes a communication control unit 201, a user information registration unit 202, a first verification unit 203, and a storage unit 204.

[0041] The communication control unit 201 is a means for controlling communication with other devices. Specifically, the communication control unit 201 receives data (packets) from the gate device 10. Also, the communication control unit 201 transmits data to the gate device 10.

[0042] The user information registration unit 202 is a means for acquiring gate user information and registering the acquired gate user information in the gate user database constructed in the storage unit 204. Any method can be used to acquire the gate user information.

[0043] For example, at the passport issuance window, the responsible staff may register the gate user information in the server device 20. Specifically, the responsible staff operates a scanner to read the page with the face photo and MRZ of the passport. The responsible staff operates a terminal (a computer installed at the issuance window) and transmits the read data (image data) to the server device 20. Alternatively, the read data may be input into the server device 20 via an external storage device such as a USB (Universal Serial Bus) memory.

[0044] During the check-in procedure at the airport, the above data (image data including the face photo and MRZ) may be input into the server device 20. Specifically, when a staff member of the airline checks the user's passport, the staff member reads the page with the face photo and MRZ using a scanner. The airline staff member may transmit the read data from the terminal to the server device 20.

[0045] Alternatively, the user himself / herself may read the page with the face photo and MRZ using a so-called automatic check-in machine. In this case, the read data is transmitted from the automatic check-in machine to the server device 20.

[0046] The user may take a photo of the page with the face photo and MRZ of the passport and obtain image data including the face photo and MRZ. Specifically, the user uses a smartphone or the like to take a photo of the page including the face photo and MRZ of the passport. Then, the captured image data is transmitted from the smartphone or the like to the server device 20.

[0047] Alternatively, the image data including the face photo and MRZ may be obtained from a database in which the history of users who have traveled abroad is stored. Specifically, if the face photo and MRZ have been obtained at a manned immigration booth in the past and registered in the database, the image data may be transmitted from the database to the server device 20.

[0048] The user information registration unit 202 acquires image data including the face photo and MRZ described in the user's passport by any of the methods described above or other methods.

[0049] The user information registration unit 202 extracts feature points from the face image included in the acquired image data. Since existing technologies can be used for the extraction process of feature points, a detailed description thereof is omitted. For example, the user information registration unit 202 extracts eyes, nose, mouth, etc. from the face image as feature points. Then, the user information registration unit 202 calculates the position of each feature point and the distance between each feature point as feature quantities, and generates a feature vector (vector information characterizing the face image) composed of a plurality of feature quantities.

[0050] The user information registration unit 202 extracts MRZ information from the image data including the MRZ information. Specifically, the user information registration unit 202 extracts MRZ information from the image data using optical character recognition (OCR) technology.

[0051] The user information registration unit 202 associates the generated feature vector with the extracted MRZ information and registers it in the gate user database.

[0052] FIG. 4 is a diagram showing an example of the gate user database. As shown in FIG. 4, the feature vector generated from the face image is registered as biometric information. Also, the MRZ information corresponding to each biometric information (feature vector) is registered in the gate user database.

[0053] The first verification unit 203 is a means for processing the verification request transmitted by the gate device 10. Specifically, the first verification unit 203 sets the biometric information (feature vector) included in the verification request as the verification target, and performs a verification process with the biometric information registered in the gate user database.

[0054] More specifically, the first matching unit 203 sets the feature vector extracted from the matching request as the matching target, and performs one-to-N (N is a positive integer, the same hereinafter) matching with a plurality of feature vectors registered in the gate user database.

[0055] The first matching unit 203 calculates the similarity between the feature vector of the matching target and each of the plurality of feature vectors on the registration side. For the similarity, the chi-square distance, the Euclidean distance, or the like can be used. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

[0056] The first matching unit 203 identifies, among the plurality of feature vectors registered in the gate user database, the feature vector with a similarity to the feature vector of the matching target that is equal to or greater than a predetermined value and has the highest similarity.

[0057] The first matching unit 203 reads out the MRZ information corresponding to the feature vector (biometric information) obtained as a result of the one-to-N matching from the gate user database. The first matching unit 203 transmits the read MRZ information to the gate device 10 that is the source of the matching request (responds to the matching request).

[0058] For example, in the example of FIG. 4, if the feature vector FV acquired from the gate device 10 is most similar to the feature vector FV1 stored in the gate user database, the corresponding MRZ01 is transmitted to the gate device 10.

[0059] If, as a result of performing the one-to-N matching, the first matching unit 203 determines that there is no biometric information in the gate user database that matches the biometric information included in the matching request, it notifies the gate device 10 to that effect. For example, the first matching unit 203 sets "None" and responds to the gate device 10.

[0060] Alternatively, the first collating unit 203 may notify the gate device 10 that the biometric information included in the collation request does not exist in the gate user database by not responding to the gate device 10 at all. In this case, the gate device 10 that transmitted the collation request recognizes that the biometric information included in the collation request does not exist in the gate user database because it cannot receive a response from the server device 20 for a predetermined period of time.

[0061] The storage unit 204 stores various types of information necessary for the operation of the server device 20. Also, as described above, a gate user database is constructed in the storage unit 204.

[0062] FIG. 5 is a diagram showing an example of the hardware configuration of the server device 20 according to the first embodiment. The server device 20 can be configured by an information processing device (so-called computer) and includes the configuration illustrated in FIG. 5. For example, the server device 20 includes a processor 211, a memory 212, an input / output interface 213, a communication interface 214, and the like. The components such as the processor 211 are connected by an internal bus or the like and are configured to be able to communicate with each other.

[0063] However, the configuration shown in FIG. 5 is not intended to limit the hardware configuration of the server device 20. The server device 20 may include hardware not shown, or may not include the input / output interface 213 as necessary. Also, the number of processors 211 and the like included in the server device 20 is not intended to be limited to the example shown in FIG. 5. For example, a plurality of processors 211 may be included in the server device 20.

[0064] The processor 211 is a programmable device such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), DSP (Digital Signal Processor), etc. Alternatively, the processor 211 may be a device such as an FPGA (Field Programmable Gate Array), ASIC (Application Specific Integrated Circuit), etc. The processor 211 executes various programs including an operating system (OS; Operating System).

[0065] The memory 212 is a RAM (Random Access Memory), ROM (Read Only Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), etc. The memory 212 stores an OS program, application programs, and various data.

[0066] The input / output interface 213 is an interface for a display device and an input device (not shown). The display device is, for example, a liquid crystal display, etc. The input device is a device that receives user operations such as a keyboard and a mouse, etc.

[0067] The communication interface 214 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 214 includes a NIC (Network Interface Card), etc.

[0068] The functions of the server device 20 are realized by various processing modules. The processing modules are realized, for example, by the processor 211 executing a program stored in the memory 212. Further, the program can be recorded on a computer-readable storage medium. The storage medium can be non-transitory such as a semiconductor memory, a hard disk, a magnetic recording medium, an optical recording medium, etc. That is, the present invention can also be embodied as a computer program product. Further, the above program can be downloaded via a network or updated using a storage medium storing the program. Furthermore, the above processing module may be realized by a semiconductor chip.

[0069] [Gate device] Next, the gate device 10 according to the first embodiment will be described.

[0070] FIG. 6 is a diagram showing an example of the hardware configuration of the gate device 10 according to the first embodiment. Referring to FIG. 6, the gate device 10 includes a processor 311, a memory 312, an input / output device 313, a communication interface 314, a camera device 315, a reader 316, a fingerprint scanner 317, and a gate 318.

[0071] Regarding the processor 311, the memory 312, and the communication interface 314, since they can be the same as the corresponding elements of the server device 20 described with reference to FIG. 5, detailed description thereof will be omitted.

[0072] The input / output device 313 is a device for inputting information to the gate device 10 (for example, a touch panel) or a device for outputting information (for example, a liquid crystal monitor).

[0073] The camera device 315 is, for example, a digital camera installed so as to be able to photograph the front of the gate device 10. The camera device 315 can be installed at any location. For example, the camera device 315 may be installed on the main body of the gate device 10, or may be installed at a location away from the gate device 10. The camera device 315 may be installed at any location as long as it can photograph a user approaching the gate device 10 (especially the user's face).

[0074] The reader 316 is a device that reads information from a passport. The reader 316 has a function of accessing an IC chip mounted on the passport and a function of scanning the page of the placed passport. That is, the reader 316 has a function as a card reader for exchanging information (data) in a non-contact state with the IC chip of the passport, and a function as a passport reader (scanner) for acquiring an image from the passport. The reader 316 can be installed at any location. However, the reader 316 is preferably installed at a location where the user can easily touch the passport to the device. In the present disclosure, the reader 316 is described as having a function as a card reader and a function as a passport reader, but it goes without saying that these two functions may be realized by different devices.

[0075] The fingerprint scanner 317 is a device that acquires a person's fingerprint. The fingerprint scanner 317 can collect fingerprints from up to 10 fingers.

[0076] When the user passes the immigration inspection, the gate 318 shifts from a closed state during standby that blocks the user's passage to an open state that permits the user's passage. The type of the gate 318 is not particularly limited, and examples include a flapper gate in which flappers provided on one or both sides of the passage open and close, a turnstile gate in which three bars rotate, and the like.

[0077] FIG. 7 is a diagram showing an example of the processing configuration (processing modules) of the gate device 10 according to the first embodiment. Referring to FIG. 7, the gate device 10 includes a communication control unit 301, a biometric information acquisition unit 302, a collation request unit 303, a passport possession determination unit 304, a nationality identification unit 305, a fingerprint authentication unit 306, a gate control unit 307, and a storage unit 308.

[0078] The communication control unit 301 is a means for controlling communication with other devices in the same manner as the communication control unit 201 of the server device 20.

[0079] The biometric information acquisition unit 302 is a means for acquiring biometric information of a user who attempts to pass through the gate device 10. For example, the biometric information acquisition unit 302 controls the camera device 315 to acquire a face image of a person walking toward the own device (gate device 10). For example, when the biometric information acquisition unit 302 detects the face of a user in an image taken constantly or periodically, it takes a picture of the face of the user and acquires the face image.

[0080] When the size of the face area included in the taken image is equal to or greater than a predetermined value, the biometric information acquisition unit 302 may extract the face area from the image. In this case, by appropriately adjusting the predetermined value (threshold value), a face image of a user located at a predetermined distance from the gate device 10 can be acquired. That is, it is possible to prevent a user located far from the gate device 10 from being photographed and inappropriate biometric information for face authentication (1-to-N collation by the server device 20) from being transmitted to the server device 20.

[0081] Alternatively, the biometric information acquisition unit 302 may measure the distance between the gate device 10 and the user using a distance sensor or the like, and acquire a face image of the user present at a predetermined position.

[0082] The biometric information acquisition unit 302 delivers the acquired face image to the collation request unit 303.

[0083] The verification requirement unit 303 is a means for requesting the server device 20 to verify whether the biometric information of the person corresponding to the acquired face image is registered in the gate user database. Specifically, the verification request unit 303 calculates feature amounts from the acquired face image and generates a feature vector composed of the plurality of feature amounts (generates a feature vector corresponding to the biometric information registered in the server device 20).

[0084] The verification request unit 303 generates a verification request including the generated feature vector (biometric information), and transmits the generated verification request to the server device 20 via the communication control unit 301.

[0085] For example, the verification request unit 303 generates a verification request including an identifier of its own device (hereinafter referred to as a gate identifier), a feature vector, etc. (see FIG. 8). Note that as the gate identifier, the MAC (Media Access Control) address or IP (Internet Protocol) address of the gate device 10 can be used.

[0086] The verification request unit 303 receives a response from the server device 20 for the verification request via the communication control unit 301. The verification request unit 303 delivers the response from the server device 20 (MRZ information corresponding to the feature vector specified by one-to-N verification) to the passport possession determination unit 304 and the nationality identification unit 305.

[0087] The passport possession determination unit 304 is a means for determining whether a user attempting to pass through the gate device 10 holds a valid passport. Specifically, the passport possession determination unit 304 attempts to read information from the IC chip of the passport held in front of the reader 316 using the MRZ information acquired from the verification request unit 303.

[0088] Here, as described in "Security Measures for IC Passports" in the following Reference 1, the information stored in the IC chip of the passport is encrypted (converted) using the MRZ information described in the same passport as a password. <Reference 1> https: / / www.mofa.go.jp / mofaj / toko / passport / ic_faq.html#11

[0089] When the passport possession determination unit 304 can read information from the IC chip using the MRZ information acquired from the server device 20 (when the decryption of the information is successful), it determines that the user attempting to pass through the gate device 10 is in possession of a valid passport.

[0090] On the other hand, when the passport possession determination unit 304 cannot read information from the IC chip using the MRZ information acquired from the server device 20, it determines that the user attempting to pass through the gate device 10 is not in possession of a valid passport.

[0091] In this way, if the passport possession determination unit 304 succeeds in reading information from the IC chip using the MRZ information (if the encryption can be decrypted), it determines that the user is in possession of a valid passport. Therefore, the passport possession determination unit 304 may or may not confirm the content of the information read from the IC chip.

[0092] When the passport possession determination unit 304 determines that the user attempting to pass through the gate device 10 is in possession of a valid passport, it notifies the gate control unit 307 to that effect.

[0093] When the passport possession determination unit 304 determines that the user attempting to pass through the gate device 10 is not in possession of a valid passport, it does not perform any special operation. That is, when it is determined that the user attempting to pass through the gate device 10 is not in possession of a valid passport, the gate 318 will not open.

[0094] The nationality identification unit 305 is a means for identifying the nationality of a user who is attempting to pass through the gate device 10. Specifically, the nationality identification unit 305 identifies whether the nationality of the user is Japan or a foreign country based on the MRZ information obtained from the verification request unit 303. The nationality identification unit 305 notifies the fingerprint authentication unit 306 and the gate control unit 307 of the identification result (Japan, foreign country).

[0095] The fingerprint authentication unit 306 is a means for performing authentication (fingerprint authentication) using the fingerprint of the user. Specifically, the fingerprint authentication unit 306 acquires the fingerprint of the user using the fingerprint scanner 317. When the nationality of the user is "Japan", the fingerprint authentication unit 306 does not perform any special operations. That is, if the user is Japanese, the fingerprint authentication unit 306 does not acquire (collect) the fingerprint.

[0096] On the other hand, when the nationality of the user is "foreign", the fingerprint authentication unit 306 acquires the fingerprint of the user. For example, when the nationality of the user is other than Japan, the fingerprint authentication unit 306 instructs the user to perform an operation to collect the fingerprint. For example, the fingerprint authentication unit 306 displays a message with the content shown in FIG. 9 on a liquid crystal monitor or the like. The fingerprint authentication unit 306 controls the fingerprint scanner 317 to acquire a fingerprint image. The fingerprint authentication unit 306 checks the quality (image quality) of the acquired fingerprint image, and if it meets a predetermined standard, sets the status to "fingerprint acquisition successful". On the other hand, if the acquired fingerprint image does not meet the predetermined standard, the fingerprint authentication unit 306 sets the status to "fingerprint acquisition failed".

[0097] Note that the above-mentioned predetermined standard can be, for example, the size of the area (effective area) where the ridge lines of the fingerprint are clearly shown. Alternatively, the acquired fingerprint image may be compared with a predetermined template image, and the degree of coincidence (similarity) may be set to the above-mentioned predetermined standard. Alternatively, a learning model obtained by machine learning may be used for determining the fingerprint image quality. For example, a large number of fingerprint images determined by a fingerprint examiner to meet the standard can be collected, and the learning model can be generated by labeling the fingerprint images as teacher data. Any algorithm such as a support vector machine, boosting, or neural network can be used for generating the learning model. Note that since algorithms such as the above-mentioned support vector machine use known technologies, the description thereof is omitted. The fingerprint authentication unit 306 may input the acquired fingerprint image into the learning model and determine the quality of the fingerprint image according to the similarity with the labeled fingerprint image.

[0098] When the fingerprint acquisition fails, the fingerprint authentication unit 306 notifies the user that the fingerprint needs to be reacquired and reacquires the fingerprint. When a fingerprint that meets the predetermined standard can be acquired (when the status is successful fingerprint acquisition), the fingerprint authentication unit 306 executes an authentication process using the fingerprint (fingerprint image).

[0099] For example, the fingerprint authentication unit 306 checks whether the acquired fingerprint corresponds to the fingerprint of a criminal, and determines "authentication successful" when the acquired fingerprint does not correspond to the fingerprint of a criminal. That is, the fingerprint authentication unit 306 refers to a blacklist of criminal fingerprint images and determines authentication successful when the acquired fingerprint image is not included in the list.

[0100] Alternatively, the fingerprint authentication unit 306 may determine authentication successful when the acquired fingerprint image is included in the pre-registered fingerprint images. That is, the fingerprint authentication unit 306 may refer to a whitelist and determine authentication successful when the acquired fingerprint image is registered in the list.

[0101] Alternatively, the fingerprint authentication unit 306 may transmit the acquired fingerprint image to a fingerprint authentication server (not shown in FIG. 2 or the like). The fingerprint authentication server may execute the above-described collation process (authentication process) using the blacklist and whitelist, and transmit the result to the gate device 10.

[0102] Note that since existing technologies can be used for the authentication process (collation process) by the fingerprint authentication unit 306, detailed description thereof is omitted. The fingerprint authentication unit 306 may calculate a score indicating the similarity of two fingerprint images, and perform the authentication process based on the score. The score is calculated based on, for example, the positions of feature points of the fingerprint image and the number of core lines sandwiched between the feature points.

[0103] The fingerprint authentication unit 306 notifies the gate control unit 307 of the result of fingerprint authentication (fingerprint authentication success, fingerprint authentication failure).

[0104] The gate control unit 307 is means for controlling the gate 318 provided in the gate device 10.

[0105] When the nationality of the user is "Japan", the gate control unit 307 opens the gate 318 when the determination result of the passport possession determination unit 304 is "correct passport possession".

[0106] On the other hand, when the nationality of the user is "foreign", the gate control unit 307 opens the gate 318 when the determination result of the passport possession determination unit 304 is "correct passport possession" and the notification from the fingerprint authentication unit 306 is "fingerprint authentication success".

[0107] After a user whose passage through the gate 318 has been permitted (a user who has passed the immigration inspection) passes through the gate 318, the gate control unit 307 closes the gate 318.

[0108] [Operation of Immigration Inspection System] Next, the operation of the immigration inspection system according to the first embodiment will be described.

[0109] FIG. 10 is a sequence diagram showing an example of the operation of the immigration system according to the first embodiment. Note that FIG. 10 is a sequence diagram showing an example of the system operation on the user's boarding date. Prior to the operation of FIG. 10, it is assumed that the "gate user information" of the user has been registered in the server device 20 in advance.

[0110] When the user approaches the self-device, the gate device 10 acquires biometric information from the user (step S01). For example, the gate device 10 acquires a face image of the user.

[0111] When the acquisition of the face image is successful, the gate device 10 transmits a collation request including the biometric information of the user to the server device 20 (step S02). Specifically, the gate device 10 calculates a feature vector from the face image and transmits a collation request including the calculated feature vector to the server device 20.

[0112] The server device 20 that has acquired the collation request extracts biometric information (feature vector) from the collation request and performs a one-to-N collation between the feature vector and the biometric information registered in the gate user database (step S03). The server device 20 searches for the biometric information that is most similar to the biometric information acquired from the gate device 10 among the plurality of biometric information registered in the gate user database.

[0113] The server device 20 transmits a response including the MRZ information specified as a result of the above one-to-N collation to the gate device 10 (the gate device 10 that transmitted the collation request) (step S04).

[0114] The gate device 10 determines whether the user has a valid passport (step S05). Specifically, the gate device 10 reads information from the IC chip of the passport held against the reader 316 using the received MRZ information, and determines that the user has a valid passport if the information can be read. The gate device 10 determines that the user does not have a valid passport if the information cannot be read from the IC chip of the passport.

[0115] The gate device 10 identifies the nationality of the user based on the MRZ information acquired from the server device 20 (step S06).

[0116] If the user is a foreigner (if the nationality of the user is other than Japan), the gate device 10 performs fingerprint authentication using the fingerprint of the user (steps S07, Yes branch; step S08). The gate device 10 does not perform the operation related to fingerprint authentication if the user is Japanese.

[0117] Thereafter, the gate device 10 performs opening / closing control of the gate 318 (step S09). Specifically, when the user is Japanese, the gate device 10 opens the gate 318 if it can be confirmed that the user has a valid passport. On the other hand, when the user is a foreigner, the gate device 10 controls the gate 318 to be passable when, in addition to the user having a valid passport, the fingerprint authentication using the fingerprint acquired from the user is successful.

[0118] As described above, in the immigration inspection system according to the first embodiment, the biometric information of users who wish to use the gate device 10 is registered in advance in the server device 20. Then, when a user appears in front of the gate device 10 on the boarding date, the gate device 10 acquires the biometric information of the user and inquires whether the acquired biometric information is registered in the server device 20 (requests the server device 20 to perform one-to-N verification using the biometric information). As a result of the verification, when it is confirmed that the biometric information of the user is registered in the server device 20, the gate device 10 checks whether the passport presented by the user is truly the passport of the user. Specifically, the gate device 10 checks whether it can read information from the IC chip of the passport using the MRZ information specified by the result of face authentication from the server device 20. Further, the gate device 10 identifies the nationality of the user based on the acquired MRZ information. If the user is a foreigner with a valid passport, the gate device 10 completes the immigration inspection after successful fingerprint authentication. On the other hand, if the user is Japanese, the gate device 10 completes the immigration inspection on the condition that it has been confirmed that the user has a valid passport. As a result, the immigration inspection of the user can be completed with one gate device 10 regardless of the nationality of the user. That is, in the immigration inspection system according to the first embodiment, one face authentication automated gate can realize the immigration inspection of foreigners who require fingerprint acquisition (fingerprint authentication) and Japanese who do not require fingerprint acquisition.

[0119] [Second Embodiment] Subsequently, the second embodiment will be described in detail with reference to the drawings.

[0120] In the first embodiment, it is assumed that there is no contradiction (discrepancy) between the biometric information and the MRZ information of the gate user information registered in the server device 20. When the gate user information is registered by a public agency staff member, it is unlikely that the above contradiction will occur, but when the user registers the gate user information in the server device 20, there is a slight possibility that the above contradiction will occur.

[0121] If such a contradiction exists, correct entry examination cannot be performed, leading to problems. In the second embodiment, a case will be described where more reliable entry examination is realized by performing collation processing also in the gate device 10.

[0122] Note that in the second embodiment, since the schematic configuration of the entry examination system and the processing configuration of the server device 20 can be the same as those in the first embodiment, descriptions corresponding to FIGS. 2 and 3 and the like are omitted. Hereinafter, the description will focus on the differences between the first and second embodiments.

[0123] FIG. 11 is a diagram showing an example of the processing configuration (processing modules) of the gate device 10 according to the second embodiment. Referring to FIG. 11, a second collation unit 309 is added to the configuration shown in FIG. 7.

[0124] The second collation unit 309 is a means for performing collation (one-to-one collation) to determine whether the biometric information of the user matches the biometric information read from the IC chip of the passport that the user has brought into contact with the reader 316.

[0125] The biometric information acquisition unit 302 stores the acquired biometric information (for example, the face image of the user captured using the camera device 315) in the storage unit 308.

[0126] When the passport possession determination unit 304 succeeds in reading information from the IC chip using the MRZ information acquired from the server device 20, it delivers the face image among the read information to the second collation unit 309.

[0127] The second matching unit 309 performs a comparison (one-to-one comparison) between the face image acquired from the passport possession determination unit 304 and the face image stored in the storage unit 308. Specifically, the second matching unit 309 calculates a feature vector from each of the two images. Thereafter, the second matching unit 309 calculates the similarity (e.g., Euclidean distance) between the two images, and determines whether the two images are face images of the same person based on the result of threshold processing for the calculated similarity. For example, if the similarity is greater than a predetermined value (if the distance is shorter than a predetermined value), the second matching unit 309 determines that the two face images are by the same person.

[0128] When the second matching unit 309 succeeds in the one-to-one comparison (when the face image of the user in front of the device matches the face image read from the IC chip of the presented passport), it is determined that the user has the correct passport.

[0129] In the second embodiment, the nationality identification unit 305 may identify the nationality of the user from the MRZ information or from the information read from the IC chip. Information such as the name and nationality of the passport holder is recorded on the IC chip of the passport.

[0130] In this way, when the gate device 10 succeeds in comparing the biometric information acquired from the user with the biometric information read from the IC chip presented by the user, it is determined that the user has the correct passport. That is, when the distance between the feature vectors obtained from each of the above two biometric information is shorter than a predetermined distance and the two biometric information can be determined to be substantially the same, the gate device 10 determines that the user has the correct passport.

[0131] As described above, in the second embodiment, a one-to-one comparison is performed between the face image of the user obtained from the camera device 315 attached to the gate device 10 and the face image read from the IC chip of the passport presented by the user. When the one-to-one comparison results in successful authentication, the gate device 10 determines that the user has the correct passport. That is, even in a case where there is a contradiction in the gate user information registered in the server device 20 and which was a problem in the first embodiment, in the second embodiment, by performing the final authentication, it is possible to prevent a user who should not pass through the gate device 10 from passing through the gate device 10. In the second embodiment, by performing a one-to-one comparison at the gate device 10 after the one-to-N comparison in the server device 20, it is ensured that the user attempting to pass through the gate device 10 has the correct passport (their own passport).

[0132] [Modification Example] Note that the configuration, operation, etc. of the immigration inspection system described in the above embodiment are examples and are not intended to limit the configuration of the system etc.

[0133] For example, all or part of the functions of the server device 20 may be realized by the gate device 10. Alternatively, the gate user database provided in the server device 20 may be constructed in another database server.

[0134] In the above embodiment, the case where the gate device 10 is used in immigration inspection has been described. However, the gate device 10 may be used in emigration inspection. Also, in the above embodiment, the case where the gate device 10 installed in Japan does not collect fingerprints from Japanese people has been described. However, it goes without saying that the present disclosure is also applicable to immigration inspection outside Japan. For example, the present disclosure can be applied in a case where a user of nationality A is exempted from fingerprint collection and a user of nationality B requires fingerprint collection. That is, the present disclosure is applicable in a case where the inspection content (fingerprint collection not required, fingerprint collection required) changes according to the nationality of the immigration / emigration inspection target person.

[0135] In the above embodiment, the case where the feature vectors calculated from the face images are transmitted and received between the gate device 10 and the server device 20 has been described. However, the face image may be transmitted from the gate device 10 to the server device 20. In this case, a collation request including the face image is transmitted from the gate device 10 to the server device 20, and the server device 20 may calculate the feature vector from the received face image and execute 1-to-N collation. Alternatively, face images instead of feature vectors may be registered in the user information database of the server device 20, and feature amounts may be calculated each time collation is performed.

[0136] In the above embodiment, it is assumed that one face area is included in one image. However, depending on the situation of the examination site, a plurality of face areas may be included in one image. In this case, the gate device 10 may extract the face area closest to itself and transmit the biometric information to the server device 20. For example, the gate device 10 may calculate the area of each face area and extract the face area with the largest area. Alternatively, a depth camera or the like capable of measuring the distance in the depth direction may be adopted for the camera device 315, the distance from the camera device 315 may be measured, and the face image of the closer person may be extracted.

[0137] In the above embodiment, the case where the gate device 10 specifies the nationality of the user from the MRZ information acquired from the server device 20 has been described. However, the gate device 10 may directly acquire the nationality of the user from the MRZ of the passport.

[0138] In the above embodiment, the operations of the gate device 10 and the server device 20 have been mainly described using "face" as biometric information. However, the biometric information that can be used in the present disclosure is not limited to "face". Other biometric information such as iris can be used.

[0139] The form of data transmission and reception between the gate device 10 and the server device 20 is not particularly limited, but the data transmitted and received between these devices may be encrypted. Face images and feature amounts calculated from the face images are personal information, and in order to appropriately protect the personal information, it is desirable that encrypted data be transmitted and received.

[0140] In the above embodiment, the case of acquiring information by using MRZ information from the IC chip of a passport has been described. However, the method disclosed in the present application is also applicable to other methods. That is, when reading information from an IC chip mounted on a card or the like similar to a passport, information corresponding to the MRZ information may be used.

[0141] In the above embodiment, the fingerprint authentication unit 306 has been described as acquiring the fingerprint of a foreigner and opening the gate 318 when the authentication using the acquired fingerprint is successful. However, the gate device 10 (fingerprint authentication unit 306) may open the gate 318 on the condition that it has been able to acquire the fingerprint of a foreigner.

[0142] In the flowcharts (flowcharts, sequence diagrams) used in the above description, a plurality of steps (processes) are described in order. However, the execution order of the steps executed in the embodiment is not limited to the described order. In the embodiment, for example, the order of the illustrated steps can be changed within the range where the content is not impaired, such as executing each process in parallel.

[0143] The above embodiment has been described in detail for the purpose of facilitating the understanding of the present disclosure, and it is not intended that all the configurations described above are necessary. Also, when a plurality of embodiments are described, each embodiment may be used alone or in combination. For example, it is also possible to replace a part of the configuration of an embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of an embodiment. Furthermore, it is possible to add, delete, or replace other configurations for a part of the configuration of an embodiment.

[0144] From the above description, the industrial applicability of the present invention is clear, and the present invention is suitably applicable to an immigration inspection system at an airport or the like.

[0145] Some or all of the above embodiments may be described as follows in the following supplementary notes, but are not limited thereto. [Supplementary Note 1] An identifying unit that identifies the nationality of the person to be examined, and When the nationality of the person subject to examination is the first country, a fingerprint authentication unit that acquires the fingerprint of the person subject to examination and performs fingerprint authentication using the acquired fingerprint; A gate control unit that controls the gate so that the person subject to examination whose nationality is the first country can pass when the fingerprint authentication of the person subject to examination is successful; A gate device comprising: [Appendix 2] The gate device according to Appendix 1, wherein the fingerprint authentication unit does not acquire the fingerprint of a person subject to examination whose nationality is the second country when the nationality of the person subject to examination is the second country. [Appendix 3] The gate device according to Appendix 2, wherein the specifying unit specifies the nationality of the person subject to examination based on the MRZ (Machine Readable Zone) information described in the machine-readable area of the passport. [Appendix 4] The gate device according to Appendix 2, wherein the specifying unit specifies the nationality of the person subject to examination based on the information read from the IC (Integrated Circuit) chip of the passport. [Appendix 5] An acquisition unit that acquires biometric information of the person subject to examination; A verification request unit that requests verification of the biometric information of the person subject to examination from a server device that stores the biometric information of the user in association with the MRZ (Machine Readable Zone) information described in the machine-readable area of the passport issued to the user; A determination unit that determines that the person subject to examination holds a valid passport when information is successfully read from the IC (Integrated Circuit) chip of the passport using the MRZ information identified by the verification; Further comprising: The gate control unit controls the gate so that the person subject to examination can pass when the person subject to examination holds a valid passport. The gate device according to any one of Appendices 2 to 4. [Appendix 6] The gate control unit controls the gate so that the person under examination can pass through when the collation between the biometric information acquired from the person under examination and the biometric information read from the IC chip is successful. The gate device according to Supplementary Note 5. [Supplementary Note 7] The fingerprint authentication unit instructs the person under examination to perform an operation of collecting a fingerprint when the nationality of the person under examination is the first country. The gate device according to Supplementary Note 6. [Supplementary Note 8] When the first country is a country other than Japan, the gate control unit opens the gate when the person under examination has a valid passport and the fingerprint authentication unit has successfully authenticated the fingerprint of the person under examination. The gate device according to Supplementary Note 7. [Supplementary Note 9] When the second country is Japan, the gate control unit opens the gate when the person under examination has a valid passport. The gate device according to Supplementary Note 8. [Supplementary Note 10] The biometric information is information related to a person's face. The gate device according to any one of Supplementary Notes 5 to 9. [Supplementary Note 11] In a gate device, Specify the nationality of the person under examination, When the nationality of the person under examination is the first country, acquire the fingerprint of the person under examination, Perform fingerprint authentication using the acquired fingerprint, A control method for a gate device that controls the gate so that the person under examination whose nationality is the first country can pass through when the fingerprint authentication of the person under examination is successful. [Supplementary Note 12] On a computer mounted on a gate device, A process of specifying the nationality of the person under examination, and When the nationality of the person under examination is the first country, a process of acquiring the fingerprint of the person under examination, and A process of performing fingerprint authentication using the acquired fingerprint, and A process for controlling a gate so that a subject whose nationality is a first country can pass through when the fingerprint authentication of the subject is successful, A computer-readable storage medium storing a program for causing the above to be executed. Note that the forms of Supplementary Note 11 and Supplementary Note 12 can be developed into the forms of Supplementary Notes 2 to 10 in the same manner as the form of Supplementary Note 1.

[0146] Note that each disclosure of the above-cited prior art documents is incorporated herein by reference. As described above, embodiments of the present invention have been described, but the present invention is not limited to these embodiments. It will be understood by those skilled in the art that these embodiments are merely illustrative and that various modifications can be made without departing from the scope and spirit of the present invention. That is, the present invention naturally includes all disclosures including the claims, various modifications and corrections that can be made by those skilled in the art in accordance with the technical idea.

Explanation of Reference Numerals

[0147] 10, 10-1 to 10-3, 100 Gate device 20 Server device 101 Specific part 102, 306 Fingerprint authentication part 103, 307 Gate control part 201, 301 Communication control part 202 User information registration part 203 First collation part 204, 308 Storage part 211, 311 Processor 212, 312 Memory 213 Input / output interface 214, 314 Communication interface 302 Biometric information acquisition part 303 Collation request part 304 Passport possession determination part 305 Nationality identification part 309 Second collation part 313 Input / output device 315 Camera device 316 Reader 317 Fingerprint Scanner 318 Gate

Claims

1. Identification means for identifying the nationality of the person subject to examination using the passport of the person subject to examination, authentication means for, when the nationality of the person subject to examination is a first country, acquiring the fingerprint of the person subject to examination and performing authentication using the acquired fingerprint, and not performing authentication using the fingerprint of the person subject to examination when the nationality of the person subject to examination is a second country, acquisition means for acquiring biometric information of the person subject to examination by photographing the person subject to examination, and The identification means is a processing device used for immigration examination that identifies the nationality of the person subject to examination based on MRZ information described in the machine-readable area of the passport received from the server device in response to transmitting the biometric information of the person subject to examination to the server device.

2. In a processing device used for immigration examination, identifying the nationality of the person subject to examination using the passport of the person subject to examination, when the nationality of the person subject to examination is a first country, acquiring the fingerprint of the person subject to examination and performing authentication using the acquired fingerprint, and not performing authentication using the fingerprint of the person subject to examination when the nationality of the person subject to examination is a second country, a control method for a processing device that acquires biometric information of the person subject to examination by photographing the person subject to examination, a control method for a processing device that identifies the nationality of the person subject to examination based on MRZ information described in the machine-readable area of the passport received from the server device in response to transmitting the biometric information of the person subject to examination to the server device.

3. A program for causing a computer installed in a processing device used for immigration examination to execute a process of identifying the nationality of the person subject to examination using the passport of the person subject to examination, execute a process of, when the nationality of the person subject to examination is a first country, acquiring the fingerprint of the person subject to examination and performing authentication using the acquired fingerprint, and not performing authentication using the fingerprint of the person subject to examination when the nationality of the person subject to examination is a second country, execute a process of acquiring biometric information of the person subject to examination by photographing the person subject to examination, wherein the process of identifying the nationality of the person subject to examination identifies the nationality of the person subject to examination based on MRZ information described in the machine-readable area of the passport received from the server device in response to transmitting the biometric information of the person subject to examination to the server device. ​

Images