Gate device, control method for gate device, and recording medium

Abstract

A gate device, a control method for the gate device, and a recording medium are provided that can shorten the time required for users to pass through. [Solution] The gate device has an exit gate door, a first biometric information acquisition unit that acquires first target biometric information from a user moving toward the closed exit gate door to be matched with pre-registered registered biometric information, a second biometric information acquisition unit that acquires second target biometric information from a user remaining in front of the exit gate door to be matched with the registered biometric information when there is a mismatch or no match between the first target biometric information and the registered biometric information, and a door control unit that opens the closed exit gate door depending on the result of matching the first target biometric information or the second target biometric information with the registered biometric information.

Description

Technical Field

[0001] The present invention relates to a gate device, a control method for the gate device, and a recording medium.

Background Art

[0002] Patent Document 1 describes a gate device applied to a gate system that automatically performs face authentication work carried out in the examination of entry and exit. The gate device described in Patent Document 1 has a face authentication device that compares and collates a face image acquired from a camera with a face image acquired from a passport reader.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the gate device described in Patent Document 1, since the face of the subject who places the travel document on the passport reader in front of the face authentication device is acquired by the camera, it is difficult for the subject to pass through the gate device in a short time.

[0005] An object of the present invention is to provide a gate device, a control method for the gate device, and a recording medium that can shorten the time required for a user to pass through the gate device in view of the above-described problems.

Means for Solving the Problems

[0006] According to one aspect of the present invention, there is provided a gate device including an exit gate door, a first biometric information acquisition unit that acquires first target biometric information to be compared with pre-registered registered biometric information from a user moving toward the exit gate door in a closed state, a second biometric information acquisition unit that acquires second target biometric information to be compared with the registered biometric information from the user staying in front of the exit gate door when the comparison between the first target biometric information and the registered biometric information does not match or when the comparison cannot be made, and a door control unit that opens the exit gate door in the closed state according to the result of the comparison between the first target biometric information or the second target biometric information and the registered biometric information.

[0007] According to another aspect of the present invention, there is provided a gate device including an exit gate door, a first biometric information acquisition unit that acquires first target biometric information to be compared with pre-registered registered biometric information from a user moving toward the exit gate door in a closed state, a second biometric information acquisition unit that acquires second target biometric information to be compared with the registered biometric information from the user staying in front of the exit gate door when the orientation of the face of the user moving toward the exit gate door in the closed state is not facing the exit gate door or when an accessory is worn on the face of the user, and a door control unit that opens the exit gate door in the closed state according to the result of the comparison between the first target biometric information or the second target biometric information and the registered biometric information.

[0008] According to still another aspect of the present invention, there is provided a gate device including an exit gate door, a biometric information acquisition unit that acquires target biometric information to be compared with pre-registered registered biometric information from a user moving toward the exit gate door in a closed state or staying in front of the exit gate door, and a door control unit that opens the exit gate door in the closed state according to the determination result of the declaration information associated with the registered biometric information that matches the target biometric information.

[0009] According to still another aspect of the present invention, there is provided a method for controlling a gate device having an exit gate door, the method including: obtaining first target biometric information to be compared with pre-registered registered biometric information from a user moving toward the exit gate door in a closed state; obtaining second target biometric information to be compared with the registered biometric information from the user staying in front of the exit gate door when the comparison between the first target biometric information and the registered biometric information does not match or the comparison cannot be made; and opening the exit gate door in the closed state according to the result of the comparison between the first target biometric information or the second target biometric information and the registered biometric information.

[0010] According to still another aspect of the present invention, there is provided a program for causing a gate device having an exit gate door to execute: obtaining first target biometric information to be compared with pre-registered registered biometric information from a user moving toward the exit gate door in a closed state; obtaining second target biometric information to be compared with the registered biometric information from the user staying in front of the exit gate door when the comparison between the first target biometric information and the registered biometric information does not match or the comparison cannot be made; and opening the exit gate door in the closed state according to the result of the comparison between the first target biometric information or the second target biometric information and the registered biometric information.

Advantages of the Invention

[0011] According to the present invention, the time required for a user to pass through the gate device can be shortened.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4A

Figure 4B

Figure 5

Figure 6A

Figure 6B

Figure 7A

Figure 7B

Figure 8A

Figure 8B

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15A

Figure 15B

Figure 16

Figure 17

Figure 18A

Figure 18B

Figure 18C

Figure 19

Figure 20

Figure 21

Figure 22

[0013] [One Embodiment] An information processing apparatus, a gate apparatus, an information processing method, and a control method for a gate apparatus according to an embodiment of the present invention will be described with reference to FIGS. 1 to 20.

[0014] First, the overall configuration of the information processing system according to this embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a schematic diagram showing the overall configuration of the information processing system according to this embodiment. FIG. 2 is a schematic diagram showing a customs inspection site where a kiosk terminal and an electronic gate according to this embodiment are installed.

[0015] As shown in FIG. 1, the information processing system 1 according to this embodiment includes a kiosk terminal 10, an electronic gate 20, a management server 50, and a mobile terminal 60. The electronic gate 20 has an entrance gate terminal 30 and an exit gate terminal 40. The information processing system 1 is a system that, for example, accepts declarations in customs procedures when users U such as passengers and crew members entering the country from abroad pass through the electronic gate 20 after the declaration is completed at airports, seaports, etc.

[0016] For example, when the information processing system 1 is introduced at an airport in Japan, the user U is a passenger or crew member who has arrived at the airport from abroad by airplane, a Japanese person who has returned to Japan from abroad and is entering the country, a foreigner entering Japan from abroad, etc. The customs declaration, which is a declaration in customs procedures accepted in the information processing system 1, is more specifically, for example, a declaration in luggage clearance, and in the case of Japan, it is the same declaration as the declaration using the Personal Effects and Separate Shipment Declaration Form of Customs Form C No. 5360.

[0017] The management server 50 is installed, for example, inside a customs facility. The kiosk terminal 10 and the electronic gate 20 are installed, for example, at a customs inspection site C where customs inspections are carried out at airports, seaports, etc.

[0018] As shown in FIG. 2, a kiosk terminal 10 is installed near the entrance of the customs inspection area C where the user U enters. Near the kiosk terminal 10, a digital signage terminal 70 is installed to display and guide the procedure method at the kiosk terminal 10 in the form of a video or a still image. At the exit of the customs inspection area C, an electronic gate 20 and a manned booth M are installed. Near the entrance gate terminal 30 of the electronic gate 20, a digital signage terminal 80 is installed to display and guide the precautions when passing through the electronic gate 20 in the form of a video or a still image. At the manned booth M, face-to-face customs inspections such as the acceptance of declarations in customs procedures and the inspection of baggage are carried out by customs officers S.

[0019] The mobile terminal 60 is a terminal that the user U owns or carries and uses. A customs declaration application for making a customs declaration at the kiosk terminal 10 is installed on the mobile terminal 60. As will be described later, the user U can make a customs declaration at the kiosk terminal 10 using the declaration code generated by the customs declaration application on the mobile terminal 60.

[0020] The kiosk terminal 10, the entrance gate terminal 30, the exit gate terminal 40, and the management server 50 are connected to the network NW. The network NW is composed of a WAN (Wide Area Network), a LAN (Local Area Network), a mobile communication network, etc. The kiosk terminal 10 and the management server 50 can communicate with each other via the network NW. The entrance gate terminal 30 and the exit gate terminal 40 can communicate with each other either via the network NW or without using the network NW. The exit gate terminal 40 and the management server 50 can communicate with each other via the network NW. The mobile terminal 60 can communicate with servers such as the management server 50 via the network NW.

[0021] Next, each component in the information processing system 1 according to this embodiment will be further described with reference to FIGS. 3 to 14.

[0022] First, the configuration of the mobile terminal 60 will be described with reference to FIG. 3. FIG. 3 is a block diagram showing an example of the hardware configuration of the mobile terminal 60.

[0023] The mobile terminal 60 is a terminal that the user U possesses or carries and uses, and is, for example, a mobile information device such as a smartphone, a tablet terminal, or a mobile phone. As shown in FIG. 3, the mobile terminal 60 includes a CPU (Central Processing Unit) 602, a RAM (Random Access Memory) 604, a storage device 606, an input device 608, a display 610, a mobile wireless communication unit 612, and a short-range wireless communication unit 614. The CPU 602, the RAM 604, the storage device 606, the input device 608, the display 610, the mobile wireless communication unit 612, and the short-range wireless communication unit 614 are connected to a bus line 616.

[0024] The CPU 602 operates by executing a program stored in the storage device 606 and functions as a control unit that controls the overall operation of the mobile terminal 60. In addition, the CPU 602 executes an application program stored in the storage device 606 to execute various processes as the mobile terminal 60. The RAM 604 provides a memory area necessary for the operation of the CPU 602.

[0025] For example, a customs declaration application for performing customs declaration at the kiosk terminal 10 is installed in the storage device 606. By executing the customs declaration application, the CPU 602 can perform various processes for the user U to perform customs declaration.

[0026] More specifically, the CPU 602 can, for example, receive input of declaration information required for customs declaration by the user U. The declaration information is, for example, information having the same content as the items to be declared in the personal belongings and separate shipment declaration form. That is, the declaration information includes, for example, information necessary for customs declaration such as the name of the user U, the current address or place of stay in the country of entry, occupation, date of birth, passport number, name of the flight, place of departure, date of entry, and items to be declared in the customs declaration.

[0027] Also, as will be described later, the CPU 602 can generate a reporting code, such as a two-dimensional code including the declaration information input by the user U, and display it on the display 610. The mobile terminal 60 can function as a medium for displaying the reporting code.

[0028] The reporting code is not particularly limited as long as it can include the declaration information. For example, it is a two-dimensional code such as a QR code (registered trademark). Also, the reporting code may be a one-dimensional code such as a barcode. The CPU 602 can also generate a reporting code with an expiration date, and set the expiration date. The CPU 602 can display the set expiration date on the display 610 together with the reporting code. After the reporting code with an expiration date is generated, it becomes invalid as the date and time set as the expiration date elapses. By setting an expiration date for the reporting code, the user U can be prompted to promptly conduct a customs declaration after the reporting code is generated.

[0029] When the user U has a traveling family member who is a fellow traveler, each of the user U and the traveling family member can conduct a customs declaration using their respective mobile terminals 60, or the user U can conduct a customs declaration on behalf of them. When the user U conducts a customs declaration on behalf of others, the CPU 602 can generate, in addition to the reporting code used by the user U himself / herself at the kiosk terminal 10, a reporting code for the traveling family members used by the traveling family members at the kiosk terminal 10 and display it on the display 610. The traveling family members can use the reporting code for the traveling family members displayed on the mobile terminal 60 of the user U to use the kiosk terminal 10 in the same manner as the user U. Also, after using the kiosk terminal 10, the traveling family members are guided to the electronic gate 20 or the manned booth M in the same manner as the user U.

[0030] Also, the code display medium for displaying the reporting code does not necessarily have to be the mobile terminal 60, and other media may be used. For example, the reporting code may be printed on paper as the code display medium.

[0031] In addition, the customs declaration application supports multiple languages such as Japanese, English, Chinese, Korean, etc. As a result, the customs declaration application can be displayed and input in the language selected from multiple languages and set according to the language setting of the mobile terminal 60, for example. Also, the customs declaration application may be able to be displayed and input in the language selected from multiple languages and set within the application, separately from the language setting of the mobile terminal 60, for example. The customs declaration application can be used in the language used, which is the language set in this way.

[0032] The CPU 602 can further include language information, which is information indicating the language used in the customs declaration application, in the declaration code. The language information is, for example, information indicating the language set in the language setting of the mobile terminal 60, or information regarding the language if the language is set in the settings within the customs declaration application.

[0033] The storage device 606 is composed of a storage medium such as a non-volatile memory and a hard disk drive, and functions as a storage unit. The storage device 606 stores a program executed by the CPU 602, data referred to by the CPU 602 during the execution of the program, and the like. The storage device 606 stores the customs declaration application as an application program executed by the CPU 602.

[0034] The storage device 606 can store information such as the declaration information input in the customs declaration application. Also, the storage device 606 can store the declaration code generated in the customs declaration application.

[0035] The input device 608 is, for example, a touch panel incorporated in the display 610. The input device 608 functions as an input unit that receives inputs from the user U. The user U can input various types of information or give instructions to execute processing to the mobile terminal 60 via the input device 608. For example, the user U can input declaration information or give an instruction to generate a declaration code to the mobile terminal 60 that executes a customs declaration application via the input device 608, which is a touch panel.

[0036] The display 610 functions as a display unit that displays various screens to the user U. For example, in the mobile terminal 60 that executes a customs declaration application, the display 610 displays a declaration information input screen that receives the input of declaration information, a declaration code display screen that displays a declaration code, etc., as will be described later.

[0037] The mobile wireless communication unit 612 connects to the network NW via a mobile communication network under the control of the CPU 602. The communication method of the mobile wireless communication unit 612 is not particularly limited, and examples include the third-generation mobile communication method, the LTE (Long Term Evolution) method, the fourth-generation mobile communication method, etc.

[0038] The short-range wireless communication unit 614 performs wireless communication with an access point, an external device, etc. under the control of the CPU 602, and connects to the network NW via an access point, for example, inside an airport. The communication method of the short-range wireless communication unit 614 is not particularly limited, and examples include wireless LAN methods such as Wi-Fi (registered trademark), Bluetooth (registered trademark) communication methods, NFC (Near Field Communication) methods, infrared communication methods, etc.

[0039] In this way, the mobile terminal 60 is configured.

[0040] Next, the configuration of the kiosk terminal 10 will be described with reference to FIGS. 4A to 10. FIGS. 4A and 4B are schematic views showing the appearance of the kiosk terminal 10. FIG. 4A is a perspective view showing the entire kiosk terminal 10 installed on the pole 100, and FIG. 4B is an enlarged perspective view showing the kiosk terminal 10 installed on the pole 100. FIG. 5 is a block diagram showing an example of the hardware configuration of the kiosk terminal 10. FIGS. 6A and 6B are schematic views showing the configuration when one kiosk terminal 10 is installed. FIGS. 7A and 7B are schematic views showing the configuration when two kiosk terminals 10 are installed. FIGS. 8A and 8B are schematic views showing the configuration when three kiosk terminals 10 are installed. FIG. 9 is a schematic view for explaining the prevention of peeping in the kiosk terminal 10. FIG. 10 is a schematic view showing the configuration when the kiosk terminals 10 are installed at different heights.

[0041] The kiosk terminal 10 is an information processing device that accepts customs declarations based on the declaration codes displayed on the mobile terminal 60 of the user U and guides the user U to the electronic gate 20 or the manned booth M according to the content of the customs declaration. As shown in FIGS. 4A and 4B, the kiosk terminal 10 is attached and installed on the side of a pole 100, which is a support installed with its longitudinal direction vertical. Note that, as will be described later, one or a plurality of kiosk terminals 10 can be installed on one pole 100.

[0042] Also, as shown in FIG. 5, the kiosk terminal 10 has a CPU 102, a RAM 104, a storage device 106, an input device 108, and a display 110. Further, the kiosk terminal 10 has a passport reader 112, a code reader 114, a camera 116, a depth camera 118, a communication unit 120, and a status lamp 122. The CPU 102, RAM 104, storage device 106, input device 108, display 110, passport reader 112, code reader 114, camera 116, depth camera 118, communication unit 120, and status lamp 122 are connected to a bus line 124.

[0043] As shown in FIGS. 4A and 4B, the kiosk terminal 10 has a housing 126 attached to the pole 100. The housing 126 has a first housing portion 126a provided with a display 110 and a camera 116, and a second housing portion 126b provided with a travel document reader 112 and a code reader 114. Note that a CPU 102, a RAM 104, a storage device 106, and a communication unit 120 are housed in the housing 126.

[0044] The first housing portion 126a has a display surface provided with the display 110. The second housing portion 126b has a reading surface provided with the travel document reader 112 and the code reader 114. The second housing portion 126b is integrally connected to the lower portion of the first housing portion 126a such that the display surface and the reading surface form an obtuse angle with each other. The first housing portion 126a and the second housing portion 126b are configured such that when the kiosk terminal 10 is installed on the pole 100, the display surface of the first housing portion 126a faces obliquely upward in the front, opposite to the rear side of the pole 100 side, and the reading surface of the second housing portion 126b is substantially horizontal.

[0045] The kiosk terminal 10 is installed on the pole 100, for example, at a height such that a user U having a height equal to or greater than a predetermined height can look down on the display 110, the travel document reader 112, and the code reader 114.

[0046] On the display surface of the first housing portion 126a, the display 110 is provided such that its screen faces obliquely upward in the front. An input device 108 as a touch panel is incorporated in the display 110.

[0047] Also, a camera 116 is provided at the center of the portion between the display 110 and the second housing portion 126b at the lower part of the display surface of the first housing portion 126a. The camera 116 is provided between the display 110, which is a display portion provided in the first housing portion 126a, and the travel document reader 112 and the code reader 114, which are information acquisition portions provided in the second housing portion 126b. In addition to one camera 116 being provided, two cameras 116 may be provided above and below with the display 110 in between. In this case, the lower camera 116 is provided, for example, at the center of the portion between the display 110 and the second housing portion 126b at the lower part of the display surface of the first housing portion 126a as described above. On the other hand, the upper camera 116 is provided, for example, at the center of the upper portion of the display 110 on the display surface of the first housing portion 126a.

[0048] The camera 116 is provided such that its shooting direction is directed obliquely upward in the front. The user U in front of the kiosk terminal 10 will look down at the display 110, the travel document reader 112, or the code reader 114 with the line of sight directed obliquely downward in the front and operate the kiosk terminal 10. The camera 116 has an angle of view capable of photographing the face of the user U who operates the kiosk terminal 10 while looking down at the display 110, the travel document reader 112, or the code reader 114 in this way.

[0049] Also, a depth camera 118 is provided at the center of the upper part of the display surface of the first housing portion 126a. The depth camera 118 is provided so as to be able to acquire three-dimensional information of an object photographed by the camera 116. In addition, the depth camera 118 may be provided adjacent to and aligned with the one or two cameras 116 provided as described above.

[0050] On both sides of the display surface of the first housing part 126a, plate-shaped visors 128 are respectively provided so as to protrude from the display surface along the display 110. The visors 128 function as shielding parts that block the line of sight directed at the display 110 from the sides, diagonally behind, and diagonally in front of the kiosk terminal 10, making it difficult for people other than the user U who uses the kiosk terminal 10 to peek at the display 110.

[0051] In addition, on both sides of the display surface of the first housing part 126a, illuminations 130, which are illumination parts for illuminating the face of the user U who operates the kiosk terminal 10, are respectively provided. The illumination 130 can be constituted by, for example, a light source that illuminates from below to above along the display 110, a rod-shaped light source provided along the display 110, or the like. The light source is not particularly limited, but an LED (Light Emitting Diode) or the like can be used. By the illuminations 130 provided on both sides of the display 110, sufficient brightness can be ensured when the face of the user U who operates the kiosk terminal 10 is photographed by the camera 116. Note that the illumination 130 may be constantly lit during the operation of the kiosk terminal 10. Also, the illumination 130 does not necessarily have to be constantly lit during the operation of the kiosk terminal 10, and it can also be configured to be lit when the face of the user U is photographed by the camera 116. In this case, the illumination 130 can be configured to be lit, for example, when the travel document is read by the travel document reading device 112 or when the declaration code is read by the code reading device 114. Also, the illumination 130 can be configured to be lit, for example, when the user U is detected by a human sensor (not shown) provided in the kiosk terminal 10. Further, the illumination 130 that is lit at these predetermined timings can be configured to turn off, for example, after the photographing of the face of the user U by the camera 116 is completed or after a predetermined time has elapsed.

[0052] On the reading surface of the second housing portion 126b, a travel document reading device 112 is provided on the left side and a code reading device 114 is provided on the right side facing the display 110. In other kiosk terminals installed at airports or the like, generally, a reading device for reading a code such as a QR code is provided on the right side facing the terminal. Also in the kiosk terminal 10, since the code reading device 114 is provided on the right side facing the display 110, the user U can smoothly hold the declaration code displayed on the mobile terminal 60 in front of the code reading device 114 to have it read.

[0053] The travel document reading device 112 is provided, for example, with a reading unit for reading a travel document facing upward, and is configured to have a slot into which the travel document is inserted on the reading unit. In this case, the user U can have the travel document reading device 112 read the travel document by inserting the travel document with the identity page opened into the slot with the page facing downward and holding it in front of the reading unit of the travel document reading device 112. In the method of inserting the travel document into the slot, once the travel document is inserted into the slot, the user U does not need to continuously hold the travel document to maintain the page-open state, and the position of the travel document can be accurately aligned with the reading unit of the travel document reading device 112. Thereby, smooth reading of the travel document can be realized.

[0054] Note that the configuration of the travel document reading device 112 is not limited to the above configuration, and various configurations can be adopted. For example, the travel document reading device 112 can also be configured such that the user U presses the travel document with the identity page opened against the reading unit. In this case, the user U can have the travel document reading device 112 read the travel document by pressing the travel document with the identity page opened against the reading unit of the travel document reading device 112 with the page facing downward and holding it in front.

[0055] In addition, the code reader 114 is also provided, for example, with a reading unit for reading the declaration code facing upward. In this case, the user U can cause the code reader 114 to read the declaration code by holding the display 610 of the mobile terminal 60 on which the declaration code is displayed downward over the reading unit of the code reader 114.

[0056] Note that the configuration of the code reader 114 is not limited to the above configuration, and various configurations can be adopted. For example, the code reader 114 can be configured such that its reading unit reads the declaration code from above. In this case, the user U can cause the code reader 114 to read the declaration code by holding the display 610 of the mobile terminal 60 on which the declaration code is displayed upward over the reading unit of the code reader 114.

[0057] On the upper part of the pole 100, a status lamp 122 is provided so as to be located above the first housing 126a including the display 110. The status lamp 122 is provided at the tip of an arm 132 attached to the upper part of the pole 100 so that the status lamp 122 is located corresponding to above the kiosk terminal 10 indicating the status. The arm 132 protrudes from the pole 100 to the upper side of the kiosk terminal 10.

[0058] In addition, the arm 132 is provided with a monitoring camera 134 for monitoring the status of the kiosk terminal 10. More specifically, the monitoring camera 134 functioning as a monitoring unit captures and monitors the state of the kiosk terminal 10 and its surroundings, the state of the user U operating the kiosk terminal 10, and the like. The monitoring camera 134 is connected to the corresponding kiosk terminal 10 or connected to the network NW. The monitoring camera 134 can transmit the video captured of the state of the user U to the management server 50 via the network NW with or without passing through the kiosk terminal 10.

[0059] The CPU 102 operates by executing a program stored in the storage device 106 and functions as a control unit that controls the operation of the entire kiosk terminal 10. Further, the CPU 102 executes an application program stored in the storage device 106 to perform various processes as the kiosk terminal 10. The RAM 104 provides a memory area necessary for the operation of the CPU 102.

[0060] More specifically, the CPU 102 functions as a collation request unit that requests the management server 50 to perform face collation of the user U who conducts customs declaration using the kiosk terminal 10. The CPU 102 as the collation request unit requests collation between the captured face image of the user U and the face image on the user U's passport as the face collation of the user U. The captured face image is the face image of the user U captured by the camera 116 when using the kiosk terminal 10. The passport face image is the face image acquired from the user U's passport by the passport reader 112. To request collation, the CPU 102 transmits the captured face image and the passport face image or the face feature amounts extracted therefrom to the management server 50 together with the collation request. The CPU 102 reads at least one of the passport and the declaration code to acquire the captured face image of the user U, and when reading the other of the passport and the declaration code, can request the management server 50 to perform face collation of the user U. Note that the timing at which the CPU 102 acquires the captured face image and the timing at which the CPU 102 requests face collation are not limited thereto, and various variations are possible respectively.

[0061] During the shooting by camera 116, CPU 102 can perform accessory estimation on the captured face image. Based on the accessory estimation, CPU 102 can detect face accessories such as masks, sunglasses, glasses, hats, etc. in the captured face image. When CPU 102 detects a face accessory that is an accessory worn on the face of user U, it can issue a warning to user U to remove the face accessory that hinders face verification. For example, CPU 102 can issue a warning by displaying on display 110 an instruction to user U to remove the face accessory, or by emitting a voice from a speaker or the like instructing user U to remove the face accessory.

[0062] Also, CPU 102 functions as a collation information acquisition unit that receives and acquires from management server 50 collation information, which is information indicating the result of face verification requested from management server 50. The collation information indicates the result of face verification, that the identity verification of user U who performs customs declaration at kiosk terminal 10 has succeeded because the passport face image and the captured face image match, or that the identity verification of user U has failed because they do not match. When the passport face image and the captured face image match, it includes the case where the collation score indicating the similarity between the two face images exceeds a predetermined threshold and the two face images show a high similarity.

[0063] Note that instead of functioning as a collation request unit and a collation information acquisition unit, CPU 102 can also function as a collation unit that collates the passport face image and the captured face image for face verification of user U to acquire collation information. When collating the passport face image and the captured face image, CPU 102 can collate the two face images by collating the face feature amounts extracted from the passport face image and the face feature amounts extracted from the captured face image.

[0064] Also, CPU 102 functions as a user information transmission unit that transmits the user information of user U to management server 50. The user information of user U includes the identity matter information, face information, and declaration information of user U that are associated with each other.

[0065] The identity information includes information about the user U, such as the name and date of birth of the user U. In addition, the identity information includes information about the user U's passport, such as the passport number and expiration date of the passport. The identity information is obtained from the user U's passport by the passport reader 112.

[0066] The face information is the captured face image and passport face image of the user U. Also, the face information may not be the captured face image and passport face image themselves, but may be face feature amounts extracted from the captured face image and passport face image respectively. In this case, the CPU 102 extracts face feature amounts from each of the captured face image and passport face image.

[0067] The declaration information includes information to be declared in the customs declaration when the user U enters the country. The declaration information is obtained from the declaration code displayed on the user U's mobile terminal 60 by the code reader 114. As described above, the declaration information includes, for example, information necessary for customs declaration, such as the name of the user U, current address or place of stay in the country of entry, occupation, date of birth, passport number, name of the flight, departure place, entry date, and matters to be declared in the customs declaration.

[0068] Note that the user information of the user U transmitted to the management server 50 is registered in the user information database (DB, Database) 506a in the management server 50 as will be described later. The captured face image or passport face image included in the user information is registered in the user information DB 506a as a registered face image which is registered biometric information in advance.

[0069] Also, the CPU 102 functions as a determination request unit that requests the management server 50 to determine the declaration content included in the declaration information of the user U who performs customs declaration using the kiosk terminal 10. The CPU 102 as the determination request unit requests the management server 50 to determine the declaration content included in the declaration information transmitted thereto. The CPU 102 receives determination information which is information indicating the determination result of the declaration content included in the declaration information from the management server 50.

[0070] Also, the CPU 102 functions as a determination information acquisition unit that receives and acquires from the management server 50 determination information that is information indicating the determination result of the declared content requested from the management server 50. The determination information indicates, as a result of the determination, whether the user U is subject to taxation and whether there is a risk for the user U. The case where the user U is subject to taxation is, for example, when there is a declaration in the declared content that the user U has items exceeding the tax-free range, when there is a declaration in the declared content that the user U has commercial goods or commercial samples, etc. The case where there is a risk for the user U is, for example, when there is a declaration in the declared content that the user U has something prohibited or restricted from being brought into the country, when there is a declaration in the declared content that the user U has something entrusted by others, etc.

[0071] Note that instead of functioning as a determination request unit and a determination information acquisition unit, the CPU 102 can also function as a determination unit that determines the declared content included in the declaration information of the user U. In this case, the CPU 102 can determine the declared content included in the declaration information in the same manner as the management server 50.

[0072] Also, the CPU 102 functions as a determination unit that determines whether the user U can use the e-gate 20 based on the verification information and the determination information received from the management server 50. The CPU 102 as the determination unit determines that the user U can use the e-gate 20 when the passport face image of the user U matches the captured face image, the user U is not subject to taxation, and there is no risk for the user U. On the other hand, the CPU 102 determines that the user U cannot use the e-gate 20 when the passport face image of the user U does not match the captured face image, when the user U is subject to taxation, or when there is a risk for the user U.

[0073] In addition, the CPU 102 can transmit gate availability information, which is information indicating the determination result of the availability of the electronic gate 20, to the management server 50. In this case, the gate availability information transmitted to the management server 50 is registered in the user information DB 506a in the management server 50 in association with the user information as will be described later. When the passport face image of the user U matches the captured face image, and the user U is not subject to taxation and there is no risk for the user U, the gate availability information indicates that the user U can use the electronic gate 20.

[0074] In addition, the CPU 102 functions as a display control unit that causes the display 110 to display screens for guiding, notifying, etc. the user U who conducts customs declaration at the kiosk terminal 10. For example, the CPU 102 as the display control unit causes the display 110 to display a guidance screen for guiding the usage method of the kiosk terminal 10. In addition, the CPU 102 causes the display 110 to display a declaration content confirmation screen for the user U to confirm the declaration content included in the declaration information acquired from the mobile terminal 60 of the user U and correct it as necessary.

[0075] In addition, the CPU 102 functions as a processing unit that performs processing on the user U who has conducted customs declaration at the kiosk terminal 10 according to the determination result of the availability of the electronic gate 20. More specifically, the CPU 102 causes the display 110 to display a guidance screen for guiding the user U to the electronic gate 20 or the manned booth M according to the determination result of the availability of the electronic gate 20, and guides the user U to the electronic gate 20 or the manned booth M.

[0076] Further, the CPU 102 functions as a language setting unit that sets the language used by the kiosk terminal 10 based on the language information read from the declaration code displayed on the mobile terminal 60 of the user U who performs customs declaration on the kiosk terminal 10. Also, when a change input for changing the language used by the kiosk terminal 10 to another language is input from the user U via the input device 108, the CPU 102 changes the language used in response to the change input. Note that the language used by the kiosk terminal 10 is, for example, the language for displaying various information on the display 110 and receiving input from the input device 108. The kiosk terminal 10 supports multiple languages such as Japanese, English, Chinese, Korean, etc., similar to the customs declaration application of the mobile terminal 60. As a result, the kiosk terminal 10 can display and input in the language used set from among multiple languages.

[0077] The storage device 106 is composed of a storage medium such as a non-volatile memory and a hard disk drive, and functions as a storage unit. The storage device 106 stores programs executed by the CPU 102, data referred to by the CPU 102 during the execution of the programs, and the like.

[0078] The input device 108 is, for example, a touch panel incorporated in the display 110. The input device 108 functions as an input unit that receives input of instructions from the user U. The user U can input various information to the kiosk terminal 10 or input an instruction to execute processing via the input device 108.

[0079] The display 110 functions as a display unit that displays various screens for the user U who uses the kiosk terminal 10. For example, the display 110 displays a guidance screen for guiding the usage method of the kiosk terminal 10, a declaration content confirmation screen for the user U, a guidance screen for the user U, and the like. Also, the display 110 can display collation information indicating the result of collation between the photographed face image and the passport face image, and determination information indicating the determination result of the declaration content.

[0080] The display 110 can be installed vertically, for example. With the vertically installed display 110, it is possible to install it in the narrow space of the kiosk terminal 10 while realizing a display of an information amount equivalent to that of a horizontally long display of the same size. Further, with the vertically installed display 110, it is possible to prevent the display 110 from being peeked at from behind by the body of the user U standing in front of the display 110.

[0081] The travel document reading device 112 functions as a reading unit that reads the travel document of the user U and acquires the information recorded in the travel document. The travel document reading device 112 is configured by, for example, an image scanner, a non-contact IC (Integrated Circuit) reader, an OCR (Optical Character Reader) device, or the like. The travel document reading device 112 reads the travel document, which is a medium held in front of its reading unit, and acquires information from the travel document.

[0082] For example, the travel document reading device 112 reads and acquires the identity information of the user U displayed on the travel document surface by an OCR device. Also, for example, the travel document reading device 112 reads and acquires the travel document face image of the user U displayed on the travel document surface by an image scanner. In the case of an IC travel document, the travel document reading device 112 reads and acquires the identity information of the user U, the travel document face image, etc. recorded in the IC chip of the IC travel document by a non-contact IC reader. Note that the biometric information of the user U recorded and included in the travel document is not limited to the face image, and may be other biometric information such as an iris image. The travel document reading device 112 can acquire the biometric information of the user U included in the travel document.

[0083] The code reader 114 functions as a reading unit that reads the declaration code displayed on the mobile terminal 60 of the user U and acquires the declaration information and language information included in the declaration code. The code reader 114 is, for example, a code reader corresponding to the type of declaration code to be read, such as a QR code reader or a barcode reader. The code reader 114 reads the declaration code displayed on the mobile terminal 60, which is a code display medium held in front of its reading unit, and acquires information from the declaration code.

[0084] The camera 116 functions as a biometric information acquisition unit that acquires a face image of the user U as biometric information of the user U who performs customs declaration using the kiosk terminal 10. The camera 116 is, for example, a photographing device such as a digital camera that photographs the face of the user U in front of the kiosk terminal 10 as a moving image or a still image, and acquires a photographed face image, which is a face image of the user U, from the photographed moving image or still image. The camera 116, according to the control of the CPU 102, as will be described later, photographs a face image of the user U who causes the passport reader 112 to read a passport or the code reader 114 to read a declaration code in front of the kiosk terminal 10 and acquires the photographed face image. In this way, when the camera 116 reads at least one of the passport and the declaration code, it can photograph a face image of the user U and acquire the photographed face image. Note that instead of the camera 116, a biometric information acquisition unit that acquires the same type of biometric information as the biometric information acquired from the passport by the passport reader 112 from the user U can be provided.

[0085] The CPU 102 can set the number of pixels between the eyes in the photographed face image photographed by the camera 116 within a predetermined range. In this case, for example, the CPU 102 can exclude from the target of the photographed face image a face image in which the number of pixels between the eyes is less than a predetermined number of pixels among the face images photographed by the camera 116. Thereby, the camera 116 can surely photograph the user U operating the kiosk terminal 10 without photographing a person in the distance behind the user U operating the kiosk terminal 10.

[0086] In addition, the CPU 102 can mask predetermined ranges on both sides within the shooting range of the camera 116. As a result, the camera 116 can surely shoot the user U operating the kiosk terminal 10 while preventing the reflection of people around the user U operating the kiosk terminal 10.

[0087] Note that the kiosk terminal 10 can be configured such that the captured face image captured by the camera 116 is not displayed on the display 110 or the like. In this case, the user U does not recognize that his / her face has been captured by the kiosk terminal 10. Therefore, the user U can comfortably use the kiosk terminal 10 without feeling any resistance to the shooting or being psychologically pressured by the shooting.

[0088] The depth camera 118 acquires three-dimensional information of the object captured by the camera 116. Based on the three-dimensional information acquired by the depth camera 118, the CPU 102 can determine whether the captured face image of the user U by the camera 116 is obtained from the shooting of a real person or from the shooting of a two-dimensional image such as a photograph. Thereby, fraudulent acts such as identity theft of others can be prevented.

[0089] The communication unit 120 is connected to the network NW and performs data transmission and reception via the network NW. The communication unit 120 performs communication with the management server 50 or the like according to the control by the CPU 102.

[0090] The status lamp 122 functions as a status display unit that indicates the status of the kiosk terminal 10. More specifically, the status lamp 122 can indicate, as the status of the kiosk terminal 10, for example, the progress status of the customs declaration of the user U at the kiosk terminal 10, the presence or absence of abnormalities in the kiosk terminal 10, the availability of use of the kiosk terminal 10, etc., in different lamp colors. The status lamp 122 can be lit in a lamp color corresponding to the status of the kiosk terminal 10 according to the control by the CPU 102. Note that a surveillance camera for detecting suspicious behavior may be provided between the status lamp 122 and the pole 100. This surveillance camera can be configured to start shooting, for example, when a travel document is read by the travel document reader 112 or a declaration code is read by the code reader 114.

[0091] The status lamp 122 can be lit in different lamp colors according to the situation, for example, green, yellow, red, green blinking, yellow blinking, or red blinking. In this case, for example, each lamp color indicates the following situations. That is, green indicates that the face verification is consistent and there is no problem with the customs information. Yellow indicates that the face verification has failed. Red indicates that there is a problem with the customs information. Green blinking indicates that the customs complaint situation is slow. Yellow blinking indicates that there is a problem with the system including the kiosk terminal 10. Red blinking indicates that an illegal passport or a person has been determined to be on the blacklist by face verification. Note that these are examples, and the combination of the lamp color and the situation may be other combinations. In this way, the status lamp 122 can perform different lighting based on at least one of the information read by, for example, the passport reader 112 or the code reader 114, the result of face verification, and the status of the procedure. Also, the above-mentioned lighting 130 provided on the side of the display 110 may also be lit in the same color as the status lamp 122. Similar to the status lamp 122, the lighting 130 can also perform different lighting based on at least one of the information read by, for example, the passport reader 112 or the code reader 114, the result of face verification, and the status of the procedure. In this case, the lighting 130 can be provided, for example, on the upper surface or the upper end of the visor 128. While the screen content of the display 110 is hidden from the surroundings by the visor 128, relevant personnel such as staff who know the relationship between the lamp color and the situation such as an error can grasp the situation of the kiosk terminal 10 according to the lighting status of the status lamp 122 and the lighting 130. Thereby, relevant personnel can respond appropriately, for example, immediately respond when the display 110 and the lighting 130 blink red.

[0092] In this way, the kiosk terminal 10 is configured.

[0093] The kiosk terminal 10 configured as described above can be installed one unit per pole 100, or multiple units can be installed per pole 100. FIG. 6B is a perspective view showing the configuration when one kiosk terminal 10 is installed, and FIG. 6A is a top view of FIG. 6B. FIG. 7B is a perspective view showing the configuration when two kiosk terminals 10 are installed, and FIG. 7A is a top view of FIG. 7B. FIG. 8B is a perspective view showing the configuration when three kiosk terminals 10 are installed, and FIG. 8A is a top view of FIG. 8B.

[0094] In the case of a configuration where one kiosk terminal 10 is installed per pole 100, one kiosk terminal 10 is installed on the side of the pole 100 facing a predetermined direction, as shown in FIGS. 6A and 6B.

[0095] Also, by installing multiple kiosk terminals 10 per pole 100, a kiosk terminal group, which is a group of information processing devices, can be configured.

[0096] In the case of a configuration where two kiosk terminals 10 are installed per pole 100, as shown in FIGS. 7A and 7B, two kiosk terminals 10 are installed on the side of the pole 100 at a predetermined angular interval radially around the pole 100. The angular interval between two adjacent kiosk terminals 10 is, for example, 120°. In this way, a kiosk terminal group including two kiosk terminals 10 is configured.

[0097] In the case of a configuration where three kiosk terminals 10 are installed per pole 100, as shown in FIGS. 8A and 8B, three kiosk terminals 10 are installed on the side of the pole 100 at a predetermined angular interval radially around the pole 100. The angular interval between two adjacent kiosk terminals 10 among the three kiosk terminals 10 is, for example, 120° each at equal angles. In this way, a kiosk terminal group including three kiosk terminals 10 is configured.

[0098] Thus, when installing a plurality of kiosk terminals 10, by installing them radially around the pole 100, it is possible to ensure a greater distance between each user U who uses the adjacent kiosk terminals 10 than when arranging them linearly side by side horizontally. As a result, it is possible to make it difficult for a user U in front of an adjacent kiosk terminal 10 to peek at the display 110 of the kiosk terminal 10.

[0099] Note that when installing a plurality of kiosk terminals 10 radially, the angular interval between two adjacent kiosk terminals 10 is not limited to the above 120° and can be set as appropriate. Also, the number of kiosk terminals 10 installed on one pole 100 is not limited to the above number and may be a plurality of four or more.

[0100] Furthermore, on the kiosk terminal 10, visors 128 are respectively provided along the display 110 on both sides of the display 110. In the kiosk terminal 10, the visor 128 also makes it difficult to peek at the display 110.

[0101] FIG. 9 shows the blocking of the line of sight by the visor 128 in a configuration where three kiosk terminals 10 are installed as shown in FIGS. 8A and 8B. As shown in FIG. 9, the line of sight directed from a user U in front of the kiosk terminal 10 to an adjacent kiosk terminal 10 is blocked by the visor 128 provided on the adjacent kiosk terminal 10 as shown by the dashed arrow in the figure. Thus, the visor 128 also makes it difficult to peek at the display 110.

[0102] In addition, when installing multiple kiosk terminals 10 on a single pole 100, the multiple kiosk terminals 10 can be installed at different heights. For example, as shown in FIG. 10, in a configuration where three kiosk terminals 10 are installed, one kiosk terminal 10 can be installed at a position lower than the other two kiosk terminals 10. In this way, by installing multiple kiosk terminals 10 at different heights from each other, users U of a wide range of heights can use the kiosk terminals 10. In addition, the kiosk terminal 10 installed at a position lower than the other kiosk terminals 10 can be used, for example, by a user U using a wheelchair while still using the wheelchair.

[0103] Note that the means for attaching and fixing the kiosk terminal 10 to the pole 100 is not particularly limited, and various means can be used. For example, the kiosk terminal 10 can be fixedly installed by screwing it to any one of a plurality of mounting positions at different heights provided on the pole 100. Also, for example, the kiosk terminal 10 can be installed on the pole 100 so that it can be slid up and down by the user U himself / herself who uses the kiosk terminal 10, a customs officer who manages the kiosk terminal 10, etc. In this case, the user U etc. can slide the kiosk terminal 10 installed on the pole 100 up and down to adjust the height of the kiosk terminal 10.

[0104] In addition, cords or cables such as a power cord and a communication cable (not shown) connected to the kiosk terminal 10 are housed and hidden inside the pole 100. Also, the surplus portion of the cords or cables can be accommodated inside the housing 126 of the kiosk terminal 10.

[0105] Note that the kiosk terminal 10 can be installed on various supports such as a support stand and a counter in addition to the above-mentioned pole 100.

[0106] Next, the configuration of the electronic gate 20 will be described with reference to FIGS. 11 to 13. FIG. 11 is a schematic diagram showing the appearance of the entrance gate terminal 30 and the exit gate terminal 40 that make up the electronic gate 20. FIG. 12 is a block diagram showing an example of the hardware configuration of the entrance gate terminal 30. FIG. 13 is a block diagram showing an example of the hardware configuration of the exit gate terminal 40.

[0107] The electronic gate 20 is a gate device that permits or denies the passage of a user U guided to the electronic gate 20 by the kiosk terminal 10 based on the result of face verification or the like at the electronic gate 20. A user U permitted to pass through the electronic gate 20 can leave the customs inspection area C. A user U not permitted to pass through the electronic gate 20 will receive individual treatment, such as being guided to a manned booth M by a customs officer and undergoing a face-to-face customs inspection by the customs officer.

[0108] As shown in FIG. 11, the entrance gate terminal 30 and the exit gate terminal 40 that make up the electronic gate 20 are installed at the entrance and the exit of a gate passage P through which a user U guided to the electronic gate 20 can pass, respectively, assuming that the electronic gate 20 can be used. The gate passage P is restricted from exiting from other than the exit gate terminal 40 by a user U who has entered the gate passage P, for example, by partition plates, walls, fences, inspection tables, etc. installed on both sides along the gate passage P.

[0109] First, the entrance gate terminal 30 will be described with reference to FIGS. 11 and 12. As shown in FIG. 11, the entrance gate terminal 30 is a gate device installed at the entrance of a gate passage P through which a user U guided to the electronic gate 20 passes. As shown in FIG. 12, the entrance gate terminal 30 includes a CPU 302, a RAM 304, a storage device 306, an entrance gate door 308, a passage detection sensor 310, a communication unit 312, and a guidance display 314. The CPU 302, the RAM 304, the storage device 306, the entrance gate door 308, the passage detection sensor 310, the communication unit 312, and the guidance display 314 are connected to a bus line 316.

[0110] Further, as shown in FIG. 11, the entrance gate terminal 30 has a pair of housings 318 installed so as to face each other across the entrance of the gate passage P. An entrance gate door 308 is provided between the pair of housings 318 so as to be closable between the pair of housings 318. Further, a plurality of passage detection sensors 310 are provided on the pair of housings 318 so as to be arranged in the direction of entering the gate passage P. Further, a guide display 314 directed forward of the entrance gate terminal 30, which is outside the gate passage P, is provided on the pair of housings 318. The CPU 302, the RAM 304, the storage device 306, and the communication unit 312 may be housed in the housing 318 or may be housed in a housing separate from the housing 318.

[0111] The CPU 302 operates by executing a program stored in the storage device 306 and functions as a control unit that controls the operation of the entire entrance gate terminal 30. Further, the CPU 302 executes an application program stored in the storage device 306 to execute various processes as the entrance gate terminal 30. The RAM 304 provides a memory area necessary for the operation of the CPU 302.

[0112] More specifically, the CPU 302 functions as a determination unit that determines whether or not the user U has passed through the entrance gate terminal 30 and entered the gate passage P based on the output signals of the plurality of passage detection sensors 310 and their output order.

[0113] Also, the CPU 302 functions as a door control unit that controls the opening and closing operations of the entrance gate door 308. When no user U is entering the gate passage P, the CPU 302 maintains the entrance gate door 308 in an open state. Also, when the CPU 302 determines based on the output signal of the passage detection sensor 310 that the user U has passed through the entrance gate terminal 30 and entered the gate passage P, the CPU 302 closes the entrance gate door 308. Also, the CPU 302 maintains the entrance gate door 308 in a closed state until it determines that the user U who has entered the gate passage P has passed through the exit gate terminal 40 and exited from the gate passage P. Also, the CPU 302 determines that the user U has exited from the gate passage P based on the exit passage information transmitted from the exit gate terminal 40. When the CPU 302 determines that the user U has exited from the gate passage P, the CPU 302 opens the entrance gate door 308.

[0114] Also, when the CPU 302 determines as described above that the user U has passed through the entrance gate terminal 30 and entered the gate passage P, the CPU 302 transmits entrance passage information indicating that the user U has passed through the entrance gate terminal 30 and entered the gate passage P to the exit gate terminal 40.

[0115] Also, the CPU 302 functions as a display control unit that controls the display of the guidance display 314 according to the open / closed state of the entrance gate door 308. When the entrance gate door 308 is in an open state, the CPU 302 causes the guidance display 314 to display a message indicating that entry into the gate passage P is permitted. Also, when the entrance gate door 308 is in a closed state, the CPU 302 causes the guidance display 314 to display a message indicating that entry into the gate passage P is prohibited.

[0116] The storage device 306 is composed of a storage medium such as a non-volatile memory and a hard disk drive, and functions as a storage unit. The storage device 306 stores programs executed by the CPU 302, data referred to by the CPU 302 during the execution of those programs, and the like.

[0117] The entrance gate door 308 is an opening and closing door that performs an opening operation and a closing operation according to the control by the CPU 302, and shifts between an open door state that allows the user U to pass through and a closed door state that blocks the passage of the user U. The opening and closing method of the entrance gate door 308 is not particularly limited, and examples thereof include a flapper type, a slide type, a rotary type, etc.

[0118] When the passage detection sensor 310 detects the passage of the user U, it outputs an output signal indicating the passage of the user U. The CPU 302 can determine whether or not the user U has passed through the entrance gate terminal 30 and entered the gate passage P based on the output signals of the plurality of passage detection sensors 310 provided in the pair of housings 318 arranged in the direction of entry into the gate passage P and the order of their outputs. The passage detection sensor 310 is not particularly limited, and examples thereof include a transmissive photoelectric sensor, a reflective photoelectric sensor, etc. The transmissive photoelectric sensor has an irradiation unit that irradiates light such as infrared rays, and a light receiving unit that receives the light irradiated by the irradiation unit, and outputs an output signal indicating the passage of an object based on a change in the light received by the light receiving unit.

[0119] The communication unit 312 is connected to the network NW and performs data transmission and reception via the network NW. The communication unit 312 performs communication with the exit gate terminal 40 etc. according to the control by the CPU 302. Note that the communication unit 312 may be connected to the exit gate terminal 40 so as to be communicable with the exit gate terminal 40 without passing through the network NW.

[0120] The guidance display 314 displays a display indicating whether entry into the gate passage P is permitted or not according to the control by the CPU 302. When the entrance gate door 308 is in an open state, the guidance display 314 displays a display indicating that entry into the gate passage P is permitted. Also, when the entrance gate door 308 is in a closed state, the guidance display 314 displays a display indicating that entry into the gate passage P is prohibited. The guidance display 314 can display a display indicating whether entry into the gate passage P is permitted or not by, for example, color display, symbol display, character display, etc.

[0121] In this way, the entrance gate terminal 30 is configured.

[0122] Next, the configuration of the exit gate terminal 40 will be described with reference to FIGS. 11 and 13. As shown in FIG. 11, the exit gate terminal 40 is a gate device installed at the exit of the gate passage P, which is a passage through which the user U guided by the electronic gate 20 passes. Further, as shown in FIG. 13, the exit gate terminal 40 includes a CPU 402, a RAM 404, a storage device 406, a display 408, a first camera 410, a second camera 412, an exit gate door 414, a passage detection sensor 416, a communication unit 418, and a guidance display 420. The CPU 402, the RAM 404, the storage device 406, the display 408, the first camera 410, the second camera 412, the exit gate door 414, the passage detection sensor 416, the communication unit 418, and the guidance display 420 are connected to a bus line 422.

[0123] Also, as shown in FIG. 11, the exit gate terminal 40 has a pair of housings 424 installed so as to face each other across the exit of the gate passage P. An exit gate door 414 is provided between the pair of housings 424 so as to be closable. Further, a plurality of passage detection sensors 416 are provided on the pair of housings 424 so as to be arranged in the direction of exiting from the gate passage P. Also, a guidance display 420 directed forward of the exit gate terminal 40, which is inside the gate passage P, is provided on the pair of housings 424. The CPU 402, the RAM 404, the storage device 406, and the communication unit 418 may be housed in the housing 424 or may be housed in a housing separate from the housing 424.

[0124] Also, a display 408 is installed on one of the pair of housings 424. The display 408 is installed, for example, such that its screen faces the center of the gate passage P in front of the exit gate terminal 40. A first camera 410 and a second camera 412 are provided at the lower and upper parts on the screen side of the display 408, respectively. Note that the installation position of the display 408 is not particularly limited as long as it is a position where the user U in the gate passage P can see the display 408.

[0125] The first camera 410 is a long-distance camera that can at least photograph within the gate passage P between the entrance gate terminal 30 and the exit gate terminal 40 and can photograph up to a longer distance than the second camera 412. The second camera 412 is a short-distance camera that can at least photograph in front of the exit gate terminal 40. Note that the positions where the first camera 410 and the second camera 412 are provided are not particularly limited as long as they are positions where the respective photographable ranges can be realized.

[0126] The first camera 410 photographs the user U moving along the gate passage P from the entrance gate terminal 30 towards the exit gate terminal 40 and acquires the face image thereof as the first target face image. The second camera 412, if necessary, photographs the user U moving along the gate passage P and arriving at the exit gate terminal 40 and standing in front of the exit gate door 414 and acquires the face image thereof as the second target face image. The photographing of the user U by the first camera 410 is performed without the user U being aware. On the other hand, the photographing of the user U by the second camera 412 is performed, for example, on the user U who has received a notification of photographing by means of the display 408 or the like. The exit gate terminal 40 can perform non-intrusive authentication for identity verification by face matching using the first target face image photographed without the user U being aware by the first camera 410. Also, when the non-intrusive authentication fails, the exit gate terminal 40 can perform positive authentication for identity verification by face matching using the second target face image photographed with the user U being aware by the second camera 412.

[0127] The CPU 402 operates by executing a program stored in the storage device 406 and functions as a control unit that controls the operation of the entire exit gate terminal 40. Further, the CPU 402 executes an application program stored in the storage device 406 to perform various processes as the exit gate terminal 40. The RAM 404 provides a memory area necessary for the operation of the CPU 402.

[0128] More specifically, the CPU 402 functions as a collation request unit that requests the management server 50 to perform face collation of the user U who has entered the gate passage P after passing through the entrance gate terminal 30.

[0129] The CPU 402 as the collation request unit requests the management server 50 to perform 1:N collation between the first target face image, which is the face image of the user U captured by the first camera 410, and a plurality of registered face images registered in the user information DB 506a of the management server 50. For this purpose, the CPU 402 transmits the face feature amount extracted from the first target face image or the first target face image itself to the management server 50 together with the collation request.

[0130] Note that the CPU 402 can function as a quality determination unit that calculates a quality value indicating the quality of the first target face image and determines whether or not the calculated quality value is equal to or greater than a predetermined threshold value. The quality value can be set to a larger value as the quality of the first target face image is higher. The CPU 402 as the collation request unit can request the management server 50 to perform collation with the registered face images for the high-quality first target face image whose quality value is equal to or greater than the predetermined threshold value. Note that the quality value can also be set to a smaller value as the quality of the first target face image is higher. In this case, the CPU 402 as the quality determination unit can determine whether or not the calculated quality value is equal to or less than the predetermined threshold value. Also, in this case, the CPU 402 as the collation request unit can request the management server 50 to perform collation with the registered face images for the high-quality first target face image whose quality value is equal to or less than the predetermined threshold value. Thus, the CPU 402 can determine the quality of the first target face image and request collation with the registered face images for the high-quality first target face image with a certain quality or higher.

[0131] The first target face image is captured by the first camera 410 without the user U being aware. Therefore, when a first target face image with a quality value equal to or higher than a certain level cannot be obtained, or when face matching using the first target face image results in a mismatch due to a face-wearing item worn on the face of the user U, such as a mask, sunglasses, glasses, hat, etc., the CPU 402 as a collation request unit requests the management server 50 to perform 1:N collation between the second target face image, which is the face image of the user U captured by the second camera 412, and a plurality of registered face images registered in the user information DB 506a. For this reason, the CPU 402 transmits the face feature amount extracted from the second target face image or the second target face image itself to the management server 50 together with the collation request.

[0132] Also, the CPU 402 functions as a warning unit that gives a warning to the user U according to the state of the face of the user U during the shooting by the first camera 410. More specifically, the CPU 402 can give a warning as follows, for example.

[0133] First, the CPU 402 can perform gaze detection on the first target face image during the shooting by the first camera 410. The CPU 402 can give a warning according to the gaze situation of the user U detected from the first target face image by gaze detection. That is, if the CPU 402 determines, as a result of gaze detection, that the user U is looking down or sideways, the CPU 402 can give a warning to the user U to face forward, which is the side of the exit gate terminal 40. The CPU 402 can give a warning, for example, by displaying on the display 408 a display instructing the user U to change the face orientation so as to face forward, or by emitting from a speaker or the like a voice instructing the user U to change the face orientation so as to face forward. In this case, the warning display by the display 408 can be performed before face matching in order to prevent unnecessary face matching failures.

[0134] Also, during the shooting by the first camera 410, the CPU 402 can perform accessory estimation on the captured first target face image. By accessory estimation, the CPU 402 can detect face accessories such as masks, sunglasses, glasses, and hats in the first target face image. When the CPU 402 detects a face accessory, it can warn the user U to remove the face accessory that hinders face verification. For example, the CPU 402 can issue a warning by displaying on the display 408 an indication instructing the user U to remove the face accessory, or by emitting a voice from a speaker or the like instructing the user U to remove the face accessory. In this case, the warning display by the display 408 can be performed before face verification to prevent unnecessary face verification failures.

[0135] Also, the CPU 402 functions as a collation information acquisition unit that acquires from the management server 50 collation information indicating the result of face verification of the first target face image or the second face image requested from the management server 50. The collation information indicates the result of the collation, that a registered face image matching the first target face image or the second target face image has been found and the user U's identity verification has succeeded, or that no matching registered face image has been found and the user U's identity verification has failed. When the first target face image or the second target face image matches the registered face image, it includes the case where the collation score indicating the similarity between the two face images exceeds a predetermined threshold and the two face images show a high similarity.

[0136] Note that instead of functioning as a collation request unit and a collation information acquisition unit, the CPU 402 can also be configured to function as a collation unit that collates the first target face image or the second target face image with the registered face images in the user information DB 506a on a one-to-many basis and outputs collation information. In this case, the CPU 402 can perform face image collation by referring to the user information DB 506a of the management server 50 or by referring to the user information DB stored in the storage device 406 and synchronized with the user information DB 506a.

[0137] Further, when the CPU 402 succeeds in authenticating the user U by face verification, it can function as an information acquisition unit that acquires gate usage permission information associated with the user information of the user U from the management server 50. As described above, the gate usage permission information is information indicating the determination result of whether the user U can use the electronic gate 20.

[0138] Further, the CPU 402 functions as a determination unit that determines whether the user U in the gate passage P can pass through the electronic gate 20 based on the verification result of the face verification of the first target face image or the second target face image and the determination result of whether the electronic gate 20 can be used. The CPU 402 as the determination unit determines that the user U can pass through the electronic gate 20 when the face verification of the first target face image or the second target face image matches and the authentication of the user U is successful, and the user U can use the electronic gate 20. The case where the authentication of the user is successful is the case where the first target face image or the second target face image matches the registered face image, which is the captured face image or the passport face image acquired at the kiosk terminal 10. The case where the user U can use the electronic gate 20 is the case where there is gate usage permission information associated with the user information including the matched registered face image and indicating that the user U can use the electronic gate 20.

[0139] Further, the CPU 402 functions as a door control unit that controls the opening and closing operations of the exit gate door 414. When the CPU 402 determines that the user U can pass through the electronic gate 20, it opens the exit gate door 414, which is normally in the closed state. Further, when the CPU 402 determines that the user U has passed through the exit gate terminal 40 and exited from the gate passage P based on the output signal of the passage detection sensor 416, it closes the exit gate door 414.

[0140] Further, the CPU 402 functions as a determination unit that determines whether the user U has passed through the exit gate terminal 40 and exited from the gate passage P based on the output signals of the plurality of passage detection sensors 416 and their output order.

[0141] Also, when the CPU 402 determines that the user U has passed through the exit gate terminal 40 and exited from the gate passage P as described above, the CPU 402 transmits exit passage information indicating that the user U has passed through the exit gate terminal 40 and exited from the gate passage P to the entrance gate terminal 30.

[0142] Also, the CPU 402 functions as a display control unit that controls the display of the display 408. The CPU 402 can cause various notifications to the user U in the gate passage P to be displayed on the display 408. For example, the CPU 402 can cause a warning instructing the user U in the gate passage P to remove face-wearing items such as masks, sunglasses, glasses, and hats that interfere with face verification to be displayed on the display 408. Also, for example, the CPU 402 can cause a notification indicating that a face image is to be captured by the second camera 412 as necessary to be displayed on the display 408 to the user U staying in front of the exit gate door 414. When the collation between the first target face image and the registered face image does not match or the collation cannot be performed, the CPU 402 can cause the user U to stay in front of the exit gate door 414 to be displayed on the display 408. In this case, the CPU 402 can further cause the user U to stay in front of the exit gate door 414 and look at the display 408 to be displayed on the display 408. Thereby, the user U can be guided so that the face image of the user U can be captured by the second camera 412.

[0143] Also, the CPU 402 functions as a display control unit that controls the display of the guidance display 420 according to the open / closed state of the exit gate door 414. When the exit gate door 414 is in an open state, the CPU 402 causes a display indicating that exit from the gate passage P is permitted to be displayed on the guidance display 420. Also, when the exit gate door 414 is in a closed state, the CPU 402 causes a display indicating that exit from the gate passage P is prohibited to be displayed on the guidance display 420.

[0144] The storage device 406 is composed of a storage medium such as a non-volatile memory or a hard disk drive, and functions as a storage unit. The storage device 406 stores programs executed by the CPU 402, data referred to by the CPU 402 during the execution of the programs, and the like.

[0145] The display 408 functions as a display unit that displays various screens for the user U within the gate passage P. For example, the display 408 displays a warning instructing the user to remove face-worn items such as masks, sunglasses, glasses, hats, etc., which may obstruct face verification. Also, for example, the display 408 displays a notification to the effect that the face will be photographed by the second camera 412 as needed. Specifically, when the first target face image captured by the first camera 410 cannot be verified, the display 408 displays an indication instructing the user to stop in front of the display 408 and look in the direction of the second camera 412 so that positive authentication can be performed. For example, the display 408 can display an indication such as "Please stop in front of the display 408 for face authentication and look at the second camera 412." Further, the display 408 can display the result of non-positive authentication verification using the first target face image, which is a face image of the moving user U, and the result of positive authentication verification using the second target face image, which is a face image of the stationary user U.

[0146] The first camera 410 functions as a biometric information acquisition unit that enters the gate passage P and photographs a user U moving toward the exit gate terminal 40 in the gate passage P, and acquires a first target face image that is the face image of the user U as the biometric information of the user U. The first target face image photographed by the first camera 410 is the face image of the moving user U. The first camera 410 is a photographing device such as a digital camera that photographs the user U moving in the gate passage P as a moving image or a still image, and acquires the first target face image of the user U from the photographed moving image or still image. As described above, the first camera 410 can photograph at least the inside of the gate passage P between the entrance gate terminal 30 and the exit gate terminal 40, and is a long-distance camera that can photograph up to a longer distance than the second camera 412. The first camera 410 photographs the user U without making the user U aware that he / she is being photographed. Instead of the first camera 410, a device that acquires the same type of biometric information as the registered biometric information registered in the user information DB 506a of the management server 50 from the user U can be provided as the biometric information acquisition unit.

[0147] The second camera 412 functions as a biometric information acquisition unit that, if necessary, moves through the gate passage P to reach the exit gate door 414 of the exit gate terminal 40 and stops to photograph the user U who has stopped there, and acquires a second target face image that is the face image of the user U as biometric information of the user U. The second target face image photographed by the second camera 412 is the face image of the stationary user U. The second camera 412 is a photographing device such as a digital camera that photographs the user U in front of the exit gate door 414 as a moving image or a still image, and acquires the second target face image of the user U from the photographed moving image or still image. As described above, the second camera 412 is a close-range camera that can at least photograph in front of the exit gate terminal 40. The second camera 412 photographs the user U who has received a photographing notification by, for example, the display of the display 408, voice guidance, etc. The second camera 412 acquires a second target face image to be compared with the registered face image from the user U who stays in front of the exit gate door 414 in a predetermined case. The predetermined case here is, as will be described later, a case where the comparison between the first target face image and the registered face image does not match or the comparison cannot be made. Specifically, the predetermined case is a case where the face direction of the user U moving toward the closed exit gate door 414 is not facing the exit gate door 414, a case where a wearable is worn on the face of the user U, etc. Note that instead of the second camera 412, a device that acquires the same type of biometric information as the registered biometric information registered in the user information DB 506a of the management server 50 from the user U can be provided as the biometric information acquisition unit.

[0148] The exit gate door 414 is an opening and closing door that performs an opening operation and a closing operation according to the control by the CPU 402, and shifts between a closed state that blocks the passage of the user U and an open state that permits the passage of the user U. The opening and closing method of the exit gate door 414 is not particularly limited, and examples thereof include a flapper type, a slide type, a rotary type, etc.

[0149] When the passage detection sensor 416 detects the passage of the user U, it outputs an output signal indicating the passage of the user U. The CPU 402 can determine whether the user U has passed through the exit gate terminal 40 and exited from the gate passage P based on the output signals of the plurality of passage detection sensors 416 provided on the pair of housings 424 arranged in the direction of exiting the gate passage P and the order of their outputs. The passage detection sensor 416 is not particularly limited, but similar to the passage detection sensor 310 of the entrance gate terminal 30, for example, it is a transmissive photoelectric sensor, a reflective photoelectric sensor, or the like.

[0150] The communication unit 418 is connected to the network NW and performs data transmission and reception via the network NW. The communication unit 418 communicates with the management server 50, the entrance gate terminal 30, etc. according to the control by the CPU 402. Note that the communication unit 418 may be connected to the entrance gate terminal 30 so as to be communicable with the entrance gate terminal 30 without passing through the network NW.

[0151] The guidance display 420 displays a display indicating whether exit from the gate passage P is permitted according to the control by the CPU 402. When the exit gate door 414 is in the closed state, the guidance display 420 displays a display indicating that exit from the gate passage P is prohibited. Also, when the exit gate door 414 is in the open state, the guidance display 420 displays a display indicating that exit from the gate passage P is permitted. The guidance display 420 can display a display indicating whether exit from the gate passage P is permitted, for example, by color display, symbol display, character display, etc.

[0152] In this way, the exit gate terminal 40 is configured.

[0153] Next, the configuration of the management server 50 will be described with reference to FIG. 14. FIG. 14 is a block diagram showing an example of the hardware configuration of the management server 50.

[0154] The management server 50 manages the information processing system 1 and is an information processing device that performs collation of the first target face image or the second target face image with a plurality of registered face images in the user information DB 506a, determination of the declared content included in the declaration information, and the like. Note that the functions of the management server 50 may be realized by a single server or by a plurality of servers.

[0155] As shown in FIG. 14, the management server 50 includes a CPU 502, a RAM 504, a storage device 506, and a communication unit 508. The CPU 502, the RAM 504, the storage device 506, and the communication unit 508 are connected to a bus line 510.

[0156] The CPU 502 operates by executing a program stored in the storage device 506 and functions as a control unit that controls the overall operation of the management server 50. Further, the CPU 502 executes an application program stored in the storage device 506 to execute various processes as the management server 50. The RAM 504 provides a memory area necessary for the operation of the CPU 502.

[0157] More specifically, when the CPU 502 receives a collation request for requesting face collation of the user U from the kiosk terminal 10, it functions as a collation unit that performs face collation of the user U. The CPU 502 as the collation unit collates the captured face image and the passport face image included in the user information on a one-to-one basis. When collating the captured face image and the passport face image, the CPU 502 can collate the two face images by collating the face feature amounts extracted from the captured face image and the face feature amounts extracted from the passport face image.

[0158] Further, the CPU 502 functions as a transmission unit that transmits collation information indicating the result of face collation of the user U to the kiosk terminal 10 that has transmitted the collation request. The collation information indicates collation match or collation mismatch. That is, the collation information indicates that, as a result of the collation, the captured face image and the passport face image match and the identity verification of the user U who makes a customs declaration is successful, or the captured face image and the passport face image do not match and the identity verification of the user U fails.

[0159] Also, when the CPU 502 receives the user information of the user U from the kiosk terminal 10, it functions as a determination unit that determines the declaration content included in the declaration information of the user U. The CPU 502 as the determination unit determines whether the user U is a taxable entity and whether there is a risk for the user U from the declaration content included in the declaration information of the user U. When the user U is a taxable entity and when there is a risk for the user U, they are as described above.

[0160] Also, the CPU 502 functions as a transmission unit that transmits determination information indicating the determination result of the declaration content included in the declaration information of the user U to the kiosk terminal 10 that transmitted the user information. As described above, the determination information indicates whether the user U is a taxable entity and whether there is a risk for the user U as a result of the determination.

[0161] The CPU 502 functions as an information management unit that stores and manages the user information of the user U received from the kiosk terminal 10 in the storage device 506. The CPU 502 as the information management unit registers and manages the user information received from the kiosk terminal 10 in the user information DB 506a stored in the storage device 506. Each time the CPU 502 receives user information from the kiosk terminal 10, it registers the received user information in the user information DB 506a.

[0162] The user information of the user U includes, as described above, the identity item information, face information, and declaration information of the user U that are associated with each other. The face information is the photographed face image and passport face image acquired by the kiosk terminal 10 or the face feature amounts extracted therefrom. The photographed face image or passport face image registered in the user information DB 506a is used as a registered face image that is registered biometric information registered in advance. As the registered face image, either the photographed face image or the passport face image can be used, but a photographed face image that is newer than the passport face image can be used as the registered face image. The registered face image that is the photographed face image or passport face image registered in the user information DB 506a or its face feature amounts are used for face verification for identifying the user U at the electronic gate 20.

[0163] Further, when the CPU 502 receives the gate availability information from the kiosk terminal 10, it registers the gate availability information in the user information DB 506a in association with the user information. As described above, the gate availability information is information indicating the determination result of the availability of the electronic gate 20 for the user U who conducts customs declaration.

[0164] In addition, based on the gate availability information, the CPU 502 can also register in the user information DB 506a the user information of the user U for whom it is determined that the use of the electronic gate 20 is possible. That is, the CPU 502 can also not register in the user information DB 506a the user information of the user U for whom it is determined that the electronic gate 20 cannot be used.

[0165] Alternatively, instead of receiving the gate availability information from the kiosk terminal 10, the CPU 502 can also determine the availability of the user U to use the electronic gate 20 in the same manner as the kiosk terminal 10 and obtain the gate availability information.

[0166] In addition, the CPU 502 can delete the user information in the user information DB 506a after a certain period of time has elapsed since its registration. For example, the CPU 502 can delete the user information after the elapse of the time normally required from the completion of customs declaration at the kiosk terminal 10 in the customs inspection area C until passing through the electronic gate 20.

[0167] Further, when the CPU 502 receives a verification request for requesting face verification of the user U from the exit gate terminal 40, it functions as a verification unit that performs face verification of the user U. The CPU 502 as the verification unit performs 1:N verification of the first target face image or the second target face image or their face feature amounts with a plurality of registered face images or their face feature amounts registered in the user information DB 506a. When verifying the first target face image or the second target face image with the registered face image, the CPU 502 can verify both face images by verifying the face feature amounts extracted from the first target face image or the second target face image with the face feature amounts extracted from the registered face image.

[0168] The CPU 502, serving as the verification unit, attempts to find a registered face image that matches the first target face image or the second target face image among a plurality of registered face images by verifying the first target face image or the second target face image against the plurality of registered face images. Also, the CPU 502 attempts to find the facial feature amount of a registered face image that matches the facial feature amount of the first target face image or the second target face image from among the facial feature amounts of the plurality of registered face images by verifying the facial feature amount of the first target face image or the second target face image against the facial feature amounts of the plurality of registered face images. Note that when the first target face image or the second target face image matches the registered face image, it includes the case where the matching score indicating the similarity between the two face images exceeds a predetermined threshold and the two face images show a high similarity. Also, when the facial feature amount of the first target face image or the second target face image matches the facial feature amount of the registered face image, it includes the case where the matching score indicating the similarity between the two facial feature amounts exceeds a predetermined threshold and the two facial feature amounts show a high similarity.

[0169] The CPU 502 functions as a transmission unit that transmits collation information indicating the result of the collation to the exit gate terminal 40 that transmitted the collation request. The collation information indicates collation match or collation mismatch. That is, the collation information indicates, as a result of the collation, that a registered face image that matches the first target face image or the second target face image has been found and the authentication of the user U has succeeded, or that no matching registered face image has been found and the authentication of the user U has failed. Also, the collation information indicates, as a result of the collation, that the facial feature amount of a registered face image that matches the facial feature amount of the first target face image or the second target face image has been found and the authentication of the user U has succeeded, or that no facial feature amount of a matching registered face image has been found and the authentication of the user U has failed. Note that the CPU 502 may perform a collation between the first target face image or the second target face image or its facial feature amount and a single registered face image or its facial feature amount.

[0170] The CPU 502 can delete from the user information database 506a the registered face image that matches the first target face image or the second target face image, or the user information including the registered face image. Further, the CPU 502 can delete from the user information database 506a the user information including the face feature amount of the registered face image that matches the face feature amount of the first target face image or the face feature amount of the second target face image, or the face feature amount of the registered face image.

[0171] Further, the CPU 502 functions as a transmission unit that transmits gate use permission information to the exit gate terminal 40 as necessary.

[0172] The storage device 506 is composed of a storage medium such as a non-volatile memory and a hard disk drive, and functions as a storage unit. The storage device 506 stores programs executed by the CPU 502, data referred to by the CPU 502 during the execution of the programs, and the like.

[0173] Further, the storage device 506 stores the user information database 506a. In the user information database 506a, the user information of a plurality of users U who have made customs declarations at the kiosk terminal 10 is registered. Also, in the user information database 506a, the gate use permission information of the user U associated with the user information is registered.

[0174] The communication unit 508 is connected to the network NW and transmits and receives data via the network NW. The communication unit 508 performs communication with the kiosk terminal 10, the exit gate terminal 40, etc. according to the control by the CPU 502.

[0175] In this way, the management server 50 is configured.

[0176] The kiosk terminal 10 according to this embodiment photographs the user U operating the kiosk terminal 10 by means of a camera 116 provided between a display 110, a travel document reader 112, and a code reader 114. When the user U looks at the display 110, holds a travel document in front of the travel document reader 112, or holds a mobile terminal 60 in front of the code reader 114, the user U will face the camera 116. As a result, while the kiosk terminal 10 reads a travel document by the travel document reader 112 or reads a declaration code by the code reader 114, during the reading process in parallel, the kiosk terminal 10 photographs the face of the user U by the camera 116 to obtain a photographed face image. Since the user U will inevitably face the camera 116 provided between the display 110, the travel document reader 112, and the code reader 114, there is no need to interrupt the operation of the user U on the kiosk terminal 10 and make the user U face the camera 116. Also, the kiosk terminal 10 can execute the reading of a travel document by the travel document reader 112 and the reading of a declaration code by the code reader 114 simultaneously or in any order.

[0177] Therefore, according to the kiosk terminal 10 of this embodiment, procedures on the kiosk terminal 10 including the reading of a travel document, the reading of a declaration code, and the acquisition of a photographed face image for face verification can be completed in a short time. Also, since the kiosk terminal 10 can photograph the face of the user U during the reading of a travel document or a declaration code, the user U is not made aware of the photographing, thus reducing the psychological burden on the user U.

[0178] In addition, the exit gate terminal 40 of the electronic gate 20 according to the present embodiment collates a first target face image obtained by photographing a user U moving toward the exit gate terminal 40 with a first camera 410 with a registered face image registered in the user information DB506a of the management server 50. The first target face image can be obtained without the user U stopping. Therefore, according to the electronic gate 20 of the present embodiment, face collation of the user U can be efficiently performed using the first target face image. Thereby, the time required for the user U to pass through the electronic gate 20 can be shortened. Further, when the collation of the first target face image does not match or cannot be collated, the exit gate terminal 40 photographs the user U staying in front of the exit gate door 414 with a second camera 412 and obtains a second target face image, and collates it with the registered face image. Therefore, according to the electronic gate 20 of the present embodiment, the identity verification by face collation of the user U can be surely performed.

[0179] Furthermore, the exit gate terminal 40 of the electronic gate 20 according to the present embodiment opens the exit gate door 414 according to a determination result of whether the gate can be used, which has been determined in advance. Therefore, according to the electronic gate 20 of the present embodiment, the time required for the user U to pass through the electronic gate 20 can be shortened.

[0180] Hereinafter, the operations of the respective components in the information processing system 1 according to the present embodiment and the control method for realizing these operations will be further described with reference to FIGS. 15A to 20.

[0181] First, the operation of the kiosk terminal 10 will be described with reference to FIGS. 15A to 18C together with the operation of the management server 50. FIG. 15A is a schematic diagram showing an example of a declaration information input screen on the mobile terminal 60. FIG. 15B is a schematic diagram showing an example of a declaration code display screen on the mobile terminal 60. FIG. 16 is a sequence diagram showing the operations of the kiosk terminal 10 and the management server 50. FIG. 17 is a sequence diagram showing the language setting operation of the kiosk terminal 10. FIG. 18A is a schematic diagram showing an example of a reception screen on the kiosk terminal 10. FIG. 18B is a schematic diagram showing an example of a declaration content confirmation screen on the kiosk terminal 10. FIG. 18C is a schematic diagram showing an example of a guidance screen on the kiosk terminal 10.

[0182] For example, a user U who arrives at an airport from a foreign country by airplane goes to the customs inspection area C to conduct a customs declaration after going through immigration inspection at the immigration inspection area and receiving the entrusted baggage at the baggage claim area. The user U inputs declaration information in the customs declaration application executed on the mobile terminal 60 and generates and displays a declaration code including the declaration information. Note that the user U may generate and display the declaration code before using the kiosk terminal 10.

[0183] FIG. 15A shows a declaration information input screen SHE of the customs declaration application on the mobile terminal 60. The declaration information input screen SHE has, for example, a declaration information input field SHE10 for inputting information to be declared in the declaration for luggage clearance. The declaration information input field SHE10 can input information to be declared in the declaration according to the Personal Effects and Separate Consignments Declaration Form of Customs Form C No. 5360 in the case of Japan, for example. That is, the declaration information input field SHE10 can input boarding information, which is information regarding the user U's boarding such as the flight name, departure place, and entry date, and answers to questions. Note that in the customs declaration application, among the declaration information, the basic information of the user U that does not change every time a customs declaration is made, such as the user U's name, current address, telephone number, date of birth, and passport number, can be input and registered on a user registration screen, a setting screen, etc., not shown.

[0184] FIG. 15B shows a declaration code display screen SHC of a customs declaration application in the mobile terminal 60. The declaration code display screen SHC has a declaration code display column SHC10 in which a declaration code including the declaration information input on the declaration information input screen SHE is generated and displayed. The declaration code displayed in the declaration code display column SHC10 further includes language information regarding the language used in the customs declaration application in addition to the declaration information. In addition, the declaration code display column SHC10 can display the date and time when the declaration code expires, how to use the declaration code, and the like.

[0185] The user U who has entered the customs inspection area C makes a customs declaration using the kiosk terminal 10 installed near the entrance of the customs inspection area C. Note that the user U can generate and display a declaration code using the mobile terminal 60 before going in front of the kiosk terminal 10. At that time, the user U can refer to how to use the declaration code displayed in the customs declaration application of the mobile terminal 60, and guidance on how to proceed with the kiosk terminal 10 displayed on the digital signage terminal 70 installed near the kiosk terminal 10.

[0186] As shown in FIG. 16, the CPU 102 of the kiosk terminal 10 continuously determines whether or not a passport is held up to the passport reader 112 and whether or not a declaration code is held up to the code reader 114 (step S102). In this way, the CPU 102 waits until at least one of the passport and the declaration code is held up (step S102, NO).

[0187] FIG. 18A shows an example of a reception screen SKR displayed on the display 110 of the kiosk terminal 10 that waits for at least one of the passport and the declaration code to be held up by the user U. The reception screen SKR displays, for example, that a declaration code is required to use the kiosk terminal 10 and how to hold up the passport and the declaration code.

[0188] As shown in FIG. 16, when the CPU 102 determines that the travel document is presented (step S102, YES), the travel document reading device 112 reads and acquires the identity information of the user U, travel document information such as the travel document face image, etc. from the travel document (step S104). Further, when the CPU 102 determines that the declaration code is presented (step S102, YES), the code reading device 114 reads and acquires the declaration information and language information from the declaration code (step S106).

[0189] Note that the user U may hold the travel document in front of the travel document reading device 112 to read it before presenting the declaration code, or may hold the declaration code in front of the code reading device 114 to read it before presenting the travel document. Also, the user U may hold the travel document and the declaration code in front of the travel document reading device 112 and the code reading device 114 respectively at the same time to read them. The CPU 102 can cause the travel document reading device 112 to read the travel document and the code reading device 114 to read the declaration code in an arbitrary order or simultaneously according to the timing of causing the user U to read the travel document and the declaration code.

[0190] In addition, after the CPU 102 reads one of the travel document and the declaration code, if a certain period of time elapses or it is detected that the user U has left the kiosk terminal 10 without the other being presented, the process can be interrupted. In this case, the CPU 102 can, for example, display an error message or the like on the display 110, or perform a reset process to invalidate the previous processing. After that, the CPU 102 can shift to step S102. Note that the CPU 102 can detect that the user U has left the kiosk terminal 10 based on, for example, a moving image captured by the camera 116 or a still image continuously captured.

[0191] Furthermore, when the CPU 102 determines that a passport or a declaration code is being held up (step S102, YES), the camera 116 captures the face of the user U to obtain a captured face image of the user U (step S108). The CPU 102 can capture the face of the user U by the camera 116 in parallel with the reading of the passport by the passport reader 112 or the reading of the declaration code by the code reader 114, during the reading of the passport or the declaration code. The camera 116 can start capturing when a passport or a declaration code is being held up.

[0192] In this way, the CPU 102 uses the camera 116 to capture the face image of the user U who causes the passport reader 112 to read the passport or the code reader 114 to read the declaration code in front of the kiosk terminal 10, and obtains a captured face image.

[0193] As described above, the camera 116 is provided so that its shooting direction is diagonally upward in the front direction, and has an angle of view capable of capturing the face of the user U who operates the kiosk terminal 10 while looking down at the display 110, the passport reader 112, or the code reader 114. Therefore, the camera 116 can capture the face of the user U who operates the kiosk terminal 10 while looking down at the display 110, the passport reader 112, or the code reader 114 with the line of sight directed diagonally downward in the front, without making the user U aware of the shooting. For example, when shooting by the camera 116, it is not necessary to request the user U to face the direction of the camera 116.

[0194] In addition, the camera 116 can acquire a plurality of face images of the user U operating the kiosk terminal 10 by shooting a video at a predetermined frame rate or shooting a still image at a predetermined time interval. In this case, the CPU 102 can select and acquire the highest-quality face image among the plurality of face images of the user U captured by the camera 116 as the captured face image of the user U. The camera 116 can start shooting triggered by the presentation of a passport or a declaration code. The quality of the face image can be evaluated, for example, based on the orientation of the face with respect to the camera 116, and when the orientation of the face with respect to the camera 116 is within a predetermined range, it can be evaluated as a face image having a certain level of quality or higher.

[0195] When the CPU 102 acquires the passport face image of the user U from the passport and acquires the captured face image of the user U by the camera 116, it transmits a verification request for face verification of the user U to the management server 50 via the network NW (step S110). The CPU 102 transmits the captured face image and the passport face image or their face feature amounts together with the verification request to the management server 50.

[0196] When the CPU 502 of the management server 50 receives the verification request from the kiosk terminal 10, it performs face verification of the user U (step S112). The CPU 502 verifies the captured face image and the passport face image on a one-to-one basis.

[0197] Next, the CPU 502 transmits verification information indicating the result of the verification between the captured face image and the passport face image to the kiosk terminal 10 via the network NW (step S114).

[0198] In this way, while the user U is operating the kiosk terminal 10, face verification of the user U is performed by verifying the captured face image and the passport face image.

[0199] In addition, when the verification between the captured face image and the passport face image does not match, the kiosk terminal 10 can re - execute step S108 of capturing the face of the user U by the camera 116 to obtain the captured face image of the user U, and re - capture the captured face image. The kiosk terminal 10 can re - capture the captured face image once or multiple times.

[0200] Also, the CPU 102 sets the language used by the kiosk terminal 10 for the user U to confirm the declared content and make corrections if necessary (step S116). In setting the language used, first, as shown in FIG. 17, the CPU 102 acquires the language information read from the declaration code (step S202).

[0201] Next, the CPU 102 sets the language used by the customs declaration application indicated by the acquired language information as the language used by the kiosk terminal 10 (step S204). Here, the language used by the customs declaration application set as the language used by the kiosk terminal 10 is the language set in the language setting of the mobile terminal 60, or the language if the language is set in the settings within the customs declaration application. Thus, the CPU 102 can display various information on the display 110 in the same language used by the customs declaration application of the mobile terminal 60 used by the user U. Also, the CPU 102 can receive input from the user U through the input device 108 such as a touch panel incorporated in the display 110 in the same language used by the customs declaration application of the mobile terminal 60 used by the user U.

[0202] Also, the CPU 102 determines whether there is an input of a change instruction for instructing the user U to change to another language of the language used via the input device 108 (step S206). If there is no input of a change instruction (step S206, NO), the CPU 102 maintains the language used set in step S204.

[0203] If there is an input of a change instruction (step S206, YES), the CPU 102 changes the language used by the kiosk terminal 10 to another language specified by the change instruction (step S208).

[0204] In this way, even if the user U is a foreigner, the user U can confirm the display content and input information in the language that the user U uses or the language for which the user U has instructed a change on the kiosk terminal 10. For this reason, the user U can smoothly use the kiosk terminal 10 without language becoming an obstacle.

[0205] After setting the language used by the kiosk terminal 10, as shown in FIG. 16, the CPU 102 displays the declaration content of the declaration information read from the declaration code on the display 110 for the user U to confirm, and accepts corrections from the user U as necessary (step S118). The user U confirms the declaration content displayed on the display 110, and corrects the declaration content via the input device 108 if the declaration content needs to be corrected. The user U who has confirmed the declaration content inputs a confirmation instruction via the input device 108 to instruct to confirm the declaration content and finalize the declaration content. Thereby, the declaration content declared by the user U in the customs declaration is finalized.

[0206] FIG. 18B shows an example of a declaration content confirmation screen SKC displayed on the display 110 of the kiosk terminal 10 on which the user U confirms the declaration content and makes corrections as necessary. The declaration content confirmation screen SKC displays the declaration content included in the declaration information. The declaration content confirmation screen SKC can transition to a declaration content correction screen on which the declaration content can be corrected, for example, when a correction button is pressed by a touch input of the user U. Also, on the declaration content confirmation screen SKC, for example, when a confirmation button is pressed by a touch input of the user U, a confirmation instruction is input to the kiosk terminal 10. Thereby, the declaration content declared by the user U in the customs declaration is finalized.

[0207] Note that the CPU 102 can display a declaration information input screen SHE of a customs declaration application shown in FIG. 15A displayed on the display 610 of the mobile terminal 60 and a declaration content confirmation screen SKC with a unified layout. By unifying the layouts of both screens, it is possible to realize a screen display that is not confusing for the operation of the kiosk terminal 10.

[0208] When the declaration content is determined, as shown in FIG. 16, the CPU 102 transmits the user information of the user U to the management server 50 via the network NW (step S120). The user information includes the identity information, face information, and declaration information of the user U that are associated with each other. Note that since the CPU 102 transmits the photographed face image and the passport face image together with the collation request in step S110, it is not necessary to transmit the face information in the user information again.

[0209] Next, the CPU 502 determines the declaration content included in the declaration information of the user information of the user U (step S122). The CPU 502 determines whether the user U is subject to taxation and whether there is a risk for the user U from the declaration content included in the declaration information of the user U.

[0210] Furthermore, in addition to determining the declaration content, the CPU 502 can perform collation of the passport number. In this case, the CPU 502 collates the passport number included in the identity information of the user information with the passport number included in the declaration information of the user information.

[0211] Next, the CPU 502 transmits determination information indicating the determination result of the declaration content included in the declaration information of the user U to the kiosk terminal 10 via the network NW (step S124). In addition, the CPU 502 can include the collation result of the passport number in the determination information.

[0212] When the CPU 102 of the kiosk terminal 10 receives the determination information from the management server 50, it determines whether the user U can use the electronic gate 20 based on the received determination information and the previously received verification information (step S126). The previously received verification information is the one transmitted from the management server 50 in step S114. Note that the CPU 102 can display on the display 110 the verification information indicating the result of the comparison between the photographed face image and the passport face image, and the determination information indicating the determination result of the declared content to show the user U.

[0213] The CPU 102 determines that the user U can use the electronic gate 20 when the passport face image of the user U matches the photographed face image, the user U is not subject to taxation, and there is no risk to the user U. When the determination information includes the verification result of the passport number, the CPU 102 determines that the user U can use the electronic gate 20 when the passport face image of the user U matches the photographed face image, the user U is not subject to taxation, there is no risk to the user U, and furthermore the passport numbers match.

[0214] On the other hand, the CPU 102 determines that the user U cannot use the electronic gate 20 when the passport face image of the user U does not match the photographed face image, the user U is subject to taxation, or there is a risk to the user U. Also, when the determination information includes the verification result of the passport number, the CPU 102 determines that the user U cannot use the electronic gate 20 even when the passport numbers do not match.

[0215] The CPU 102 transmits gate use availability information indicating the determination result of whether the electronic gate 20 can be used to the management server 50 (step S128). The gate use availability information indicates that the user U can use the electronic gate 20 when the passport face image of the user U matches the photographed face image, the user U is not subject to taxation, and there is no risk to the user U. Also, when the determination information includes the verification result of the passport number, the gate use availability information further indicates that the user U can use the electronic gate 20 when the passport numbers match.

[0216] When the CPU 502 of the management server 50 receives the gate availability information from the kiosk terminal 10, it registers the user information of the user U in the user information DB 506a in association with the gate availability information (step S130). Note that instead of receiving the gate availability information from the kiosk terminal 10, the CPU 502 can also determine whether the user U can use the electronic gate 20 based on the collation information and the determination information, similar to the CPU 102 of the kiosk terminal 10.

[0217] Alternatively, instead of registering the user information in the user information DB 506a in association with the gate availability information, the CPU 502 can also register the user information of a specific user U in the user information DB 506a. That is, the CPU 502 can register the user information of the user U determined to be able to use the electronic gate 20 in the user information DB 506a based on the gate availability information. In other words, the CPU 502 can also choose not to register the user information of users U other than the specific user U in the user information DB 506a.

[0218] Next, when the CPU 102 of the kiosk terminal 10 determines that the user U can use the electronic gate 20 (step S132, YES), it executes a process to guide the user U to the electronic gate 20 (step S134). The CPU 102, for example, causes a guidance screen for guiding the user U to the electronic gate 20 to be displayed on the display 110 to guide the user U to the electronic gate 20.

[0219] FIG. 18C shows an example of a guidance screen SKG displayed on the display 110 of the kiosk terminal 10 for guiding the user U to the electronic gate 20. The guidance screen SKG shows, for example, words, symbols, pictures, etc. for guiding the user to the electronic gate 20, as well as words, symbols, pictures, etc. indicating that the customs declaration has been completed.

[0220] On the other hand, when the CPU 102 determines that the user U cannot use the electronic gate 20 (step S132, NO), it executes a response process for the user U who cannot use the electronic gate 20 (step S136). As the response process, for example, the CPU 102 causes the display 110 to display a guidance screen for guiding the user U to the manned booth M, and guides the user U to the manned booth M.

[0221] In this way, a customs declaration by the user U is performed at the kiosk terminal 10.

[0222] Next, the operation of the electronic gate 20 to which the user U is guided at the kiosk terminal 10 will be described with reference to FIGS. 19 and 20 together with the operation of the management server 50. FIG. 19 is a sequence diagram showing the operation of the entrance gate terminal 30 and the exit gate terminal 40 constituting the electronic gate 20, and the management server 50.

[0223] In the standby state of the electronic gate 20 where the user U has not entered the gate passage P, the entrance gate door 308 of the entrance gate terminal 30 is in an open state, and the exit gate door 414 of the exit gate terminal 40 is in a closed state. Further, in the standby state, the guidance display 314 of the entrance gate terminal 30 displays a display indicating permission to enter the gate passage P, and the guidance display 420 of the exit gate terminal 40 displays a display indicating prohibition of exit from the gate passage P.

[0224] The user U who has completed the customs declaration at the kiosk terminal 10 and is guided to the electronic gate 20 will enter the gate passage P by passing through the entrance gate terminal 30 with the entrance gate door 308 in an open state.

[0225] As shown in FIG. 19, in the standby state, the CPU 302 of the entrance gate terminal 30 determines whether the user U has passed through the entrance gate terminal 30 and entered the gate passage P (step S302), and waits for the user U to pass (step S302, NO). The CPU 302 can determine whether the user U has passed through the entrance gate terminal 30 and entered the gate passage P based on the output signals of the plurality of passage detection sensors 310 and their output order.

[0226] When the CPU 302 determines that the user U has passed through the entrance gate terminal 30 and entered the gate passage P (step S302, YES), it closes the entrance gate door 308 (step S304). Further, the CPU 302 changes the display of the guidance display 314 from a display indicating permission to enter the gate passage P to a display indicating prohibition of entering the gate passage P.

[0227] As will be described later, the entrance gate door 308 is controlled so as not to open until the user U who has entered the gate passage P passes through the exit gate terminal 40 and exits from the gate passage P. For this reason, only one user U can enter the gate passage P. Thereby, it is possible to prevent a situation in which a plurality of users U are photographed by the first camera 410, and the collation of the first target face images can be surely performed.

[0228] Further, the CPU 302 transmits entrance passage information indicating that the user U has passed through the entrance gate terminal 30 and entered the gate passage P to the exit gate terminal 40 (step S306). Note that the CPU 302 can execute either step S304 or step S306 in the previous order, or can execute both steps S304 and S306 simultaneously.

[0229] Upon receiving the entrance passage information from the entrance gate terminal 30, the CPU 402 of the exit gate terminal 40 captures the user U moving towards the exit gate terminal 40 through the gate passage P with the first camera 410, and acquires the first target face image of the user U (step S308). The first camera 410 captures a moving picture at a predetermined frame rate or captures a still picture at a predetermined time interval, thereby acquiring a plurality of first target face images of the user U moving through the gate passage P. In this way, the first target face image, which is the face image of the user U moving in the gate passage P, is acquired. During the shooting by the first camera 410, the user U can move towards the exit gate terminal 40 without stopping in the gate passage P.

[0230] During the shooting by the first camera 410, the CPU 402 performs line-of-sight detection on the first target face image. If, as a result of the line-of-sight detection, it is determined that the user U is looking down or sideways, a warning can be given to the user U to face forward, which is the side of the exit gate terminal 40. The CPU 402 can give a warning to the user U to face forward, for example, by displaying on the display 408, making a sound from a speaker, etc. Thereby, a high-quality first target face image can be acquired more reliably.

[0231] If the user U does not face forward in violation of the above warning, the CPU 402 can also prevent the first target face image from being collated without performing the quality determination in step S310 and the collation request in step S312 below.

[0232] Also, during the shooting by the first camera 410, the CPU 402 performs accessory estimation on the captured first target face image and attempts to detect face accessories such as sunglasses, glasses, and hats in the first target face image. If the CPU 402 detects a face accessory, it can give a warning to instruct the user U to remove the face accessory, for example, by displaying on the display 408, making a sound from a speaker, etc. Thereby, factors that interfere with the collation of the first target face image can be removed.

[0233] If, contrary to the above warning, the face wear is not removed from the face of the user U, the CPU 402 may also refrain from performing the quality determination in step S310 and the collation request in step S312 described above, and may refrain from collating the first target face image.

[0234] The CPU 402 calculates a quality value for each of the acquired first target face images, and determines the quality of the first target face image based on the calculated quality value (step S310).

[0235] As a result of the quality determination, for high-quality first target face images with a certain quality or higher, the CPU 402 sequentially transmits a collation request to the management server 50 via the network NW (step S312). Thereby, the CPU 402 requests the management server 50 to collate the first target face images with a certain quality or higher and a plurality of registered face images registered in the user information DB 506a of the management server 50 on a one-to-many basis. The CPU 402 transmits the face feature amount extracted from the first target face image or the first target face image itself to the management server 50 together with the collation request.

[0236] Note that the CPU 402 may transmit all of the acquired first target face images to the management server 50 regardless of the quality. In this case, the CPU 502 of the management server 50 similarly determines the quality of the first target face image, and can collate the first target face images with a certain quality or higher with the registered face images. Further, the CPU 502 can collate the first target face image and the registered face image regardless of the quality.

[0237] When the CPU 502 of the management server 50 receives a collation request for the first target face image from the exit gate terminal 40, the CPU 502 collates the first target face image (step S314). The CPU 502 collates the face feature amount of the first target face image received from the exit gate terminal 40 and the face feature amounts of a plurality of registered face images registered in the user information DB 506a on a one-to-many basis. The face feature amount of the first target face image is either the one received from the exit gate terminal 40 or the one extracted from the first target face image received from the exit gate terminal 40.

[0238] Next, the CPU 502 transmits collation information indicating the result of collation of the first target face image to the exit gate terminal 40 via the network NW (step S316).

[0239] The CPU 402 of the exit gate terminal 40 and the CPU 502 of the management server 50 can repeatedly execute the above steps S312, S314, and S316 for a plurality of first target face images of a certain quality or higher.

[0240] The CPU 402 of the exit gate terminal 40 receives collation information from the management server 50. When the collation information for any one of the first target face images indicates that the verification of the user U who has moved through the gate passage P and found a matching registered face image has been successful (step S318, YES), the CPU 402 ends the shooting by the first camera 410. Subsequently, the CPU 402 proceeds to step S336.

[0241] On the other hand, if the CPU 402 indicates that the verification of the user U has failed because no matching registered face image has been found for the collation information of any of the first target face images by a predetermined time (step S318, NO), it is determined that the verification by collation of the first target face image has failed. The predetermined time is, for example, the time when the user U reaches the exit gate door 414 of the exit gate terminal 40. The CPU 402 can determine whether the user U has reached the exit gate door 414 from the image captured by the first camera 410.

[0242] Also, if the CPU 402 has not received the collation information by the same predetermined time as above, it can be determined that the verification by collation of the first target face image has failed. In this case, a first target face image of a certain quality or higher cannot be obtained, and the first target face image and the registered face image cannot be collated.

[0243] When the CPU 402 determines that the verification of the first target face image has failed to confirm the identity of the user, it notifies the user U to take a picture with the second camera 412 (step S320). That is, when the comparison between the first target face image and the registered face image does not match or cannot be performed, the CPU 402 notifies the user U to take a picture with the second camera 412. The CPU 402 can notify the user U to take a picture with the second camera 412 by, for example, displaying on the display 408, voice guidance, etc.

[0244] Next, the CPU 402 uses the second camera 412 to take a picture of the user U who stays in front of the exit gate door 414 after receiving the notification (step S322). Thereby, the CPU 402 acquires a second target face image of the user U who reaches in front of the exit gate door 414 of the exit gate terminal 40 and stays in front of the exit gate door 414. In this way, the second target face image, which is the face image of the user U stationary in front of the exit gate door 414, is acquired.

[0245] The second camera 412 can acquire a plurality of face images of the user U in front of the exit gate door 414 by taking a video at a predetermined frame rate or taking a still image at a predetermined time interval. In this case, the CPU 402 can select and acquire the highest-quality face image among the plurality of face images of the user U taken by the second camera 412 as the second target face image of the user U.

[0246] When taking a picture with the second camera 412, the CPU 402 can guide the user U by, for example, displaying on the display 408, voice from a speaker, etc. For example, if a face covering is detected in the second target face image, the CPU 402 can guide the user U to remove the face covering and the second camera 412 to face the direction of the display 408.

[0247] FIG. 20 shows an example of a guidance display shown on the display 408 during shooting by the second camera 412. As shown in the figure, the display on the display 408 can guide the removal of the mask which is a face-wearing item.

[0248] Next, the CPU 402 transmits a collation request to the management server 50 via the network NW for the second target face image (step S324). Thereby, the CPU 402 requests the management server 50 to collate the second target face image with a plurality of registered face images registered in the user information DB 506a of the management server 50 in a 1:N manner. The CPU 402 transmits the face feature amount extracted from the second target face image or the second target face image itself together with the collation request to the management server 50.

[0249] When the CPU 502 of the management server 50 receives a collation request for the second target face image from the exit gate terminal 40, it collates the second target face image (step S326). The CPU 502 collates the face feature amount of the second target face image received from the exit gate terminal 40 with the feature amounts of a plurality of registered face images registered in the user information DB 506a in a 1:N manner. The face feature amount of the second target face image is either the one received from the exit gate terminal 40 or the one extracted from the second target face image received from the exit gate terminal 40.

[0250] Next, the CPU 502 transmits collation information indicating the result of the collation of the second target face image to the exit gate terminal 40 via the network NW (step S328).

[0251] The CPU 402 of the exit gate terminal 40 receives the collation information from the management server 50. When the collation information for the second target face image indicates that a matching registered face image has been found and the authentication of the user U in front of the exit gate door 414 has been successful (step S330, YES), the process proceeds to step S336.

[0252] Note that when the matching between the second target face image and the registered face image does not match, the exit gate terminal 40 can re - execute step S322 of capturing the user U by the second camera 412 to obtain the second target face image of the user U, and re - capture the second target face image. The exit gate terminal 40 can re - capture the second target face image only once or multiple times.

[0253] Also, when the CPU 502 of the management server 50 succeeds in the identity verification of the user U as a result of the matching of the first target face image or the matching of the second target face image (step S332, YES), it transmits the gate usage permission information (step S334). That is, the CPU 502 acquires the gate usage permission information associated with the user information of the user U who has succeeded in the identity verification from the user information DB 506a and transmits it to the exit gate terminal 40 via the network NW.

[0254] When the collation information about the second target face image indicates that no matching registered face image is found and the identity verification of the user U fails (step S330, NO), the CPU 402 of the exit gate terminal 40 executes corresponding processing (step S338). In this case, the identity verification of the user U fails by either the collation of the first target face image or the collation of the second target face image. As the corresponding processing, the CPU 402 can, for example, sound an alarm or send a notification to the terminal of the customs officer to call the customs officer to the gate passage P. In this case, the customs officer can, for example, guide the user U to the manned booth M or a separate room. Also, after conducting a face - to - face customs inspection at the inspection table provided on the side of the electronic gate 20, the customs officer can manually open the exit gate door 414 and let the user U exit from the gate passage P.

[0255] On the other hand, the CPU 402 that has successfully verified the identity of the user U through the verification of the first target face image or the second target face image and has moved to step S336 determines whether the user U can use the electronic gate 20 (step S336). The CPU 402 determines whether the user U can use the electronic gate 20 based on the gate availability information received from the management server 50.

[0256] If the CPU 402 determines that the electronic gate 20 cannot be used (step S336, NO), it executes corresponding processing (step S338). In this case, although the identity of the user U has been successfully verified through the verification of the first target face image or the second target face image, the user U is a person determined to be subject to taxation, a person determined to be at risk, etc. As corresponding processing, the CPU 402 can, for example, sound an alarm or send a notification to the terminal of the customs officer to call the customs officer to the gate passage P. In this case as well, the customs officer can respond to the user U in the same manner as above.

[0257] On the other hand, if the CPU 402 determines that the electronic gate 20 can be used (step S336, YES), it opens the exit gate door 414 (step S340). Further, the CPU 402 changes the display of the guidance display 420 from the display indicating prohibition of exit from the gate passage P to the display indicating permission of exit from the gate passage P.

[0258] Next, the CPU 402 determines whether the user U has passed through the exit gate terminal 40 and exited from the gate passage P (step S342), and waits for the user U to pass (step S342, NO). The CPU 402 can determine whether the user U has passed through the exit gate terminal 40 and exited from the gate passage P based on the output signals of the plurality of passage detection sensors 416 and their output order.

[0259] When the CPU 402 determines that the user U has passed through the exit gate terminal 40 and exited from the gate passage P (step S342, YES), it closes the exit gate door 414 (step S344). Further, the CPU 402 changes the display of the guidance display 420 from the display indicating permission to exit from the gate passage P to the display indicating prohibition of exit from the gate passage P.

[0260] Also, the CPU 402 transmits exit passage information indicating that the user U has passed through the exit gate terminal 40 and exited from the gate passage P to the entrance gate terminal 30 (step S346). Note that the CPU 402 can execute either step S344 or step S346 in any order, or can execute both steps S344 and S346 simultaneously.

[0261] The CPU 302 of the entrance gate terminal 30 that has received the exit passage information from the exit gate terminal 40 opens the entrance gate door 308 (step S348). Further, the CPU 302 changes the display of the guidance display 314 from the display indicating prohibition of entry into the gate passage P to the display indicating permission of entry into the gate passage P.

[0262] In this way, the electronic gate 20 shifts to the standby state of waiting for the user U to enter the gate passage P.

[0263] As described above, according to the present embodiment, in the kiosk terminal 10, a photographed face image used for face verification, which is biometric information verification, is acquired during the reading of the travel document or the reading of the declaration code. Therefore, according to the present embodiment, the procedures at the kiosk terminal 10 including the acquisition of information by reading the travel document and the declaration code and the face verification using the photographed face image can be completed in a short time.

[0264] Also, according to this embodiment, at the exit gate terminal 40 of the electronic gate 20, the user U moving toward the exit gate terminal 40 is photographed by the first camera 410, and a first target face image used for face verification, which is biometric information verification, is acquired. Also, according to this embodiment, the exit gate door 414 is opened according to the determination result of whether the gate can be used, which has been determined in advance. Therefore, according to this embodiment, the time required for the user U to pass through the electronic gate 20 can be shortened.

[0265] [Other Embodiments] According to other embodiments, the gate device described in the above embodiment can also be configured as shown in FIGS. 21 and 22. FIGS. 21 and 22 are schematic diagrams showing the configurations of information processing devices according to other embodiments.

[0266] As shown in FIG. 21, a gate device 1000 according to another embodiment includes an exit gate door 1002, a first biometric information acquisition unit 1004, a second biometric information acquisition unit 1006, and a door control unit 1008. The first biometric information acquisition unit 1004 acquires first target biometric information to be verified with registered biometric information from a user moving toward the closed exit gate door 1002. The second biometric information acquisition unit 1006 acquires second target biometric information to be verified with registered biometric information from a user staying in front of the exit gate door 1002 when the verification between the first target biometric information and the registered biometric information does not match or cannot be performed. The door control unit 1008 opens the closed exit gate door 1002 according to the result of the verification between the first target biometric information or the second target biometric information and the registered biometric information.

[0267] In addition to the above, the second biometric information acquisition unit 1006 can also be configured to acquire second target biometric information to be verified with registered biometric information from a user staying in front of the exit gate door 1002 in a predetermined case. The predetermined case here means a case where the face direction of the user moving toward the closed exit gate door 1002 is not facing the exit gate door 1002, or a case where a wearable is worn on the user's face.

[0268] According to the gate device 1000 according to another embodiment, since the first target biometric information for matching with the registered biometric information registered in advance is acquired from a user moving toward the closed exit gate door 1002, the time required for the user to pass through can be shortened.

[0269] Also, as shown in FIG. 22, the gate device 2000 according to another embodiment includes an exit gate door 2002, a biometric information acquisition unit 2004, and a door control unit 2006. The biometric information acquisition unit 2004 acquires target biometric information for matching with the registered biometric information registered in advance from a user moving toward the closed exit gate door or staying in front of the exit gate door. The door control unit 2006 opens the closed exit gate door 2002 according to the determination result of the declaration information associated with the registered biometric information that matches the target biometric information.

[0270] According to the gate device 2000 according to another embodiment, since the closed exit gate door 2002 is opened according to the determination result of the declaration information associated with the registered biometric information that matches the target biometric information, the time required for the user to pass through can be shortened.

[0271] [Modification Embodiment] The present invention is not limited to the above embodiments, and various modifications are possible.

[0272] For example, in the above embodiment, the case where customs declaration is made at the kiosk terminal 10 is described as an example, but the present invention is not limited thereto. The kiosk terminal 10 can be configured to receive various declarations by the user.

[0273] Also, in the above embodiment, the case where the camera 116, the first camera 410, and the second camera 412 capture and acquire the face image of the user U as the biometric information of the user U is described as an example, but the present invention is not limited thereto. The camera 116, the first camera 410, and the second camera 412 may acquire, as the biometric information of the user U, not only the face image which is face information but also an iris image or the like.

[0274] Further, the kiosk terminal 10 according to the above embodiment can be configured as a system including one or a plurality of devices. Further, the entrance gate terminal 30 according to the above embodiment can be configured as a system including one or a plurality of devices. Further, the exit gate terminal 40 according to the above embodiment can be configured as a system including one or a plurality of devices. Further, the management server 50 according to the above embodiment can be configured as a system including one or a plurality of devices.

[0275] Also, a processing method that records a program for operating the configuration of the above embodiment on a recording medium so as to realize the functions of the above embodiments, reads out the program recorded on the recording medium as code, and executes it on a computer is also included in the scope of each embodiment. That is, a computer-readable recording medium is also included in the scope of each embodiment. Further, not only the recording medium on which the above-described computer program is recorded, but also the computer program itself is included in each embodiment.

[0276] As the recording medium, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM (Compact Disc-Read Only Memory), a magnetic tape, a non-volatile memory card, or a ROM can be used. Further, not only those that execute processing with the program recorded on the recording medium alone, but also those that operate on an OS (Operating System) and execute processing in cooperation with the functions of other software and expansion boards are included in the scope of each embodiment.

[0277] Some or all of the above embodiments can be described as follows in the appended claims, but are not limited thereto.

[0278] (Appended Claim 1) An exit gate door, a first biometric information acquisition unit that acquires first target biometric information to be compared with pre-registered registered biometric information from a user moving toward the exit gate door in a closed state; When the verification between the first target biometric information and the registered biometric information does not match or cannot be performed, a second biometric information acquisition unit that acquires second target biometric information for verification with the registered biometric information from the user staying in front of the exit gate door; A door control unit that opens the exit gate door in the closed state according to the result of verification between the first target biometric information or the second target biometric information and the registered biometric information A gate device having the above.

[0279] (Appendix 2) The gate device according to Appendix 1, wherein the door control unit opens the exit gate door in the closed state according to the determination result of the declaration information associated with the registered biometric information that matches the first target biometric information or the second target biometric information.

[0280] (Appendix 3) The gate device according to Appendix 2, wherein the declaration information is information necessary for customs declaration.

[0281] (Appendix 4) The exit gate door is installed at the exit of the passage, The gate device according to any one of Appendices 1 to 3, which has an entrance gate door installed at the entrance of the passage, which closes when the user enters the passage, and opens when the exit gate door opens and the user exits the passage.

[0282] (Appendix 5) The first biometric information acquisition unit acquires, as the first target biometric information, first target face information for verification with the registered face information as the registered biometric information from the user, The gate device according to any one of Appendices 1 to 4, which has a display unit that performs display according to the state of the face of the user moving toward the exit gate door in the closed state.

[0283] (Appendix 6) The gate device according to any one of Appendices 1 to 4, having a display unit that, when the collation between the first target biometric information and the registered biometric information does not match or when the collation cannot be performed, displays to the user to stay in front of the exit gate door.

[0284] (Appendix 7) The display unit is the gate device according to Appendix 6, which, when the collation between the first target biometric information and the registered biometric information does not match or when the collation cannot be performed, performs the display so that the user stays in front of the exit gate door and views the display unit.

[0285] (Appendix 8) The display unit is the gate device according to Appendix 5, which performs the display according to the state of the user's line of sight detected from the first target face information.

[0286] (Appendix 9) The display unit is the gate device according to Appendix 8, which displays the display instructing the user to change the direction of the face.

[0287] (Appendix 10) The display unit is the gate device according to any one of Appendices 5, 8, and 9, which performs the display when a wearable worn on the user's face is detected.

[0288] (Appendix 11) The display unit is the gate device according to any one of Appendices 5, 8, and 9, which, when a wearable worn on the user's face is detected, performs the display to remove the wearable.

[0289] (Appendix 12) The first biometric information acquisition unit acquires a plurality of the first target biometric information, The gate device according to any one of Appendices 1 to 11, having a control unit that collates or requests collation between the first target biometric information of a certain quality or higher among the plurality of first target biometric information and the registered biometric information.

[0290] (Appendix 13) An exit gate door, a first biometric information acquisition unit that acquires first target biometric information to be compared with pre-registered registered biometric information from a user moving toward the exit gate door in a closed state; a second biometric information acquisition unit that acquires second target biometric information to be compared with the registered biometric information from the user staying in front of the exit gate door when the face direction of the user moving toward the exit gate door in the closed state is not facing the exit gate door or when a wearable is worn on the face of the user; a door control unit that opens the exit gate door in the closed state according to a result of comparison between the first target biometric information or the second target biometric information and the registered biometric information A gate device having the above.

[0291] (Appendix 14) An exit gate door, a biometric information acquisition unit that acquires target biometric information to be compared with pre-registered registered biometric information from a user moving toward the exit gate door in a closed state or staying in front of the exit gate door; a door control unit that opens the exit gate door in the closed state according to a determination result of declaration information associated with the registered biometric information that matches the target biometric information A gate device having the above.

[0292] (Appendix 15) A control method for a gate device having an exit gate door, acquiring first target biometric information to be compared with pre-registered registered biometric information from a user moving toward the exit gate door in a closed state, acquiring second target biometric information to be compared with the registered biometric information from the user staying in front of the exit gate door when the comparison between the first target biometric information and the registered biometric information does not match or when the comparison cannot be made, A control method for a gate device that opens the exit gate door in the closed state according to a result of comparison between the first target biometric information or the second target biometric information and the registered biometric information.

[0293] (Appendix 16) In a gate device having an exit gate door, acquire first target biometric information to be compared with pre-registered registered biometric information from a user moving toward the exit gate door in a closed state; when the comparison between the first target biometric information and the registered biometric information does not match or when the comparison cannot be made, acquire second target biometric information to be compared with the registered biometric information from the user staying in front of the exit gate door; open the exit gate door in the closed state according to the result of the comparison between the first target biometric information or the second target biometric information and the registered biometric information. A recording medium on which a program for executing the above is recorded.

Explanation of Signs

[0294] 1… Information processing system 10… Kiosk terminal 20… Electronic gate 30… Entrance gate terminal 40… Exit gate terminal 50… Management server 60… Mobile terminal

Claims

1. A first acquisition unit that acquires biometric information of a user; A second acquisition unit that acquires gate availability information indicating a determination result of whether the user can use the gate, which is determined based on the declaration information registered in association with the registered biometric information based on a comparison between the biometric information and the registered biometric information registered in a registration terminal for customs declaration; A gate device comprising a control unit that controls a gate based on the gate availability information.

2. A method in which a gate device acquires biometric information of a user, acquires gate availability information indicating a determination result of whether the user can use the gate, which is determined based on the declaration information registered in association with the registered biometric information based on a comparison between the biometric information and the registered biometric information registered in a registration terminal for customs declaration, and controls a gate based on the gate availability information.

3. A program that causes a computer to acquire biometric information of a user, acquire gate availability information indicating a determination result of whether the user can use the gate, which is determined based on the declaration information registered in association with the registered biometric information based on a comparison between the biometric information and the registered biometric information registered in a registration terminal for customs declaration, and control a gate based on the gate availability information.

Images