Information processing device, information processing method, and recording medium

Abstract

To provide an information processing apparatus, an information processing method, and a recording medium that can efficiently perform an immigration examination.SOLUTION: An information processing apparatus includes: an information acquisition unit that acquires, from a user who completed a departure examination of a first country but has not started boarding for a second country, user information related to the user; and an information providing unit that provides the user information for an immigration examination of the second country.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a recording medium. [Background technology]

[0002] Patent Document 1 describes an immigration inspection system in which a traveler inputs planned entry information into a traveler information input terminal before departure. The immigration inspection system described in Patent Document 1 compares the planned entry information with a list of people requiring special attention to determine whether the person is on the list, and if the person is not on the list, they are subject to passing through an automated gate. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-222459 Summary of the Invention [Problem to be solved by the invention]

[0004] In the immigration inspection system described in Patent Document 1, the planned entry information entered before departure does not include the traveler's biometric information, and after arrival, the traveler must have their biometric information read by a biometric information reader, which is a peripheral device at the automated gate. For this reason, it is difficult to carry out immigration inspections efficiently using the immigration inspection system described in Patent Document 1.

[0005] In view of the above-mentioned problems, an object of the present invention is to provide an information processing device, an information processing method, and a recording medium that enable immigration inspection to be carried out efficiently. [Means for solving the problem]

[0006] According to one aspect of the present invention, there is provided an information processing device having an information acquisition unit that acquires user information about a user from a user who has undergone immigration inspection in a first country and is yet to board a flight to a second country, and an information provision unit that provides the user information for immigration inspection in the second country.

[0007] According to another aspect of the present invention, there is provided an information processing method for obtaining user information about a user after immigration control in a first country and before boarding for a flight to a second country, and providing the user information for immigration control in the second country.

[0008] According to yet another aspect of the present invention, there is provided a recording medium having recorded thereon a program that causes a computer to cause an information acquisition unit to acquire user information about a user from the user after immigration control in a first country and before boarding for a flight to a second country, and to provide the user information for immigration control in the second country. [Effects of the Invention]

[0009] According to the present invention, the time required for immigration inspection can be significantly reduced. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram showing the overall configuration of an information processing system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a schematic diagram showing an immigration inspection area where automated gate devices and face-to-face inspection booths are installed. [Figure 3] FIG. 3 is a block diagram showing an example of the hardware configuration of a remote examination terminal according to an embodiment of the present invention. [Figure 4] FIG. 4 is a block diagram showing an example of the hardware configuration of the examination server according to one embodiment of the present invention. [Figure 5] FIG. 5 is a block diagram showing an example of the hardware configuration of a mobile terminal according to an embodiment of the present invention. [Figure 6]FIG. 6 is a block diagram showing an example of a hardware configuration of a guidance device according to an embodiment of the present invention. [Figure 7] FIG. 7 is a block diagram showing an example of the hardware configuration of a signage terminal according to an embodiment of the present invention. [Figure 8] FIG. 8 is a block diagram showing an example of the hardware configuration of an automated gate apparatus according to an embodiment of the present invention. [Figure 9] FIG. 9 is a sequence diagram showing the operations of the remote examination terminal and the examination server in the information processing system according to one embodiment of the present invention. [Figure 10] FIG. 10 is a flowchart showing the operation of the remote examination of the examination server according to one embodiment of the present invention. [Figure 11] FIG. 11 is a sequence diagram showing the operations of the examination server and the mobile terminal in the information processing system according to one embodiment of the present invention. [Figure 12A] FIG. 12A is a schematic diagram illustrating an example of a guidance notice displayed on a mobile terminal according to an embodiment of the present invention. [Figure 12B] FIG. 12B is a schematic diagram illustrating an example of a guidance notice displayed on a mobile terminal according to an embodiment of the present invention. [Figure 13] FIG. 13 is a sequence diagram showing the operation of the examination server and the guidance device in the information processing system according to one embodiment of the present invention. [Figure 14A] FIG. 14A is a schematic diagram illustrating an example of a guidance notice projected by a guidance device according to an embodiment of the present invention. [Figure 14B] FIG. 14B is a schematic diagram illustrating an example of a guidance notice projected by a guidance device according to an embodiment of the present invention. [Figure 15] FIG. 15 is a sequence diagram showing the operations of the examination server and the signage terminal in the information processing system according to one embodiment of the present invention. [Figure 16A] FIG. 16A is a schematic diagram illustrating an example of a guidance notice displayed on a signage terminal according to an embodiment of the present invention. [Figure 16B]FIG. 16B is a schematic diagram illustrating an example of a guide notice displayed on a signage terminal according to an embodiment of the present invention. [Figure 17] FIG. 17 is a sequence diagram showing the operation of the screening server and the automated gate device in the information processing system according to one embodiment of the present invention. [Figure 18] FIG. 18 is a block diagram showing the configuration of an information processing device according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0011] [One embodiment] An information processing system, an information processing device, and an information processing method according to a first embodiment of the present invention will be described with reference to FIGS.

[0012] First, the configuration of the information processing system according to this embodiment will be described with reference to Figures 1 and 2. Figure 1 is a schematic diagram showing the overall configuration of the information processing system according to this embodiment. Figure 2 is a schematic diagram showing an immigration inspection area where automated gate devices and face-to-face inspection booths are installed.

[0013] As shown in Figure 1, the information processing system 1 according to this embodiment includes a remote examination terminal 10, an examination server 20, a mobile terminal 30 of a user U, a guidance device 40, a signage terminal 50, and an automated gate device 60.

[0014] The information processing system 1 according to this embodiment is a remote inspection system that performs immigration inspection as a remote inspection when a user U, who is planning to depart a first country by airplane from an airport DA of the first country and enter a second country from an airport AA of a second country different from the first country, enters the second country. Note that remote inspection means that immigration inspection is performed on a user U who is planning to enter the second country before the user reaches the immigration inspection area of ​​the second country.

[0015] The information processing system 1 is operated, for example, by an agency of the second country, such as an immigration control bureau that manages immigration into the second country, or by a contractor entrusted with the work by that agency. Foreigners enter the second country from a first foreign country for various purposes, such as tourism or business. In the second country, nationals and foreign residents depart for the first foreign country for various purposes, such as tourism, business, or returning home temporarily, and then the nationals and foreign residents who depart for the first country return and enter the country. Note that a foreigner is someone who does not have the nationality of the second country. The information processing system 1 remotely performs immigration inspections for users U, such as these, who enter the second country.

[0016] Specifically, for example, the information processing system 1 is operated by an institution such as the Immigration Bureau of Japan, which is the second country, and remotely performs immigration inspection for a user U entering Japan from a first country, which is a foreign country such as the United States. The first country may be a specific country or may include multiple countries.

[0017] The information processing system 1 may remotely perform immigration inspections not only for users U entering the country through an airport, but also for users U entering the country through a seaport or the like.

[0018] The remote screening terminal 10 is installed in a restricted area DA14 within the airport DA of the first country from which the user U is departing. The restricted area DA14 is an area that the user U can enter after completing immigration screening and receiving confirmation of departure when departing from the first country at the immigration screening area DA12 within the airport DA. The user U boards an aircraft bound for the second country from a boarding gate DA16 installed in the restricted area DA14. Note that if the first country is a country without immigration screening, the terms "immigration screening area" and "immigration screening" in this specification can be read as "security inspection area" and "security inspection," respectively.

[0019] For example, the remote inspection terminal 10 is installed in a lounge in the restricted area DA14, a waiting room near the boarding gate DA16, an aisle, etc. The lounge in which the remote inspection terminal 10 is installed is operated, for example, by an airline, a credit card company, an airport, etc. The number of remote inspection terminals 10 installed is not particularly limited, and may be one or more. Furthermore, the location where the remote inspection terminal 10 is installed is not particularly limited, and may be various locations in the restricted area DA14.

[0020] The examination server 20 is installed, for example, in a facility of an institution such as an immigration control bureau that manages immigration into the second country. The facility where the examination server 20 is installed may be, for example, a domestic facility in the second country, a domestic facility in the first country, or even a domestic facility in a country that is neither the first nor the second country. Note that the examination server 20 does not need to be a single server, but may be configured as a server group including multiple servers. For example, a server that performs some of the functions of the examination server 20 may be installed in the first country, and another server that performs the remaining functions of the examination server 20 may be installed in the second country.

[0021] The mobile terminal 30 is a terminal that is owned or carried by the user U. The mobile terminal 30 is not particularly limited, but may be, for example, a mobile information device such as a smartphone, a tablet terminal, or a mobile phone.

[0022] The guidance device 40 is installed in an aisle AA14, which is a place through which the user U passes before reaching immigration control AA16 at the airport AA of the second country where the user U is entering. The aisle AA14 where the guidance device 40 is installed is, for example, an aisle connecting the quarantine area AA12 and the immigration control AA16 at the airport AA. At the quarantine area AA12, quarantine is carried out for the user U who is planning to enter the country. At the immigration control AA16, immigration control is carried out for the user U who is planning to enter the country. The guidance device 40 is installed, for example, on the ceiling, wall, etc. of the aisle AA14, and projects a guide notice onto the floor F of the aisle AA14, as described below, to guide the user U to a specific lane at the immigration control AA16. The number of guidance devices 40 to be installed is not particularly limited, and may be one or more. The installation location of the guidance device 40 is also not particularly limited, and may be, for example, in various locations from the international arrival gate at the airport AA of the second country to the immigration control AA16.

[0023] The signage terminal 50 is installed in a location within the airport AA of the second country through which the user U passes before reaching the immigration checkpoint AA16. The signage terminal 50 is installed, for example, in the passageway AA14, the entrance to the immigration checkpoint AA16, or the like. The signage terminal 50 displays a guide notice as described below and guides the user U to a specific lane at the immigration checkpoint AA16. The number of signage terminals 50 installed is not particularly limited, and may be one or more. The installation location of the signage terminal 50 is also not particularly limited, and may be installed in various locations from the international arrival gate at the airport AA of the second country to the immigration checkpoint AA16, for example.

[0024] The automated gate device 60 is installed at the immigration inspection area AA16. As shown in FIG. 2, the immigration inspection area AA16 is provided with a remote inspection-only lane L1 for users U who have undergone remote inspection, and a general lane L2 for users U who have not undergone remote inspection. The automated gate device 60 is installed at the exit of the remote inspection-only lane L1. Meanwhile, at the exit of the general lane L2, an inspection booth B is installed where an immigration inspector E conducts face-to-face inspection. The number of automated gate devices 60 to be installed is not particularly limited, and may be one or more. The number of inspection booths B is also not particularly limited, and may be one or more.

[0025] As shown in Figure 1, multiple surveillance cameras 70 are installed at various locations within airport DA in the first country. For example, a surveillance camera 70 is installed in restricted area DA14 of airport DA in the first country to capture images of remote examination terminal 10 and its surroundings. Additionally, multiple surveillance cameras 80 are installed at various locations within airport AA in the second country.

[0026] The remote examination terminal 10, examination server 20, guide device 40, signage terminal 50, automated gate device 60, and surveillance cameras 70 and 80 are connected to a network NW. The network NW is composed of a WAN (Wide Area Network), a LAN (Local Area Network), a mobile communication network, etc. The LANs that make up the network NW include the on-site network of airport DA in the first country, the on-site network of airport AA in the second country, etc. The mobile terminal 30 can be connected to the network NW, for example, wirelessly.

[0027] The remote examination terminal 10 and the examination server 20 are capable of communicating with each other via a network NW. The examination server 20 and the mobile terminal 30 are capable of communicating with each other via a network NW. The examination server 20 and the guide device 40 are capable of communicating with each other via a network NW. The examination server 20 and the signage terminal 50 are capable of communicating with each other via a network NW. The examination server 20 and the automated gate device 60 are capable of communicating with each other via a network NW.

[0028] Next, each component of the information processing system 1 according to this embodiment will be further described with reference to FIGS.

[0029] First, the configuration of the remote examination terminal 10 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the hardware configuration of the remote examination terminal 10.

[0030] The remote inspection terminal 10 is an information processing device that acquires user information, which is information necessary for immigration inspection when entering a second country, from a user U who has completed immigration inspection at an airport DA in a first country and has been permitted to depart. In other words, the remote inspection terminal 10 is an information acquisition terminal that acquires user information about the user U from the user U after immigration inspection in the first country and before boarding for the second country. The remote inspection terminal 10 is installed at the airport DA in the first country, for example, in a lounge in the restricted area DA14 or in a boarding waiting room near the boarding gate DA16. The remote inspection terminal 10 is configured, for example, as a kiosk terminal that is operated by the user U himself.

[0031] The remote inspection terminal 10 does not necessarily have to be installed in the restricted area DA14 of the airport DA of the first country. For example, the remote inspection terminal 10 may be installed or movably mounted on an aircraft capable of connecting to the network NW of the aircraft bound for the second country. In other words, the remote inspection terminal 10 only needs to acquire user information about the user U from the user U after the departure inspection in the first country and before the user U arrives in the second country.

[0032] 3, the remote examination terminal 10 has a CPU (Central Processing Unit) 102, a RAM (Random Access Memory) 104, a storage device 106, an input device 108, and a display 110. The remote examination terminal 10 further has a medium reading device 112, a camera 114, a fingerprint scanner 116, an issuing device 118, and a communication unit 120. The CPU 102, RAM 104, storage device 106, input device 108, display 110, medium reading device 112, camera 114, fingerprint scanner 116, issuing device 118, and communication unit 120 are connected to a bus line 122.

[0033] The CPU 102 operates by executing a program stored in the storage device 106, and functions as a control unit that controls the overall operation of the remote examination terminal 10. The CPU 102 also executes an application program stored in the storage device 106 to perform various processes as the remote examination terminal 10. The RAM 104 provides a memory area necessary for the operation of the CPU 102.

[0034] More specifically, CPU 102 functions as an acquisition control unit that controls the acquisition of various information related to user U from user U who uses remote examination terminal 10. That is, CPU 102 as an acquisition control unit controls the acquisition of information from user U's passport by medium reading device 112. CPU 102 also controls the acquisition of information from user U's airline ticket medium by medium reading device 112. CPU 102 also controls the acquisition of a facial image, which is biometric information of user U, by camera 114. CPU 102 also controls the acquisition of a fingerprint image, which is biometric information of user U, by fingerprint scanner 116. Medium reading device 112, camera 114, and fingerprint scanner 116 each function as an information acquisition unit that acquires various information included in user U's user information.

[0035] The CPU 102 can control the operation of the camera 114 and the fingerprint scanner 116 so that the camera 114 takes an image of the face of the user U while the fingerprint scanner 116 reads the fingerprint of the user U. This allows the CPU 102 to cause the camera 114 and the fingerprint scanner 116 to acquire, in parallel, multiple types of biometric information of the user U, namely, a facial image and a fingerprint image. In this way, the remote examination terminal 10 can prevent as much as possible spoofing of the user U by non-biometric persons by acquiring multiple types of biometric information of the user U in parallel.

[0036] Furthermore, CPU 102 functions as an impersonation determination unit that determines whether or not user U is being impersonated based on the acquisition status of user U's biometric information. CPU 102 as an impersonation determination unit determines that user U is not being impersonated if both a facial image of user U photographed by camera 114 and a fingerprint image of user U read by fingerprint scanner 116 are acquired within a time limit. On the other hand, CPU 102 determines that user U is being impersonated if either a facial image or a fingerprint image of user U is not acquired within the time limit. The time limit is, for example, the time from when the passport or airline ticket medium is read by medium reading device 112, and is set in advance taking into consideration the time required for user U's operations, etc.

[0037] For example, even if a facial image is acquired by camera 114, if a fingerprint image is not acquired by fingerprint scanner 116, there is a possibility that user U is being spoofed based on a facial photograph, a facial image displayed on a tablet, etc. In such a case, CPU 102 can determine that spoofing is occurring.

[0038] Furthermore, the CPU 102 can analyze video of the remote examination terminal 10 and its surroundings captured by the surveillance camera 70, and determine whether or not user U is being spoofed based on the results of the video analysis. To determine whether or not user U is being spoofed, the CPU 102 can analyze video of the remote examination terminal 10 and its surroundings captured by the surveillance camera 70 between the time of capturing the image by the camera 114 and the time of reading by the fingerprint scanner 116, as the acquisition status of user U's biometric information. Based on the results of the video analysis, the CPU 102 can determine that user U is being spoofed, for example, when multiple people are detected in front of the remote examination terminal 10, or when unnatural behavior of user U using the remote examination terminal 10 is detected.

[0039] When it is determined that spoofing is occurring, CPU 102 can execute alert processing. As the alert processing, CPU 102 can, for example, display an alert indicating the possibility of spoofing occurring on display 110 or output an audio message from a speaker (not shown). Furthermore, as the alert processing, CPU 102 can, for example, transmit an alert indicating the possibility of spoofing occurring to a business terminal, which is an information terminal used by an employee, an external server, or the like via network NW.

[0040] On the other hand, if it is determined that impersonation has not occurred, the CPU 102 functions as an information providing unit that transmits and provides user information, which is information about user U obtained from user U using the remote examination terminal 10, to the examination server 20 via the network NW. The CPU 102 as an information providing unit provides the user information of user U to the examination server 20 for the immigration examination of the second country for user U. The user information of user U transmitted by the CPU 102 to the examination server 20 includes user U's personal information, face information, fingerprint information, and boarding information, which are associated with each other. Some or all of the user information of user U provided to the examination server 20 is used for the immigration examination of the second country for user U, which is carried out by the examination server 20.

[0041] The personal information is information about the user U, such as the user U's name, nationality, gender, date of birth, etc. The personal information also includes passport information such as the user U's passport number, passport issuing country, passport issue date, and passport expiration date. The personal information is obtained from the user U's passport by the medium reading device 112.

[0042] The facial information is biometric information of user U, and includes a photographed facial image of user U and a passport facial image of user U. The photographed facial image is a facial image of user U photographed by camera 114. The passport facial image is a facial image of user U obtained from user U's passport by medium reading device 112. The facial information does not have to be the facial image itself, but may be facial feature amounts, which are feature amounts extracted from the facial image.

[0043] The CPU 102 can also function as a matching unit that matches the photographed face image with the passport face image. In this case, the CPU 102 can include matching information indicating the result of matching the photographed face image with the passport face image in the user information, instead of or in addition to the face information. When matching the photographed face image with the passport face image, the CPU 102 functioning as a matching unit can match both face images by matching the facial feature amounts extracted from the photographed face image with the facial feature amounts extracted from the passport face image.

[0044] The fingerprint information is biometric information of user U and includes a read fingerprint image of user U. The read fingerprint image is a fingerprint image read by fingerprint scanner 116. Furthermore, if user U's passport is an integrated circuit (IC) passport and user U's fingerprint image is recorded on the IC passport, the fingerprint information can also include a passport fingerprint image, which is a fingerprint image read from the IC passport by medium reading device 112. The read fingerprint image and passport fingerprint image may each be fingerprint images of one or more fingers of one hand, or fingerprint images of two or more fingers of both hands. The fingerprint information does not have to be the fingerprint image itself, but may also be fingerprint features, which are features extracted from the fingerprint image.

[0045] CPU 102 can also function as a matching unit that matches the read fingerprint image with the passport fingerprint image. In this case, CPU 102 can include matching information indicating the result of matching the read fingerprint image with the passport fingerprint image in the user information, instead of or in addition to the fingerprint information. When matching the read fingerprint image with the passport fingerprint image, CPU 102 functioning as a matching unit can match the two fingerprint images by matching fingerprint feature amounts extracted from the read fingerprint image with fingerprint feature amounts extracted from the passport fingerprint image.

[0046] The CPU 102 may include both facial information and fingerprint information in the user information as biometric information for verifying the identity of the user U, or may include either facial information or fingerprint information in the user information. As will be described later, the examination server 20 can verify the identity of the user U using at least one of the facial information and fingerprint information included in the user information.

[0047] Furthermore, the CPU 102 may include biometric information of the user U other than face information and fingerprint information in the user information as biometric information for verifying the identity of the user U. In this case, the remote examination terminal 10 has a biometric information acquisition device that acquires biometric information other than face information and fingerprint information.

[0048] The boarding information is information about the flight that user U plans to take, such as the airline, flight number, departure point, arrival point, departure date and time, arrival date and time, seat type, etc. The boarding information is obtained from user U's airline ticket medium by the medium reading device 112.

[0049] The user information of the user U sent to the examination server 20 is registered in the user information database (DB) 206c if the examination server 20 determines that the user U is a target for remote examination.

[0050] Furthermore, the CPU 102 functions as a notification unit that executes notification processing for the user U using the remote examination terminal 10 in response to the examination information or ineligible notification received from the examination server 20, as will be described later. The CPU 102 as a notification unit can notify the user U of the notification content corresponding to the examination information or ineligible notification by displaying it on the display 110. The CPU 102 can also notify the user U of the notification content corresponding to the examination information or ineligible notification by audio output from a speaker (not shown).

[0051] When the CPU 102 receives the examination information, it can notify the user U by displaying on the display 110 or outputting by voice that the remote examination has been completed. Furthermore, in this case, the CPU 102 can also notify the user U by displaying on the display 110 or outputting by voice the specific results of the remote examination, depending on whether the received examination information is entry permission information, entry denial information, or face-to-face examination information.

[0052] In addition, when the CPU 102 receives reception completion information from the examination server 20 instead of examination information, it can notify the user U by displaying on the display 110 or outputting by voice that the user information to be used for the remote examination has been received.

[0053] On the other hand, when the CPU 102 receives the ineligible notification, it can notify the user U that the user U is ineligible for the remote examination by displaying on the display 110 or outputting a voice message.

[0054] The CPU 102 also functions as a display control unit that causes the display 110 to display screens for guidance, notifications, etc. for the user U. For example, the CPU 102 as a display control unit causes the display 110 to display a guidance screen that provides guidance on how to use the remote examination terminal 10. The user U can operate the remote examination terminal 10 himself / herself in accordance with the guidance screen displayed on the display 110. For example, the CPU 102 also causes the display 110 to display various notifications for the user U.

[0055] The CPU 102 also functions as an issuance control unit that causes the issuing device 118 to issue a ticket such as a piece of paper on which an inspection completion code is printed, based on the inspection information received from the inspection server 20. The inspection completion code is a code that includes inspection completion information, which is information indicating that remote inspection as immigration inspection has been completed for user U, and is, for example, a two-dimensional code such as a QR code (registered trademark) or a one-dimensional code such as a barcode. The inspection completion code may include personal identification information of user U. The inspection completion code may be any code symbol that can include information.

[0056] The ticket with the inspection completion code printed on it is issued to user U who uses the remote inspection terminal 10 and is held by user U until he or she enters the second country. As will be described later, user U uses the ticket with the inspection completion code printed on it at the automated gate device 60 when entering the second country.

[0057] The inspection completion code of the ticket issued by the issuing device 118 may, for example, be a one-time code with an expiration date set thereon and valid only once. The expiration date of the inspection completion code may, for example, be the date and time of user U's arrival in the second country included in the boarding information, plus an amount of time taking into account the time required for various procedures before entering the second country, arrival delays, etc. By making the inspection completion code a one-time code with an expiration date set thereon, high security can be ensured. The inspection completion code does not necessarily have to be a one-time code with an expiration date set thereon and valid only once, and may also be a one-time code with an expiration date set thereon or a one-time code valid only once.

[0058] In addition, instead of issuing a ticket with an examination completion code printed on it by the issuing device 118, the mobile terminal 30 can also be configured to display a similar examination completion code on the display 310 of the mobile terminal 30 of the user U, as described below.

[0059] The storage device 106 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 106 stores programs executed by the CPU 102, data referenced by the CPU 102 when the programs are executed, etc.

[0060] The input device 108 is, for example, a touch panel incorporated in the display 110. The input device 108 functions as an input unit that accepts input of instructions from the user U. The user U can input various information to the remote examination terminal 10 and instruct the execution of processing via the input device 108.

[0061] The display 110 functions as a display unit that displays various screens to the user U who uses the remote examination terminal 10. For example, the display 110 displays a guidance screen that guides the user U on how to use the remote examination terminal 10, a notification screen for the user U, etc.

[0062] The medium reading device 112 functions as an information acquisition unit that reads the passport or airline ticket medium of the user U and acquires information recorded on the passport or airline ticket. The airline ticket medium is, for example, a paper airline ticket or a mobile terminal 30 that displays an e-ticket receipt. The medium reading device 112 is composed of, for example, a code reader, an image scanner, a contactless IC (Integrated Circuit) reader, an OCR (Optical Character Reader) device, etc., and acquires information from various media held over the reading unit.

[0063] For example, the medium reading device 112 reads and acquires the personal information including the passport information of user U displayed on the face of the passport using an OCR device. Also, for example, the medium reading device 112 reads and acquires the passport face image of user U displayed on the face of the passport using an image scanner. Also, in the case of an ePassport, the medium reading device 112 reads and acquires the personal information including the passport information of user U, the passport face image, etc. recorded in the IC chip of the ePassport using a contactless IC reader. Note that the biometric information of user U recorded and included in the passport is not limited to a face image, and may be other biometric information such as a fingerprint image. The medium reading device 112 can acquire the biometric information of user U included in the passport.

[0064] Furthermore, for example, the medium reading device 112 reads the barcode or QR code (registered trademark) displayed on the airline ticket medium using a code reader, and acquires the boarding information of the user U from the airline ticket medium.

[0065] The remote examination terminal 10 can acquire boarding information not only from the airline ticket medium but also by other methods. For example, the CPU 102 can inquire about airline ticket reservation and purchase information based on the credit card number, reservation number, confirmation number, etc. of the user U input via the input device 108 by the user U, and acquire the boarding information of the user U from the airline server.

[0066] The camera 114 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U who uses the remote examination terminal 10. The camera 114 is, for example, a photographing device such as a digital camera that captures a video or still image of the face of the user U in front of the remote examination terminal 10, and acquires a photographed facial image that is a facial image of the user U from the captured video or still image. The camera 114 acquires the photographed facial image by photographing the face of the user U who is having his fingerprint read by the fingerprint scanner 116 under the control of the CPU 102. In this way, the camera 114 acquires the facial image of the user U in parallel with the acquisition of the fingerprint image of the user U by the fingerprint scanner 116.

[0067] The fingerprint scanner 116 functions as a biometric information acquisition unit that acquires a fingerprint image of the user U as biometric information of the user U who uses the remote examination terminal 10. The fingerprint scanner 116 is composed of, for example, two fingerprint scanners, and reads the fingerprints of two fingers on both hands, such as the index fingers, placed with their bellies facing towards each other on the reading surface, thereby acquiring a fingerprint image of each.

[0068] In addition to the camera 114 and fingerprint scanner 116, the remote examination terminal 10 may have a biometric information acquisition device according to the biometric information to be included in the user information.

[0069] The issuing device 118, under the control of the CPU 102, prints an examination completion code including examination completion information indicating that remote immigration examination for user U has been completed on a ticket such as a piece of paper, and issues a ticket on which the examination completion code is printed.

[0070] The communication unit 120 is connected to the network NW and transmits and receives data via the network NW. The communication unit 120 communicates with the examination server 20 and the like under the control of the CPU 102.

[0071] In this way, the remote examination terminal 10 is configured.

[0072] Next, the configuration of the examination server 20 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the hardware configuration of the examination server 20.

[0073] The examination server 20 is an information processing device that performs a remote examination of user U, such as immigration examination of a second country when user U enters the second country, based on the user information of user U received from the remote examination terminal 10. The examination server 20 can complete the remote examination before user U arrives in the second country. The functions of the examination server 20 may be realized by a single server or by multiple servers.

[0074] 4, the examination server 20 includes a CPU 202, a RAM 204, a storage device 206, and a communication unit 208. The CPU 202, the RAM 204, the storage device 206, and the communication unit 208 are connected to a bus line 210.

[0075] The CPU 202 operates by executing a program stored in the storage device 206, and functions as a control unit that controls the overall operation of the examination server 20. The CPU 202 also executes an application program stored in the storage device 206 to perform various processes as the examination server 20. The RAM 204 provides a memory area necessary for the operation of the CPU 202.

[0076] More specifically, the CPU 202 functions as an information management unit that records and manages travel history information, which is information related to the traveler's entry and exit into the second country, in the storage device 206. As an information management unit, the CPU 202 registers and manages the travel history information in a travel history information DB 206a stored in the storage device 206. The CPU 202 can use the travel history information to determine whether or not the user U is subject to remote screening. The travel history information of the traveler is transmitted to the screening server 20, for example, from a management server that manages the traveler's entry and exit into the second country. The CPU 202 registers and manages the transmitted travel history information in the travel history information DB 206a.

[0077] The travel history information DB 206a may be stored in a storage device of an external server, such as an administrative server that manages immigration control for travelers. In this case, the CPU 202 of the examination server 20 can access the travel history information DB 206a of the external server via the network NW to acquire the travel history information.

[0078] The CPU 202 also functions as a list management unit that records and manages a person list including a person whitelist (WL) and a blacklist in the storage device 206. As a list management unit, the CPU 202 registers and manages the person list in a person list DB 206b stored in the storage device 206. The blacklist is a list in which personal information, including biometric information, of blacklist people who should be denied entry into the second country is registered. The person WL is a list in which personal information, including biometric information, of people who should be allowed entry is registered. The CPU 202 uses the person list in remote screening. Note that the person list does not necessarily have to include both the person WL and the blacklist, and may include either the person WL or the blacklist. The CPU 202 can omit comparing a person WL not included in the person list with the blacklist or the blacklist.

[0079] Furthermore, the CPU 202 functions as an eligibility determination unit that determines whether or not the user U is a target for remote examination based on the user information of the user U received from the remote examination terminal 10. The CPU 202 as an eligibility determination unit can determine whether or not the user U is a target for remote examination based on the user information of the user U in accordance with various determination criteria. Specific examples of the determination criteria are as follows:

[0080] First, the CPU 202 can determine whether or not the user U is eligible for remote screening based on travel history information, which is information regarding the user U's travel to a second country identified from the user information of the user U. For example, the CPU 202 can determine that the user U is eligible for remote screening if the number of times the user U has traveled to a second country in a predetermined period immediately prior to a reference date, such as the departure date or arrival date, is equal to or greater than a threshold, and can determine that the user U is not eligible if the number of times is less than the threshold. This determination criterion determines that the user U whose number of travels is equal to or greater than the threshold is a highly reliable user and is eligible for remote screening. To make this determination, the CPU 202 can obtain the departure date, arrival date, etc. from the boarding information included in the user information of the user U. The CPU 202 can also extract travel history information associated with the user U's personal identification information from the travel history information DB 206a stored in the storage device 206 and calculate the number of times the user U has traveled to a second country in a predetermined period.

[0081] The CPU 202 can obtain, for example, a passport number from the identity information included in the user information of the user U as the personal identification information of the user U, which is information that uniquely identifies the user U. The CPU 202 can also obtain a combination of two or more items such as the name, nationality, and date of birth from the identity information as the personal identification information of the user U. In addition, the CPU 202 can use information that can uniquely identify the user U, which is included in the user information, as the personal identification information of the user U.

[0082] Furthermore, if user U's passport is an ePassport, the same travel history information of user U as described above may be recorded on the IC chip of the ePassport. In this case, the CPU 102 of the remote examination terminal 10 can transmit the travel history information read from the user's ePassport by the media reading device 112, along with the user information of user U, to the examination server 20 via the network NW. Based on the travel history information received from the remote examination terminal 10, the CPU 202 of the examination server 20 can determine whether user U is a target for remote examination, in the same manner as described above.

[0083] The CPU 202 can also determine whether or not the user U is a target for remote inspection based on the time from the boarding date and time in the boarding information included in the user information of the user U to the boarding time specified. For example, the CPU 202 can determine that the user U is a target for remote inspection if the time from the time the user information was acquired by the remote inspection terminal 10 to the boarding time is equal to or less than the long-term threshold, and can determine that the user U is not a target for remote inspection if the time exceeds the long-term threshold. For example, the CPU 202 can determine that the user U is a target for remote inspection if the time from the time the user information was acquired by the remote inspection terminal 10 to the boarding time is equal to or greater than the short-term threshold, and can determine that the user U is not a target for remote inspection if the time is less than the short-term threshold. The long-term threshold is set longer than the short-term threshold. These determination criteria are used to exclude a user U who is too long or too short from the time of use of the remote inspection terminal 10 to the boarding time as a low-reliability user exhibiting suspicious or unnatural behavior from the remote inspection. In this way, the targets for remote inspections that do not involve face-to-face inspection by the inspector E can be narrowed down to more reliable users U.

[0084] Furthermore, the CPU 202 can determine whether or not the user U is a target for remote screening based on the airline used by the user U, which is obtained from the boarding information included in the user information of the user U. For example, the CPU 202 can determine that the user U is a target for remote screening if the airline used by the user U is an FSC (Full Service Carrier), and can determine that the user U is not a target for remote screening if the airline used by the user U is an LCC (Low Cost Carrier). For example, the CPU 202 can determine that the user U is a target for remote screening if the airline used by the user U is an airline of a second country that operates the information processing system 1, and can determine that the user U is not a target for remote screening if the airline is an airline of a country other than the second country. These determination criteria determine whether or not the user U is a target for remote screening based on the attributes of the airline used by the user U, which can be used as information for estimating the trustworthiness of the user U. In this way, the targets for remote screening, which do not involve face-to-face screening by the inspector E, can be narrowed down to more reliable users U.

[0085] Furthermore, the CPU 202 can determine whether or not the user U is a target for remote screening based on the type of seat on the aircraft used by the user U, which is obtained from the boarding information included in the user information of the user U. For example, the CPU 202 can determine that the user U is a target for remote screening if the type of seat on the aircraft used by the user U is first class or business class, and can determine that the user U is not a target for remote screening if the type of seat is economy class. This criterion determines whether or not the user U is a target for remote screening based on the type of seat, which can be used as information to infer the trustworthiness of the user U. In this way, the targets for remote screening, which do not involve face-to-face screening by the screener E, can be narrowed down to more reliable users U.

[0086] Furthermore, the CPU 202 can determine whether or not user U is a target for remote inspection based on a preset capacity for the aircraft to be subject to remote inspection. The capacity for the aircraft to be subject to remote inspection can be preset for each aircraft, for example, according to the aircraft's scheduled flight time, flight distance, etc. Specifically, the longer the scheduled flight time or flight distance, the larger the capacity can be set. By setting the capacity in this manner, it is possible to ensure that the remote inspection is completed before user U arrives at immigration inspection station AA16 of the second country. The CPU 202 can determine that user U is a target for remote inspection if the preset capacity for the aircraft used by user U, obtained from the boarding information included in the user information of user U, has not been reached, and can determine that user U is not a target for remote inspection if the capacity has been reached.

[0087] Furthermore, CPU202 can determine whether user U is a target of remote screening based on whether user U is a pre-registered person who has previously registered to use remote screening. That is, CPU202 can determine that user U is a target of remote screening if user U is a pre-registered person. In this case, information about pre-registered people is registered and managed in a pre-registration information DB, which is a DB accessible to CPU202. CPU202 can determine whether user U is a pre-registered person by referring to the pre-registration information DB.

[0088] Furthermore, the CPU 202 can determine whether or not the user U is a target for remote inspection based on the behavior of the user U at the airport DA in the first country. The behavior of the user U at the airport DA in the first country is, for example, captured by a surveillance camera 70 and recorded as video on a monitoring server (not shown). The CPU 202 can access the monitoring server and identify the behavior of the user U in the video recorded on the monitoring server using biometric information, such as facial information, of the user U included in the user information. For example, if the CPU 202 determines that the identified behavior is unnatural or suspicious, such as staying in a specific location for a long time or behaving suspiciously in a store such as a duty-free shop, the CPU 202 can determine that the user U is not a target for remote inspection.

[0089] In addition to the above, the CPU 202 can also determine whether or not the user U is a target of remote screening based on the identity information included in the user information of the user U.

[0090] The CPU 202 can determine whether or not the user U is a target of the remote examination using some or all of the above-mentioned criteria.

[0091] If the CPU 202 determines that the user U is not eligible for the remote examination, the CPU 202 generates an ineligible notification indicating that the user U is not eligible for the remote examination. The CPU 202 transmits the generated ineligible notification to the remote examination terminal 10.

[0092] The CPU 202 also functions as an information management unit that records and manages the user information of the user U who has been determined to be a target of the remote examination in the storage device 206. The CPU 202 as an information management unit registers and manages the user information of the user U who has been received from the remote examination terminal 10 in the user information DB 206c stored in the storage device 206.

[0093] The CPU 202 also functions as an inspection unit that performs a remote immigration inspection of user U who is determined to be a target of remote inspection when entering a second country. The CPU 202 as an inspection unit further functions as a biometric matching unit that performs biometric matching for identity verification using biometric information of user U included in the user information of user U, and a list matching unit that matches user U with a person list including person WL and a blacklist.

[0094] The CPU 202, which serves as a biometric matching unit, performs biometric matching using biometric information included in the user information of the user U to verify the identity of the user U. For example, the CPU 202 can verify the identity of the user U by performing face matching, which matches a captured face image included in the user information with a passport face image also included in the user information. When matching the captured face image with the passport face image, the CPU 202 can match both face images by matching facial features extracted from the captured face image with facial features extracted from the passport face image. Furthermore, for example, the CPU 202 can verify the identity of the user U by performing fingerprint matching, which matches a read fingerprint image included in the user information with a passport fingerprint image also included in the user information. When matching the read fingerprint image with the read fingerprint image, the CPU 202 can match both fingerprint images by matching fingerprint features extracted from the read fingerprint image with fingerprint features extracted from the passport fingerprint image.

[0095] In order to verify the identity of the user U, the CPU 202 may perform both face matching and fingerprint matching, or may perform either one of them.

[0096] The CPU 202 determines that identity verification of user U is successful if the biometric matching results in a match, and determines that identity verification of user U is unsuccessful if the biometric matching results in a match. A case in which the biometric matching results in a match is when both face matching and fingerprint matching are performed and both face matching and fingerprint matching are matched, or when either face matching or fingerprint matching is performed and one of face matching and fingerprint matching is matched. A case in which the face matching results in a match is when the matching score indicating the degree of match or similarity between the captured face image and the passport face image exceeds a predetermined threshold, indicating that both face images have a high degree of match or similarity. A case in which the fingerprint matching results in a match is when the matching score indicating the degree of match or similarity between the read fingerprint image and the passport fingerprint image exceeds a predetermined threshold, indicating that both fingerprint images have a high degree of match or similarity.

[0097] Furthermore, biometric information such as a facial image and fingerprint image of user U may be pre-registered in association with the personal identification information of user U in a database accessible by the examination server 20, based on a prior application or the like. In this case, the CPU 202 can verify the identity of user U by comparing the biometric information included in the user information of user U with the biometric information pre-registered in association with the personal identification information of user U.

[0098] The CPU 202, which serves as a list comparison unit, compares information that can identify the user U, which is included in the user information of the user U, with similar information of multiple people included in the person WL registered in the person list DB 206b and the blacklist, in a 1:N ratio. Information that can identify the user U, which is included in the user information, is, for example, facial information, fingerprint information, personal information, passport information, etc. As a result, the CPU 202 determines whether the user U corresponds to a person registered in the person WL or the blacklist.

[0099] In addition, the CPU 202 as the inspection unit generates entry permission information, entry denial information, or face-to-face inspection required information as inspection information, which is information indicating the results of the remote inspection, based on the results of biometric matching and matching with the person list, as follows.

[0100] If the CPU 202 successfully verifies the identity of user U through biometric matching and user U corresponds to person WL, it generates entry permission information as screening information, which is information indicating that user U is permitted to enter the second country.

[0101] In addition, the CPU 202 generates entry permission information as screening information even if the identity of the user U is successfully verified by biometric matching and the user U does not correspond to a person on the person WL and does not correspond to a person on the blacklist.

[0102] Furthermore, if the CPU 202 successfully verifies the identity of user U through biometric matching but finds that user U is on the blacklist, it generates entry denial information indicating that user U will be denied entry into the second country. In this case, the CPU 202 can also generate, as the examination information, face-to-face examination required information indicating that user U requires a face-to-face examination by examiner E at examination booth B. This allows for careful consideration when refusing entry.

[0103] On the other hand, if the CPU 202 fails to verify the identity of user U through biometric matching, it generates, as the screening information, face-to-face screening required information, which is information indicating that user U requires a face-to-face screening by inspector E at screening booth B. Note that even if the CPU 202 successfully verifies the identity of user U through biometric matching but user U is a person on the blacklist, it can also generate face-to-face screening required information instead of entry denial information.

[0104] Furthermore, the CPU 202 can complete the remote inspection at the latest by the time the user U arrives at immigration inspection area AA16 at the airport AA of the second country. For example, the CPU 202 can complete the remote inspection while the user U, who has used the remote inspection terminal 10, remains in front of the remote inspection terminal 10. Also, for example, the CPU 202 can complete the remote inspection by the arrival date and time of the user U's arrival in the second country. The CPU 202 can obtain the arrival date and time from the boarding information included in the user information of the user U.

[0105] Furthermore, the CPU 202 functions as an information management unit that records and manages the screening information generated as described above in the storage device 206. As an information management unit, the CPU 202 registers and manages the screening information in the screening information DB 206d stored in the storage device 206. The CPU 202 associates the screening information of the user U with information that can uniquely identify the user U, such as personal identification information or face information, included in the user information, or with the user information of the user U itself, and registers the information in the screening information DB 206d.

[0106] The CPU 202 also functions as an information transmission unit that transmits the examination information generated for the user U to the remote examination terminal 10. If the remote examination is not completed while the user U remains in front of the remote examination terminal 10, the CPU 202 can transmit reception completion information, which is information indicating that the user information to be used for the remote examination has been received, to the remote examination terminal 10 instead of the examination information.

[0107] Furthermore, when the CPU 202 receives a notification request for a notification regarding a remote examination from the mobile terminal 30, the guide device 40, or the signage terminal 50, it functions as a notification generation unit that generates a notification regarding a remote examination depending on the presence or absence of examination information for the user U. The CPU 202 as a notification generation unit generates a notification regarding a user U using the mobile terminal 30 that sent the notification request, or the user U detected by the guide device 40 or the signage terminal 50 that sent the notification request, depending on the presence or absence of examination information.

[0108] Based on the personal identification information of the user U received from the mobile terminal 30 together with the notification request, the CPU 202 can search the examination information DB 206d for examination information associated with this personal identification information.

[0109] Furthermore, based on the facial information of user U received together with the guidance notification request from the guiding device 40, the CPU 202 can search the screening information DB 206d for screening information associated with facial information that matches this facial information. As will be described later, the facial information transmitted from the guiding device 40 is a facial image of user U detected and photographed by the camera 408 of the guiding device 40 or facial features extracted from the facial image. When biometric information such as facial information and fingerprint information matches, it means that the matching score, which indicates the degree of match or similarity between one piece of biometric information and another piece of biometric information, exceeds a predetermined threshold, and both pieces of biometric information show a high degree of match or similarity.

[0110] Furthermore, based on the facial information of user U received together with the notification request from the signage terminal 50, the CPU 202 can search the screening information DB 206d for screening information associated with facial information that matches this facial information. As will be described later, the facial information transmitted from the signage terminal 50 is a facial image of user U detected and photographed by the camera 510 of the signage terminal 50 or facial feature amounts extracted from the facial image.

[0111] If the search results in the discovery of examination information for user U in the examination information DB 206d, the CPU 202 generates a notice for users who have already been examined, indicating that the remote examination has been completed. The CPU 202 can generate a notice that explicitly or directly indicates that the remote examination has been completed, or can generate a notice that implicitly or indirectly indicates that the remote examination has been completed. For example, the CPU 202 can generate a notice that implicitly or indirectly indicates that the remote examination has been completed, guiding user U to the remote examination-only lane L1 and then to the automated gate device 60.

[0112] Furthermore, when screening information for user U is found in the screening information DB206d, the CPU202 can generate a guide notice for users who have already been screened, including the content indicated by the screening information, depending on whether the screening information is entry permission information, entry denial information, or face-to-face screening information. That is, when the screening information is entry permission information, the CPU202 can generate a guide notice that also indicates that entry is permitted for user U. When the screening information is entry denial information, the CPU202 can generate a guide notice that also indicates that entry is denied for user U. When the screening information is face-to-face screening information, the CPU202 can generate a guide notice that also indicates that face-to-face screening by inspector E at screening booth B is required for user U.

[0113] In addition, when the examination information is entry denial information or face-to-face examination information, the CPU 202 can also generate a guidance notice that guides the user U to the general lane L2, unlike the above.

[0114] On the other hand, if the search results in no screening information being found for user U in the screening information DB 206d, the CPU 202 generates a guidance notice for users who have not yet been screened, indicating that remote screening has not been performed. The CPU 202 can generate a guidance notice that explicitly or directly indicates that remote screening has not been performed, or can generate a guidance notice that implicitly or indirectly indicates that remote screening has not been performed. For example, the CPU 202 can generate a guidance notice that implicitly or indirectly indicates that remote screening has not been performed, guiding the user to the general lane L2.

[0115] If the examination information for user U does not exist in the examination information DB 206d, the user U is either not using the remote examination terminal 10 or is using the remote examination terminal 10 but has been determined to be ineligible for remote examination. Therefore, in this case, it is not necessarily necessary to explicitly or directly indicate that remote examination is not being performed, and it is sufficient for the CPU 202 to generate a guidance notice guiding user U to the general lane L2.

[0116] The CPU 202 functions as a transmitting unit that transmits the guidance notification for a screened or unscreened product generated as described above via the network NW to the mobile terminal 30, the guide device 40, or the signage terminal 50 that transmitted the guidance notification request. The CPU 202 can transmit the guidance notification for a screened or unscreened product to the mobile terminal 30, the guide device 40, or the signage terminal 50 in response to the guidance notification request transmitted from the mobile terminal 30, the guide device 40, or the signage terminal 50.

[0117] Furthermore, when the CPU 202 receives biometric information of a user U attempting to pass through the automated gate device 60 from the automated gate device 60, the CPU 202 functions as a biometric matching unit that performs biometric matching using the received biometric information to verify the identity of the user U. The CPU 202 as a biometric matching unit performs a 1:N comparison between the biometric information received from the automated gate device 60 and the biometric information included in the user information registered in the user information DB 206c. The biometric information transmitted from the automated gate device 60 is, for example, a facial image of the user U detected and captured by a camera that is the biometric information acquisition device 614 of the automated gate device 60, or facial features extracted from the facial image, as will be described later. The biometric information may also be a fingerprint image of the user U read and acquired by a fingerprint scanner that is the biometric information acquisition device 614 of the automated gate device 60, or fingerprint features extracted from the fingerprint image.

[0118] If, as a result of biometric matching, user information including biometric information that matches the biometric information received from the automated gate device 60 is found in the user information DB 206c, the CPU 202 determines that identity verification of the user U has been successful. Note that the CPU 202 may receive multiple types of biometric information from the automated gate device 60. In this case, the CPU 202 can determine that identity verification of the user U has been successful if user information including multiple types of biometric information that respectively match the multiple types of biometric information received is found in the user information DB 206c.

[0119] On the other hand, if the result of the biometric matching is that no user information containing biometric information matching the biometric information received from the automated gate device 60 is found in the user information DB 206c, the CPU 202 determines that identity verification of user U has failed.

[0120] The CPU 202 transmits verification information indicating the result of biometric verification of the user U attempting to pass through the automated gate device 60 to the automated gate device 60 via the network NW.

[0121] Furthermore, when the CPU 202 receives from the automated gate device 60 an audit information request requesting audit information for a user U attempting to pass through the automated gate device 60, the CPU 202 functions as an information extraction unit that extracts the audit information for the user U from the audit information DB 206d. As an information extraction unit, the CPU 202 can extract the audit information for the user U when it determines that the identity of the user U has been successfully verified. The CPU 202 can, for example, extract audit information associated with biometric information that matches the biometric information of the user U received from the automated gate device 60 or with user information that includes such biometric information. The CPU 202 can also extract, for example, audit information associated with personal identification information of the user U attempting to pass through the automated gate device 60, which is received from the automated gate device 60 along with the audit information request.

[0122] The CPU 202 also functions as an information transmitting unit that transmits the screening information extracted from the screening information DB 206d to the automated gate device 60 that has transmitted the screening information request via the network NW.

[0123] The storage device 206 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 206 stores programs executed by the CPU 202, data referenced by the CPU 202 when executing the programs, etc.

[0124] The storage device 206 also stores a travel history information DB 206a, a person list DB 206b, a user information DB 206c, and an examination information DB 206d.

[0125] The travel history information DB 206a stores travel history information. The travel history information stored in the travel history information DB 206a is information about travelers who have traveled to a second country. The travel history information is registered, for example, when a traveler enters and departs from a second country. The travel history information includes, for example, passport information, biometric information, and history information of a traveler who has traveled to a second country. The passport information includes the passport number of the passport issued to the traveler, the country of issue of the passport, and personal information. The personal information includes the traveler's name, nationality, date of birth, gender, and the like. The biometric information is the traveler's facial image, fingerprint image, etc., or features extracted from such biometric information. The biometric information may be one or more. The biometric information may be obtained from an integrated circuit (IC) passport on which the traveler's biometric information is recorded, or may be obtained directly from the traveler during screening. The history information includes the traveler's port of entry, date of entry, port of departure, date of departure, flight number, etc. The port of entry and port of departure may refer to the airport of entry and airport of departure, respectively. The travel history information and the passport information, biometric information, and history information included in the travel history information are associated with each other.

[0126] A person list is registered in the person list DB 206b. The person list registered in the person list DB 206b includes a blacklist and a person WL. The person WL registers biometric information, text information, etc. as personal information of a person who should be permitted to enter the second country. The biometric information included in each piece of personal information in the person WL and the blacklist is, for example, a face image, a fingerprint image, etc. of the person, or features extracted from such biometric information.

[0127] The user information DB 206c stores user information of the user U who is the subject of the remote inspection, received from the remote inspection terminal 10. As described above, the user information includes the user U's personal information, face information, fingerprint information, and boarding information, which are associated with each other.

[0128] The screening information DB206d stores the screening information such as entry permission information, entry denial information, or face-to-face screening information generated as described above. The screening information of user U is registered in the screening information DB206d in association with information that can uniquely identify user U contained in the user information, such as personal identification information or face information, or with the user information of user U itself.

[0129] Note that some or all of the travel history information DB206a, person list DB206b, user information DB206c, and screening information DB206d do not necessarily have to be stored in the storage device 206 of the screening server 20. Some or all of the travel history information DB206a, person list DB206b, user information DB206c, and screening information DB206d may be stored in the storage device of an external server accessible by the screening server 20 via the network NW.

[0130] The communication unit 208 is connected to the network NW and transmits and receives data via the network NW. The communication unit 208 communicates with the remote examination terminal 10, the guide device 40, the signage terminal 50, the automated gate device 60, etc. under the control of the CPU 202.

[0131] In this way, the examination server 20 is configured.

[0132] Next, the configuration of the mobile terminal 30 will be described with reference to Fig. 5. Fig. 5 is a block diagram showing an example of the hardware configuration of the mobile terminal 30.

[0133] The mobile terminal 30 is a terminal that is owned or carried by the user U and is, for example, a mobile information device such as a smartphone, a tablet terminal, a mobile phone, etc. The mobile terminal 30 is capable of executing an entry support application, which is an application program for supporting the user U's entry into a second country.

[0134] 5, the mobile terminal 30 has a CPU 302, a RAM 304, a storage device 306, an input device 308, a display 310, a mobile wireless communication unit 312, a short-range wireless communication unit 314, a position sensor 316, and a magnetic sensor 318. The CPU 302, RAM 304, storage device 306, input device 308, display 310, mobile wireless communication unit 312, short-range wireless communication unit 314, position sensor 316, and magnetic sensor 318 are connected to a bus line 320.

[0135] CPU 302 operates by executing programs stored in storage device 306, and functions as a control unit that controls the overall operation of mobile terminal 30. CPU 302 also executes application programs stored in storage device 306 to perform various processes as mobile terminal 30. RAM 304 provides a memory area necessary for the operation of CPU 302.

[0136] For example, an entry support application for supporting user U's entry into a second country is installed in storage device 306. By executing the entry support application, CPU 302 can perform various processes for supporting user U's entry.

[0137] More specifically, the CPU 302 functions as a determination unit that determines whether it is time to receive a notification regarding a remote examination from the examination server 20. The CPU 302 that functions as a determination unit can determine whether it is time to receive a notification according to various determination criteria. Specific examples of the determination criteria are as follows:

[0138] First, CPU 302 can measure the position of mobile terminal 30 based on the position information acquired by position sensor 316. CPU 302 can also measure the position of mobile terminal 30, particularly the position of mobile terminal 30 indoors where positioning satellite signals are difficult to receive, based on geomagnetic information acquired by magnetic sensor 318. CPU 302 can determine whether or not it is time to receive a guidance notification based on the information related to the position of mobile terminal 30 thus acquired.

[0139] More specifically, the CPU 302 can detect that the user U who owns or carries the mobile terminal 30 has entered or landed in the second country, based on the location information acquired by the location sensor 316 or the geomagnetic information acquired by the magnetic sensor 318. The CPU 302 can determine that the timing at which it is detected that the user U has entered or landed in the second country is the timing at which the user should receive a guidance notification.

[0140] Furthermore, the CPU 302 can detect that a user U carrying or possessing the mobile terminal 30 approaches the immigration control area AA16 at the airport AA of the second country by indoor positioning based on geomagnetic information acquired by the magnetic sensor 318. Furthermore, the CPU 302 can detect that a user U carrying the mobile terminal 30 approaches the immigration control area AA16 at the airport AA of the second country by indoor positioning based on a beacon signal received by the short-range wireless communication unit 314. The beacon signal is, for example, a beacon signal using Bluetooth (registered trademark) Low Energy (BLE). The beacon signal is transmitted from multiple beacon transmitters installed throughout the airport. Note that the indoor positioning technology for detecting the approach to the immigration control area AA16 is not limited to these, and various indoor positioning technologies using Wi-Fi (registered trademark) positioning, etc., can be used.

[0141] As described above, the CPU 302 can determine that the timing at which the user U detects that the user U has approached the immigration area AA16 is the timing at which the user should receive a guidance notification. Note that there are no particular limitations on the extent to which the user U approaches the immigration area AA16. For example, the CPU 302 can determine that the user U has approached the immigration area AA16 when the user proceeds to a position where the information sign at the immigration area AA16 or the immigration area AA16 itself is visible, and can detect that the user U has approached the immigration area AA16.

[0142] Furthermore, the CPU 302 can determine whether it is time to receive a guidance notification based on a preset date and time. For example, the CPU 302 can determine that the timing to receive a guidance notification is the arrival of the arrival date and time of an aircraft bound for the second country or a date and time obtained by adding or subtracting a predetermined time from the arrival date and time. In this case, the CPU 302 can obtain the arrival date and time from, for example, boarding information input by the user U in the immigration assistance application and stored in the storage device 306, an e-ticket receipt stored in the storage device 306 as an airline ticket medium, or the like.

[0143] Furthermore, the CPU 302 can determine that the timing at which the guidance notification should be received is the timing at which the mobile terminal 30 is operated in relation to entry into a second country. In addition to the entry assistance application, the storage device 306 of the mobile terminal 30 may have installed therein an entry-related application program, such as a customs declaration application for electronically filing a customs declaration. The CPU 302 can determine that the timing at which such an entry-related application program is executed or a specific operation is performed in the entry-related application program is the timing at which the guidance notification should be received.

[0144] Furthermore, the CPU 302 can determine that the timing at which the user U inputs an instruction to receive a guidance notification is the timing at which the user U should receive a guidance notification. The user U can input an instruction to receive a guidance notification in, for example, an entry assistance application. The user U can input an instruction to receive a guidance notification at any timing.

[0145] When the CPU 302 determines that it is time to receive the guidance notification, the CPU 302 functions as a requesting unit that sends a guidance notification request to the examination server 20 along with personal identification information of the user U using the mobile terminal 30 at that timing. The CPU 302 can acquire and use, as the personal identification information of the user U, for example, the passport number of the user U input in the immigration assistance application and stored in the storage device 306. The CPU 302 can also acquire and use, as the personal identification information of the user U, for example, a combination of two or more items such as the name, nationality, and date of birth included in the personal information input in the immigration assistance application and stored in the storage device 306. The CPU 302 can also use, as the personal identification information of the user U, biometric information of the user U, such as a facial image of the user U acquired by a camera (not shown) of the mobile terminal 30 or facial features extracted from the facial image.

[0146] Furthermore, the CPU 302 functions as a display control unit that displays the information notification transmitted from the screening server 20 to the mobile terminal 30 in response to the information notification request on the display 310. The CPU 302 as a display control unit displays the content of the information notification for a person who has already been screened or a person who has not yet been screened, received from the screening server 20, on the display 310. The CPU 302 can, for example, display the information notification on the screen of the immigration support application displayed on the display 310, or can display the information notification in a display format such as a pop-up display or a banner display on the display 310.

[0147] In addition to or instead of displaying the information notice on the display 310, the CPU 302 can also output the contents of the information notice as audio from a speaker or the like (not shown) provided in the mobile terminal 30.

[0148] Furthermore, when the CPU 302 receives a notice of information for an item that has already been inspected, the CPU 302 functions as a code generating unit that generates an inspection completion code similar to the inspection completion code printed on the ticket issued by the issuing device 118 of the remote inspection terminal 10. The CPU 302 can generate an inspection completion code at any timing in response to an instruction input by the user U and display it on the display 310.

[0149] The storage device 306 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 306 stores programs executed by the CPU 302, data referenced by the CPU 302 when executing the programs, etc. The storage device 306 stores an immigration assistance application as an application program executed by the CPU 302.

[0150] The input device 308 is, for example, a touch panel incorporated in the display 310. The input device 308 functions as an input unit that accepts input of instructions from the user U. The user U can input various information to the mobile terminal 30 and instruct the mobile terminal 30 to execute processing via the input device 308.

[0151] The display 310 functions as a display unit that displays various screens to the user U. For example, in the mobile terminal 30 that executes the entry support application, the display 310 displays a screen that displays a guidance notice, a screen that displays an inspection completion code, and the like.

[0152] The mobile wireless communication unit 312 connects to the network NW via a mobile communication network under the control of the CPU 302. The communication method of the mobile wireless communication unit 312 is not particularly limited, but examples thereof include a third generation mobile communication method, an LTE (Long Term Evolution) method, and a fourth generation mobile communication method.

[0153] The short-range wireless communication unit 314 performs wireless communication with an access point, an external device, etc. under the control of the CPU 302, and connects to the network NW via an access point, for example, within the premises of an airport AA, etc. The communication method of the short-range wireless communication unit 314 is not particularly limited, but examples thereof include a wireless LAN method such as Wi-Fi (registered trademark), a Bluetooth (registered trademark) communication method, an NFC (Near Field Communication) method, an infrared communication method, etc.

[0154] The position sensor 316 uses a Global Navigation Satellite System (GNSS) to measure the position of the mobile terminal 30. As a result, the position sensor 316 acquires position information indicating the position of the mobile terminal 30. The GNSS is not particularly limited, and examples include a Global Positioning System (GPS), a Global Navigation Satellite System (GLONASS), Galileo, a compass, etc.

[0155] The magnetic sensor 318 detects the geomagnetism at the location of the mobile terminal 30 to obtain geomagnetism information. The magnetic sensor 318 is not particularly limited, but may detect the geomagnetism using, for example, a hall element, a magnetoresistance element, a magnetic impedance element, or the like.

[0156] In this way, the mobile terminal 30 is configured.

[0157] Next, the configuration of the guidance device 40 will be described with reference to Fig. 6. Fig. 6 is a block diagram showing an example of the hardware configuration of the guidance device 40.

[0158] The guidance device 40 is a device that guides a user U who arrives at the airport AA of the second country and heads towards the immigration inspection area AA16 by projecting a guidance notice onto the floor F of the passage AA14 that connects the quarantine area AA12 and the immigration inspection area AA16. The guidance device 40 is a projection device that can project the contents of the guidance notice. The guidance device 40 guides the user U to the remote inspection dedicated lane L1 or the general lane L2 depending on whether or not remote inspection is being performed for the user U.

[0159] 6, the guidance device 40 has a CPU 402, a RAM 404, a storage device 406, a camera 408, a projector 410, and a communication unit 412. The CPU 402, the RAM 404, the storage device 406, the camera 408, the projector 410, and the communication unit 412 are connected to a bus line 414.

[0160] The CPU 402 operates by executing a program stored in the storage device 406, and functions as a control unit that controls the overall operation of the guidance device 40. The CPU 402 also executes an application program stored in the storage device 406 to perform various processes as the guidance device 40. The RAM 404 provides a memory area necessary for the operation of the CPU 402.

[0161] More specifically, when the camera 408 acquires a facial image of the user U passing through the passage AA14 and detects the user U, the CPU 402 functions as a request unit that transmits a guidance notification request, requesting a guidance notification, along with facial information to the examination server 20. The facial information transmitted together with the guidance notification request is biometric information for identifying the user U, and is the facial image acquired by the camera 408 or facial features extracted from the facial image.

[0162] The CPU 402 also functions as a projection control unit that causes the projector 410 to project the guidance notification transmitted from the screening server 20 to the guide device 40 in response to the guidance notification request onto the floor surface F of the passage AA14. The CPU 402 as a projection control unit causes the projector 410 to project the contents of the guidance notification for the already screened or unscreened person received from the screening server 20.

[0163] In addition to or instead of projecting the guidance notice by the projector 410, the CPU 402 can also output the contents of the guidance notice as audio from a speaker or the like (not shown) provided in the guidance device 40.

[0164] The storage device 406 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 406 stores programs executed by the CPU 402, data referenced by the CPU 402 when executing the programs, etc.

[0165] The camera 408 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U passing through the passage AA14. The camera 408 is, for example, a digital camera that captures a moving image or a series of still images of the passage AA14, and when the face of the user U is detected in the captured moving image or series of still images, the camera 408 captures the face of the user U and acquires the facial image.

[0166] In addition to the camera 408, the guide device 40 may have a biometric information acquisition device that acquires biometric information that can be used to identify the user U passing through the passage AA14.

[0167] The projector 410 functions as a projection unit that projects the contents of the guidance notice for a user U who has already been screened or has not yet been screened, received from the screening server 20, onto the floor surface F of the passage AA14. As a projection unit, the projector 410 projects the contents of the guidance notice onto a position on the floor surface F that is visible to a user U in front of the user U who is moving along the passage AA14. Furthermore, the projector 410 can change the position at which the contents of the guidance notice are projected onto the floor surface F according to the position of the moving user U, for example, by changing the projection direction using a pan-tilt mechanism or the like to follow the movement of the user U moving along the passage AA14.

[0168] The communication unit 412 is connected to the network NW and transmits and receives data via the network NW. The communication unit 412 communicates with the examination server 20 and the like under the control of the CPU 402.

[0169] In this way, the guidance device 40 is configured.

[0170] Next, the configuration of signage terminal 50 will be described with reference to Fig. 7. Fig. 7 is a block diagram showing an example of the hardware configuration of signage terminal 50.

[0171] The signage terminal 50 is a device that guides a user U who arrives at the airport AA of a second country and heads toward the immigration checkpoint AA16 by displaying information notices, for example, at the passage AA14, the entrance to the immigration checkpoint AA16, etc. The signage terminal 50 is a display terminal that can display the contents of the information notices.

[0172] 7, signage terminal 50 has CPU 502, RAM 504, storage device 506, display 508, camera 510, and communication unit 512. CPU 502, RAM 504, storage device 506, display 508, camera 510, and communication unit 512 are connected to bus line 514.

[0173] CPU 502 operates by executing programs stored in storage device 506, and functions as a control unit that controls the overall operation of signage terminal 50. CPU 502 also executes application programs stored in storage device 506 to perform various processes as signage terminal 50. RAM 504 provides a memory area necessary for the operation of CPU 502.

[0174] More specifically, when the camera 510 acquires a facial image of the user U in front of the signage terminal 50 and detects the user U, the CPU 502 functions as a request unit that transmits, together with facial information, an announcement notification request requesting an announcement notification to the examination server 20. The facial information transmitted together with the announcement notification request is biometric information for identifying the user U, and is the facial image acquired by the camera 510 or facial features extracted from the facial image.

[0175] The CPU 502 also functions as a display control unit that displays the information notification transmitted from the review server 20 to the signage terminal 50 in response to the information notification request on the display 508. The CPU 502 as a display control unit displays the content of the information notification for reviewed or unreviewed items received from the review server 20 on the display 508.

[0176] In addition to or instead of displaying the information notice on the display 508, the CPU 502 can also output the contents of the information notice as audio from a speaker or the like (not shown) provided in the signage terminal 50.

[0177] Furthermore, the CPU 502 can cause the display 508 to simultaneously display a guidance notice, which is a display intended for a specific user U, together with general displays such as advertisements and route guidance. The CPU 502 can also cause the display 508 to alternate between the guidance notice, which is a display intended for a specific user U, and general displays such as advertisements and route guidance at predetermined time intervals.

[0178] The storage device 506 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 506 stores programs executed by the CPU 502, data referenced by the CPU 502 when executing the programs, etc.

[0179] The display 508 functions as a display unit that displays, for the user U in front of the signage terminal 50, a screen that displays a guidance notice, a screen that displays advertisements, route guidance, and the like.

[0180] The camera 510 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U in front of the signage terminal 50. The camera 510 is, for example, a digital camera that captures moving images or a series of still images in front of the signage terminal 50, and when the camera 510 detects the face of the user U in the captured moving images or series of still images, it captures the face of the user U and acquires the facial image.

[0181] In addition to the camera 510, the signage terminal 50 may have a biometric information acquisition device that acquires biometric information that can be used to identify the user U in front of the signage terminal 50.

[0182] The communication unit 512 is connected to the network NW and transmits and receives data via the network NW. The communication unit 512 communicates with the examination server 20 and the like under the control of the CPU 502.

[0183] In this way, signage terminal 50 is configured.

[0184] Next, the configuration of the automated gate device 60 will be described with reference to Fig. 8. Fig. 8 is a block diagram showing an example of the hardware configuration of the automated gate device 60.

[0185] The automated gate device 60 is installed at the exit of the remote inspection-only lane L1 at the immigration inspection area AA16, and is a gate device that controls the passage of the user U depending on the results of the remote inspection of the user U who has undergone the remote inspection. The user U who has been permitted to pass through by the automated gate device 60 can pass through the automated gate device 60 and exit from the immigration inspection area AA16. After exiting from the immigration inspection area AA16, the user U, for example, collects their checked baggage at the baggage claim area as needed at the airport AA of the second country, and then undergoes customs inspection to complete the procedures related to entry into the second country.

[0186] 8, the automated gate device 60 has a CPU 602, a RAM 604, a storage device 606, an input device 608, a display 610, a medium reading device 612, a biometric information acquisition device 614, a gate 616, and a communication unit 618. The CPU 602, RAM 604, storage device 606, input device 608, display 610, medium reading device 612, biometric information acquisition device 614, gate 616, and communication unit 618 are connected to a bus line 620.

[0187] The CPU 602 operates by executing programs stored in the storage device 606, and functions as a control unit that controls the overall operation of the automated gate device 60. The CPU 602 also executes application programs stored in the storage device 606 to perform various processes as the automated gate device 60. The RAM 604 provides a memory area necessary for the operation of the CPU 602.

[0188] More specifically, the CPU 602 functions as a judgment unit that determines whether the inspection completion code read by the media reading device 612 is valid. The inspection completion code is, for example, one printed on a ticket issued to the user U by the remote inspection terminal 10, or one displayed on the display 310 of the user U's mobile terminal 30. The CPU 602 as a judgment unit determines that the inspection completion code is valid if it includes inspection completion information indicating that the remote inspection has been completed. However, even in this case, if the expiration date of the inspection completion code has passed or if there is a history of a one-time inspection completion code being read by the media reading device 612, the CPU 602 determines that the inspection completion code is invalid. Furthermore, the CPU 602 determines that the inspection completion code is invalid if it does not include inspection completion information indicating that the remote inspection has been completed.

[0189] When the CPU 602 determines that the examination completion code is invalid, the CPU 602 can execute an alert process. As the alert process, the CPU 602 can, for example, display an alert indicating that the examination completion code is invalid on the display 610 or output an audio message from a speaker (not shown). Furthermore, as the alert process, the CPU 602 can, for example, transmit an alert indicating that the examination completion code is invalid to a business terminal, which is an information terminal used by a staff member, an external server, or the like, via the network NW.

[0190] The CPU 602 does not necessarily have to be configured to function as a determination unit that determines whether the inspection completion code is valid. In this case, the medium reader 612 that reads the inspection completion code is not required, and the user U does not need to use the inspection completion code when passing through the automated gate device 60.

[0191] The CPU 602 also functions as an acquisition control unit that controls the acquisition of biometric information, such as a facial image of the user U, by the biometric information acquisition device 614. When the CPU 602 as an acquisition control unit determines that the inspection completion code is valid, it causes the biometric information acquisition device 614 to acquire the biometric information of the user U. When the CPU 602 does not determine the validity of the inspection completion code, it causes the biometric information acquisition device 614 to uniformly acquire the biometric information of the user U in front of the automated gate device 60.

[0192] Furthermore, when the CPU 602 acquires biometric information from the user U, it functions as a requesting unit that transmits an examination information request requesting examination information to the examination server 20 along with the acquired biometric information. The CPU 602 can transmit, as the biometric information, for example, a facial image of the user U acquired by the biometric information acquisition device 614 or facial information which is facial features extracted from the facial image. The CPU 602 can also transmit, as the biometric information, for example, a fingerprint image of the user U acquired by the biometric information acquisition device 614 or fingerprint information which is fingerprint features extracted from the fingerprint image. The CPU 602 can transmit one or more types of biometric information.

[0193] The CPU 602 can also transmit the personal identification information of the user U read from the examination completion code by the medium reading device 612 to the examination server 20 together with the examination information request.

[0194] The CPU 602 also functions as a judgment unit that determines whether or not to permit the user U to pass through the automated gate device 60. The CPU 602 as a judgment unit determines whether or not to permit the user U to pass through based on the matching information indicating the result of the identity verification of the user U by biometric matching received from the screening server 20 and the screening information of the user U received from the screening server 20.

[0195] If the matching information received from the inspection server 20 indicates that the identity of user U has been successfully verified and the inspection information received from the inspection server 20 is entry permission information, the CPU 602 determines that user U should be allowed to pass through the automated gate device 60.

[0196] On the other hand, if the verification information received from the screening server 20 indicates that user U's identity has been unsuccessful, the CPU 602 determines that user U will not be permitted to pass through the automated gate device 60. Furthermore, if the verification information received from the screening server 20 indicates that user U's identity has been successfully verified, but the screening information received from the screening server 20 is entry denial information, the CPU 602 determines that user U will not be permitted to pass through the automated gate device 60. Furthermore, if the verification information received from the screening server 20 indicates that user U's identity has been successfully verified, but the screening information received from the screening server 20 is information requiring face-to-face screening, the CPU 602 determines that user U will not be permitted to pass through the automated gate device 60.

[0197] When the CPU 602 determines that the user U is permitted to pass through, the CPU 602 controls the gate 616 to transition the gate 616 from a closed state to an open state. In this way, the CPU 602 permits the user U to pass through the gate 616.

[0198] On the other hand, when it is determined that the user U is not permitted to pass through, the CPU 602 can execute an alert process. As the alert process, the CPU 602 can, for example, display an alert indicating that the user U is not permitted to pass through the automated gate device 60 on the display 610 or output an audio signal from a speaker (not shown). Furthermore, as the alert process, the CPU 602 can, for example, transmit an alert indicating that the user U is not permitted to pass through the automated gate device 60 to an information terminal used by a staff member, an external server, or the like via the network NW.

[0199] If the CPU 602 determines that the user U is not permitted to pass through, the CPU 602 keeps the gate 616 closed.

[0200] The CPU 602 also functions as a display control unit that causes the display 610 to display screens for guidance, notifications, etc. for the user U. For example, the CPU 602 as a display control unit causes the display 610 to display a guidance screen that provides guidance on how to use the automated gate device 60. Also, for example, the CPU 602 causes the display 610 to display a notification screen that notifies the user U that a valid or invalid inspection completion code has been read, that the user has been permitted or not permitted to pass through the automated gate device 60, etc.

[0201] The storage device 606 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 606 stores programs executed by the CPU 602, data referenced by the CPU 602 when executing the programs, etc.

[0202] The input device 608 is, for example, a touch panel incorporated in the display 610. The input device 608 functions as an input unit that accepts input of instructions from the user U. The user U can input various information and instructions to execute processing to the automated gate device 60 via the input device 608.

[0203] The display 610 functions as a display unit that displays various screens to a user U who is about to pass through the automated gate device 60. For example, the display 610 displays a guidance screen that provides instructions on how to use the automated gate device 60, a notification screen for the user U, and the like.

[0204] The medium reading device 612 functions as an information acquisition unit that reads and acquires information contained in the examination completion code from the examination completion code printed on a ticket held by the user U or the examination completion code displayed on the display 310 of the mobile terminal 30. The medium reading device 612 can read and acquire information such as the examination completion information contained in the examination completion code and the personal identification information of the user U. The medium reading device 612 is configured, for example, by a code reader that can read two-dimensional codes such as QR codes and one-dimensional codes such as barcodes. The medium reading device 612 reads and acquires information from the examination completion code held over its reading unit.

[0205] The medium reading device 612 can also be configured to read and acquire passport information from the passport of user U. The passport information read by the medium reading device 612 can be used to verify the identity of user U, together with or instead of the biometric information acquired by the biometric information acquisition device 614. In this case, the CPU 602 can send the passport information along with the screening information request to the screening server 20. The CPU 202 of the screening server 20 can search the user information DB 206c that contains passport information that matches the passport information received from the automated gate device 60, and perform the identity verification of user U.

[0206] The biometric information acquisition device 614 functions as a biometric information acquisition unit that acquires biometric information of a user U in front of the automated gate device 60 who is about to pass through the automated gate device 60. The biometric information acquisition device 614 is, for example, a digital camera that captures a photograph of the face of the user U in front of the automated gate device 60 to acquire a facial image of the user U. The biometric information acquisition device 614 may also be, for example, a fingerprint scanner that acquires a fingerprint image of the user U in front of the automated gate device 60. The fingerprint scanner may have a configuration similar to that of the fingerprint scanner 116 of the remote examination terminal 10. The biometric information acquisition device 614 may acquire one type of biometric information of the user U, or may acquire multiple types of biometric information.

[0207] In addition, the automated gate device 60 may have a digital camera, a fingerprint scanner, etc., as well as a biometric information acquisition device that acquires biometric information used to verify the identity of the user U.

[0208] When user U is permitted to pass through the automated gate device 60, the gate 616, under the control of the CPU 602, transitions from a closed standby state that blocks the passage of user U to an open state that allows the passage of user U. The type of gate 616 is not particularly limited, and may be, for example, a flapper gate in which flappers installed on one or both sides of the passage open and close, or a turnstile gate in which three bars rotate.

[0209] The communication unit 618 is connected to the network NW and transmits and receives data via the network NW. The communication unit 618 communicates with the examination server 20 and the like under the control of the CPU 602.

[0210] In this way, the automated gate device 60 is constructed.

[0211] In the information processing system 1 according to this embodiment, the remote inspection terminal 10 acquires user information, including identity information, biometric information, and boarding information, about user U to be used for remote inspection from user U after immigration in a first country and before boarding for a flight to a second country. The remote inspection terminal 10 according to this embodiment can use the time user U waits to board a flight to a second country after immigration in the first country to acquire user information about user U to be used for immigration in the second country, thereby making efficient use of user U's time. Moreover, because the user information is acquired from user U after immigration in the first country, a certain level of reliability of the user information can be guaranteed.

[0212] Furthermore, in the information processing system 1 according to this embodiment, the examination server 20 performs a remote immigration examination for the second country based on user information about the user U acquired by the remote examination terminal 10 from the user U before boarding for the second country after the departure examination for the first country. According to the examination server 20 according to this embodiment, the remote examination is performed based on the user information acquired from the user U before boarding for the second country, so that the remote examination can be completed by the time the user U arrives in the second country and reaches the immigration inspection site AA16. For the user U for whom the remote examination has been completed, there is no need to acquire user information for immigration examination at the immigration inspection site AA16. Thus, according to this embodiment, the processing or procedures to be performed at the immigration inspection site AA16 can be reduced. This can minimize the occurrence of queues waiting to exit the immigration inspection site AA16.

[0213] Furthermore, in the information processing system 1 according to this embodiment, the user U can receive a notification regarding the remote examination via the mobile terminal 30, the guide device 40, or the signage terminal 50. Therefore, according to this embodiment, it is expected that the user U will act smoothly in accordance with the notification when entering the second country.

[0214] Thus, according to this embodiment, after the departure inspection of the first country, user information about user U is obtained from user U before boarding for the second country, and immigration inspection of the second country is carried out remotely based on such user information, so that immigration inspection of the second country can be carried out efficiently.

[0215] The operation of each component in the information processing system 1 according to this embodiment will be further described below with reference to FIGS.

[0216] First, the operation of the remote examination terminal 10 will be described together with the operation of the examination server 20 using Fig. 9 and Fig. 10. Fig. 9 is a sequence diagram showing the operation of the remote examination terminal 10 and the examination server 20. Fig. 10 is a flowchart showing the operation of the remote examination of the examination server 20.

[0217] A user U who plans to fly from a first country to a second country completes immigration control at immigration control area DA12 at the airport DA of the first country and receives confirmation of departure, then enters restricted area DA14 and waits to board an aircraft at boarding gate DA16. After immigration control, user U can use a remote immigration control terminal 10 installed in a lounge, boarding lounge, aisle, etc. in restricted area DA14.

[0218] As shown in FIG. 9, the medium reader 112 of the remote examination terminal 10 determines whether or not the passport of the user U is held over its reading section (step S102), and waits until the passport is held over (step S102, NO).

[0219] When the medium reading device 112 determines that a passport has been held over the passport (step S102, YES), it reads and acquires the user U's personal information from the held passport (step S104). The personal information includes passport information. The medium reading device 112 also acquires information such as the passport face image and passport fingerprint image of the user U recorded on the passport.

[0220] Next, the medium reader 112 determines whether or not the airline ticket medium of the user U is held over its reading section (step S106), and waits until the airline ticket medium is held over (step S106, NO).

[0221] When the medium reader 112 determines that the airline ticket medium has been held over the boarding pass (step S106, YES), it reads and acquires the boarding information of the user U from the held airline ticket medium (step S108).

[0222] The order of step S104 of acquiring personal information and step S108 of acquiring boarding information is not limited to the above case. Either step S104 or S108 may be executed first, or steps S104 and S108 may be executed simultaneously.

[0223] Next, the camera 114 of the remote examination terminal 10 photographs the face of the user U who places his / her fingers on the reading surface of the fingerprint scanner 116 of the remote examination terminal 10 to have his / her fingerprint read, and acquires a photographed facial image of the user U (step S110). The user U can place his / her finger on the reading surface of the fingerprint scanner 116 by following instructions displayed on the display 110 of the remote examination terminal 10, for example. The fingerprint scanner 116 reads the fingerprint of the finger placed on the reading surface and acquires a read fingerprint image of the user U (step S112).

[0224] In this way, the camera 114 acquires a photographed face image and the fingerprint scanner 116 acquires a read fingerprint image in parallel. In this way, by acquiring multiple types of biometric information of the user U in parallel, it is possible to prevent as much as possible impersonation of the user U by a non-biometric person.

[0225] Note that step S110 for acquiring a photographed face image and step S112 for acquiring a read fingerprint image may be performed before steps S104 and S108, or may be performed between steps S104 and S108, whichever is performed first.

[0226] Next, the CPU 102 of the remote examination terminal 10 determines whether or not the user U is being impersonated (step S114). The CPU 102 can determine whether or not the user U is being impersonated, for example, based on the acquisition status of the biometric information of the user U in steps S110 and S112, the analysis results of the video of the remote examination terminal 10 and its surroundings captured by the monitoring camera 70, etc.

[0227] When CPU 102 determines that spoofing is occurring (step S114, YES), it executes alert processing (step S116). As the alert processing, CPU 102 can execute, for example, displaying an alert indicating the possibility of spoofing on display 110, outputting audio from a speaker, transmitting the alert to a business terminal or the like.

[0228] On the other hand, if the CPU 102 determines that no impersonation has occurred (step S114, NO), it transmits the user information of user U to the examination server 20 via the network NW (step S118). The user information includes user U's personal information, face information, fingerprint information, and boarding information, which are associated with each other. The face information of user U is face features extracted from the photographed face image of user U and the passport face image or both face images. The fingerprint information of user U includes the read fingerprint image of user U or fingerprint features extracted from the read fingerprint image, and may further include the passport fingerprint image of user U or fingerprint features extracted from the passport fingerprint image.

[0229] When the CPU 202 of the examination server 20 receives the user information of the user U from the remote examination terminal 10, it determines whether the user U is a target of the remote examination based on the received user information (step S120). For example, the CPU 202 can determine whether the user U is a target of the remote examination based on the travel history information of the user U to a second country extracted from the travel history information DB 206a or the travel history information of the user U to a second country included in the user information. Also, for example, the CPU 202 can determine whether the user U is a target of the remote examination based on the time from the time the user information is acquired by the remote examination terminal 10 to the boarding time. Also, for example, the CPU 202 can determine whether the user U is a target of the remote examination based on the airline used by the user U acquired from the boarding information included in the user information. Also, for example, the CPU 202 can determine whether the user U is a target of the remote examination if the user U is a pre-registered user who has previously registered to use the remote examination.

[0230] When the CPU 202 determines that the user U is not eligible for the remote examination (step S120, NO), it generates an ineligible notice indicating that the user U is not eligible for the remote examination (step S122).

[0231] On the other hand, if the CPU 202 determines that the user U is a target for remote examination (YES in step S120), it registers the user information of the user U in the user information DB 206c (step S124).

[0232] Next, the CPU 202 performs a remote immigration inspection for the user U when the user U enters the second country, based on the user information of the user U registered in the user information DB 206c (step S126).

[0233] In the remote examination, first, as shown in Fig. 10, the CPU 202 performs biometric matching using biometric information included in the user information of the user U (step S202). In this way, the CPU 202 confirms the identity of the user U. As biometric matching for identity confirmation, for example, the CPU 202 can perform face matching, which matches a photographed face image included in the user information with a passport face image also included in the user information. In addition, for example, the CPU 202 can perform fingerprint matching, which matches a read fingerprint image included in the user information with a passport fingerprint image also included in the user information.

[0234] If the CPU 202 determines that the biometric matching does not match and that identity verification of user U has failed (step S204, NO), it generates face-to-face examination required information as examination information indicating that face-to-face examination is required for user U (step S206).

[0235] On the other hand, if the CPU 202 determines that the biometric matching is a match and that the identity of user U has been successfully verified (step S204, YES), it compares user U with the person list (step S208). In comparing with the person list, the CPU 202 compares information that can identify user U, included in the user information of user U, with similar information of multiple people included in the person WL or blacklist registered in the person list DB 206b in a 1:N ratio. As a result, the CPU 202 determines whether user U corresponds to a person registered in the person WL or blacklist (steps S210, S214).

[0236] First, the CPU 202 determines whether the user U corresponds to a person registered in the person WL (step S210). If the CPU 202 determines that the user U corresponds to a person registered in the person WL (step S210, YES), the CPU 202 generates, as screening information, entry permission information indicating that the user U is permitted to enter the second country (step S212).

[0237] Furthermore, if the CPU 202 determines that the user U is not a person registered in the person WL (step S210, NO), it further determines whether the user U is a person registered in the blacklist (step S214).If the CPU 202 determines that the user U is not a person registered in the blacklist (step S214, NO), it also generates entry permission information (step S212).

[0238] On the other hand, if the CPU 202 determines that the user U is a person registered on the blacklist (step S214, YES), it generates entry refusal information indicating that the user U will be denied entry into the second country (step S216). Note that in this case, the CPU 202 can also generate face-to-face examination required information as the examination information, instead of the entry refusal information, as in the case where it determines that the identity verification has failed.

[0239] In this way, the CPU 202 generates the examination information, such as entry permission information, entry denial information, or face-to-face examination required information, and ends the remote examination.

[0240] After completing the remote examination, the CPU 202 registers and manages the generated examination information in the examination information DB 206d, as shown in FIG. 9 (step S128).

[0241] Next, the CPU 202 transmits the generated examination information or non-eligible notification depending on whether the user U is the subject of the remote examination to the remote examination terminal 10 via the network NW (step S130). If the remote examination is not completed while the user U remains in front of the remote examination terminal 10, the CPU 202 can transmit reception completion information indicating that the user information to be used for the remote examination has been received to the remote examination terminal 10 instead of the examination information.

[0242] The CPU 102 of the remote examination terminal 10 executes a notification process for the user U who used the remote examination terminal 10 in response to the examination information or the ineligible notice received from the examination server 20 (step S132).

[0243] When the CPU 102 receives the examination information, it can notify the user U by displaying on the display 110 or outputting by voice that the remote examination has been completed. Furthermore, in this case, the CPU 102 can also notify the user U of the specific results of the remote examination by displaying on the display 110 or outputting by voice, depending on whether the received examination information is entry permission information, entry denial information, or face-to-face examination required information. That is, when the received examination information is entry permission information, the CPU 102 can also notify the user U that entry into the second country has been permitted. Furthermore, when the received examination information is entry denial information, the CPU 102 can also notify the user U that entry into the second country has been denied. Furthermore, when the received examination information is face-to-face examination required information, the CPU 102 can also notify the user U that face-to-face examination is required for entry into the second country.

[0244] Furthermore, when the examination information is received, the CPU 102 causes the issuing device 118 to issue a ticket such as a paper ticket on which an examination completion code is printed. The user U can then travel to the second country with the issued ticket.

[0245] In addition, if reception completion information is received instead of examination information, the CPU 102 can notify the user U by displaying on the display 110 or outputting a voice message that the user information to be used for the remote examination has been received.

[0246] On the other hand, when the CPU 102 receives the ineligible notification, it notifies the user U that the user U is ineligible for the remote examination by displaying on the display 110 or outputting a voice message.

[0247] In this way, processing is carried out for the user U who uses the remote examination terminal 10.

[0248] Next, the operation of the mobile terminal 30 will be described together with the operation of the examination server 20 using Figures 11, 12A, and 12B. Figure 11 is a sequence diagram showing the operation of the examination server 20 and the mobile terminal 30. Figures 12A and 12B are schematic diagrams showing examples of guidance notifications displayed on the mobile terminal 30.

[0249] A user U using the remote inspection terminal 10 boards an aircraft at boarding gate DA16 and travels by air to a second country. From the time the user U uses the remote inspection terminal 10 until the time the user U arrives at immigration inspection area AA16 at airport AA in the second country, the user U can receive information about the remote inspection from the inspection server 20 on a mobile terminal 30 that the user U possesses or carries with him / her.

[0250] 11, the CPU 302 of the mobile terminal 30 determines whether it is time to receive a notification regarding a remote examination from the examination server 20 (step S302). If it is determined that it is not time to receive a notification (step S302, NO), the CPU 302 continuously determines whether it is time to receive a notification and waits for a specific notification timing to arrive.

[0251] The CPU 302 can determine that the timing to receive a guidance notification is the timing when it detects that the user U has entered or landed in a second country based on the location information acquired by the position sensor 316 or the geomagnetic information acquired by the magnetic sensor 318. The CPU 302 can also determine that the timing to receive a guidance notification is the timing when it detects that the user U has approached the immigration inspection area AA16 through indoor positioning. The CPU 302 can perform indoor positioning based on, for example, geomagnetic information acquired by the magnetic sensor 318 or a beacon signal received by the short-range wireless communication unit 314. The CPU 302 can also determine whether the timing to receive a guidance notification is the timing based on a preset date and time. The CPU 302 can also determine that the timing to receive a guidance notification is the timing when an entry-related application program is executed on the mobile terminal 30 or a specific operation is performed in the entry-related application program. The CPU 302 can also determine that the timing to receive a guidance notification is the timing when the user U inputs an instruction to receive a guidance notification.

[0252] When the CPU 302 determines that it is time to receive the guidance notification (step S302, YES), it transmits a guidance notification request requesting a guidance notification to the examination server 20 via the network NW at that timing (step S304). The CPU 302 transmits the guidance notification request together with personal identification information of the user U who uses the mobile terminal 30. The CPU 302 can use, for example, the passport number of the user U that is input in the immigration assistance application and stored in the storage device 306 as the personal identification information of the user U.

[0253] When the CPU 202 of the screening server 20 receives the notification request from the mobile terminal 30, it searches the screening information DB 206d for screening information associated with the personal identification information of the user U received along with the notification request (step S306).

[0254] When the CPU 202 finds the examination information for user U in the examination information DB 206d as a result of the search (step S308, YES), it generates a notice for those who have already been examined, indicating that the remote examination has been completed (step S310). The CPU 202 can generate a notice that explicitly or directly, or implicitly or indirectly indicates that the remote examination has been completed. Furthermore, depending on whether the examination information is entry permission information, entry denial information, or face-to-face examination required information, the CPU 202 can generate a notice for those who have already been examined, including the content indicated by each of the information.

[0255] On the other hand, if the CPU 202 does not find any examination information for user U in the examination information DB 206d as a result of the search (step S308, NO), it generates a notice for those who have not yet been examined, indicating that a remote examination has not been conducted (step S312). The CPU 202 can generate a notice that explicitly or directly, or implicitly or indirectly indicates that a remote examination has not been conducted.

[0256] Next, the CPU 202 transmits the generated guide notice for the reviewed or unreviewed user via the network NW to the mobile terminal 30 that transmitted the guide notice request (step S314).

[0257] When the CPU 302 of the mobile terminal 30 receives the guidance notice for the reviewed or unreviewed item from the review server 20, the CPU 302 displays the content of the received guidance notice for the reviewed or unreviewed item on the display 310 (step S316). The CPU 302 can display the content of the guidance notice using, for example, the language set in the language setting of the mobile terminal 30.

[0258] 12A shows an example of the screen of the display 310 of the mobile terminal 30 displaying a guidance notice for those who have already been inspected, which implicitly or indirectly indicates that the remote inspection has been completed. As shown in FIG. 12A, the display 310 of the mobile terminal 30 displays, as the content of the guidance notice for those who have already been inspected, guidance G32 which guides the user U to the remote inspection-only lane L1 at the immigration inspection site AA16 and then to the automated gate device 60. The guidance G32 showing the guidance notice for those who have already been inspected implicitly or indirectly indicates that the remote inspection has been completed by guiding the user U to the remote inspection-only lane L1.

[0259] 12B shows an example of the screen of the display 310 of the mobile terminal 30 displaying a guidance notice for those who have not yet been inspected, which implicitly or indirectly indicates that remote inspection is not being performed. As shown in FIG. 12B, the display 310 of the mobile terminal 30 displays, as a guidance notice for those who have not yet been inspected, guidance G34 which guides the user U to the general lane L2 at the immigration inspection site AA16 and then to the inspection booth B. The guidance G34 showing the guidance notice for those who have not yet been inspected implicitly or indirectly indicates that remote inspection is not being performed by providing guidance to the general lane L2.

[0260] In this way, the user U can receive a notice regarding the remote inspection on the mobile terminal 30. Upon seeing the notice displayed on the mobile terminal 30, the user U can take action in accordance with the notice when heading to the immigration inspection area AA16.

[0261] Next, the operation of the guiding device 40 will be described together with the operation of the examination server 20 using Figures 13, 14A, and 14B. Figure 13 is a sequence diagram showing the operation of the examination server 20 and the guiding device 40. Figures 14A and 14B are schematic diagrams showing examples of guidance notifications projected by the guiding device 40.

[0262] A user U who arrives at an airport AA in a second country by air travels through, for example, a quarantine area AA12 where quarantine procedures are carried out, and heads to an immigration area AA16. During this time, the user U passes through, for example, an aisle AA14 which is a passage connecting the quarantine area AA12 and the immigration area AA16.

[0263] 13, the camera 408 of the guide device 40 constantly or periodically captures an image of the passage AA14, and determines whether the face of the user U is detected in the captured image (step S402). The camera 408 waits until the face of the user U is detected in the image (step S402, NO).

[0264] When the camera 408 determines that the face of the user U has been detected (step S402, YES), it photographs the face of the user U to acquire a facial image of the user U (step S404). In this way, the guide device 40 detects the user U passing through the passage AA14.

[0265] Next, the CPU 402 of the guide device 40 that detected the user U transmits a notification request for a notification of the user U to the examination server 20 via the network NW (step S406). The CPU 402 transmits the notification request together with the face information of the user U, which is the face image of the user U detected and photographed by the camera 408 or the face features extracted from the face image.

[0266] When the CPU 202 of the screening server 20 receives the notification request from the guide device 40, it searches the screening information DB 206d for screening information associated with the facial information of the user U received together with the notification request (step S408).

[0267] As a result of the search, when the CPU 202 finds the screening information for the user U in the screening information DB 206d (step S410, YES), it generates a guide notice for those who have already been screened, similar to step S310 (step S412).

[0268] On the other hand, if the CPU 202 does not find any screening information for the user U in the screening information DB 206d as a result of the search (step S410, NO), it generates a guide notice for users who have not yet been screened, as in step S312 (step S414).

[0269] Next, the CPU 202 transmits the generated guide notice for the screened or unscreened person via the network NW to the guide device 40 that transmitted the guide notice request (step S416).

[0270] When the CPU 402 of the guiding device 40 receives the guidance notice for the screened or unscreened user from the screening server 20, the CPU 402 causes the projector 410 to project the contents of the received guidance notice for the screened or unscreened user onto the floor F of the passage AA14 (step S418). The CPU 402 can display the contents of the guidance notice using, for example, a language corresponding to the nationality of the user U identified by the user information.

[0271] FIG. 14A shows an example of the floor surface F of the passage AA14 on which the guidance device 40 projects the content of a guidance notice for those who have already been inspected, which implicitly or indirectly indicates that the remote inspection has been completed. As shown in FIG. 14A, the projector 410 of the guidance device 40 displays guidance G42 as the content of the guidance notice for those who have already been inspected, guiding the user U to the remote inspection lane L1 at the immigration inspection area AA16 and then to the automated gate device 60. The guidance G42 may include a guidance display such as an arrow indicating the location of the remote inspection lane L1. The guidance G42 may be composed of a still image, a video, or the like. The guidance G42 showing the guidance notice for those who have already been inspected implicitly or indirectly indicates that the remote inspection has been completed by providing guidance to the remote inspection lane L1.

[0272] On the other hand, FIG. 14B shows an example of the floor surface F of the passage AA14 on which the guidance device 40 projects the content of a guidance notice for non-screened users, which implicitly or indirectly indicates that remote screening is not being conducted. As shown in FIG. 14B, the projector 410 of the guidance device 40 displays guidance G44 as a guidance notice for non-screened users, guiding the user U to the general lane L2 at the immigration inspection area AA16 and then to the screening booth B. The guidance G44 may include a guidance display such as an arrow indicating the location of the general lane L2. The guidance G44 may be composed of a still image, a video, or the like. The guidance G44 indicating the guidance notice for non-screened users implicitly or indirectly indicates that remote screening is not being conducted by providing guidance to the general lane L2.

[0273] In this way, user U can receive a guidance notice regarding remote inspection when passing through passage AA14. Upon seeing the guidance notice projected on the floor F of passage AA14, user U can take action in accordance with the guidance notice when heading to immigration inspection area AA16.

[0274] In particular, if the passage AA14 on which the guidance notice is projected onto the floor surface F by the guidance device 40 is a narrow passage such as the passage connecting the quarantine area AA12 and the immigration inspection area AA16, the user U can more reliably see the contents of the guidance notice projected onto the floor surface F.

[0275] Next, the operation of the signage terminal 50 will be described together with the operation of the examination server 20 using Figures 15, 16A, and 16B. Figure 15 is a sequence diagram showing the operation of the examination server 20 and the signage terminal 50. Figures 16A and 16B are schematic diagrams showing examples of information notifications displayed on the signage terminal 50.

[0276] A user U who has arrived at an airport AA in a second country by air passes in front of signage terminals 50 installed at various locations in the airport AA from the arrival gate to immigration checkpoint AA16 while heading to immigration checkpoint AA16. In addition, the user U may look at advertisements, route guidance, and other information displayed on the signage terminal 50 while standing in front of the signage terminal 50.

[0277] 15, camera 510 of signage terminal 50 constantly or periodically captures an image in front of signage terminal 50, and determines whether the face of user U is detected in the captured image (step S502). Camera 510 waits until the face of user U is detected in the image (step S502, NO).

[0278] When camera 510 determines that the face of user U has been detected (step S502, YES), it photographs the face of user U to obtain a facial image of user U (step S504). In this way, signage terminal 50 detects user U in front of signage terminal 50.

[0279] Next, the CPU 502 of the signage terminal 50 that detected the user U transmits an information notification request to the examination server 20 via the network NW (step S506). The CPU 502 transmits the information notification request together with the face information of the user U, which is the face image of the user U detected and photographed by the camera 510 or the face features extracted from the face image.

[0280] When the CPU 202 of the screening server 20 receives the information notification request from the signage terminal 50, it searches the screening information DB 206d for screening information associated with the facial information of the user U received together with the information notification request (step S508).

[0281] As a result of the search, when the CPU 202 finds the screening information for the user U in the screening information DB 206d (step S510, YES), it generates a guide notice for those who have already been screened, similar to step S310 (step S512).

[0282] On the other hand, if the CPU 202 does not find any screening information for the user U in the screening information DB 206d as a result of the search (step S510, NO), it generates a guide notice for users who have not yet been screened, as in step S312 (step S514).

[0283] Next, CPU 202 transmits the generated guide notification for the reviewed or unreviewed user via network NW to signage terminal 50 that transmitted the guide notification request (step S516).

[0284] When the CPU 502 of the signage terminal 50 receives the guidance notice for the reviewed or unreviewed user from the review server 20, it displays the content of the received guidance notice for the reviewed or unreviewed user on the display 508 (step S518). The CPU 502 can display the content of the guidance notice using, for example, a language corresponding to the nationality of the user U identified by the user information.

[0285] FIG. 16A shows an example of the screen of the display 508 of the signage terminal 50 displaying a guidance notice for those who have already been inspected, which implicitly or indirectly indicates that the remote inspection has been completed. As shown in FIG. 16A, the display 508 of the signage terminal 50 displays, as the content of the guidance notice for those who have already been inspected, guidance G52, which guides the user U to the remote inspection-only lane L1 at the immigration inspection area AA16 and then to the automated gate device 60. The guidance G52 may include a guidance display such as an arrow indicating the location of the remote inspection-only lane L1. The guidance G52 may be composed of a still image, a video, or the like. The guidance G52 showing the guidance notice for those who have already been inspected implicitly or indirectly indicates that the remote inspection has been completed by providing guidance to the remote inspection-only lane L1.

[0286] On the other hand, FIG. 16B shows an example of the screen of the display 508 of the signage terminal 50 displaying a guidance notice for those who have not yet been screened, which implicitly or indirectly indicates that remote screening is not being performed. As shown in FIG. 16B, the display 508 of the signage terminal 50 displays, as a guidance notice for those who have not yet been screened, guidance G54, which guides user U to general lane L2 at immigration inspection site AA16 and then to screening booth B. Guidance G54 may include a guidance display such as an arrow indicating the location of general lane L2. Guidance G54 may be composed of a still image, a video, etc. Guidance G54, which displays a guidance notice for those who have not yet been screened, implicitly or indirectly indicates that remote screening is not being performed by providing guidance to general lane L2.

[0287] In this way, the user U can receive a guidance notice regarding the remote inspection on the signage terminal 50. Upon seeing the guidance notice displayed on the signage terminal 50, the user U can take action in accordance with the guidance notice when heading to the immigration inspection area AA16.

[0288] Next, the operation of the automated gate device 60 will be described together with the operation of the screening server 20 with reference to Fig. 17. Fig. 17 is a sequence diagram showing the operation of the screening server 20 and the automated gate device 60.

[0289] After undergoing remote inspection, user U lines up in the remote inspection lane L1 at immigration inspection site AA16, either voluntarily or in accordance with the guidance notice for those who have already been inspected as described above. User U who has lined up in the remote inspection lane L1 passes through an automated gate device 60 installed at the exit of the remote inspection lane L1 to exit immigration inspection site AA16. The automated gate device 60 permits or denies user U passage through the automated gate device 60 based on verification information about user U, inspection information about user U that has already been generated by the inspection server 20, etc. Note that gate 616 of the automated gate device 60 is in a closed state during standby, blocking user U's passage.

[0290] 17, the media reader 612 of the automated gate device 60 determines whether or not the user U has held up the inspection completion code over its reading section (step S602), and waits until the inspection completion code is held up (step S602, NO). The inspection completion code is, for example, one printed on a ticket issued by the issuing device 118 of the remote inspection terminal 10, or one displayed on the mobile terminal 30 of the user U, etc.

[0291] When the medium reader 612 determines that the inspection completion code has been held over the card (S602, YES), the medium reader 612 reads and acquires information from the held inspection completion code (step S604).

[0292] Next, the CPU 602 of the automated gate device 60 determines whether the inspection completion code read by the media reading device 612 is valid (step S606). If the inspection completion code includes inspection completion information, the CPU 602 determines that the inspection completion code is valid. However, even in this case, if the expiration date of the inspection completion code has passed or if there is a reading history of an inspection completion code that is valid only once, the CPU 602 determines that the inspection completion code is invalid. Furthermore, if the inspection completion code does not include inspection completion information, the CPU 602 determines that the inspection completion code is invalid.

[0293] When the CPU 602 determines that the examination completion code is invalid (step S606, NO), it executes an alert process (step S608). As the alert process, the CPU 602 can execute, for example, displaying an alert indicating that the examination completion code is invalid on the display 610, outputting an audio message from a speaker, or transmitting the alert to a business terminal or the like.

[0294] On the other hand, if the CPU 602 determines that the examination completion code is valid (step S606, YES), it causes the biometric information acquisition device 614 to acquire biometric information of the user U (step S610). The biometric information acquisition device 614 can acquire one or more types of biometric information of the user U, such as a facial image or a fingerprint image, under the control of the CPU 602.

[0295] It is also possible to omit steps S602, S604, and S606 and not use the inspection completion code. In this case, when the biometric information acquisition device 614 detects a user U in front of the automated gate device 60, it acquires the biometric information of the user U. For example, when a camera serving as the biometric information acquisition device 614 detects the face of the user U in an image that is constantly or periodically captured in front of the automated gate device 60, it captures the face of the user U and acquires the facial image of the user U as biometric information.

[0296] Next, the CPU 602 transmits an examination information request requesting examination information together with the biometric information of the user U to the examination server 20 via the network NW (step S612). The CPU 602 can transmit, as the biometric information, for example, a facial image of the user U acquired by a camera serving as the biometric information acquisition device 614 or facial information which is facial features extracted from the facial image. The CPU 602 can also transmit, as the biometric information, for example, a fingerprint image of the user U acquired by a fingerprint scanner serving as the biometric information acquisition device 614 or fingerprint information which is fingerprint features extracted from the fingerprint image.

[0297] When the CPU 202 of the screening server 20 receives, from the automated gate device 60, biometric information of a user U attempting to pass through the automated gate device 60, the CPU 202 performs biometric matching using the received biometric information (step S614). As a result, the CPU 202 performs identity verification of the user U. The CPU 202 performs a 1:N comparison between the biometric information received from the automated gate device 60 and the biometric information included in the user information registered in the user information DB 206c. If, as a result of the biometric matching, the CPU 202 finds user information in the user information DB 206c that contains biometric information matching the biometric information received from the automated gate device 60, the CPU 202 determines that identity verification of the user U has been successful. On the other hand, if, as a result of the biometric matching, the CPU 202 does not find user information in the user information DB 206c that contains biometric information matching the biometric information received from the automated gate device 60, the CPU 202 determines that identity verification of the user U has failed.

[0298] Next, the CPU 202 transmits verification information indicating the result of the identity verification of the user U through biometric verification to the automated gate device 60 via the network NW (step S616).

[0299] Furthermore, if the CPU 202 determines that the identity verification of the user U has been successful (step S618, YES), it extracts the screening information of the user U from the screening information DB 206d (step S620). The CPU 202 can, for example, extract screening information associated with biometric information that matches the biometric information of the user U received from the automated gate device 60 or with user information that includes such biometric information. The CPU 202 can also, for example, extract screening information associated with the personal identification information of the user U received from the automated gate device 60.

[0300] If the CPU 202 determines that the identity verification of the user U has failed (step S618, NO), the CPU 202 does not extract the screening information because the screening information of the user U does not exist in the screening information DB 206d.

[0301] Next, the CPU 202 transmits the screening information extracted from the screening information DB 206d to the automated gate device 60 that transmitted the screening information request via the network NW (step S622).

[0302] The CPU 602 of the automated gate device 60 determines whether or not to permit user U to pass through the automated gate device 60 based on the verification information and screening information of user U received from the screening server 20 (step S624). If the verification information indicates that user U's identity has been successfully verified and the screening information is entry permission information, the CPU 602 determines to permit user U to pass through the automated gate device 60. On the other hand, if the verification information indicates that user U's identity has not been verified, the CPU 602 determines not to permit user U to pass through the automated gate device 60. Furthermore, if the verification information indicates that user U's identity has been successfully verified and the screening information is entry denial information or face-to-face screening information, the CPU 602 determines not to permit user U to pass through the automated gate device 60.

[0303] When the CPU 602 determines that the user U is permitted to pass through the automated gate device 60 (step S626, YES), the CPU 602 controls the gate 616 to transition the gate 616 from a closed state to an open state (step S628). As a result, the CPU 602 permits the user U to pass through the gate 616.

[0304] On the other hand, if the CPU 602 determines that the user U is not permitted to pass through the automated gate device 60 (step S626, NO), it executes an alert process (step S608). As the alert process, the CPU 602 can execute, for example, displaying an alert on the display 610 indicating that the user U is not permitted to pass through the automated gate device 60, outputting an audio message from a speaker, or transmitting the alert to a business terminal or the like. In this case, the CPU 602 maintains the gate 616 in a closed state.

[0305] In this way, based on the collation information and the screening information, user U is either permitted or denied passage through the automated gate device 60. User U who is permitted to pass through the automated gate device 60 passes through the automated gate device 60 and exits at immigration inspection area AA16. On the other hand, user U who is not permitted to pass through the automated gate device 60 is guided by an officer to screening booth B so that he or she can undergo face-to-face screening again with inspector E, for example.

[0306] As described above, according to this embodiment, the remote inspection terminal 10 acquires user information about the user U from the user U after the departure inspection of the first country and before boarding for the second country, and the inspection server 20 performs the immigration inspection of the second country as a remote inspection based on the user information. Therefore, according to this embodiment, the immigration inspection of the second country can be performed efficiently.

[0307] [Other embodiments] According to another embodiment, the information processing device described in the above embodiment can also be configured as shown in Fig. 18. Fig. 18 is a block diagram showing the configuration of an information processing device according to another embodiment.

[0308] 18, an information processing device 1000 according to another embodiment includes an information acquisition unit 1002 that acquires user information about a user from the user after immigration control in a first country and before boarding for a flight to a second country. The information processing device 1000 also includes an information provision unit 1004 that provides the user information for immigration control in the second country.

[0309] In another embodiment, the information processing device 1000 acquires user information about a user after the departure inspection of a first country and before boarding for a flight to a second country, and provides the user information for the immigration inspection of the second country. This allows the immigration inspection of the second country to be carried out efficiently according to the other embodiment.

[0310] [Modified embodiment] The present invention is not limited to the above-described embodiment, and various modifications are possible.

[0311] For example, in the above embodiment, the case where the user U operates the remote examination terminal 10 by himself / herself has been described as an example, but the present invention is not limited to this. For example, the remote examination terminal 10 can be configured so that a guide assists the user U in operating it or the guide operates it.

[0312] Furthermore, in the above embodiment, an example has been described in which a user U who has completed remote inspection is guided to the remote inspection-only lane L1 and then to the automated gate device 60, but this is not limited to this. The automated gate device 60 does not necessarily have to be installed at the exit of the remote inspection-only lane L1. For example, an inspection booth may be installed at the exit of the remote inspection-only lane L1 where an immigration inspector conducts a simplified, face-to-face immigration inspection for a user U who has completed remote inspection, which is simpler than the immigration inspection at inspection booth B installed at the exit of the general lane L2. In this case, the remote inspection is conducted as a preliminary inspection for the face-to-face immigration inspection by the inspector, and the results of the preliminary inspection are used in the face-to-face immigration inspection by the inspector, thereby simplifying the face-to-face immigration inspection by the inspector.

[0313] In the above embodiment, the remote examination terminal 10, the guiding device 40, the signage terminal 50, and the automated gate device 60 have been described as examples in which they acquire a face image or a fingerprint image as biometric information of the user U, but this is not limited to this. The remote examination terminal 10, the guiding device 40, the signage terminal 50, and the automated gate device 60 may each acquire other biometric information such as an iris image, a finger vein image, a palm print image, or a palm vein image as biometric information of the user U.

[0314] Furthermore, when the contents of the present invention are assumed to be applied to countries that do not have immigration control, the term "immigration control" in this specification can be read as "security check."

[0315] Furthermore, the remote examination terminal 10 according to the above embodiment can be configured as a system consisting of one or more devices. The examination server 20 according to the above embodiment can be configured as a system consisting of one or more devices. The guidance device 40 according to the above embodiment can be configured as a system consisting of one or more devices. The signage terminal 50 according to the above embodiment can be configured as a system consisting of one or more devices. The automated gate device 60 according to the above embodiment can be configured as a system consisting of one or more devices.

[0316] Furthermore, the scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described computer program is recorded, but also the computer program itself.

[0317] Examples of the recording medium that can be used include a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM (Compact Disc-Read Only Memory), a magnetic tape, a non-volatile memory card, and a ROM. In addition, the scope of each embodiment is not limited to programs that execute processing by themselves recorded on the recording medium, but also includes programs that execute processing by operating on an OS (Operating System) in cooperation with other software and functions of an expansion board.

[0318] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0319] (Appendix 1) an information acquisition unit that acquires user information about a user from the user who has undergone immigration screening in a first country and is about to board a flight to a second country; an information providing unit that provides the user information for immigration inspection in the second country; An information processing device having the above.

[0320] (Appendix 2) 2. The information processing device according to claim 1, wherein the information acquisition unit acquires biometric information of the user as the user information.

[0321] (Appendix 3) 3. The information processing device according to claim 2, wherein the information acquisition unit acquires multiple types of biometric information of the user in parallel.

[0322] (Appendix 4) 4. The information processing device according to claim 3, wherein the information acquisition unit acquires facial information and fingerprint information of the user in parallel as the biometric information.

[0323] (Appendix 5) 5. The information processing device according to claim 2, further comprising an impersonation determination unit that determines whether or not the user is being impersonated based on the acquisition status of the biometric information.

[0324] (Appendix 6) 6. An information processing device according to any one of appendices 1 to 5, comprising a notification unit that notifies the user that the immigration inspection has been completed or that the user is not subject to the immigration inspection based on the user information.

[0325] (Appendix 7) 7. The information processing device according to claim 6, wherein the notification unit notifies the result of the immigration inspection.

[0326] (Appendix 8) 7. The information processing device according to claim 1, wherein the information providing unit transmits the user information to a server and provides the user information for the immigration inspection.

[0327] (Appendix 9) After immigration in the first country, obtain user information about the user before boarding for the second country; An information processing method for providing the user information for immigration inspection in the second country.

[0328] (Appendix 10) On the computer, After immigration in the first country, the information acquisition unit acquires user information about the user from the user before boarding for the second country; Providing said user information for immigration inspection in said second country A recording medium on which a program for executing the above is recorded.

[0329] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

[0330] This application claims priority based on Japanese Patent Application No. 2018-244803, filed December 27, 2018, the disclosure of which is incorporated herein by reference in its entirety. [Explanation of symbols]

[0331] 1. Information processing system 10...Remote examination terminal 20...Review server 30...Mobile device 40...Guidance device 50...Signage terminal 60...Automated gate device 70, 80...surveillance cameras

Claims

1. an information acquisition unit that acquires user information about a user traveling from a first country to a second country before the user reaches an immigration inspection area of ​​the second country; an image acquisition unit that acquires an image of the user's acquisition of the user information; a determination unit that determines whether or not the user is being impersonated based on the analysis result of the image; an information providing unit that provides the user information for immigration inspection in the second country when it is determined that the spoofing has not occurred; An information processing device having the above.

2. The information processing device according to claim 1 , wherein the information acquisition unit acquires the user information before the user arrives in the second country.

3. The information processing device according to claim 1 , wherein the information acquisition unit acquires the user information within a mobile object traveling to the second country.

4. The information processing device according to claim 1 , wherein the information acquisition unit acquires the user information after the user has completed immigration procedures in the first country.

5. an information processing device acquires user information about a user traveling from a first country to a second country before the user reaches an immigration inspection area of ​​the second country; the information processing device acquires an image capturing a state of acquisition of the user information by the user, The information processing device determines whether or not the user is being impersonated based on the analysis result of the image; An information processing method in which the information processing device provides the user information for immigration inspection in the second country when it is determined that the impersonation has not occurred.

6. On the computer, having an information acquisition unit acquire user information about a user traveling from a first country to a second country before the user reaches an immigration inspection area of ​​the second country; Acquire an image capturing a state of acquisition of the user information by the user; determining whether or not the user is being impersonated based on the analysis result of the image; If it is determined that no such spoofing has occurred, the user information is provided for immigration inspection in the second country. A program that makes it happen.

Images