Server device, control method for server device, and program

Abstract

We provide server equipment that contributes to improving the convenience of users undergoing airport procedures such as immigration inspections. [Solution] The server device comprises a first acquisition means, a first determination means, a second acquisition means, and a first registration means. The first acquisition means acquires information about each of several entrants, including passport number and nationality, as an entry API. The first determination means determines whether each of the several entrants is Japanese or a foreigner based on the nationality contained in each of the several entrants' information. The second acquisition means acquires biometric information for each entrant determined to be Japanese by sending the passport number of each entrant determined to be Japanese to a first server that manages Japanese passport numbers. The first registration means registers the entrant information and acquired biometric information of each entrant determined to be Japanese in a first database.

Description

Technical Field

[0001] The present invention relates to a server device, a control method for the server device, and a program.

Background Art

[0002] There is a technology that uses biometric authentication for immigration inspection at airports and the like.

[0003] For example, in Patent Document 1, when comparing passport information with a blacklist, in addition to character information, face image information is compared to improve the determination accuracy, and the face image of a foreigner entering or leaving the country is compared with the passport information to realize high-precision confirmation of identity. The system for assisting the immigration inspection of foreigners in Patent Document 1 includes a reading unit, a face image acquisition unit, a storage device, a registration unit, a comparison determination device, and a display unit. The reading unit reads the description information written in the passport. The face image acquisition unit acquires the face image of a foreigner entering or leaving the country using a camera. The storage device records passport information, visas, certificates of eligibility for stay, information on the issuance of alien registration certificates, and blacklists. The registration unit registers the blacklist. The comparison determination device compares the description information of the read document with the information recorded in the storage device and extracts the feature points of the face image to compare the feature points of the images. The display unit displays the read information, the information recorded in the storage device, and the result of comparing them.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] To implement biometric authentication in immigration and customs inspections, it is necessary to register the facial images of travelers entering and leaving the country in the system. In this regard, Patent Document 1 employs a configuration in which travelers register the information written in their passports along with their facial images in the system. However, requiring users to perform such system registration reduces user convenience.

[0006] The primary objective of this invention is to provide a server device, a control method for the server device, and a program that contribute to improving the convenience of users undergoing airport procedures such as immigration inspections. [Means for solving the problem]

[0007] According to a first aspect of the present invention, a server device is provided that includes: a first acquisition means for acquiring information about each of a plurality of entrants, including their passport number and nationality, as an entrant API (Advance Passenger Information); a first determination means for determining whether each of the plurality of entrants is Japanese or a foreigner based on the nationality contained in each of the plurality of entrants' entrants' entrants' entrants determined to be Japanese, by transmitting their passport numbers to a first server that manages the passport numbers of Japanese nationals who have been issued passports, thereby acquiring biometric information of each entrant determined to be Japanese; and a first registration means for registering the entrant information of each entrant determined to be Japanese and the acquired biometric information in association with each entrant in a first database.

[0008] According to a second aspect of the present invention, a server device is provided that includes: a first acquisition means for acquiring departure API (Advance Passenger Information) which is information relating to each of a plurality of departures, including the passport number and nationality of each departure; a first determination means for determining whether each of the plurality of departures is Japanese or a foreigner based on the nationality included in each of the plurality of departures'

[0009] A third aspect of the present invention provides a server control method which involves a server device that acquires information about each of several entrants, including their passport number and nationality, as an entry API (Advance Passenger Information), determines whether each of the several entrants is Japanese or a foreigner based on the nationality included in each of the several entrants, and transmits the passport number of each entrant determined to be Japanese to a first server that manages the passport numbers of Japanese nationals who have been issued passports, thereby acquiring the biometric information of each entrant determined to be Japanese, and registers the acquired biometric information in association with the entrant information of each entrant determined to be Japanese in a first database.

[0010] A fourth aspect of the present invention is provided, which causes a computer mounted on a server device to perform the following processes: acquiring information about each of several entrants, including their passport number and nationality, as an entrant API (Advance Passenger Information); determining whether each of the several entrants is Japanese or a foreigner based on the nationality contained in each of the several entrants' [Effects of the Invention]

[0011] According to each aspect of the present invention, a server device, a control method for the server device, and a program are provided that contribute to improving the convenience of users undergoing airport procedures such as immigration inspection. However, the effects of the present invention are not limited to those described above. The present invention may also produce other effects in lieu of or in conjunction with the effects described above. [Brief explanation of the drawing]

[0012] [Figure 1] Figure 1 is a diagram illustrating the outline of one embodiment. [Figure 2] Figure 2 is a flowchart illustrating the operation of one embodiment. [Figure 3] Figure 3 shows an example of a schematic configuration of an information processing system according to the embodiment of this disclosure. [Figure 4] Figure 4 is a diagram illustrating the operation of an information processing system according to an embodiment of this disclosure. [Figure 5] Figure 5 is a diagram illustrating the operation of an information processing system according to an embodiment of this disclosure. [Figure 6] Figure 6 is a diagram illustrating the operation of an information processing system according to an embodiment of this disclosure. [Figure 7] FIG. 7 is a diagram showing an example of a processing configuration of a server device according to an embodiment of the present disclosure. [Figure 8] FIG. 8 is a flowchart showing an example of the operation of an immigrant information control unit according to an embodiment of the present disclosure. [Figure 9] FIG. 9 is a diagram showing an example of an immigrant management database according to an embodiment of the present disclosure. [Figure 10] FIG. 10 is a flowchart showing an example of the operation of an examination control unit according to an embodiment of the present disclosure. [Figure 11] FIG. 11 is a flowchart showing an example of the operation of an examination control unit according to an embodiment of the present disclosure. [Figure 12] FIG. 12 is a diagram showing an example of a schematic configuration of an information processing system according to an embodiment of the present disclosure. [Figure 13] FIG. 13 is a diagram for explaining the operation of an information processing system according to an embodiment of the present disclosure. [Figure 14] FIG. 14 is a diagram for explaining the operation of an information processing system according to an embodiment of the present disclosure. [Figure 15] FIG. 15 is a diagram for explaining the operation of an information processing system according to an embodiment of the present disclosure. [Figure 16] FIG. 16 is a diagram showing an example of a processing configuration of a server device according to an embodiment of the present disclosure. [Figure 17] FIG. 17 is a flowchart showing an example of the operation of an emigrant information control unit according to an embodiment of the present disclosure. [Figure 18] FIG. 18 is a diagram showing an example of an emigrant management database according to an embodiment of the present disclosure. [Figure 19] FIG. 19 is a diagram showing an example of a hardware configuration of a server device according to the present disclosure.

MODE FOR CARRYING OUT THE INVENTION

[0013] First, an overview of one embodiment will be described. The reference numerals in the drawings attached to this overview are provided for convenience as examples to aid understanding, and this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. The connecting lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows schematically indicate the flow of the main signal (data) and do not exclude bidirectional flow. In this specification and in the drawings, elements that can be similarly described are given the same reference numerals to avoid redundant explanation.

[0014] A server device 100 according to one embodiment includes a first acquisition means 101, a first determination means 102, a second acquisition means 103, and a first registration means 104 (see Figure 1). The first acquisition means 101 acquires information about each of a plurality of entrants, including entrant information such as passport number and nationality, as an entrant API (Advance Passenger Information) (Step S1 in Figure 2). The first determination means 102 determines whether each of the plurality of entrants is Japanese or a foreigner based on the nationality contained in each of the plurality of entrant information (Step S2). The second acquisition means 103 acquires biometric information of each entrant determined to be Japanese by transmitting the passport number of each entrant determined to be Japanese to a first server that manages the passport numbers of Japanese people who have been issued passports (Step S3). The first registration means 104 registers the entrant information and acquired biometric information of each entrant determined to be Japanese in a first database (Step S4).

[0015] Server device 100 obtains passport numbers and other information of passengers attempting to enter Japan by aircraft or ship from airlines, shipping companies, etc., using the immigration API mechanism. If the passenger is Japanese, server device 100 transmits the passenger's passport number to a first server (for example, the Ministry of Foreign Affairs server) to obtain the passenger's biometric information (facial image). Server device 100 stores the information obtained as an immigration API and the information obtained from the Ministry of Foreign Affairs server in a database. As a result, the database stores the passport numbers and other information of entrants in association with their biometric information. The information stored in the database is used for procedures within the airport, such as landing inspection, customs inspection, and departure inspection. For example, procedures such as landing inspection and customs inspection can be carried out using biometric authentication. Here, the registration of information in the above database is carried out without requiring any procedure from the user (passenger). In other words, the user can proceed with airport procedures using biometric authentication without performing any procedures. In other words, it will improve convenience for users undergoing airport procedures such as immigration inspections. Also, since the majority of users (passengers) who have no problems with immigration and customs procedures will be able to proceed with airport procedures using biometric authentication, the workload on immigration and customs officials will be reduced.

[0016] Specific embodiments will be described in more detail below with reference to the drawings.

[0017] [First Embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0018] The first embodiment describes an information processing system that controls landing and customs inspections when a passenger enters Japan from a foreign country. The embodiment disclosed herein describes a case where the passenger enters Japan by boarding an aircraft. However, the passenger may also enter Japan by boarding a ship.

[0019] [System Configuration] Figure 3 is a diagram showing an example of the schematic configuration of an information processing system according to the embodiment disclosed herein. The information processing system shown in Figure 3 includes a server device 10, a Ministry of Foreign Affairs server 20, a Ministry of Foreign Affairs server 30, a Customs server 40, and a plurality of cameras 50-1 and 50-2.

[0020] In the following explanation, unless there is a particular reason to distinguish between cameras 50-1 and 50-2, they will simply be referred to as "camera 50".

[0021] Server device 10 is a server that controls passenger immigration and customs inspections (landing and departure inspections) and customs inspections. Server device 10 may be operated by a public institution such as the national or local government, or by a private company commissioned by such a public institution. Server device 10 may be installed within the airport or on a cloud network. Server device 10 may be installed at each airport or seaport. Alternatively, server device 10 may control immigration and customs inspections (landing and departure inspections) at each airport or seaport depending on its settings.

[0022] The Ministry of Foreign Affairs Server 20 is a server managed and operated by the Ministry of Foreign Affairs. For example, the Ministry of Foreign Affairs Server 20 is the primary server that manages the passport numbers of Japanese citizens who have been issued passports. More specifically, the Ministry of Foreign Affairs Server 20 stores information about passports issued to Japanese citizens using a designated database. For example, the Ministry of Foreign Affairs Server 20 stores biometric information (facial images) in addition to the passport recipient's name, gender, passport number, etc.

[0023] The Immigration Services Agency Server 30 is a server managed and operated by the Immigration Services Agency. For example, the Immigration Services Agency Server 30 is a second server that stores information on individuals who have been determined by the Immigration Services Agency to be subject to entry restrictions. More specifically, the Immigration Services Agency Server 30 holds a blacklist containing information on individuals subject to entry restrictions, such as criminals and persons of interest. The blacklist includes passport numbers and facial images of criminals and others.

[0024] Customs Server 40 is a server managed and operated by customs. For example, Customs Server 40 is a third server that stores information on individuals who have been determined by customs to be subject to entry restrictions. More specifically, Customs Server 40 maintains a blacklist containing information on individuals subject to entry restrictions, such as criminals and persons of interest. The blacklist includes passport numbers and facial images of criminals and other individuals.

[0025] Furthermore, the administrative agency server 30 and the customs server 40 maintain blacklists.

[0026] Camera 50-1 is positioned to photograph incoming travelers (those subject to immigration inspection) appearing at the immigration inspection area. Camera 50-2 is positioned to photograph incoming travelers (those subject to customs inspection) appearing at the customs inspection area.

[0027] The devices included in the information processing system shown in Figure 3 (server device 10, Ministry of Foreign Affairs server 20, etc.) are configured to communicate with each other via a network. For example, server device 10 and camera 50 are connected by wired or wireless communication means and are configured to communicate with each other.

[0028] Figure 3 is illustrative and is not intended to limit the configuration of the information provision system disclosed in this application. For example, the information processing system may include multiple server devices 10. Load balancing and redundancy may be achieved by using multiple server devices 10. Also, the number of cameras 50 included in the information processing system is not limited to 2. For example, multiple cameras 50 may be installed in both the landing inspection area and the customs inspection area.

[0029] [System Overview] Next, we will explain the general operation of the information processing system.

[0030] As described above, the first embodiment will describe the passenger landing inspection and customs inspection.

[0031] There are no gates or other barriers at immigration or customs inspection areas to physically restrict the passage of incoming travelers. Travelers who do not have any problems found during immigration or customs inspection can walk through these areas. In contrast, travelers who do have problems found during immigration or customs inspection will be stopped by immigration officers or customs staff.

[0032] The airline of the aircraft carrying the arriving passenger transmits passenger information to the server device 10 for each flight. The airline may transmit the passenger information directly to the server device 10, or it may transmit the passenger information to the server device 10 via another system. Specifically, the airline's server transmits the flight number and information about each arriving passenger (passenger) (name, nationality / region, date of birth, gender, passport number, departure city, final destination) to the server device 10 as an arrival API (Advance Passenger Information).

[0033] In the following explanation, the information transmitted to the server device 10 as the immigration API will be referred to as "immigrant information."

[0034] Furthermore, before entering the country, visitors transmit customs declaration information to the server device 10 using electronic travel authorization systems such as VJW (Visit Japan Web) or ETA (Electronic Travel Authorization). In addition, foreign visitors transmit the information written on their ED (Embarkation / Disembarkation) card (ED information) and customs declaration information to the server device 10 before entering the country.

[0035] Entering the country transmits customs declaration information and other details to the server device 10 using a smartphone or other terminal.

[0036] Furthermore, if the entrant is a foreign national, biometric information (facial image, fingerprint image) is acquired at kiosk terminals (not shown in Figure 3, etc.) installed within the airport. The kiosk terminals acquire the name, nationality, passport number, and biometric information from the passport held by the entrant (foreign national). Specifically, the kiosk terminals acquire the name, gender, passport number, etc. from the MRZ (Machine Readable Zone) of the passport. Alternatively, the kiosk terminals use OCR (Optical Character Recognition) technology to acquire the name, gender, passport number, etc. from the page of the passport where the facial photograph is located. In addition, the kiosk terminals acquire biometric information (facial image) from the IC (Integrated Circuit) chip embedded in the passport. Alternatively, the kiosk terminals acquire biometric information (facial image) from the page of the passport where the facial photograph is located. The kiosk terminals transmit information obtained from the passport, including name, nationality, and passport number (hereinafter referred to as passport information), and biometric information to the server device 10 and the administrative agency server 30.

[0037] The kiosk terminals described above are examples of information processing terminals capable of acquiring passport information and biometric information and transmitting the acquired information to the server device 10 and the administrative agency server 30. These may be replaced by other information processing terminals such as tablets or personal computers. Furthermore, the acquisition of passport information and biometric information, and the transmission of passport information and biometric information to the server device 10 and the administrative agency server 30, may each be performed by separate information processing terminals.

[0038] Detailed explanations of entry API transmission and electronic travel authorization systems such as VJW are omitted as they are self-evident to those skilled in the art. Similarly, detailed explanations of obtaining biometric and passport information at kiosk terminals are omitted as they are also self-evident to those skilled in the art.

[0039] <Generating a dataset> The server device 10 determines whether each entrant is Japanese or a foreigner based on the nationality contained in the entrant information received from the airline's server.

[0040] If the person entering the country is Japanese, the server device 10 transmits the person's passport number to the Ministry of Foreign Affairs server 20 (step S01 in Figure 4). The Ministry of Foreign Affairs server 20 searches its database based on the passport number and transmits the corresponding facial image to the server device 10 (step S02).

[0041] Upon receiving a facial image, the server device 10 stores the information obtained from the airline's server (e.g., name, passport number, etc.), the facial image obtained from the Ministry of Foreign Affairs server 20, and the customs declaration information obtained in advance from the passenger, in association with each other. For example, the server device 10 generates a dataset (gallery, token) consisting of the passenger information, facial image, and customs declaration information, and stores it in the passenger management database. Details of the passenger management database will be described later.

[0042] If the entrant is a foreign national, the server device 10 stores the passport information and biometric information (facial image, fingerprint image) received from the kiosk terminal, etc., in the entrant management database. The server device 10 also stores the ED information and customs declaration information obtained in advance from the passenger in the entrant management database.

[0043] When the immigration API generates a dataset for each incoming person notified, the server device 10 sends each incoming person's passport number, nationality, and facial image to the administrative agency server 30 (step S03).

[0044] The management agency server 30 uses nationality, passport number, and facial image to determine whether or not each entrant is on the blacklist.

[0045] If an entrant is on the blacklist, the management agency server 30 notifies the server device 10 that the entrant is a "person whose entry is pending" (step S04).

[0046] For example, the administrative agency server 30 sends a list containing the passport numbers of persons with entry reservations to the server device 10. If the administrative agency server 30 does not include any persons with entry reservations among the entrants, it notifies the server device 10 accordingly. For example, the administrative agency server 30 sends an empty list without passport numbers to the server device 10.

[0047] The server device 10 sets an entry (entry in the immigration management database) for the entrant who has been notified as an immigration reserve. For example, the server device 10 sets the immigration reserve (immigration) flag in the corresponding entry in the immigration management database.

[0048] Before and after transmitting information to the administrative agency server 30, the server device transmits each entrant's passport number, nationality, and facial image to the customs server 40 (step S05).

[0049] The customs server 40, like the administrative agency server 30, determines whether or not each incoming person is on the blacklist.

[0050] If an entrant is on the blacklist, the customs server 40 notifies the server device 10 that the entrant is a person whose entry is being held back (step S06).

[0051] For example, the customs server 40 sends a list containing the passport numbers of persons with entry reservations to the server device 10. If the customs server 40 does not include any persons with entry reservations among the entrants, it notifies the server device 10 accordingly. For example, the customs server 40 sends an empty list without passport numbers to the server device 10.

[0052] The server device 10 sets an entry for an entrant who has been notified as an entry detainee. For example, the server device 10 sets the entry for entry detainee (customs) in the corresponding entry in the entrant management database.

[0053] <Landing inspection> Upon disembarking from the aircraft, the arriving passengers proceed to the immigration inspection area. As described above, the immigration inspection area is equipped with a camera 50-1 capable of photographing arriving passengers passing through the area. Camera 50-1 transmits the image data acquired through photography, along with the camera ID, to the server device 10 (step S11 in Figure 5).

[0054] The camera ID is an identifier used to identify camera 50 installed within the airport. The camera ID can be the MAC (Media Access Control) address or IP (Internet Protocol) address of camera 50.

[0055] When image data is acquired from camera 50-1, server device 10 extracts a face image from the image data. After extracting the face image, server device 10 performs a matching process using the extracted face image and biometric information stored in the immigration management database. By performing the matching process, server device 10 identifies the entrant (person subject to inspection) who is about to pass through the immigration inspection area from among multiple entrants stored in the immigration management database.

[0056] The server device 10 determines whether the "Immigration Reserved Person (Immigration) Flag" is set for the identified entrant.

[0057] If the identified entrant does not have the "Immigration Reserved Person (Immigration) Flag" set, the server device 10 notifies the management agency server 30 that it has confirmed the entry of the entrant who is not set as an immigration reserve person. Specifically, the server device 10 sends the entrant's passport number and other information to the management agency server 30.

[0058] If the "Immigration Reserved Person (Immigration) Flag" is set for the identified entrant, the server device 10 notifies the immigration officer waiting at the landing inspection area of ​​the information of the immigration reserve person (e.g., facial image, name, nationality, passport number, etc.). For example, the server device 10 transmits the above information of the immigration reserve person to the immigration officer's terminal 60 (step S12).

[0059] The immigration officer will refer to the provided facial image and other information to identify the person with entry restrictions from among the multiple entrants attempting to pass through the immigration inspection area, and will approach the identified person with entry restrictions. The immigration officer will then conduct an immigration inspection, including questioning the person with entry restrictions about their circumstances.

[0060] Immigrants who are not stopped by an inspector at the immigration checkpoint will proceed through the immigration checkpoint to the customs inspection area.

[0061] <Customs Inspection> As described above, camera 50-2 is installed in the customs inspection area. Camera 50-2 transmits the camera ID along with the image data obtained from the camera to the server device 10 (step S21 in Figure 6).

[0062] The server device 10, similar to the landing inspection process, performs a matching process using facial images to identify the entrant (person subject to inspection) who is about to pass through the customs inspection area from among multiple entrants stored in the immigration management database.

[0063] The server device 10 determines whether the "entry reservation (customs) flag" is set for the identified entrant.

[0064] If the identified entrant does not have the "entry reservation (customs) flag" set, the server device 10 notifies the customs server 40 that it has conducted a customs inspection of the entrant who is not set as an entry reservation. Specifically, the server device 10 sends the entrant's passport number to the customs server 40.

[0065] If the "Immigration Reserved Person (Customs) Flag" is set for the identified entrant, the server device 10 notifies the customs officer waiting at the customs inspection area of ​​the information of the immigration reserve person (e.g., facial image, name, nationality, passport number, etc.). For example, the server device 10 transmits the above information of the immigration reserve person to the officer's terminal 61 (step S22).

[0066] Customs officers will refer to the provided facial images and other information to identify individuals with entry restrictions from among multiple entrants attempting to pass through the customs inspection area, and will approach these individuals. Customs officers will then conduct a customs inspection, including questioning the individuals with entry restrictions about their circumstances.

[0067] Immigrants who are not stopped by customs officers at the landing customs inspection area will pass through the customs inspection area (customs).

[0068] Thus, the vast majority of entrants who are not designated as those with entry restrictions can pass through the immigration and customs inspection areas without gates.

[0069] Next, we will describe the details of each device included in the information processing system according to the first embodiment.

[0070] [Server equipment] Figure 7 shows an example of the processing configuration (processing module) of the server device 10 according to the embodiment disclosed herein. Referring to Figure 7, the server device 10 comprises a communication control unit 201, an immigration information control unit 202, an examination control unit 203, and a storage unit 204.

[0071] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the Ministry of Foreign Affairs server 20. The communication control unit 201 also transmits data to the Ministry of Foreign Affairs server 20. The communication control unit 201 passes the data received from other devices to other processing modules. The communication control unit 201 transmits the data obtained from other processing modules to other devices. In this way, other processing modules send and receive data with other devices via the communication control unit 201. The communication control unit 201 has the function of a receiving unit that receives data from other devices and the function of a transmitting unit that transmits data to other devices.

[0072] The immigration information control unit 202 is a means for performing control over immigration information received from servers of airlines, etc.

[0073] The immigration information control unit 202 includes the functions of a first acquisition means, a first determination means, a second acquisition means, and a first registration means.

[0074] The first acquisition means obtains information about each of the multiple entrants, including their passport number and nationality, as entry API (Advance Passenger Information). The first determination means determines whether each of the multiple entrants is Japanese or a foreigner based on the nationality contained in each of the multiple entrants' entry information. The second acquisition means obtains biometric information (facial image) of each entrant determined to be Japanese by transmitting the passport number of each entrant determined to be Japanese to the Ministry of Foreign Affairs server 20 managed by the Ministry of Foreign Affairs. The first registration means registers the entry information and the obtained biometric information of each entrant determined to be Japanese in the first database (entrant management database).

[0075] Figure 8 is a flowchart showing an example of the operation of the immigration information control unit 202 according to the embodiment disclosed herein. The operation of the immigration information control unit 202 will be explained with reference to Figure 8.

[0076] The immigration information control unit 202 determines whether each entrant is Japanese or not based on the nationality contained in each of the at least one pieces of immigration information received from the server of an airline or the like (determining nationality; step S101).

[0077] The immigration information control unit 202 transmits the passport number of each entrant determined to be Japanese to the Ministry of Foreign Affairs server 20 (step S102). For example, the immigration information control unit 202 transmits a list containing the passport numbers of each entrant determined to be Japanese to the Ministry of Foreign Affairs server 20.

[0078] The immigration information control unit 202 receives a combination of passport number and facial image for each entrant from the Ministry of Foreign Affairs server 20.

[0079] The immigration information control unit 202 stores immigration information (e.g., name, passport number, etc.), facial images obtained from the Ministry of Foreign Affairs server 20, and customs declaration information obtained in advance from the passenger in the immigration management database for each entrant (Japanese national). The immigration information control unit 202 generates a dataset for Japanese nationals and registers it in the immigration management database (registration of Japanese national data; step S103).

[0080] Figure 9 shows an example of an immigration management database according to the embodiment disclosed herein. The immigration management database is generated for each flight (or each ship). Note that the immigration management database shown in Figure 9 is illustrative and is not intended to limit the items to be stored.

[0081] The immigration information control unit 202 matches immigration information, passport information, and biometric information for each immigration person determined to be a foreigner, based on the passport number and country code (country identification code) included in the immigration information and the passport number included in the passport information received from a kiosk terminal or the like.

[0082] Once the name matching is complete, the immigration information control unit 202 stores information obtained from passport information such as name and passport number, biometric information (facial image, fingerprint image), ED information, and customs declaration information in the immigration management database. The immigration information control unit 202 generates a dataset for foreigners and registers it in the immigration management database (foreigner data registration; step S104).

[0083] Once the registration of data for both Japanese and foreign nationals is complete, the immigration information control unit 202 generates feature quantities from the facial images of each entrant. The immigration information control unit 202 stores the generated feature quantities in the immigration management database.

[0084] Regarding the feature generation process, existing technologies can be used, so a detailed explanation will be omitted. For example, the immigration information control unit 202 extracts the eyes, nose, mouth, etc., from the face image as feature points. Then, the immigration information control unit 202 calculates the position of each feature point and the distance between each feature point as feature quantities (generating a feature vector consisting of multiple feature quantities).

[0085] Once the registration of data for Japanese and foreign nationals is complete, the immigration information control unit 202 transmits the passport number, nationality, and facial image set for each entry stored in the immigration management database to the management agency server 30 (transmitting facial image, etc.; step S105).

[0086] The immigration information control unit 202 receives a list containing the passport numbers of immigration detainees from the administrative agency server 30.

[0087] The immigration information control unit 202 searches the immigration management database based on the passport numbers included in the list and identifies the corresponding entry. The immigration information control unit 202 sets a flag in the immigration reserve (immigration) field of the identified entry (setting immigration reserve; step S106).

[0088] Furthermore, if the immigration information control unit 202 receives an empty list from the management agency server 30, it will not perform any special processing.

[0089] Before and after transmitting information to the administrative agency server 30, the immigration information control unit 202 transmits the passport number, nationality, and facial image set for each entry stored in the immigration management database to the customs server 40 (transmitting facial image, etc.; step S107).

[0090] The immigration information control unit 202 receives a list from the customs server 40 that includes the passport numbers of persons with entry reservations.

[0091] The immigration information control unit 202 searches the immigration management database based on the passport numbers included in the list and identifies the corresponding entry. The immigration information control unit 202 sets a flag in the immigration reserver (customs) field of the identified entry (setting immigration reserver; step S108).

[0092] If the customs server 40 receives an empty list, the immigration information control unit 202 does not perform any special processing.

[0093] Thus, the immigration information control unit 202 functions as a third acquisition means for acquiring passport information, including passport number and nationality, and biometric information, for each entrant determined to be a foreigner, as recorded in their passport. The first registration means registers the passport information and biometric information of each entrant determined to be a foreigner in the first database (entrant management database).

[0094] Furthermore, the immigration information control unit 202 includes the functions of a first setting means and a second setting means. The first setting means transmits the passport number, nationality, and biometric information of at least one entrant registered in the first database to the management agency server 30. By transmitting the passport number, etc., to the management agency server 30, the first setting means receives the passport number of a first entry reserve person, who is among at least one entrant whose entry into Japan is being withheld. The first setting means sets the entrant corresponding to the passport number received from the management agency server 30, among at least one entrant registered in the first database, as the first entry reserve person. The second setting means transmits the passport number, nationality, and biometric information of at least one entrant registered in the first database to the customs server 40. By transmitting the passport number, etc., to the customs server 40, the second setting means receives the passport number of a second entry reserve person, who is among at least one entrant whose entry into Japan is being withheld. The second setting means sets the entrant corresponding to the passport number received from the customs server 40 from among at least one entrant registered in the first database as the second entrant reservation.

[0095] The inspection control unit 203 is a means for performing control related to landing inspection and customs inspection.

[0096] Figures 10 and 11 are flowcharts illustrating an example of the operation of the examination control unit 203 according to the embodiment disclosed herein. The operation of the examination control unit 203 will be explained with reference to Figures 10 and 11.

[0097] The inspection control unit 203 receives the camera ID and image data from the camera 50.

[0098] The inspection control unit 203 extracts a face image from the received image data (step S201).

[0099] Note that the facial image extraction process by the review control unit 203 can utilize existing technologies, so a detailed explanation is omitted. For example, the review control unit 203 may extract facial images (facial regions) from image data using a learning model trained by a CNN (Convolutional Neural Network). Alternatively, the review control unit 203 may extract facial images using methods such as template matching.

[0100] If no facial image is extracted, the review control unit 203 terminates the process.

[0101] If a facial image is extracted, the examination control unit 203 performs a matching process using the extracted facial image and at least one biometric information (feature) stored in the immigration management database (step S202).

[0102] More specifically, the screening control unit 203 generates feature quantities from the extracted facial image. The screening control unit 203 sets the generated feature quantities as the matching targets and performs a matching process (one-to-many matching; N is a positive integer, the same applies hereafter) with each of the multiple feature quantities stored in the immigration management database.

[0103] The review control unit 203 calculates the similarity between each of the feature quantities to be matched and the multiple feature quantities on the registration side. The chi-squared distance, Euclidean distance, etc., can be used to calculate this similarity. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

[0104] The examination control unit 203 determines that the matching process has failed if, among the multiple feature quantities stored in the immigration management database, there is no feature quantity whose similarity to the feature quantity to be matched is equal to or greater than a predetermined value.

[0105] The review control unit 203 determines that the matching process was successful if, among the multiple features stored in the immigration management database, there is a feature whose similarity to the feature to be matched is equal to or greater than a predetermined value. In this case, the user of the entry with the highest similarity is identified as the person in the image.

[0106] If the matching process fails, the examination control unit 203 does not perform any special processing. Alternatively, the examination control unit 203 may notify the immigration officer, customs officer, etc., at the landing inspection area or customs inspection area that there is a person who is not registered in the immigration management database. Normal entrants are registered in the immigration management database. Since the person who failed the matching process may be a suspicious person, the examination control unit 203 may notify the immigration officer, customs officer, etc., of the facial image, etc., of the person who failed the matching process.

[0107] If the matching process is successful, the inspection control unit 203 identifies the location where the image data was taken based on the camera ID (step S203). Specifically, the inspection control unit 203 determines whether the image data was obtained by photographing the landing inspection area or the customs inspection area.

[0108] If image data is obtained at the landing inspection area (step S204, Yes branch), the inspection control unit 203 determines whether the entrant identified by the matching process is a person who has been determined to be a person with immigration reservations by immigration authorities. The inspection control unit 203 determines whether the immigration reservation (immigration) flag is set for the entrant identified by the matching process.

[0109] If the entrant is not an entry reserve (step S205, No branch), the examination control unit 203 notifies the administrative agency server 30 that it has confirmed the entry of the entrant who is not designated as an entry reserve. Specifically, the examination control unit 203 sends the passport number and other information of the entrant who is not designated as an entry reserve to the administrative agency server 30 (step S206).

[0110] If the entrant is a person with an entry reservation (step S205, Yes branch), the examination control unit 203 notifies the immigration officer waiting at the landing inspection area of ​​the information of the person with an entry reservation (e.g., facial image, name, nationality, passport number, etc.). Specifically, the examination control unit 203 transmits the above information of the person with an entry reservation to the immigration officer's terminal 60 (providing information to the immigration officer; step S207).

[0111] If image data is obtained at the customs inspection station (step S204, No branch), the examination control unit 203 determines whether the entrant identified by the matching process is a person who has been determined to be a person with entry reservations at customs. The examination control unit 203 determines whether the entry reservation (customs) flag is set for the entrant identified by the matching process.

[0112] If the entrant is not an entry reserve (step S208, No branch in Figure 11), the inspection control unit 203 notifies the customs server 40 that it has confirmed the entry of the entrant who is not designated as an entry reserve. Specifically, the inspection control unit 203 sends the passport number and other information of the entrant who is not designated as an entry reserve to the customs server 40 (step S209).

[0113] If the person entering the country is a person with an entry reservation (step S208, Yes branch), the inspection control unit 203 notifies the customs officer waiting at the customs inspection area of ​​the information of the person with an entry reservation (e.g., facial image, name, nationality, passport number, etc.). Specifically, the inspection control unit 203 transmits the above information of the person with an entry reservation to the officer's terminal 61 held by the customs officer (providing information to customs officer; step S210).

[0114] Furthermore, if multiple people are captured in a single image file, the screening control unit 203 performs the processing shown in Figures 10 and 11 for each of those multiple people. In addition, if the screening control unit 203 performs the determination of an entry reserve and the information transmission process for an entrant identified through the matching process, it may store this fact in the entrant management database. If a person who has already been determined to be an entry reserve is photographed again by camera 50-1 or camera 50-2, the screening control unit 203 may omit processing for that person based on the settings in the entrant management database.

[0115] Thus, the inspection control unit 203 functions as an inspection means. The inspection control unit 203 acquires image data of persons under inspection who have arrived at the landing inspection area from a first camera installed at the landing inspection area. The inspection control unit 203 performs a matching process using the biometric information of the persons under inspection captured in the acquired image data and at least one biometric information stored in the first database (immigration management database). By performing the matching process, the inspection control unit 203 identifies the person under inspection, and if the identified person under inspection is set as a first immigration reserve person, it notifies the inspection officer waiting at the landing inspection area of ​​the information of the identified person under inspection. In addition, the inspection control unit 203 acquires image data of persons under inspection who have arrived at the customs inspection area from a second camera installed at the customs inspection area. The inspection control unit 203 performs a matching process using the biometric information of the persons under inspection captured in the acquired image data and at least one biometric information stored in the first database. The inspection control unit 203 identifies the person to be inspected by performing a matching process, and if the identified person to be inspected is designated as a second person to remain in immigration, it notifies the customs officers waiting at the customs inspection area of ​​the information of the identified person to be inspected.

[0116] The memory unit 204 is a means for storing information necessary for the operation of the server device 10.

[0117] [Ministry of Foreign Affairs servers, etc.] Detailed explanations regarding the Ministry of Foreign Affairs server 20, the Administration Agency server 30, and the Customs server 40 are omitted. When the Ministry of Foreign Affairs server 20 receives a passport number, it should send the corresponding facial image to the server device 10. When the Administration Agency server 30 and the Customs server 40 receive a passport number, they should determine whether the person identified by the passport number is a person reserved for entry into the country and send the determination result to the server device 10.

[0118] [Examiner's terminal, etc.] Examples of examiner terminals 60 and staff terminals 61 include mobile devices such as smartphones, mobile phones, and tablets, as well as computers (personal computers, laptops, etc.). Examiner terminals 60 and staff terminals 61 can be any equipment or device as long as they can receive user input and communicate with the server device 10, etc. Furthermore, the configuration of examiner terminals 60 and staff terminals 61 is obvious to those skilled in the art, so a detailed explanation is omitted.

[0119] As described above, the server device 10 according to the first embodiment obtains the passport number and other information of passengers attempting to enter Japan from airlines and other entities using the immigration API mechanism. If the passenger is Japanese, the server device 10 transmits the passenger's passport number to the Ministry of Foreign Affairs server to obtain the passenger's biometric information (facial image). The server device 10 also obtains the passport number and biometric information of foreign nationals from kiosk terminals and other devices installed in the airport. The server device 10 associates the passport number and other information of entrants with their biometric information and stores it in the immigration management database. The information stored in the immigration management database is used in the procedures for landing inspection and customs inspection. Specifically, the server device 10 uses the biometric information stored in the immigration management database to detect individuals whose entry is pending from among multiple entrants. Here, the registration of information in the immigration management database is carried out without requiring any procedures from the user (passenger). As a result, the convenience of users undergoing airport procedures related to landing inspection, etc., is improved.

[0120] Furthermore, entrants who are not determined to be persons with entry restrictions can walk through the landing inspection area and customs inspection area, which do not have gates (so-called "face-based" entry). In other words, the information processing system according to the first embodiment realizes gateless authentication for landing inspection and customs inspection. In the system according to the first embodiment, entrants who are not designated as persons with entry restrictions can pass through the landing inspection area and customs inspection area without being stopped by inspectors or customs officers. As a result, the system throughput is improved. In other words, congestion at the landing inspection area and customs inspection area is eliminated.

[0121] [Second Embodiment] Next, a second embodiment will be described in detail with reference to the drawings.

[0122] A second embodiment describes an information processing system that controls the departure procedures when a passenger departs from Japan to a foreign country. In the embodiment disclosed herein, the case where the passenger departs from Japan by boarding an aircraft is described. However, the passenger may also depart from Japan by boarding a ship.

[0123] As shown in Figure 12, the information processing system according to the second embodiment includes a camera 50-3 installed in the immigration inspection area.

[0124] The following will focus on explaining the differences between the first and second embodiments.

[0125] First, we will describe the general operation of the information processing system according to the second embodiment.

[0126] The airline of the aircraft carrying the departing passenger transmits passenger information to the server device 10 for each flight. Specifically, the airline's server transmits the flight number and information about each departing passenger (name, nationality / region, date of birth, gender, passport number, departure city, final destination) to the server device 10 as an Advance Passenger Information API (Advance Passenger Information).

[0127] In the following explanation, the information sent to the server device 10 as the departure API will be referred to as "departure information".

[0128] <Generating a dataset> The server device 10 determines whether each departing passenger is Japanese or a foreigner based on the nationality contained in the passenger information received from the airline's server.

[0129] If the departing person is a Japanese national, the server device 10 transmits the departing person's passport number to the Ministry of Foreign Affairs server 20 (step S31 in Figure 13). The Ministry of Foreign Affairs server 20 searches its database based on the passport number and transmits the corresponding facial image to the server device 10 (step S32).

[0130] Upon receiving a facial image, the server device 10 stores the departure information (e.g., name, passport number, etc.) obtained from the airline's server and the facial image obtained from the Ministry of Foreign Affairs server 20 in association with each other. For example, the server device 10 generates a dataset consisting of departure information and facial images and stores it in the departure management database. Details of the departure management database will be described later.

[0131] If the person departing is a foreign national, the server device 10 transmits the person's passport number and nationality to the administrative agency server 30 (step S33). The administrative agency server 30 searches its database based on the passport number and nationality and transmits the corresponding facial image to the server device 10 (step S34).

[0132] When foreigners enter Japan, their passport information and biometric information (facial image, fingerprint image) are collected at kiosk terminals, etc. The kiosk terminals, etc., transmit the collected passport information and biometric information to the administrative agency server 30. The administrative agency server 30 stores the passport information, including passport numbers, and biometric information in association with each country (nationality).

[0133] Upon receiving a facial image, the server device 10 stores in the departure management database, associating the departure information (e.g., name, passport number, etc.) obtained from the airline's server with the facial image obtained from the management agency server 30, similar to the case where the departureee is a Japanese national.

[0134] When the departure API generates a dataset for each person who has been notified of their departure, the server device 10 sends each person's passport number, nationality, and facial image to the administrative agency server 30 (see Figure 14).

[0135] The management agency server 30 uses nationality, passport number, and facial image to determine whether or not each person departing the country is on the blacklist.

[0136] If a person departing the country is on the blacklist, the management agency server 30 notifies the server device 10 that the person is a "person whose departure is being withheld."

[0137] For example, the administrative agency server 30 sends a list containing the passport numbers of those who have reserved their departure from the country to the server device 10. If the administrative agency server 30 does not include any persons who have reserved their departure from the country among those who have left the country, it notifies the server device 10 of this fact. For example, the administrative agency server 30 sends an empty list without passport numbers to the server device 10.

[0138] The server device 10 sets an entry for the person who has been notified as a departure reserve (an entry in the departure management database) to that effect. For example, the server device 10 sets a departure reserve flag in the corresponding entry in the departure management database.

[0139] <Exit Immigration> The departing passengers proceed to the immigration checkpoint. As described above, the immigration checkpoint is equipped with a camera 50-3 capable of photographing departing passengers passing through the checkpoint. Camera 50-3 transmits the image data acquired through photography, along with the camera ID, to the server device 10 (step S41 in Figure 15).

[0140] When image data is acquired from camera 50-3, server device 10 extracts a face image from the image data. After extracting the face image, server device 10 performs a matching process using the extracted face image and biometric information stored in the departure management database. By performing the matching process, server device 10 identifies the departure person (person subject to review) who is about to pass through the departure inspection area from among multiple departure persons stored in the departure management database.

[0141] The server device 10 determines whether the "departure reserve flag" is set for the identified departure person.

[0142] If the identified departureee flag is not set, the server device 10 notifies the administrative agency server 30 and the customs server 40 that it has confirmed the departure of the departureee who is not set as an departure reserveer. Specifically, the server device 10 sends the departureee's passport number and other information to the administrative agency server 30 and the customs server 40.

[0143] If the "departure reserve flag" is set for the identified departure person, the server device 10 notifies the immigration officer waiting at the departure inspection area of ​​the departure reserve person's information (e.g., facial image, name, nationality, passport number, etc.). For example, the server device 10 transmits the departure reserve person's information to the immigration officer's terminal 60 (step S42).

[0144] The immigration officer will refer to the provided facial image and other information to identify the person who has reserved their right to leave the country from among the multiple departing passengers attempting to pass through the immigration checkpoint, and will approach the identified person. The immigration officer will then conduct the immigration check, including questioning the person who has reserved their right to leave.

[0145] Departure passengers who are not stopped by immigration officers at the departure immigration checkpoint will proceed through the checkpoint.

[0146] [Server equipment] Figure 16 shows an example of the processing configuration (processing module) of the server device 10 according to the embodiment of the present disclosure. Referring to Figure 16, the departure information control unit 205 is added to the configuration of the server device 10 according to the first embodiment.

[0147] The departure information control unit 205 is a means for performing control over departure information received from servers of airlines, etc.

[0148] The Departure Information Control Unit 205 includes a third acquisition means function, a second determination means function, a fourth acquisition means function, and a second registration means function. The third acquisition means acquires departure information, including passport number and nationality, for each of the multiple departures as Departure API (Advance Passenger Information). The second determination means determines whether each of the multiple departures is Japanese or a foreigner based on the nationality included in each of the multiple departures' information. The fourth acquisition means acquires biometric information for each departure determined to be Japanese by transmitting the passport number of each departure determined to be Japanese to the Ministry of Foreign Affairs server 20. The second registration means registers the departure information and acquired biometric information of each departure determined to be Japanese in the second database (Departure Management Database).

[0149] Furthermore, the Departure Information Control Unit 205 has a fifth acquisition means function, which acquires biometric information of each departure person determined to be a foreigner by transmitting their passport number and nationality to the Management Agency Server 30. The second registration means registers the departure information of each departure person determined to be a foreigner and the acquired biometric information in a second database.

[0150] Figure 17 is a flowchart illustrating an example of the operation of the departure information control unit 205 according to the embodiment disclosed herein. The operation of the departure information control unit 205 will be explained with reference to Figure 17.

[0151] The departure information control unit 205 determines whether each departure is Japanese or not based on the nationality contained in each of the departure information received from the server of an airline or the like (determining nationality; step S301).

[0152] The Departure Information Control Unit 205 transmits the passport number of each departing person identified as a Japanese national to the Ministry of Foreign Affairs server 20 (step S202). The Departure Information Control Unit 205 retrieves the combination of each departing person's passport number and facial image from the Ministry of Foreign Affairs server 20.

[0153] The Departure Information Control Unit 205 stores in the Departure Management Database, for each departing person (Japanese national), the departure information (e.g., name, passport number, etc.) and the facial image obtained from the Ministry of Foreign Affairs Server 20 in association with each departing person. The Departure Information Control Unit 205 generates a dataset for Japanese nationals and registers it in the Departure Management Database (registration of Japanese national data; step S303).

[0154] Figure 18 shows an example of an outbound passenger management database according to the embodiment of the present disclosure. The outbound passenger management database is generated for each flight (or each ship). Note that the outbound passenger management database shown in Figure 18 is illustrative and is not intended to limit the items to be stored.

[0155] The Departure Information Control Unit 205 transmits the passport number and nationality of each departureee determined to be a foreigner to the Management Agency Server 30 (step S304). The Departure Information Control Unit 205 retrieves the combination of each departureee's passport number and facial image from the Management Agency Server 30.

[0156] The Departure Information Control Unit 205 stores in the Departure Management Database, associating departure information (e.g., name, passport number, etc.) with a facial image obtained from the Management Agency Server 30 for each departure (foreigner). The Departure Information Control Unit 205 generates a dataset for foreigners and registers it in the Departure Management Database (Foreigner Data Registration; Step S305).

[0157] Once the registration of data for both Japanese and foreign nationals is complete, the Departure Information Control Unit 205 generates feature quantities from the facial images of each departing national. The Departure Information Control Unit 205 stores the generated feature quantities in the Departure Management Database.

[0158] Once the registration of data for Japanese and foreign nationals is complete, the Departure Information Control Unit 205 transmits the passport number, nationality, and facial image set for each entry stored in the Departure Management Database to the Management Agency Server 30 (transmitting facial image, etc.; step S306).

[0159] The Departure Information Control Unit 205 receives a list containing the passport numbers of departure reserves from the Management Agency Server 30.

[0160] The Departure Information Control Unit 205 searches the Departure Management Database based on the passport numbers included in the list and identifies the corresponding entry. The Departure Information Control Unit 205 sets a flag in the Departure Reserver field of the identified entry (Setting of Departure Reserver; step S307).

[0161] Furthermore, if the management agency server 30 receives an empty list, the departure information control unit 205 does not perform any special processing.

[0162] The inspection control unit 203 according to the second embodiment processes image data received from the camera 50-3 installed in the immigration inspection area. The operation of the inspection control unit 203 according to the second embodiment will now be described in terms of how it differs from the operation of the inspection control unit 203 according to the first embodiment.

[0163] If the matching process using the facial image is successful, the inspection control unit 203 identifies the location where the image data was taken based on the camera ID.

[0164] If image data is obtained at the departure immigration checkpoint, the examination control unit 203 determines whether the person identified by the matching process is a person who has been determined to be a person who has been deported by immigration authorities. The examination control unit 203 also determines whether the person identified by the matching process has the deportation deportation detention flag set.

[0165] If the departing person is not a designated departure reserve, the review control unit 203 notifies the administrative agency server 30 and the customs server 40 that it has confirmed the departure of the departing person who is not designated as a departure reserve. Specifically, the review control unit 203 sends the passport number and other information of the departing person who is not designated as a departure reserve to the administrative agency server 30 and the customs server 40.

[0166] If the departing passenger is a passenger with a reservation to leave the country, the examination control unit 203 notifies the immigration officer waiting at the departure immigration area of ​​the passenger's information (e.g., facial image, name, nationality, passport number, etc.). Specifically, the examination control unit 203 transmits the above-mentioned passenger with a reservation to the immigration officer's terminal 60.

[0167] Thus, the departure information control unit 205 according to the second embodiment includes a setting means function. The departure information control unit 205 transmits the passport number, nationality, and biometric information of at least one departure person registered in the second database (departure management database) to the management agency server 30. By transmitting the passport number, etc., the departure information control unit 205 receives the passport number of at least one departure person whose departure from Japan is being withheld. The departure information control unit 205 sets the departure person whose passport number received from the management agency server 30 corresponds to the departure person among at least one departure person registered in the second database as a departure person with a reserved departure status.

[0168] Furthermore, the examination control unit 203 according to the second embodiment acquires image data of the person to be examined upon arrival at the immigration inspection area from the camera 50-3 installed at the immigration inspection area. The examination control unit 203 performs a matching process using the biometric information of the person to be examined captured in the acquired image data and at least one biometric information stored in the second database. By performing the matching process, the examination control unit 203 identifies the person to be examined, and if the identified person to be examined is set as a person with a reservation to leave the country, it notifies the immigration officer waiting at the immigration inspection area of ​​the information of the identified person to be examined.

[0169] As described above, the server device 10 according to the second embodiment acquires departure information as an departure API and acquires biometric information of departures from the Ministry of Foreign Affairs server 20 and the Management Agency server 30. The server device 10 stores the acquired departure information and biometric information in the departure management database and uses the departure management database to realize gateless authentication in departure screening. As a result, user convenience and system throughput are improved.

[0170] [Third Embodiment] Next, a third embodiment will be described.

[0171] The third embodiment describes a case in which the immigration database and the departure database are updated as appropriate.

[0172] In actual systems, entry and departure APIs may be updated sequentially before the scheduled departure time of aircraft, etc. For example, entry APIs may be updated 72 hours, 32 hours, and 1 hour before the check-in deadline.

[0173] The immigration information control unit 202 and the departure information control unit 205 may update the immigration management database and the departure management database each time they receive an immigration API or departure API.

[0174] This section explains the operation of the immigration information control unit 202 and the updating of the immigration management database, using the immigration API as an example. The departure information control unit 205 operates similarly to the immigration information control unit 202, and the departure management database is updated in the same way as the immigration management database.

[0175] When the immigration information control unit 202 receives the first immigration API (new immigration API), it generates an immigration management database as shown in Figure 9.

[0176] Upon receiving a second entry API, the entry information control unit 202 identifies the entrants (entrants whose information was not included in the first API) from the second entry API. The entry information control unit 202 then adds the information of those entrants whose information was not included in the first entry API to the entry management database.

[0177] The immigration information control unit 202 processes subsequent immigration APIs in the same manner. Specifically, the immigration information control unit 202 extracts the difference between the immigration API already received and the newly received immigration API, and reflects this difference in the immigration management database.

[0178] This operation of the immigration information control unit 202 generates the majority of entries in the immigration management database (galleries) before travelers even appear at the inspection / screening area on the day of their arrival. For example, if a traveler makes a reservation for an aircraft and appears at the check-in counter just before the aircraft's departure, that traveler's information is stored in the immigration management database through a differential update. In other words, information on travelers other than the one mentioned above is already stored in the immigration management database. As a result, the server device 10 does not need to process information on a large number of travelers just before the aircraft's departure, reducing operational risks for the system.

[0179] As described above, the server device 10 according to the third embodiment may update the immigration management database and the departure management database each time it receives an immigration API or an departure API. More specifically, the immigration information control unit 202 may update the immigration management database (first database) each time an immigration API is obtained. Similarly, the departure information control unit 205 may update the departure management database (second database) each time a departure API is obtained. Such operation of the server device 10 reduces the risks to system operation.

[0180] Next, we will describe the hardware of each device that makes up the information processing system. Figure 19 shows an example of the hardware configuration of server device 10.

[0181] The server device 10 can be configured using an information processing device (a so-called computer), and has the configuration illustrated in Figure 19. For example, the server device 10 includes a processor 311, memory 312, input / output interface 313, and communication interface 314, etc. The components of the processor 311, etc., are connected by an internal bus or the like and are configured to communicate with each other.

[0182] However, the configuration shown in Figure 19 is not intended to limit the hardware configuration of the server device 10. The server device 10 may include hardware not shown, and it may not have to have an input / output interface 313 if necessary. Also, the number of processors 311 etc. included in the server device 10 is not intended to be limited to the example in Figure 19; for example, multiple processors 311 may be included in the server device 10.

[0183] The processor 311 is a programmable device such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), or DSP (Digital Signal Processor). Alternatively, the processor 311 may be a device such as an FPGA (Field Programmable Gate Array) or ASIC (Application Specific Integrated Circuit). The processor 311 executes various programs, including an operating system (OS).

[0184] Memory 312 includes RAM (Random Access Memory), ROM (Read Only Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), etc. Memory 312 stores the OS program, application programs, and various data.

[0185] The input / output interface 313 is an interface for a display device or input device (not shown). The display device is, for example, a liquid crystal display. The input device is, for example, a device that accepts user input such as a keyboard or mouse.

[0186] The communication interface 314 is a circuit, module, etc., that communicates with other devices. For example, the communication interface 314 includes a NIC (Network Interface Card), etc.

[0187] The functions of the server device 10 are realized by various processing modules. These processing modules are realized, for example, by the processor 311 executing a program stored in memory 312. The program can also be recorded on a computer-readable storage medium. The storage medium can be a non-transitory material such as semiconductor memory, hard disk, magnetic recording medium, or optical recording medium. In other words, the present invention can also be embodied as a computer program product. Furthermore, the program can be downloaded via a network or updated using the storage medium on which the program is stored. Moreover, the processing module may be realized by a semiconductor chip.

[0188] Furthermore, the Ministry of Foreign Affairs server 20, etc., can also be configured using an information processing device, similar to the server device 10, and its basic hardware configuration is no different from that of the server device 10, so the explanation will be omitted.

[0189] The server device 10, which is an information processing device, is equipped with a computer, and its functions can be realized by having the computer execute a program. Furthermore, the server device 10 executes a control method for the server device 10 using this program.

[0190] [Differentiation] The configuration and operation of the information processing system described in the above embodiment are illustrative examples and are not intended to limit the system configuration.

[0191] In the above embodiment, the configuration and operation of the information processing system were explained using the example of a passenger entering Japan by boarding an aircraft or departing Japan by boarding an aircraft. However, passengers may also enter Japan by boarding a ship or departing Japan by boarding a ship. In this case, the ship's operating company (or its agent) can transmit the passenger information for each ship's arrival and departure to the server device 10 as an arrival API or departure API.

[0192] In the above embodiment, the configuration and operation of the information processing system were explained using the case of a passenger entering or leaving Japan as an example. However, the information processing system disclosed in this application can also be applied when a passenger enters a country other than Japan or leaves a country other than Japan.

[0193] In the above embodiment, the configuration and operation of the information processing system were explained using the example of a case where no gates are installed at the immigration inspection area. However, gate devices equipped with gates may be installed at the immigration inspection area. In this case, the gate device photographs the passenger in front of it (entering passenger, departing passenger) and transmits the image data to the server device 10. If the authenticated person identified by biometric authentication is set as an entry-reserved person or an exit-reserved person, the server device 10 notifies the gate device of this fact. In response to this notification, the gate device closes the gate. In other words, if a gate is installed at the exit of the customs inspection area and the person to be inspected is not set as an entry-reserved person, the inspection control unit 203 permits the person to be inspected who is not set as an entry-reserved person to pass through the gate of the customs inspection area. Similarly, if a gate is installed at the exit of the departure inspection area and the person to be inspected is not set as an exit-reserved person, the inspection control unit 203 permits the person to be inspected who is not set as an exit-reserved person to pass through the gate of the departure inspection area.

[0194] In the above embodiment, the case in which the immigration management database and the departure management database are configured inside the server device 10 was described, but these databases may be built on an external database server or the like. In other words, some functions of the server device 10 may be implemented on another server. More specifically, it is sufficient that the "immigration information control unit (immigration information control means)" etc. described above is implemented in any device included in the system.

[0195] The form of data transmission and reception between each device (server device 10, Ministry of Foreign Affairs server 20, etc.) is not particularly limited, but the data transmitted and received between these devices may be encrypted. Since biometric information and other sensitive data are transmitted and received between these devices, it is desirable that encrypted data be transmitted and received in order to appropriately protect personal information.

[0196] In the flowcharts (sequence diagrams) used in the above description, multiple processes (processes) are shown in order, but the execution order of the processes performed in the embodiment is not limited to the order in which they are shown. In the embodiment, the order of the illustrated processes can be changed to the extent that it does not impair the content, for example, by executing each process in parallel.

[0197] The embodiments described above are explained in detail to facilitate understanding of the disclosure, and it is not intended that all the configurations described above are necessary. Furthermore, when multiple embodiments are described, each embodiment may be used individually or in combination. For example, it is possible to replace parts of the configuration of one embodiment with those of another embodiment, or to add configurations from other embodiments to the configuration of one embodiment. In addition, it is possible to add, delete, or replace parts of the configuration of one embodiment with those of another.

[0198] As described above, the industrial applicability of the present invention is clear, and it is particularly suitable for use in information processing systems for conducting immigration and customs inspections of passengers.

[0199] Some or all of the above embodiments may also be described as follows, but are not limited to the following:

[0200] [Note 1] A first acquisition method for obtaining information about multiple entrants, including passport number and nationality, as entry API (Advance Passenger Information), A first determination means that determines whether each of the aforementioned multiple entrants is Japanese or a foreigner based on the nationality contained in each of the aforementioned multiple entrant information, A second acquisition means for acquiring biometric information of each entrant determined to be Japanese by transmitting the passport number of each entrant determined to be Japanese to a first server that manages the passport numbers of Japanese nationals who have been issued passports, A first registration means that associates the entry information of each entrant determined to be Japanese with the acquired biometric information and registers them in a first database, A server device equipped with the following features.

[0201] [Note 2] For each entrant determined to be a foreigner, a third means of acquisition is provided to acquire passport information, including passport number and nationality, and biometric information, which are recorded in the passport. The first registration means is a server device as described in Appendix 1, which associates the passport information and biometric information of each entrant determined to be a foreigner with the first database.

[0202] [Note 3] A first setting means transmits the passport numbers, nationalities, and biometric information of at least one entrant registered in the first database to a second server that stores information of persons determined by the Immigration Services Agency to be subject to entry restrictions, thereby receiving the passport number of the first entry restriction holder whose entry into Japan is restricted from among the at least one entrant, and setting the entrant corresponding to the passport number received from the second server from among the at least one entrant registered in the first database as the first entry restriction holder. A second setting means transmits the passport numbers, nationalities, and biometric information of at least one entrant registered in the first database to a third server that stores information of persons determined by customs to be subject to entry restrictions, thereby receiving the passport numbers of a second entry restriction holder whose entry into Japan is being restricted from among the at least one entrant, and setting the entrant corresponding to the passport number received from the third server from among the at least one entrant registered in the first database as the second entry restriction holder. The server device described in Appendix 2 further includes the following:

[0203] [Note 4] The server device according to Appendix 3 further comprises an examination means, which acquires image data of a person to be examined who has arrived at the landing inspection area from a first camera installed at the landing inspection area, identifies the person to be examined by performing a matching process using the biometric information of the person to be examined captured in the acquired image data and at least one biometric information stored in the first database, and, if the identified person to be examined is set as a first person to remain on entry, notifies the inspection officer waiting at the landing inspection area of ​​the information of the identified person to be examined.

[0204] [Note 5] The server device described in Appendix 4, wherein the screening means acquires image data of a person to be inspected who has arrived at the customs inspection area from a second camera installed at the customs inspection area, identifies the person to be inspected by performing a matching process using the biometric information of the person to be inspected captured in the acquired image data and at least one biometric information stored in the first database, and if the identified person to be inspected is set as a second person retained to enter the country, notifies the customs officers waiting at the customs inspection area of ​​the information of the identified person to be inspected.

[0205] [Note 6] A gate is installed at the exit of the aforementioned customs inspection area. The screening means is a server device as described in Appendix 5, which, if the identified person to be inspected is not designated as a second person to remain on entry, allows the person to pass through the gate of the customs inspection area.

[0206] [Note 7] The first registration means is a server device according to any one of the appendices 1 to 6, which updates the first database each time the entry API is obtained.

[0207] [Note 8] A third acquisition method for obtaining information about each of multiple departing passengers, including passport number and nationality, as departure API (Advance Passenger Information), A second determination means for determining whether each of the aforementioned multiple departures is Japanese or a foreigner based on the nationality contained in each of the aforementioned multiple departures' information, A fourth acquisition means that acquires biometric information of each person identified as Japanese by transmitting the passport number of each person identified as Japanese to the first server, A second registration means registers the departure information of each departure person determined to be Japanese, along with the acquired biometric information, into a second database. The server device described in Appendix 1, further equipped with the following features.

[0208] [Note 9] The system further includes a fifth acquisition means for acquiring biometric information of each departing person determined to be a foreign national by transmitting their passport number and nationality to a second server that stores information on persons determined by the Immigration Services Agency to be subject to entry restrictions. The second registration means is a server device as described in Appendix 8, which associates the departure information of each departure person determined to be a foreigner with the acquired biometric information and registers them in the second database.

[0209] [Note 10] A setting means that transmits the passport numbers, nationalities, and biometric information of at least one or more departing persons registered in the second database to the second server, receives the passport numbers of those departing from Japan who are on hold, and sets the departing persons corresponding to the passport numbers received from the second server among the at least one or more departing persons registered in the second database as the departing persons on hold. An examination means that acquires image data of a person to be examined arriving at the immigration inspection area from a camera installed at the immigration inspection area, identifies the person to be examined by performing a matching process using the biometric information of the person to be examined shown in the acquired image data and at least one biometric information stored in the second database, and if the identified person to be examined is set as a person to reserve departure, notifies the immigration officer waiting at the immigration inspection area of ​​the information of the identified person to be examined, The server device described in Appendix 9, further comprising the above.

[0210] [Note 11] A gate is installed at the exit of the aforementioned immigration checkpoint. The screening means is a server device as described in Appendix 10, which, if the identified person to be screened is not designated as a person reserved for departure, allows the person to pass through the gate of the departure immigration checkpoint.

[0211] [Note 12] The second registration means is a server device according to any one of the appendices 8 to 11, which updates the second database each time the departure API is obtained.

[0212] [Note 13] A first acquisition method that obtains information about each of multiple departing passengers, including passport number and nationality, as departure API (Advance Passenger Information), A first determination means that determines whether each of the aforementioned multiple departure persons is Japanese or a foreigner based on the nationality contained in each of the aforementioned multiple departure persons' information, A second acquisition means obtains biometric information of each person identified as Japanese by transmitting the passport number of each person identified as Japanese to a first server that manages the passport numbers of Japanese persons who have been issued passports. A registration means for registering in a database the departure information of each departure person determined to be Japanese, along with the acquired biometric information, A server device equipped with the following features.

[0213] [Note 14] In the server device, Information about each of multiple entrants, including passport number and nationality, is obtained as Entry API (Advance Passenger Information). Based on the nationality contained in each of the aforementioned multiple pieces of information on entrants, it is determined whether each of the aforementioned multiple entrants is Japanese or a foreigner. By transmitting the passport number of each entrant determined to be Japanese to a first server that manages the passport numbers of Japanese nationals who have been issued passports, biometric information of each entrant determined to be Japanese is obtained. A method for controlling a server device, which associates the entry information of each entrant determined to be Japanese with the acquired biometric information and registers it in a first database.

[0214] [Note 15] The computer installed in the server device The process involves obtaining information about each of multiple entrants, including passport number and nationality, as entry API (Advance Passenger Information), A process to determine whether each of the aforementioned multiple entrants is Japanese or a foreigner, based on the nationality contained in each of the aforementioned multiple entrant information, A process to obtain biometric information of each entrant determined to be Japanese by transmitting the passport number of each entrant determined to be Japanese to a first server that manages the passport numbers of Japanese nationals who have been issued passports, The process involves registering the entry information of each entrant determined to be Japanese, along with the acquired biometric information, into a first database. A program to execute.

[0215] Furthermore, some or all of the configurations described in Appendices 2 to 12, which are subordinate to Appendice 1 above, may also be subordinate to Appendices 14 and 15 in the same way as those described in Appendices 2 to 12. Moreover, not limited to Appendices 1, 14, and 15, some or all of the configurations described as appendices may also be subordinate to various hardware, software, various recording means for recording software, or systems, without departing from the embodiments described above.

[0216] Furthermore, each disclosure of the above-mentioned prior art documents cited herein is incorporated herein by reference. Although embodiments of the present invention have been described above, the present invention is not limited to these embodiments. It will be understood by those skilled in the art that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. That is, the present invention naturally includes the entire disclosure, including the claims, and various modifications and alterations that can be made by those skilled in the art in accordance with the technical idea. [Explanation of Symbols]

[0217] 10 Server devices 20 Ministry of Foreign Affairs Server 30 Management Agency Server 40 Customs Servers 50 Cameras 50-1 Camera 50-2 Camera 50-3 Camera 60 Examiner's Terminal 61 Staff terminals 100 Server Devices 101 First means of acquisition 102 First determination means 103 Second means of acquisition 104 First registration method 201 Communication Control Unit 202 Immigration Information Control Unit 203 Examination Control Unit 204 Storage section 205 Departure Information Control Unit 311 Processors 312 memory 313 Input / Output Interfaces 314 Communication Interface

Claims

1. A first acquisition method for obtaining information about multiple entrants, including passport number and nationality, as entry API (Advance Passenger Information), A first determination means that determines whether each of the aforementioned multiple entrants is Japanese or a foreigner based on the nationality contained in each of the aforementioned multiple entrant information, A second acquisition means obtains biometric information of each entrant determined to be Japanese by transmitting the passport number of each entrant determined to be Japanese to a first server that manages the passport numbers of Japanese nationals who have been issued passports. A first registration means registers the entry information of each entrant determined to be Japanese, along with the acquired biometric information, in a first database. A server device equipped with the following features.

2. For each entrant determined to be a foreigner, the system further provides a third means of obtaining passport information, including passport number and nationality, and biometric information, as recorded in the passport. The server device according to claim 1, wherein the first registration means registers the passport information and biometric information of each entrant determined to be a foreigner in the first database.

3. A first setting means transmits the passport numbers, nationalities, and biometric information of at least one entrant registered in the first database to a second server that stores information of persons determined by the Immigration Services Agency to be subject to entry restrictions, thereby receiving the passport number of a first entry restriction holder whose entry into Japan is restricted from among the at least one entrant, and setting the entrant corresponding to the passport number received from the second server from among the at least one entrant registered in the first database as the first entry restriction holder. A second setting means transmits the passport numbers, nationalities, and biometric information of at least one entrant registered in the first database to a third server that stores information of persons determined by customs to be subject to entry restrictions, thereby receiving the passport numbers of a second entry restriction holder whose entry into Japan is being restricted from among the at least one entrant, and setting the entrant corresponding to the passport number received from the third server from among the at least one entrant registered in the first database as the second entry restriction holder. The server device according to claim 2, further comprising:

4. The server device according to claim 3, further comprising: an examination means for acquiring image data of a person to be examined who has arrived at the landing inspection area from a first camera installed at the landing inspection area; identifying the person to be examined by performing a matching process using the biometric information of the person to be examined captured in the acquired image data and at least one biometric information stored in the first database; and, if the identified person to be examined is set as a first person reserved for entry, notifying the examiner waiting at the landing inspection area of ​​the information of the identified person to be examined.

5. The server device according to claim 4, wherein the examination means acquires image data of a person to be inspected who has arrived at the customs inspection area from a second camera installed at the customs inspection area, identifies the person to be inspected by performing a matching process using the biometric information of the person to be inspected captured in the acquired image data and at least one biometric information stored in the first database, and if the identified person to be inspected is set as a second person to remain in entry, notifies the customs officers waiting at the customs inspection area of ​​the information of the identified person to be inspected.

6. A gate is installed at the exit of the aforementioned customs inspection area. The server device according to claim 5, wherein the screening means allows the person being screened who is not designated as a second person being reserved for entry to pass through the gate of the customs inspection area if the person being screened who is not designated as a second person being reserved for entry has not been designated as a second person being reserved for entry.

7. The server device according to any one of claims 1 to 6, wherein the first registration means updates the first database each time the entry API is obtained.

8. A third acquisition method for obtaining information about multiple departing passengers, including their passport number and nationality, as departure API (Advance Passenger Information), A second determination means for determining whether each of the aforementioned multiple departure information is Japanese or a foreigner, based on the nationality contained in each of the aforementioned multiple departure information, A fourth acquisition means that acquires biometric information of each person identified as Japanese by transmitting the passport number of each person identified as Japanese to the first server, A second registration means registers the departure information of each departure person determined to be Japanese, along with the acquired biometric information, in a second database. The server device according to claim 1, further comprising:

9. The system further includes a fifth acquisition means for acquiring biometric information of each departing person determined to be a foreign national by transmitting their passport number and nationality to a second server that stores information on persons determined by the Immigration Services Agency to be subject to entry restrictions. The server device according to claim 8, wherein the second registration means registers the departure information of each departure person determined to be a foreigner in association with the acquired biometric information in the second database.

10. A setting means that transmits the passport numbers, nationalities, and biometric information of at least one or more departing persons registered in the second database to the second server, receives the passport numbers of those departing from Japan who are deferred from Japan, and sets the departing persons corresponding to the passport numbers received from the second server among the at least one or more departing persons registered in the second database as the deferred persons. An examination means that acquires image data of a person to be examined arriving at the immigration inspection area from a camera installed at the immigration inspection area, performs a matching process using the biometric information of the person to be examined captured in the acquired image data and at least one biometric information stored in the second database to identify the person to be examined, and if the identified person to be examined is set as a person reserved for departure, notifies the immigration officer waiting at the immigration inspection area of ​​the information of the identified person to be examined, The server device according to claim 9, further comprising:

11. A gate is installed at the exit of the aforementioned immigration checkpoint. The server device according to claim 10, wherein the screening means allows the person being screened who is not designated as an exit reserve to pass through the gate of the departure immigration checkpoint if the person being screened who is not designated as an exit reserve is not designated as an exit reserve.

12. The server device according to any one of claims 8 to 11, wherein the second registration means updates the second database each time the departure API is acquired.

13. A first acquisition method for obtaining information about each of multiple departing persons, including departing person information such as passport number and nationality, as departure API (Advance Passenger Information), A first determination means that determines whether each of the aforementioned multiple departures is Japanese or a foreigner based on the nationality contained in each of the aforementioned multiple departures information, A second acquisition means obtains biometric information of each person identified as Japanese by transmitting the passport number of each person identified as Japanese to a first server that manages the passport numbers of Japanese persons who have been issued passports. A registration means for registering in a database the departure information of each departure person determined to be Japanese, along with the acquired biometric information, A server device equipped with the following features.

14. In the server device, Information regarding each of multiple entrants, including passport number and nationality, is obtained as entry API (Advance Passenger Information). Based on the nationality contained in each of the aforementioned multiple pieces of information on entrants, it is determined whether each of the aforementioned multiple entrants is Japanese or a foreigner. By transmitting the passport number of each entrant determined to be Japanese to a first server that manages the passport numbers of Japanese nationals who have been issued passports, biometric information of each entrant determined to be Japanese is obtained. A method for controlling a server device, which associates the entry information of each entrant determined to be Japanese with the acquired biometric information and registers them in a first database.

15. The computer installed in the server device The process involves obtaining information about each of multiple entrants, including their passport number and nationality, as entry API (Advance Passenger Information), A process to determine whether each of the aforementioned multiple entrants is Japanese or a foreigner, based on the nationality contained in each of the aforementioned multiple entrant information, A process to obtain biometric information of each entrant determined to be Japanese by transmitting the passport number of each entrant determined to be Japanese to a first server that manages the passport numbers of Japanese nationals who have been issued passports, The process involves registering the entry information of each entrant determined to be Japanese, along with the acquired biometric information, in the first database. A program to execute.

Images