Information processing device, information processing method and program
The information processing device and method address the inefficiency of boarding gate procedures by using biometric data to support passenger processing and priority guidance, enhancing airport throughput and reducing errors.
Patent Information
- Application Number
- JP2024135516
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-15
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2039-08-14
AI Technical Summary
Conventional systems, such as those described in Patent Document 1, do not effectively support procedures at the boarding gate for passengers waiting to board an aircraft, limiting the efficiency of airport throughput improvements.
An information processing device and method that acquires biometric information from passengers waiting to board, receives extraction conditions, and superimposes or outputs boarding reservation information on the captured image to support procedures at the boarding gate, using a management server to manage and process biometric and reservation data across various airport terminals.
Enhances the efficiency of passenger procedures at the boarding gate by enabling priority boarding guidance and companion confirmation, reducing errors, and improving overall airport throughput.
Smart Images

Figure 2024159787000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device, an information processing method, and a recording medium. [Background technology]
[0002] Patent Document 1 discloses a ticketless boarding system that uses biometric information (facial images) of passengers to carry out procedures through facial recognition at multiple checkpoints (check-in lobbies, security checkpoints, boarding gates, etc.). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent Publication No. 2007-79656 Summary of the Invention [Problem to be solved by the invention]
[0004] As exemplified in Patent Document 1, it is expected that throughput within airports will be improved by promoting the use of terminals with face recognition functions. However, conventional systems such as that exemplified in Patent Document 1 are not intended to support passengers waiting in the vicinity of the boarding gate with the procedures at the boarding gate.
[0005] In view of the above-mentioned problems, an object of the present invention is to provide an information processing device, an information processing method, and a recording medium for assisting passengers with procedures at a boarding gate. [Means for solving the problem]
[0006] According to one aspect of the present invention, there is provided an information processing device comprising: an acquisition unit that acquires biometric information of a passenger from a captured image of the passenger who is boarding an aircraft but has not passed through a boarding gate corresponding to the aircraft; a receiving unit that receives extraction conditions related to the passenger's boarding reservation information; and an output unit that superimposes information identifying the passenger whose boarding reservation information identified using the biometric information satisfies the extraction conditions on the captured image and outputs the information.
[0007] According to another aspect of the present invention, there is provided an information processing method in which a computer acquires biometric information of a passenger from a captured image of the passenger who is boarding an aircraft but has not passed through a boarding gate corresponding to the aircraft, receives extraction conditions related to the passenger's boarding reservation information, and outputs information identifying the passenger whose boarding reservation information identified using the biometric information satisfies the extraction conditions by superimposing it on the captured image.
[0008] According to yet another aspect of the present invention, a program is provided that causes a computer to execute the steps of acquiring biometric information of a passenger from a captured image of the passenger who is boarding an aircraft but has not passed through a boarding gate corresponding to the aircraft, receiving extraction conditions related to the passenger's boarding reservation information, and outputting information identifying the passenger whose boarding reservation information identified using the biometric information satisfies the extraction conditions by superimposing it on the captured image. Effect of the Invention
[0009] According to the present invention, it is possible to provide an information processing device, an information processing method, and a recording medium for assisting passengers with procedures at a boarding gate. [Brief description of the drawings]
[0010] [Figure 1] 1 is a block diagram showing an example of the overall configuration of an information processing system according to a first embodiment. [Diagram 2] 2 is a diagram showing an example of the arrangement of a boarding gate device, a business terminal, and a camera in the first embodiment. FIG. [Diagram 3] FIG. 4 is a diagram illustrating an example of information stored in a token ID information database in the first embodiment. [Figure 4] 5 is a diagram showing an example of information stored in a passage history information database in the first embodiment. FIG. [Diagram 5] FIG. 4 is a diagram illustrating an example of information stored in a business information database in the first embodiment. [Figure 6] FIG. 4 is a diagram showing an example of information stored in a reservation information database in the first embodiment. [Figure 7] 2 is a block diagram showing an example of a hardware configuration of a management server according to the first embodiment. FIG. [Figure 8] 2 is a block diagram showing an example of a hardware configuration of a check-in terminal in the first embodiment. FIG. [Figure 9] 2 is a block diagram showing an example of a hardware configuration of the automated baggage check-in machine in the first embodiment. FIG. [Figure 10] 1 is a block diagram showing an example of a hardware configuration of a security inspection device in a first embodiment. [Figure 11] 1 is a block diagram showing an example of a hardware configuration of an automated gate apparatus in a first embodiment. FIG. [Figure 12] 2 is a block diagram showing an example of a hardware configuration of a boarding gate apparatus in the first embodiment. FIG. [Figure 13] 2 is a block diagram showing an example of a hardware configuration of a business terminal according to the first embodiment; FIG. [Figure 14] FIG. 4 is a sequence diagram showing an example of processing of the reservation system, the check-in terminal, and the management server in the first embodiment. [Figure 15] FIG. 4 is a sequence diagram showing an example of processing of the reservation system, the automated baggage drop machine, and the management server in the first embodiment. [Figure 16] 4] FIG. 4 is a sequence diagram showing an example of processing by the reservation system, the security inspection device, and the management server in the first embodiment. [Figure 17]FIG. 2 is a sequence diagram showing an example of processing of the reservation system, the automated gate device, and the management server in the first embodiment. [Figure 18] FIG. 4 is a sequence diagram showing an example of processing by the reservation system, the business terminal, the management server, and the camera in the first embodiment. [Figure 19] FIG. 4 is a diagram showing an example of a business screen displayed on a business terminal in the first embodiment. [Figure 20] FIG. 2 is a diagram showing an example of a passenger list screen displayed on a business terminal in the first embodiment. [Figure 21] FIG. 4 is a sequence diagram showing an example of processing by the reservation system, the business terminal, the management server, and the camera in the first embodiment. [Figure 22] FIG. 13 is a diagram showing an example of a priority boarding guidance instruction screen displayed on the business terminal in the first embodiment. [Figure 23] FIG. 4 is a sequence diagram showing an example of processing by the reservation system, the business terminal, the management server, and the camera in the first embodiment. [Figure 24] FIG. 11 is a diagram showing an example of a waiting lane guidance instruction screen displayed on the business terminal in the first embodiment. [Diagram 25] FIG. 4 is a sequence diagram showing an example of processing by the reservation system, the business terminal, the management server, and the camera in the first embodiment. [Figure 26] FIG. 2 is a diagram showing an example of a passenger inquiry screen displayed on a business terminal in the first embodiment. [Figure 27] FIG. 4 is a sequence diagram showing an example of processing by the reservation system, the business terminal, the management server, and the camera in the first embodiment. [Figure 28] FIG. 11 is a diagram showing an example of an extraction condition input screen displayed on a business terminal in the first embodiment. [Figure 29] FIG. 11 is a diagram showing an example of a passenger extraction result screen displayed on the business terminal in the first embodiment. [Diagram 30] 4 is a sequence diagram showing an example of processing of the reservation system, the boarding gate device, and the management server in the first embodiment. FIG. [Diagram 31]13 is a flowchart showing an example of a process for confirming an accompanying person in the second embodiment. [Diagram 32] FIG. 11 is a diagram showing an example of an accompanying person confirmation instruction screen displayed on the business terminal in the second embodiment. [Diagram 33] FIG. 11 is a diagram showing an example of an accompanying person confirmation instruction screen displayed on the business terminal in the second embodiment. [Diagram 34] FIG. 13 is a block diagram illustrating an example of the overall configuration of an information processing system according to a third embodiment. [Diagram 35] FIG. 13 is a sequence diagram showing an example of processing by the business terminal, the management server, and the camera in the third embodiment. [Diagram 36] FIG. 13 is a diagram showing an example of a passenger search result screen displayed on a business terminal in the third embodiment. [Figure 37] FIG. 13 is a block diagram showing an example of the overall configuration of an information processing device according to a fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. In the drawings, similar or corresponding elements are denoted by the same reference numerals, and descriptions thereof may be omitted or simplified.
[0012] First Embodiment FIG. 1 is a block diagram showing an example of the overall configuration of an information processing system 1 in this embodiment. The information processing system 1 is a computer system that manages and supports operations related to screening procedures at the time of immigration of a user (hereinafter also referred to as a "passenger") U at an airport A. The information processing system 1 is operated, for example, by a public institution such as an immigration control bureau or a contractor entrusted with the operations by the institution. Unlike the information processing system 1, the reservation system 2 is a computer system provided in an airline company. The reservation system 2 includes a reservation information DB (database) 3 that manages boarding reservation information. Note that, for convenience of explanation, only one reservation system 2 is shown in FIG. 1, but a reservation system 2 is provided in each of a plurality of airline companies.
[0013] In the information processing system 1 of this embodiment, the check-in terminal 20, the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 60 are each connected to a common management server 10 via a network NW1. The security inspection device 40, the automated gate device 50, and the boarding gate device 60 are installed in a security area SA indicated by a dashed line. Similarly, in the reservation system 2 of each airline, the check-in terminal 20, the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 60 are each connected to a server (not shown) via a network NW2. The business terminal 70 used by the staff S is connected to the networks NW1 and NW2 via an access point (not shown).
[0014] The networks NW1 and NW2 are configured by a LAN (Local Area Network) including the in-house communication network of airport A, a WAN (Wide Area Network), a mobile communication network, etc. The connection method is not limited to a wired method, and may be a wireless method. The networks NW1 and NW2 are different networks. That is, in this embodiment, the information processing system 1 is not directly connected to the reservation system 2.
[0015] The management server 10 is installed, for example, in the facility of an airport company that operates airport A. The management server 10 may be a cloud server rather than a server installed in the facility where the actual business is carried out. Also, the management server 10 does not need to be a single server, and may be configured as a server group including a plurality of servers.
[0016] As shown in Figure 1, the immigration inspection procedure at airport A is carried out sequentially at five touch points. The relationship between each device and each touch point will be explained below.
[0017] The check-in terminal 20 is installed in a check-in lobby (hereinafter referred to as "touch point P1") in airport A. The check-in terminal 20 is a self-service terminal that allows a user U to carry out check-in procedures (boarding procedures) by himself / herself. After completing the procedures at touch point P1, the user U moves to the baggage counter or security checkpoint.
[0018] The automated baggage check-in machine 30 is installed at the baggage counter (hereinafter referred to as "touch point P2") in airport A. The automated baggage check-in machine 30 is a self-service terminal that a user U operates to carry on the procedure (baggage check-in procedure) of baggage that is not to be carried on board the aircraft. After completing the procedure at touch point P2, the user U moves to the security inspection area. Note that if the user U does not check in baggage, the procedure at touch point P2 is omitted.
[0019] The security inspection device 40 is installed at a security inspection area (hereinafter referred to as "touch point P3") in airport A. The security inspection device 40 is a device that uses a metal detector to check whether or not the user U is carrying any metal objects that may be dangerous. In this embodiment, the term "security inspection device" is used to include not only metal detectors but also X-ray inspection devices that use X-rays to check whether or not there are any dangerous objects in carry-on baggage, and terminal devices of a passenger reconciliation system (PRS) that determines whether or not the user U can pass through at the entrance to the security inspection area. After completing the check-in procedure and the automatic baggage drop-off procedure, the user U undergoes a security inspection procedure by the security inspection device 40 at the security inspection area. After completing the procedures at touch point P3, user U proceeds to the immigration inspection area.
[0020] The automated gate device 50 is installed at the immigration area (hereinafter referred to as "touch point P4") in airport A. The automated gate device 50 is a device that automatically performs immigration procedures for user U. After completing the procedures at touch point P4, user U moves to the immigration area where duty-free shops and boarding gates are located.
[0021] The boarding gate device 60 is a traffic control device installed at each boarding gate (hereinafter referred to as "touch point P5") in the departure area. The boarding gate device 60 confirms that the user U is a passenger of an aircraft that can board through the boarding gate. After completing the procedures at the touch point P5, the user U boards the aircraft and departs from the country.
[0022] The business terminal 70 is a terminal device used by the staff S for their work. Examples of the business terminal 70 include, but are not limited to, a personal computer, a tablet terminal, a smartphone, etc. The business terminal 70 receives information transmitted from the management server 10 and displays the information on the screen. The management server 10 of this embodiment transmits information to the business terminal 70 to assist passengers in completing procedures at the boarding gate. Details of the information will be described later.
[0023] A plurality of cameras 80 are arranged in the surrounding area (adjacent area) of the boarding gate, and are photographing devices that photograph the surrounding area of the boarding gate. The cameras 80 are attached to, for example, a ceiling, a wall, a support, or the like so as to photograph the faces of users U who are waiting to board and are in the surrounding area of the boarding gate. The type of camera 80 may be either a fixed type or a movable type.
[0024] FIG. 2 is a diagram showing an example of the arrangement of boarding gate equipment 60, business terminals 70, and cameras 80. Here, a case is shown in which multiple cameras 80 are installed in the surrounding area of the boarding gate, and passengers are photographed at various angles. It is preferable that each business terminal 70 can arbitrarily switch between images captured by the multiple cameras 80 on a business screen. Two types of business terminals 70 are shown as the terminals used by staff S: a portable type and a stationary type. L1 to L3 exemplify waiting areas (waiting lanes) where users U line up before boarding.
[0025] Generally, airlines pre-allocate users U into a number of groups based on various conditions such as seat class, membership category, companion information, and seat location, and guide users U to the boarding gate in a predetermined group order. For example, passengers accompanied by infants, passengers in first class, passengers recognized by the airline as premium members, etc. are allocated to groups with relatively high boarding priority. Groups with high priority are eligible for priority boarding service.
[0026] 1, the management server 10 has a token ID information DB 11, a passage history information DB 12, and a business information DB 13. Note that the databases that the management server 10 has are not limited to these databases.
[0027] FIG. 3 is a diagram showing an example of information stored in the token ID information DB11. The token ID information DB11 has the following data items: token ID, group ID, feature amount, registered face image, token issue time, token issuing device name, invalid flag, invalidation time, and companion ID. The token ID is an identifier that uniquely identifies ID information. In this embodiment, the token ID is issued temporarily on the condition that a passport face image read from the passport at the touch point P1 matches a face image captured of the user U who holds the passport. Then, when the user U completes the procedure at the touch point P5 (boarding gate), the token ID is invalidated. In other words, the token ID is a one-time ID that has a validity period (life cycle).
[0028] The group ID is an identifier for grouping ID information. The feature amount is a value extracted from biometric information. For example, when a person is accompanied or is a group tourist, the same group ID is set. The registered face image is a face image registered for the user U. The term biometric information in this embodiment means a face image and feature amounts extracted from the face image. Note that the biometric information is not limited to a face image and face feature amounts. In other words, biometric authentication may be performed using a fingerprint image, a palm print image, an ear image, an iris image, etc. as the biometric information of the user U.
[0029] The token issue time is the time when the management server 10 issues the token ID. The token issuing device name is the name of the device from which the registered face image that triggered the issuance of the token ID was acquired. The invalid flag is flag information indicating whether the token ID is currently valid or not. When a token ID is issued, the invalid flag becomes "1", indicating that the token ID is valid. Furthermore, when a specific condition is met, the invalid flag is updated to "0", indicating that the token ID is invalid. The invalid time is the timestamp when the invalid flag was invalidated.
[0030] The companion ID is a token ID issued to a person who boards an aircraft with the support of another passenger, such as an infant or small child (hereinafter referred to as the "supportee"). The person to whom the companion ID is associated is a person who provides support, such as a guardian such as a parent or a caregiver (hereinafter referred to as the "supporter"). The companion ID is issued to the supportee at the same time, for example, when the supporter first carries out the procedure. In this embodiment, a case will be described in which one supporter is associated with one supportee. However, there may also be cases in which multiple supportees are associated with one supporter.
[0031] FIG. 4 is a diagram showing an example of information stored in the passage history information DB12. The passage history information DB12 has the following data items: passage history ID, token ID, passage time, device name, business system type, and passed touch point. The passage history ID is an identifier that uniquely identifies the passage history information. The passage time is a timestamp when the passenger passed through touch points P1 to P5. The device name is the name of the terminal used for the procedures at touch points P1 to P5. The business system type is the type of business system to which the terminal belongs. The passed touch point is the name of the passed touch point P1 to P5. By extracting the passage history information on a token ID basis, the management server 10 can grasp up to which touch point the user U has completed the procedures.
[0032] 5 is a diagram showing an example of information stored in the business information DB 13. The business information DB 13 has the following data items: token ID, reservation number, airline code, and business information. The reservation number is an identifier that uniquely identifies reservation information for boarding an aircraft. The airline code is an identifier that uniquely identifies an airline. The business information is any information obtained through business at each touch point.
[0033] 6 is a diagram showing an example of information stored in the reservation information DB 3. The reservation information DB 3 has the following data items: reservation number, airline code, passenger name, departure point, destination, flight number, operation date, seat number, seat class (e.g., first class / business class / economy class), nationality, passport number, surname, first name, date of birth, sex, membership category, whether accompanied, and accompanying person category.
[0034] In this embodiment, the business information DB13 and the reservation information DB3 are associated with each other by a reservation number and an airline code. Specifically, when the terminal device at each touch point (such as the check-in terminal 20) reads the reservation number and airline code from the airline ticket medium presented by the passenger, it can make an inquiry about boarding reservation information to the reservation system 2 of the airline corresponding to the airline code based on the reservation number. Note that the method of inquiring about boarding reservation information to the reservation system 2 is not limited to this.
[0035] Next, an example of the hardware configuration of each device constituting the information processing system 1 will be described with reference to Fig. 7 to Fig. 13. Note that devices with the same name but different reference numerals in Fig. 7 to Fig. 13 have equivalent functions, and therefore detailed descriptions thereof will be omitted in the subsequent drawings.
[0036] 7 is a block diagram showing an example of a hardware configuration of the management server 10. As shown in the figure, the management server 10 includes a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a storage device 103, and a communication I / F 104. Each device is connected to a bus line 105 .
[0037] The CPU 101 is a processor that performs a predetermined operation according to a program stored in the storage device 103 and has a function of controlling each part of the management server 10. The RAM 102 is composed of a volatile storage medium and provides a temporary memory area necessary for the operation of the CPU 101.
[0038] The storage device 103 is configured with a storage medium such as a non-volatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 103 stores programs executed by the CPU 101, data referenced by the CPU 101 when executing the programs, etc.
[0039] The communication I / F 104 is a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), and 4G, and is a module for communicating with the check-in terminal 20 and the like.
[0040] 8 is a block diagram showing an example of a hardware configuration of check-in terminal 20. As shown in the figure, check-in terminal 20 has a CPU 201, a RAM 202, a storage device 203, a communication I / F 204, an input device 206, a display device 207, a medium reading device 208, and a biometric information acquisition device 209. Each device is connected to a bus line 205.
[0041] The input device 206 is, for example, a pointing device such as a touch panel, a keyboard, etc. The display device 207 is, for example, a liquid crystal display device, an OLED (Organic Light Emitting Diode) display device, etc., and is used to display moving images, still images, characters, etc. In the check-in terminal 20 of this embodiment, the input device 206 and the display device 207 are integrally formed as a touch panel.
[0042] The medium reading device 208 is a device that reads the passport or airline ticket medium of the user U and acquires information recorded on the passport or airline ticket. Examples of airline ticket media include paper airline tickets and mobile terminals that display e-ticket copies. The medium reading device 208 is composed of, for example, a code reader, an image scanner, a non-contact IC (Integrated Circuit) reader, an OCR (Optical Character Reader) device, and the like, and acquires information from various media held up to its reading unit.
[0043] The biometric information acquisition device 209 is a device that acquires a facial image of the user U as biometric information of the user U. The biometric information acquisition device 209 is, for example, a digital camera that captures an image of the face of the user U standing in front of the check-in terminal 20, and captures the image of the face of the user U.
[0044] 9 is a block diagram showing an example of the hardware configuration of the automated baggage drop machine 30. As shown in the figure, the automated baggage drop machine 30 has a CPU 301, a RAM 302, a storage device 303, a communication I / F 304, an input device 306, a display device 307, a medium reading device 308, a biometric information acquisition device 309, a baggage conveying device 310, and an output device 311. Each device is connected to a bus line 305.
[0045] If the identity verification of the user U is successful, the baggage transporting device 310 transports the baggage to be loaded onto the aircraft that the user U is boarding. The baggage transporting device 310 transports the baggage that the user U has placed in the claim area and that has a baggage tag attached thereto to the baggage sorting section.
[0046] The output device 311 is a device that outputs a baggage tag to be attached to checked baggage. The output device 311 also outputs a baggage claim tag that is required to collect the baggage after arriving at the destination. The baggage tag and the baggage claim tag are associated with at least either passport information or boarding information.
[0047] 10 is a block diagram showing an example of a hardware configuration of the security inspection device 40. As shown in the figure, the security inspection device 40 has a CPU 401, a RAM 402, a storage device 403, a communication I / F 404, an input device 406, a display device 407, a medium reading device 408, a biometric information acquisition device 409, and a metal detection gate 410. Each device is connected to a bus line 405.
[0048] The metal detection gate 410 is a gate-type metal detector that detects metal objects carried by a user U who passes through the metal detection gate 410 .
[0049] 11 is a block diagram showing an example of the hardware configuration of automated gate device 50. Automated gate device 50 has a CPU 501, a RAM 502, a storage device 503, a communication I / F 504, an input device 506, a display device 507, a medium reading device 508, a biometric information acquisition device 509, and a gate 511. Each device is connected to a bus line 505. The automated gate device 50 installed at the immigration inspection area has the same hardware configuration as the automated gate device 50 installed at the departure inspection area.
[0050] When the automated gate device 50 successfully verifies the identity of the user U and the user U passes through immigration, the gate 511, under the control of the CPU 501, transitions from a closed state that blocks the passage of the user U during standby to an open state that allows the passage of the user U. The type of gate 511 is not particularly limited, and may be, for example, a flapper gate in which a flapper installed on one or both sides of the passage opens and closes, or a turnstile gate in which three bars rotate.
[0051] 12 is a block diagram showing an example of a hardware configuration of the boarding gate device 60. As shown in the figure, the boarding gate device 60 has a CPU 601, a RAM 602, a storage device 603, a communication I / F 604, an input device 606, a display device 607, a biometric information acquisition device 609, and a gate 611. Each device is connected to a bus line 605.
[0052] 13 is a block diagram showing an example of the hardware configuration of the business terminal 70. As shown in the figure, the business terminal 70 has a CPU 701, a RAM 702, a storage device 703, a communication I / F 704, an input device 706, and a display device 707. Each device is connected to a bus line 705.
[0053] Next, the operation of each device in the information processing system 1 in this embodiment will be described with reference to FIGS. This will be explained based on 30.
[0054] [Check-in procedure] 14 is a sequence diagram showing an example of the processing of the reservation system 2, the check-in terminal 20, and the management server 10. This processing is executed when the user U uses the check-in terminal 20 to carry out the check-in procedure.
[0055] First, the check-in terminal 20 determines whether or not the passport of the user U has been held over a reading section (not shown) of the medium reading device 208 (step S101), and waits until the passport is held over (step S101, NO).
[0056] Next, when the check-in terminal 20 determines that the passport has been held over the reading section of the medium reading device 208 (step S101, YES), it acquires the passport information of the user U from the passed passport (step S102). The acquired passport information includes the user U's passport face image, personal identification information, passport number, passport issuing country information, etc.
[0057] Next, the check-in terminal 20 photographs the face of the user U using the biometric information acquisition device 209. (Step S103), and transmit the face image and passport information to the management server 10 (Step S104). Note that, before capturing the face image, it is preferable to display a screen for obtaining the consent of the user U.
[0058] When the management server 10 receives information from the check-in terminal 20, it compares one-to-one between the facial image recorded in the user U's passport (hereinafter referred to as the "passport facial image") and the facial image captured by the check-in terminal 20 (hereinafter referred to as the "target facial image") (step S105).
[0059] Next, when the management server 10 determines that the passport face image and the target face image match (step S106, YES), it issues a token ID (step S107). The token ID is set to a unique value based on, for example, the date and time of processing or a sequence number.
[0060] Next, the management server 10 registers the relationship between the token ID and the registered face image in the token ID information DB 11, with the target face image as a registered face image (step S108).
[0061] In this embodiment, the reason for using a facial image (target facial image) taken locally as the registered facial image is that the validity period (life cycle) of the token ID is completed within the same day, and the quality (appearance) of the taken image is closer to that of the image taken in the subsequent authentication process than the passport facial image. However, instead of the target facial image (taken facial image), the passport facial image may be set as the registered facial image (registered biometric information). For example, when the life cycle of the token ID is long (for example, in the airline industry, when a token ID is valid for a certain validity period for members), it is advisable to set the passport or driver's license facial image as the registered facial image.
[0062] Next, management server 10 transmits the issued token ID and the result of the match to check-in terminal 20 (step S109).
[0063] On the other hand, if the management server 10 determines that the comparison result between the passport face image and the target face image is a mismatch (step S106, NO), it transmits the comparison result of mismatch to the check-in terminal 20 (step S110).
[0064] Next, when check-in terminal 20 determines that the check-in procedure can be executed based on the matching result received from management server 10 (step S111, YES), the process proceeds to step S112. On the other hand, when check-in terminal 20 determines that the check-in procedure cannot be executed based on the matching result received from management server 10 (step S111, NO), it notifies user U of an error message (step S113).
[0065] In step S112, the check-in terminal 20 determines whether or not the airline ticket medium of the user U has been held over the reading section of the medium reading device 208. The check-in terminal 20 waits until the airline ticket medium is held over (step S112, NO).
[0066] Next, when the check-in terminal 20 determines that the airline ticket medium has been held over the reading section of the medium reader 208 (step S112, YES), it acquires recorded data such as the reservation number and airline code from the held airline ticket medium (step S114).
[0067] Next, the check-in terminal 20 transmits the recorded data to the reservation system 2 of the airline corresponding to the airline code (step S115), and requests a match between the recorded data and the boarding reservation information.
[0068] When the reservation system 2 receives the recorded data from the check-in terminal 20, it compares the recorded data with the boarding reservation information recorded in the reservation information DB3 (step S116) and transmits the comparison result to the check-in terminal 20 (step S117).
[0069] Next, when the check-in terminal 20 receives a matching result from the reservation system 2, it executes check-in procedures such as confirming the itinerary and selecting a seat based on the input information of the user U (step S118). If the matching result in the reservation system 2 is a mismatch, the check-in terminal 20 may notify an error without executing the check-in procedure. Then, the check-in terminal 20 transmits the token ID, the business information, and passage history information indicating the completion of the procedure in the check-in terminal 20 to the management server 10 (step S119). Note that the business information includes at least the reservation number and the airline code. Also, the passage history information includes information such as the time of passing through touch point P1 and the device name of the terminal used for the procedure.
[0070] Next, when management server 10 receives information from check-in terminal 20, it registers passage history information indicating the relationship between the token ID and the passage information of touch point P1 in passage history information DB 12 (step S120). Then, management server 10 registers the business information received from check-in terminal 20 in business information DB 13 as necessary (step S121).
[0071] In this way, the target face image (photographed face image) that matches the passport face image acquired from the passport during the check-in procedure is registered as a registered face image in the token ID information DB 11, and the registered face image is associated with business information in the business information DB 13 by the issued token ID. This enables biometric authentication at each subsequent touch point by face matching between the photographed face image and the registered face image.
[0072] [Baggage check-in procedure] 15 is a sequence diagram showing an example of the processing of the reservation system 2, the automated baggage drop machine 30, and the management server 10. This processing is executed when a user U who has completed the check-in procedure performs a baggage drop procedure as necessary.
[0073] The automated baggage drop machine 30 constantly or periodically captures an image of the area in front of the machine, and determines whether the face of a user U standing in front of the automated baggage drop machine 30 is detected in the captured image (step S201). The automated baggage drop machine 30 waits until the biometric information acquisition device 309 detects the face of the user U in the image (step S201, NO).
[0074] When the automated baggage check-in machine 30 determines that the face of user U has been detected by the biometric information acquisition device 309 (step S201, YES), it photographs the face of user U and acquires the facial image of user U as a target facial image (step S202).
[0075] Next, the automated baggage drop machine 30 transmits the target face image of user U captured by the biometric information acquisition device 309 to the management server 10 together with a matching request (step S203). As a result, the automated baggage drop machine 30 requests the management server 10 to perform a 1:N matching between the target face image of user U captured by the biometric information acquisition device 309 and multiple registered face images registered in the token ID information DB 11 of the management server 10.
[0076] When the management server 10 receives the target facial image and the matching request from the automated baggage drop machine 30, it matches the facial image of the user U (step S204). That is, the management server 10 matches the target facial image received from the automated baggage drop machine 30 with multiple registered facial images registered in the token ID information DB 11 on a 1:N basis. Note that the registered facial images to be matched are limited to images associated with token IDs whose invalid flag value is "1" (valid).
[0077] If the management server 10 determines that the comparison result is a mismatch (step S205, NO), the management server 10 transmits the mismatch comparison result to the automated baggage drop machine 30 (step S208), and the process proceeds to step S209. On the other hand, if the management server 10 determines that the comparison result is a match (step S205, YES), the process proceeds to step S206.
[0078] In step S206, the management server 10 acquires the token ID associated with the registered face image that matches the match in the token ID information DB 11, and acquires the reservation number and airline code from the business information DB 13 using the token ID as a key. Then, the management server 10 transmits the token ID, reservation number, airline code, and the matching result to the automated baggage drop machine 30 (step S207).
[0079] Next, if the automated baggage check-in machine 30 determines that the procedure can be carried out based on the comparison result (step S209, YES), it sends the reservation number to the reservation system 2 of the airline corresponding to the airline code (step S210) and inquires about the boarding reservation information.
[0080] On the other hand, if the automated baggage drop machine 30 determines based on the collation result that the procedure cannot be carried out (step S209, NO), it notifies the user U of an error message (step S213).
[0081] When the reservation system 2 receives the reservation number from the automated baggage drop machine 30, it transmits the corresponding boarding reservation information to the automated baggage drop machine 30 (step S211).
[0082] Next, when the automated baggage drop machine 30 receives the boarding reservation information from the reservation system 2, it carries out the baggage drop procedure for the user U (step S212).
[0083] Next, the automated baggage drop machine 30 transmits passage history information indicating that the baggage drop procedure of the user U has been completed after matching the token ID, the business information, and the face image to the management server 10 (step S214). Note that the passage history information includes information such as the time of passing through touch point P2 and the device name of the terminal used.
[0084] When the management server 10 receives the information from the automated baggage drop machine 30, it registers passage history information indicating the relationship between the token ID and the passage information of the touch point P2 of the user U in the passage history information DB 12 (step S215). Then, the management server 10 registers the business information received from the automated baggage drop machine 30 in the business information DB 13 as necessary (step S216).
[0085] [Security Inspection Procedures] 16 is a sequence diagram showing an example of the processing of the reservation system 2, the security inspection device 40, and the management server 10. This processing is executed when a user U who has completed the check-in procedure or the baggage drop-off procedure performs the security inspection procedure.
[0086] The security inspection device 40 constantly or periodically captures an image in front of the metal detection gate 410, and determines whether the face of the user U standing in front of the metal detection gate 410 is detected in the captured image (step S301). The security inspection device 40 waits until the biometric information acquisition device 409 detects the face of the user U in the image (step S301, NO).
[0087] When the security inspection device 40 determines that the face of user U has been detected by the biometric information acquisition device 409 (step S301, YES), it photographs the face of user U and acquires the facial image of user U as a target facial image (step S302).
[0088] Next, the security inspection device 40 transmits the target face image of user U captured by the biometric information acquisition device 409 to the management server 10 together with a matching request (step S303). As a result, the security inspection device 40 requests the management server 10 to perform a 1:N matching between the target face image of user U captured by the biometric information acquisition device 409 and multiple registered face images registered in the token ID information DB 11 of the management server 10.
[0089] When the management server 10 receives the target face image and the matching request from the security inspection device 40, it matches the face image of the user U (step S304). That is, the management server 10 matches the target face image received from the security inspection device 40 with a plurality of registered face images registered in the token ID information DB 11 on a 1:N basis. Note that the registered face images to be matched are limited to images associated with token IDs whose invalid flag value is "1" (valid).
[0090] If the management server 10 determines that the comparison result is a mismatch (step S305, NO), the management server 10 transmits the mismatch comparison result to the security inspection device 40 (step S308), and the process proceeds to step S309. On the other hand, if the management server 10 determines that the comparison result is a match (step S305, YES), the process proceeds to step S306.
[0091] In step S306, the management server 10 acquires the token ID associated with the registered face image that matches the match in the token ID information DB 11, and acquires the reservation number and airline code from the business information DB 13 using the token ID as a key. Then, the management server 10 transmits the token ID, reservation number, airline code, and the matching result to the security inspection device 40 (step S307). The process proceeds to step S309.
[0092] Next, if the security inspection device 40 determines that the procedure can be carried out based on the comparison result (step S309, YES), it sends the reservation number to the reservation system 2 of the airline corresponding to the airline code (step S310) and inquires about the boarding reservation information.
[0093] On the other hand, if the security inspection device 40 determines based on the collation result that the procedure cannot be carried out (step S309, NO), it notifies the user U of an error message (step S313).
[0094] When the reservation system 2 receives the reservation number from the security inspection device 40, it transmits the corresponding boarding reservation information to the security inspection device 40 (step S311).
[0095] Next, when the security inspection device 40 receives the boarding reservation information from the reservation system 2, it executes the security inspection procedure for the user U (step S312). In the security inspection process, the CPU 401 controls each part of the security inspection device 40. In this way, the security inspection device 40 detects metal objects carried by the user U who passes through the metal detection gate 410. After passing through the metal detection gate 410, the user U proceeds to the immigration inspection area.
[0096] Next, the security inspection device 40 transmits passage history information indicating that the security inspection procedure of the user U has been completed through matching of the token ID, the business information, and the face image to the management server 10 (step S314). Note that the passage history information includes information such as the time of passing through the touch point P3 and the device name of the terminal used.
[0097] When the management server 10 receives the information from the security inspection device 40, it registers passage history information indicating the relationship between the token ID and the passage information of the touch point P3 of the user U in the passage history information DB 12 (step S315). Then, the management server 10 registers the business information received from the security inspection device 40 in the business information DB 13 as necessary (step S316).
[0098] [Departure inspection procedures] 17 is a sequence diagram showing an example of the processing of the reservation system 2, the automated gate device 50, and the management server 10. This processing is executed when a user U performs a departure inspection procedure.
[0099] The automated gate device 50 constantly or periodically photographs the area in front of the automated gate device 50, and determines whether the face of a user U standing in front of the automated gate device 50 is detected in the photographed image (step S401). The automated gate device 50 waits until the biometric information acquisition device 509 detects the face of the user U in the image (step S401, NO).
[0100] When the automated gate device 50 determines that the face of user U has been detected by the biometric information acquisition device 509 (step S401, YES), it photographs the face of user U and acquires the facial image of user U as a target facial image (step S402).
[0101] Next, the automated gate device 50 transmits the target face image of user U captured by the biometric information acquisition device 509 to the management server 10 together with a matching request (step S403). As a result, the automated gate device 50 requests the management server 10 to perform a 1:N matching between the target face image of user U captured by the biometric information acquisition device 509 and multiple registered face images registered in the token ID information DB 11 of the management server 10.
[0102] When the management server 10 receives the target facial image and the matching request from the automated gate device 50, it matches the facial image of the user U (step S404). That is, the management server 10 matches the target facial image received from the automated gate device 50 with a plurality of registered facial images registered in the token ID information DB 11 on a 1:N basis. Note that the registered facial images to be matched are limited to images associated with token IDs whose invalid flag value is "1" (valid).
[0103] Here, if the management server 10 determines that the comparison result is a mismatch (step S4 If the management server 10 determines that the result of the comparison is a match (step S405, YES), the management server 10 transmits the result of the comparison indicating a mismatch to the automated gate device 50 (step S408), and the process proceeds to step S409. On the other hand, if the management server 10 determines that the result of the comparison indicates a match (step S405, YES), the process proceeds to step S406.
[0104] In step S406, the management server 10 acquires the token ID associated with the registered face image that matches the match in the token ID information DB 11, and acquires the reservation number and airline code from the business information DB 13 using the token ID as a key. Then, the management server 10 transmits the token ID, reservation number, airline code, and the matching result to the automated gate device 50 (step S407). The process proceeds to step S409.
[0105] Next, if the automated gate device 50 determines that the procedure can be carried out based on the comparison result (step S409, YES), it sends the reservation number to the reservation system 2 of the airline corresponding to the airline code (step S410) and inquires about the boarding reservation information.
[0106] On the other hand, if the automated gate device 50 determines based on the collation result that the procedure cannot be carried out (step S409, NO), it notifies the user U of an error message (step S413). For example, a notification screen including a message such as "Please carry out the immigration procedure at a manned counter" is displayed on the display device 507.
[0107] When the reservation system 2 receives the reservation number from the automated gate device 50, it transmits the corresponding boarding reservation information to the automated gate device 50 (step S411).
[0108] Next, when the automated gate device 50 receives the boarding reservation information from the reservation system 2, it executes the departure inspection procedure for the user U (step S412) and opens the gate 511 (step S414). After passing through touch point P4, the user U heads to the departure area where the boarding gate is located.
[0109] Next, the automated gate device 50 transmits passage history information indicating that the immigration inspection procedure of the user U has been completed after matching the token ID, the business information, and the face image to the management server 10 (step S415). Note that the passage history information includes information such as the time of passing through the touch point P4 and the device name of the terminal used.
[0110] When the management server 10 receives the information from the automated gate device 50, it registers passage history information indicating the relationship between the token ID and the passage information of the touch point P4 of the user U in the passage history information DB 12 (step S416). Then, the management server 10 registers the business information received from the automated gate device 50 in the business information DB 13 as necessary (step S417).
[0111] [Pre-boarding assistance (1)] 18 is a sequence diagram showing an example of processing by the reservation system 2, the business terminal 70, the management server 10, and the camera 80. This processing is executed, for example, when an attendant S refers to passenger information included in a surveillance image of the area surrounding the boarding gate.
[0112] First, the business terminal 70 transmits a display request for a business screen to the management server 10 based on input information from the staff member S (step S501). When the management server 10 receives the display request from the business terminal 70, it acquires captured images of the area surrounding the boarding gate from the multiple cameras 80 that are distributed around the boarding gate (step S502).
[0113] Next, when the management server 10 acquires the captured image from the camera 80, it transmits a business screen including the captured image to the business terminal 70 (step S503).
[0114] Next, the business terminal 70 displays the business screen received from the management server 10 on the display device 707 (step S504).
[0115] FIG. 19 is a diagram showing an example of a business screen displayed on the business terminal 70. A captured image is displayed in the central area of the screen. The dashed lines in the captured image indicate the detection areas of the face images of the multiple users U1 to U12. In addition, a camera switching button for switching the displayed image to images captured by the camera 80 with different shooting angles, a passenger list screen button for displaying a list of passengers included in the captured image, and an end button for closing the screen are displayed in the lower area of the screen. It is preferable to distinguish passengers whose token IDs are not registered or passengers who could not be authenticated on the screen by a display format different from that of registered passengers (authenticated passengers).
[0116] Next, the business terminal 70 transmits a display request for a passenger list screen to the management server 10 based on the input information from the staff S (step S505). When the management server 10 receives the display request from the business terminal 70, it detects people from the captured image of the area around the boarding gate (step S506). If the captured image includes multiple people, the management server 10 detects the facial images of all the people as target facial images.
[0117] Next, the management server 10 performs a 1:N comparison between the target face image and a plurality of registered face images registered in the token ID information DB11 (step S507). That is, the management server 10 identifies each registered face image that matches the target face image of the passenger included in the captured image. The registered face images to be compared are limited to images associated with token IDs whose invalid flag value is "1" (valid). Furthermore, the passage history information DB12 may be referenced, and only images of people who have passed through the immigration inspection area may be compared.
[0118] Next, the management server 10 acquires the token ID associated with the matching registered face image in the token ID information DB 11, and acquires the reservation number and airline code of each person from the business information DB 13 using the token ID as a key (step S508).Then, the management server 10 transmits the data set of the token ID, reservation number, and airline code to the business terminal 70 (step S509).
[0119] Next, when the business terminal 70 receives the data set for each person from the management server 10, it sequentially transmits the reservation numbers to the reservation system 2 of the airline corresponding to the airline code (step S510) and queries the boarding reservation information for each person.
[0120] When the reservation system 2 receives the reservation number of each person from the business terminal 70, it transmits the corresponding boarding reservation information to the business terminal 70 (step S511).
[0121] Next, when the business terminal 70 receives the boarding reservation information of each person, it transmits a data set of the token ID, reservation number, airline code, and boarding reservation information to the management server 10 (step S512).
[0122] Next, when the management server 10 receives the data set of each person from the business terminal 70, it transmits a passenger list screen created based on the data set to the business terminal 70 (step S513). The passenger list screen includes boarding reservation information associated with each registered face image identified by biometric authentication.
[0123] Then, the business terminal 70 displays the passenger list screen received from the management server 10 on the display device 707 (step S514).
[0124] FIG. 20 is a diagram showing an example of a passenger list screen displayed on the business terminal 70. Here, boarding reservation information (name, nationality, flight number, departure point, destination, departure time, boarding gate) and face images of multiple people detected from the captured image are displayed in list form. Note that the data items displayed are not limited to this. For example, it is preferable to also display information on membership category, priority at boarding guidance, and waiting location before boarding (waiting lane) corresponding to the priority. In this case, by referring to this passenger list screen, staff member S can easily find passengers who may be in the wrong boarding gate or waiting lane location, and guide them to the correct location.
[0125] [Pre-boarding assistance (2)] 21 is a sequence diagram showing an example of the processing of the reservation system 2, the business terminal 70, the management server 10, and the camera 80. This processing is executed for each boarding gate to notify the staff S of persons eligible for priority boarding.
[0126] First, the management server 10 determines whether the current time is a predetermined time before the priority boarding guidance start time (step S601). If the management server 10 determines that the current time is the predetermined time before the guidance start time (step S601, YES), it acquires an image of the area around the boarding gate from the camera 80 (step S602). Then, the process proceeds to step S603. On the other hand, if the management server 10 determines that the current time is not the predetermined time before the guidance start time (step S601, NO), it waits until the current time is the predetermined time before the guidance start time.
[0127] In step S603, the management server 10 detects people from the captured image of the area around the boarding gate. If the captured image includes multiple people, the management server 10 detects the facial images of all the people as target facial images.
[0128] Next, the management server 10 performs a 1:N comparison between the target face image and a plurality of registered face images registered in the token ID information DB11 (step S604). The registered face images to be compared are limited to images associated with token IDs whose invalid flag value is "1" (valid). Furthermore, by referring to the passage history information DB12, only images of people who have passed through the immigration inspection area may be compared.
[0129] Next, the management server 10 acquires the token ID associated with the matching registered face image in the token ID information DB 11, and acquires the reservation number and airline code of each person from the business information DB 13 using the token ID as a key (step S605).Then, the management server 10 transmits the data set of the token ID, reservation number, and airline code to the business terminal 70 (step S606).
[0130] Next, when the business terminal 70 receives the data set for each person from the management server 10, it sequentially transmits the reservation numbers to the reservation system 2 of the airline corresponding to the airline code (step S607) and queries the boarding reservation information for each person.
[0131] When the reservation system 2 receives the reservation number of each person from the business terminal 70, it transmits the corresponding boarding reservation information to the business terminal 70 (step S608).
[0132] Next, when the business terminal 70 receives the boarding reservation information of each person, it transmits a data set of the token ID, reservation number, airline code, and boarding reservation information to the management server 10 (step S609).
[0133] Next, when the management server 10 receives the data set for each person from the business terminal 70, it determines the priority for boarding guidance based on each person's seat class, membership category, and accompanying person information, etc., contained in the data set, and extracts passengers with high priority (step S610).
[0134] Next, the management server 10 transmits a priority boarding guide instruction screen for the extracted passenger to the business terminal 70 (step S611).
[0135] Then, the business terminal 70 displays the priority boarding guide instruction screen received from the management server 10 on the display device 707 (step S612).
[0136] 22 is a diagram showing an example of a priority boarding guidance instruction screen displayed on the business terminal 70. A captured image is displayed in the center of the screen. The dashed line within the screen indicates the detection area of a parent and child who have been determined to be the passengers with the highest priority for boarding guidance. In addition, a message instructing staff S to guide the passengers through priority boarding ("Priority boarding will begin shortly. Please guide both passengers to the boarding gate.") is displayed in the lower area of the screen.
[0137] [Pre-boarding assistance (3)] 23 is a sequence diagram showing an example of the processing of the reservation system 2, the business terminal 70, the management server 10, and the camera 80. This processing is performed to guide passengers to appropriate waiting lanes according to their priority levels before starting the announcement for priority boarding.
[0138] First, the management server 10 judges whether the current time is a predetermined time before the priority boarding guidance start time (step S701). If the management server 10 judges that the current time is a predetermined time before the guidance start time (step S701, YES), it acquires a photographed image including the passenger boarding queue from the camera 80 (step S702). Then, the process proceeds to step S703. On the other hand, if the management server 10 judges that the current time is not the predetermined time before the guidance start time (step S701, NO), it waits until the current time is the predetermined time before the guidance start time.
[0139] In step S703, the management server 10 detects all people from the captured image including the passenger boarding queue.
[0140] Next, the management server 10 performs a 1:N comparison between the target face image and a plurality of registered face images registered in the token ID information DB 11 (step S704).
[0141] Next, the management server 10 acquires the token ID associated with the matching registered face image in the token ID information DB 11, and acquires the reservation number and airline code of each person from the business information DB 13 using the token ID as a key (step S705).Then, the management server 10 transmits the data set of the token ID, reservation number, and airline code to the business terminal 70 (step S706).
[0142] Next, when the business terminal 70 receives the data set for each person from the management server 10, it sequentially transmits the reservation numbers to the airline reservation system 2 corresponding to the airline code (step S707) and queries the boarding reservation information for each person.
[0143] When the reservation system 2 receives the reservation number of each person from the business terminal 70, it transmits the corresponding boarding reservation information to the business terminal 70 (step S708).
[0144] Next, when the business terminal 70 receives the boarding reservation information of each person, it transmits a data set of the token ID, reservation number, airline code, and boarding reservation information to the management server 10 (step S709).
[0145] Next, when the management server 10 receives the data set for each person from the business terminal 70, it determines the boarding priority of each person based on the seat class, membership category, and accompanying person information of each person contained in the data set, and extracts passengers whose priority does not match the priority for the waiting lane, i.e., passengers waiting in a different waiting lane (step S710).
[0146] Next, the management server 10 transmits a waiting lane guidance instruction screen for the extracted passengers to the business terminal 70 (step S711). That is, when passengers waiting at a waiting location include passengers with a priority different from the priority associated with the waiting location, the management server 10 outputs information to guide the passengers to the correct waiting location corresponding to their priority.
[0147] Then, the business terminal 70 displays the guidance instruction screen received from the management server 10 on the display device 707 (step S712).
[0148] 24 is a diagram showing an example of a waiting lane guidance instruction screen displayed on the business terminal 70. A photographed image showing multiple passengers lined up in a pre-boarding waiting lane provided around the boarding gate is displayed in the central area of the screen. The dashed line portion on the screen indicates the detection area of passenger E who has lined up in the wrong waiting lane.
[0149] Additionally, the lower area of the screen displays an instruction message to guide attendant S to the correct waiting lane that corresponds to passenger E's priority ("There is a customer waiting in the incorrect waiting lane (No. 1). Please guide the customer to the correct waiting lane (No. 3).").
[0150] [Pre-boarding assistance (4)] 25 is a sequence diagram showing an example of processing by the reservation system 2, the business terminal 70, the management server 10, and the camera 80. This processing is executed so that the staff member S can arbitrarily designate a person included in a captured image and inquire about information on the designated person.
[0151] First, the business terminal 70 transmits a display request for a business screen to the management server 10 based on input information from the staff member S (step S801). When the management server 10 receives the display request from the business terminal 70, it acquires captured images of the area surrounding the boarding gate from the multiple cameras 80 that are distributed around the boarding gate (step S802).
[0152] Next, when the management server 10 acquires the captured image from the camera 80, it transmits a business screen including the captured image to the business terminal 70 (step S803).
[0153] Next, the business terminal 70 displays the business screen received from the management server 10 on the display device 707 (step S804).
[0154] Next, the business terminal 70 transmits the coordinate information of the designated person in the business screen of the staff S to the management server 10 (step S805). When the management server 10 receives the coordinate information of the designated person from the business terminal 70, it detects the designated person from the photographed image based on the coordinate information (step S806) The face image of the designated person cut out from the photographed image becomes the target face image.
[0155] Next, the management server 10 performs a 1:N comparison between the target face image of the designated person and a plurality of registered face images registered in the token ID information DB 11 (step S807). That is, the management server 10 identifies a registered face image that matches the target face image of the passenger designated by the staff member S on the screen of the business terminal 70.
[0156] Next, the management server 10 acquires the token ID associated with the matching registered face image in the token ID information DB 11, and acquires the reservation number and airline code of the designated person from the business information DB 13 using the token ID as a key (step S808).Then, the management server 10 transmits the data set of the token ID, the reservation number, and the airline code to the business terminal 70 (step S809).
[0157] Next, when the business terminal 70 receives the data set of the designated person from the management server 10, it transmits the reservation number to the reservation system 2 of the airline corresponding to the airline code (step S810) and makes an inquiry about boarding reservation information.
[0158] When the reservation system 2 receives the reservation number of the designated person from the business terminal 70, it transmits the corresponding boarding reservation information to the business terminal 70 (step S811).
[0159] Next, when the business terminal 70 receives the boarding reservation information of the designated person, it transmits a data set of the token ID, the reservation number, the airline code, and the boarding reservation information to the management server 10 (step S812).
[0160] Next, when the management server 10 receives the data set of the designated person from the business terminal 70, it transmits a passenger inquiry screen created based on the data set to the business terminal 70 (step S813). That is, the management server 10 outputs the boarding reservation information associated with the registered face image of the designated person to the business terminal 70.
[0161] Then, the business terminal 70 displays the passenger inquiry screen received from the management server 10 on the display device 707 (step S814).
[0162] 26 is a diagram showing an example of a passenger inquiry screen displayed on the business terminal 70. In the left area of the screen, a photographed image (photographed image), a target face image of a designated person extracted from the photographed image, and a registered face image that matches the target face image are displayed. The dashed line portion in the photographed image is the detection area of the designated person T. In addition, in the right area of the screen, boarding reservation information of the designated person is displayed in list form as the inquiry result.
[0163] For example, when staff S designates a person on the business screen, the management server 10 identifies the passenger based on the face image of the designated person and displays the boarding reservation information on the screen. This allows staff S to check the boarding reservation information of the passenger included in the captured image in advance and use it for business purposes.
[0164] [Pre-boarding assistance (5)] 27 is a sequence diagram showing an example of the processing of the reservation system 2, the business terminal 70, the management server 10, and the camera 80. This processing is executed when the staff member S extracts a desired passenger from among passengers present in the vicinity of the boarding gate.
[0165] First, the business terminal 70 displays an extraction condition input screen (step S901). Fig. 28 is a diagram showing an example of the extraction condition input screen displayed on the business terminal 70. Here, examples of the extraction conditions include boarding gate, flight name, priority, membership category, seat class, and the presence or absence of a token ID. For example, when staff member S wants to extract only passengers with the highest priority for boarding guidance from among multiple passengers included in the captured image, staff member S sets the check box related to priority ("1") to ON.
[0166] Next, the business terminal 70 transmits the extraction conditions input by the clerk S on the extraction condition input screen to the management server 10 (step S902).
[0167] Next, when the management server 10 receives the extraction conditions from the operations terminal 70, it acquires images of the area surrounding the boarding gate from the multiple cameras 80 that are distributed around the boarding gate (step S903).
[0168] Next, when the management server 10 acquires a photographed image from the camera 80, it detects all people from the photographed image (step S904).
[0169] Next, the management server 10 performs a 1:N comparison between the target face image of each person that has been detected and a plurality of registered face images registered in the token ID information DB 11 (step S905).
[0170] Next, the management server 10 acquires the token ID associated with the matching registered face image in the token ID information DB 11, and acquires the reservation number and airline code of each person from the business information DB 13 using the token ID as a key (step S906).Then, the management server 10 transmits the data set of the token ID, reservation number, and airline code to the business terminal 70 (step S907).
[0171] Next, when the business terminal 70 receives the data set for each person from the management server 10, it sequentially transmits the reservation numbers to the reservation system 2 of the airline corresponding to the airline code (step S908) and queries the boarding reservation information for each person.
[0172] When the reservation system 2 receives the reservation number of each person from the business terminal 70, it transmits the corresponding boarding reservation information to the business terminal 70 (step S909).
[0173] Next, when the business terminal 70 receives the boarding reservation information of each person, it transmits a data set of the token ID, reservation number, airline code, and boarding reservation information to the management server 10 (step S910).
[0174] Next, when the management server 10 receives the data set of each person from the business terminal 70, it extracts passengers who meet the extraction conditions (step S911).
[0175] Next, the management server 10 transmits a passenger extraction result screen relating to the extracted passengers to the business terminal 70 (step S912).
[0176] Then, the business terminal 70 displays the passenger extraction result screen received from the management server 10 on the display device 7. 07 (step S913).
[0177] FIG. 29 is a diagram showing an example of a passenger extraction result screen displayed on the business terminal 70. The upper area of the screen displays the extraction conditions specified by staff S. Here, three items are specified: boarding gate, flight name, and membership category. In addition, the central area of the screen displays a photographed image. The multiple dashed lines in the photographed image are detection areas for passengers who satisfy the extraction conditions. In other words, the management server 10 can extract passengers corresponding to boarding reservation information that satisfies the extraction conditions input by staff S from among the passengers included in the photographed image.
[0178] [Boarding check at the boarding gate] 30 is a sequence diagram showing an example of the processing of the reservation system 2, the boarding gate device 60, and the management server 10. This processing is executed when a user U passes through the boarding gate.
[0179] The boarding gate device 60 constantly or periodically photographs the area in front of the device, and determines whether the face of a user U standing in front of the boarding gate device 60 is detected in the photographed image (step S1001). The boarding gate device 60 waits until the biometric information acquisition device 609 detects the face of the user U in the image (step S1001, NO).
[0180] When the boarding gate device 60 determines that the face of user U has been detected by the biometric information acquisition device 609 (step S1001, YES), it photographs the face of user U and acquires the facial image of user U as a target facial image (step S1002).
[0181] Next, the boarding gate device 60 transmits the target face image of the user U captured by the biometric information acquisition device 609 to the management server 10 together with a matching request (step S1003). As a result, the boarding gate device 60 requests the management server 10 to perform a 1:N matching between the target face image of the user U captured by the biometric information acquisition device 609 and a plurality of registered face images registered in the token ID information DB 11 of the management server 10.
[0182] When the management server 10 receives the target face image and the matching request from the boarding gate device 60, it matches the face image of the user U (step S1004). That is, the management server 10 matches the target face image received from the boarding gate device 60 with a plurality of registered face images registered in the token ID information DB 11 on a 1:N basis. Note that the registered face images to be matched are limited to images associated with token IDs whose invalid flag value is "1" (valid).
[0183] If the management server 10 determines that the matching result is a mismatch (step S1005, NO), the management server 10 transmits the mismatch matching result to the boarding gate device 60 (step S1008), and the process proceeds to step S1009. On the other hand, if the management server 10 determines that the matching result is a match (step S1005, YES), the process proceeds to step S1006.
[0184] In step S1006, the management server 10 acquires the token ID associated with the registered face image that matches the match in the token ID information DB 11, and acquires the reservation number and airline code from the business information DB 13 using the token ID as a key. Then, the management server 10 transmits the token ID, reservation number, airline code, and the matching result to the boarding gate device 60 (step S1007). The process proceeds to step S1009.
[0185] Next, if the boarding gate device 60 determines that the procedure can be carried out based on the comparison result (step S1009, YES), it transmits the reservation number to the reservation system 2 of the airline corresponding to the airline code (step S1010) and inquires about the boarding reservation information.
[0186] On the other hand, when the boarding gate device 60 determines based on the collation result that the procedure cannot be carried out (step S1009, NO), it notifies the user U of an error message (step S1012). For example, the boarding gate device 60 displays on the display device 607 a notification screen including a message such as "Please carry out the procedure at a manned counter."
[0187] When the reservation system 2 receives the reservation number from the boarding gate equipment 60, it transmits the corresponding boarding reservation information to the boarding gate equipment 60 (step S1011).
[0188] Next, when the boarding gate device 60 receives the boarding reservation information from the reservation system 2, it checks the user U at the boarding gate based on the flight number, gate number, boarding start time, etc. included in the boarding reservation information (step S1013), and opens the gate 611 if boarding is permitted (step S1014). The user U who has passed the touch point P5 boards the aircraft. Note that, if the boarding gate device 60 determines in step S1013 that boarding is not permitted, it may notify the user U of an error message without opening the gate 611. For example, if the user U makes a mistake in the number of the gate 611 or if the current time has not yet reached the boarding start time, the gate 611 will not be opened.
[0189] Next, the boarding gate device 60 transmits passage history information indicating that the user U has completed boarding the aircraft after verifying the token ID, the business information, and the face image to the management server 10 (step S1015). Note that the passage history information includes information such as the time of passing through the touch point P5 and the device name of the terminal used.
[0190] When the management server 10 receives the information from the boarding gate device 60, it registers the passage history information of the touch point P5 of the user U in the passage history information DB 12 (step S1016). In addition, the management server 10 registers the business information received from the boarding gate device 60 in the business information DB 13 as necessary (step S1017).
[0191] Then, the management server 10 updates the token ID information DB 11 (step S1018). Specifically, the management server 10 updates the invalid flag of the token ID information DB 11 to an invalid value ("0"). This causes the validity period (life cycle) of the token ID to expire.
[0192] According to this embodiment, the management server 10 stores the boarding reservation information of passengers who will board an aircraft in association with the registered face images of the passengers. The management server 10 also acquires a target face image of a passenger who has not yet boarded the aircraft from a captured image of the area surrounding the boarding gate, and identifies a registered face image that matches the target face image. Then, when the management server 10 identifies the boarding reservation information associated with the identified registered face image, it outputs information to the business terminal 70 used by the staff S based on the boarding reservation information to support the passenger in the procedures at the boarding gate. This allows the procedures at the boarding gate to be carried out efficiently.
[0193] The management server 10 outputs the priority of the procedures carried out at the boarding gate of the passenger as information for supporting the procedures at the boarding gate of the passenger. This enables the staff S to efficiently provide priority boarding service based on the priority of each passenger obtained from the photographed image without checking recording media such as a passport or a boarding pass.
[0194] <Second embodiment> The information processing system 1 in this embodiment will be described below. Note that the same reference numerals as those in the drawings of the first embodiment indicate the same objects. Descriptions of the parts common to the first embodiment will be omitted, and differences will be described in detail.
[0195] In this embodiment, the boarding check at the boarding gate (touch point P5) The second embodiment differs from the first embodiment in that a confirmation process is further carried out regarding those accompanying the passenger.
[0196] [Companion check at the boarding gate] 31 is a flowchart showing an example of a process for confirming an accompanying person, which is executed by the management server 10, for example, between step S1011 and step S1013 in FIG.
[0197] Based on the boarding reservation information received from the reservation system 2, the management server 10 determines whether the target person undergoing boarding check at the boarding gate is an accompanied passenger (step S1101).Here, if the management server 10 determines that the target person is an accompanied passenger (step S1101, YES), the processing proceeds to step S1102.
[0198] On the other hand, if the management server 10 determines that the target person is an unaccompanied passenger (step S1101, NO), the process proceeds to step S1013.
[0199] In step S1102, the management server 10 determines whether or not another person is included in the captured image. If the management server 10 determines that another person is included in the captured image (step S1102, YES), the process proceeds to step S1103.
[0200] On the other hand, if the management server 10 determines that no other person is included in the photographed image (step S1102, NO), the process proceeds to step S1105.
[0201] In step S1103, the management server 10 determines whether or not the person included in the captured image is a person registered as a companion. If the management server 10 determines that the person included in the captured image is a person registered as a companion (YES in step S1103), the process proceeds to step S1013.
[0202] On the other hand, if the management server 10 determines that the person included in the photographed image is not a person registered as a companion (step S1103, NO), the process proceeds to step S1106.
[0203] In step S1105, the management server 10 outputs a confirmation instruction screen indicating the absence of an accompanying person to the business terminal 70, and ends the process.
[0204] FIG. 32 is a diagram showing an example of a companion confirmation instruction screen displayed on the business terminal 70. A photographed image taken at the boarding gate is displayed in the left area of the screen. Person T in the photographed image is a passenger whose face has been authenticated. Furthermore, boarding reservation information for Person T is displayed in a list format in the right area of the screen. Here, Person T's companion is shown to be "female / infant". However, as shown by a dashed line in the photographed image, Child C, who is registered as Person T's companion, is not included in the photographed image. For this reason, a message instructing staff member S to confirm the companion ("This is a customer whose companion information is registered. Please confirm the companion.") is displayed in the lower area of the screen.
[0205] In step S1106, the management server 10 outputs a confirmation instruction screen indicating a mismatch of the accompanying persons to the business terminal 70, and ends the process.
[0206] FIG. 33 is a diagram showing an example of a companion confirmation instruction screen displayed on the business terminal 70. A photographed image taken at the boarding gate is displayed in the left area of the screen. Person T in the photographed image is a passenger whose face has been authenticated. Furthermore, boarding reservation information for person T is displayed in a list format in the right area of the screen. Here, it is shown that person T's companion is "male / infant". However, child C included in the photographed image is different from the registered companion. For this reason, a message instructing staff member S to confirm the companion ("Companion differs from registered information. Please confirm companion.") is displayed in the lower area of the screen.
[0207] Thus, according to this embodiment, the management server 10 can analyze the image captured at the boarding gate and efficiently instruct the staff S to check the passenger's companion. Specifically, the management server 10 acquires a target facial image of the passenger from the image captured at the boarding gate, and identifies a registered facial image that matches the target facial image. If the companion associated with the identified registered facial image is not included in the image captured at the boarding gate, the management server 10 outputs information prompting the staff S to check the companion.
[0208] Furthermore, if the accompanying person associated with the identified registered face image does not match other passengers included together with the passenger in other captured images, the management server 10 outputs information prompting the user to confirm the accompanying person.
[0209] [Third embodiment] The information processing system 4 in this embodiment will be described below. Note that the same reference numerals as those in the drawings of the first embodiment denote the same objects. Descriptions of the parts common to the first embodiment will be omitted, and differences will be described in detail.
[0210] 34 is a block diagram showing an example of the overall configuration of the information processing system 4 in this embodiment. The information processing system 4 differs from the information processing system 1 in the first embodiment in that it further includes a function of searching for the position of a designated passenger in the airport by using images captured by cameras 80 installed at various locations in the airport, such as touch points P1 to P5, lounges and duty-free shops (not shown), and passageways.
[0211] [Searching for designated passengers within the airport] 35 is a sequence diagram showing an example of the processing of the business terminal 70, the management server 10, and the camera 80. This processing is executed when the staff S searches for the current location of a desired passenger among passengers present in the airport. Note that the passenger to be searched for is a passenger who has already been issued a token ID.
[0212] First, the business terminal 70 displays a search condition input screen (step S1201) and transmits the search conditions input by the staff S on the condition input screen to the management server 10 (step S1202). On the search condition input screen, the same conditions as those on the extraction condition input screen shown in FIG. 28 may be input, or other conditions may be input. Examples of search conditions include reservation number, airline code, seat class, membership category, and passenger name. In this embodiment, it is assumed that such boarding reservation information is recorded as business information in the business information DB 13 when the token ID is issued. This makes it possible to omit the process of querying the reservation system 2 for boarding reservation information based on the reservation number.
[0213] Next, when the management server 10 receives the search conditions from the business terminal 70, it identifies the token ID of the person to be searched for who is associated with business information that matches the search conditions in the business information DB 13 (step S1203).
[0214] Next, the management server 10 acquires a registered face image of the searched person from the token ID information DB 11 based on the identified token ID (step S1204).
[0215] Next, the management server 10 acquires images taken by the multiple cameras 80 that are distributed at various locations in the airport A (step S1205).
[0216] Next, when the management server 10 acquires the captured images from the camera 80, it detects all people from each captured image (step S1206).
[0217] Next, the management server 10 performs 1-to-N matching between the registered face image of the searched person and the multiple face images detected from the photographed image (step S1207).
[0218] Next, the management server 10 identifies the current location of the person being searched for based on a captured image containing a person whose facial image matches the registered facial image of the person being searched for (step S1208), and transmits a passenger search result screen containing information on the current location of the person being searched for to the business terminal 70 (step S1209).
[0219] Then, the business terminal 70 displays the passenger search result screen received from the management server 10 on the display device 7. 07 (step S1210).
[0220] Fig. 36 is a diagram showing an example of a passenger search result screen displayed on the business terminal 70. In the left area of the screen, a photographed image of the location where the searched person was found, a target face image of the searched person extracted from the photographed image, and a registered face image that matches the target face image are displayed. The dashed line portion in the photographed image is the detection area of the specified person T. In addition, information on the current location of the searched person ("Terminal 1, 4F XXX Lounge") is displayed above the photographed image. In the right area of the screen, boarding reservation information for person T is displayed in list form.
[0221] According to this embodiment, the management server 10 selects an image including a face image that matches the registered face image of the passenger to be searched for from among images captured by a plurality of cameras 80 (imaging devices) arranged in the airport. Then, the management server 10 outputs the position information of the passenger in the airport based on the selected image. In other words, the management server 10 can easily search for the passenger not only in the area around the boarding gate but also in various places in the airport, and can notify the business terminal 70 of the position information (current location) of the searched passenger. This allows the staff S to share information on the desired passenger.
[0222] <Fourth embodiment> FIG. 37 is a block diagram showing an example of the overall configuration of the information processing device 100 in this embodiment. The information processing device 100 includes an acquisition unit 100A, an identification unit 100B, and an output unit 100C. The acquisition unit 100A acquires biometric information of a passenger from a captured image of a passenger who is boarding an aircraft and has not passed through a boarding gate corresponding to the aircraft. The identification unit 100B identifies boarding reservation information related to boarding using the biometric information acquired by the acquisition unit 100A. The output unit 100C outputs information for supporting the passenger in the procedure at the boarding gate based on the boarding reservation information identified by the identification unit 100B. According to the information processing device 100 in this embodiment, it is possible to support the passenger in the procedure at the boarding gate.
[0223] <Modified embodiment> Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above-mentioned embodiments. Various modifications that can be understood by those skilled in the art are possible in the configuration and details of the present invention without departing from the gist of the present invention. For example, it should be understood that an embodiment in which a part of the configuration of any of the embodiments is added to another embodiment, or an embodiment in which a part of the configuration of another embodiment is replaced with a part of the configuration of another embodiment, is also an embodiment to which the present invention can be applied.
[0224] Furthermore, the configuration of the present invention can be applied not only to international flights but also to domestic flights. In the case of domestic flights, the one-to-one matching process between the passport face image and the photographed face image can be omitted in addition to the immigration procedure. In this case, the facial image photographed when purchasing the boarding pass can be used as the registered biometric image. When purchasing a boarding pass or checking in online using a terminal such as a smartphone or a personal computer, if the facial image photographed by the terminal is registered, the passenger can board the aircraft at airport A through facial recognition.
[0225] In the above-mentioned first embodiment, the check-in terminal 20 reads a passport face image from a passport to apply for issuance of a token ID to the management server 10, but considering the case where the check-in procedure is performed online, it is preferable to make the issuance application at the automated baggage drop machine 30 or the security inspection device 40. That is, the management server 10 obtains a passport face image and a target biometric image from any one of the terminal devices that executes the procedures related to the departure of the user U. The issuance of a token ID may be applied for in the first procedure among the series of procedures performed at the time of departure.
[0226] Also, in the above-mentioned first embodiment, the business information DB13 of the management server 10 stores only some items of the boarding reservation information (reservation number and airline code), unlike the reservation information DB3 of the reservation system 2. Therefore, the terminal device (check-in terminal 20, etc.) of each touch point inquires of the reservation system 2 about boarding reservation information based on the reservation number when the procedure is performed. However, at the first procedure, the boarding reservation information acquired from the reservation system 2 may be entirely copied to the business information DB13 as business information. In this case, the terminal device of the subsequent touch point can acquire the boarding reservation information from the management server 10 (business information DB13), and therefore can omit the inquiry to the reservation system (airline system) 2 or change the inquiry method as necessary.
[0227] For example, the process between the boarding gate device 60, the management server 10, and the reservation system 2 at the boarding gate (touch point P5) can be performed in the following procedure. First, the boarding gate device 60 photographs the passenger's face and transmits the facial image to the management server 10. Next, the management server 10 performs face matching with a registered facial image registered in the token ID information DB11, and acquires a token ID corresponding to the registered facial image that matches the matching. Next, the management server 10 transmits boarding reservation information (boarding pass data) acquired from the business information DB13 using the token ID as a key to the boarding gate device 60. Next, the boarding gate device 60 transmits the acquired boarding reservation information to the reservation system 2. Next, when the reservation system 2 receives the boarding reservation information, it compares the acquired boarding reservation information (boarding pass data) with the boarding reservation information stored in the reservation information DB3, and when it determines whether the passenger can board, it transmits the determination result to the boarding gate device 60. This allows the boarding gate device 60 to control the opening of the gate 611 based on the determination result received from the reservation system 2.
[0228] Furthermore, in the above-described first embodiment, the case where the output destination of the information for assisting the passenger in the procedure at the boarding gate is the business terminal 70 has been described, but the output destination terminal device is not limited to this. For example, the information may be output to a signage terminal arranged in the surrounding area or aisle of the boarding gate, or to a mobile terminal carried by the passenger. If the contact information of the passenger's mobile terminal, such as an email address, is registered in a database (not shown), when it is detected that the passenger is waiting in the wrong waiting lane, guidance information indicating the correct waiting lane can be output to the contact information.
[0229] The scope of each embodiment also includes a processing method in which a program that operates the configuration of the embodiment to realize the functions of the above-mentioned embodiment is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. That is, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, not only the recording medium on which the above-mentioned program is recorded, but also the program itself is included in each embodiment.
[0230] Examples of the recording medium that can be used include a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a non-volatile memory card, etc. Furthermore, the scope of each embodiment is not limited to those that execute processing by a single program recorded on the recording medium, but also includes those that execute processing by operating on an OS in cooperation with other software and functions of an expansion board.
[0231] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.
[0232] (Appendix 1) an acquisition unit that acquires biometric information of a passenger from a captured image of the passenger who is boarding an aircraft and has not passed through a boarding gate corresponding to the aircraft; an identification unit that identifies boarding reservation information related to the boarding using the acquired biometric information; an output unit that outputs information for assisting the passenger in completing a procedure at the boarding gate based on the identified boarding reservation information; An information processing device comprising:
[0233] (Appendix 2) A control unit issues a token ID corresponding to the registered biometric information of the passenger for each passenger, and associates the registered biometric information and the boarding reservation information in advance via the token ID, The identification unit identifies the boarding reservation information of the passenger based on the token ID corresponding to the registered biometric information that matches the biometric information. 2. An information processing device according to claim 1.
[0234] (Appendix 3) the information includes a priority for the passenger to be processed at the boarding gate; 3. The information processing device according to claim 1 or 2.
[0235] (Appendix 4) The boarding reservation information includes a seat class in the aircraft or a classification of the passenger set by an airline, The output unit outputs the priority based on the grade or the category. 4. The information processing device according to claim 3.
[0236] (Appendix 5) The output unit outputs a pre-boarding waiting location corresponding to the priority. 5. The information processing device according to claim 4.
[0237] (Appendix 6) When the passengers waiting at the waiting area include a person having a priority different from the priority corresponding to the waiting area, the output unit outputs the information that prompts the passenger to be guided to another waiting area corresponding to the priority of the person. 6. The information processing device according to claim 5.
[0238] (Appendix 7) The boarding reservation information further includes registration information regarding a specified companion; The output unit outputs the priority based on the presence or absence of the accompanying person. 7. An information processing device according to any one of claims 3 to 6.
[0239] (Appendix 8) the acquiring unit acquires other biometric information of the passenger from other captured images of the passenger at the boarding gate; The identification unit identifies the boarding reservation information of the passenger using the other biometric information, the output unit outputs the information prompting a user to confirm the companion recorded in the identified boarding reservation information when the companion is not included in the other photographed images. 8. The information processing device according to claim 7.
[0240] (Appendix 9) the acquiring unit acquires other biometric information of the passenger from other captured images of the passenger at the boarding gate; The identification unit identifies the boarding reservation information of the passenger using the other biometric information, the output unit outputs the information prompting a user to confirm the companion when the companion recorded in the identified boarding reservation information does not match a person detected together with the passenger in the other photographed image. 8. The information processing device according to claim 7.
[0241] (Appendix 10) The identification unit identifies the boarding reservation information of each of the passengers using the biometric information of all of the passengers included in the captured images, The output unit outputs a list screen including the specified boarding reservation information. 10. An information processing device according to any one of claims 1 to 9.
[0242] (Appendix 11) The identification unit identifies the boarding reservation information by using the biometric information of the passenger designated on a screen displaying the captured image, The output unit outputs the specified boarding reservation information to the screen. 11. An information processing device according to any one of claims 1 to 10.
[0243] (Appendix 12) An input unit for inputting the passenger extraction conditions; an extraction unit that extracts the passengers corresponding to the boarding reservation information that satisfies the extraction condition from the passengers included in the captured image; 12. The information processing device according to any one of claims 1 to 11, further comprising:
[0244] (Appendix 13) A selection unit is further provided for selecting, from among images captured by photographing devices installed in the airport, the images from which the biometric information of the passenger to be searched can be obtained, The output unit outputs position information of the passenger within the airport based on the selected image. 13. An information processing device according to any one of claims 1 to 12.
[0245] (Appendix 14) A step of acquiring biometric information of a passenger from a captured image of the passenger who is boarding an aircraft and has not passed through a boarding gate corresponding to the aircraft; identifying boarding reservation information regarding the boarding using the acquired biometric information; , outputting information for assisting the passenger in completing a procedure at the boarding gate based on the identified boarding reservation information; An information processing method comprising:
[0246] (Appendix 15) On the computer, A step of acquiring biometric information of a passenger from a captured image of the passenger who is boarding an aircraft and has not passed through a boarding gate corresponding to the aircraft; identifying boarding reservation information regarding the boarding using the acquired biometric information; , outputting information for assisting the passenger in completing a procedure at the boarding gate based on the identified boarding reservation information; A recording medium on which a program for executing the above is recorded. [Explanation of symbols]
[0247] NW1, NW2...Network 1,4 Information Processing System 2. Reservation system 3. Reservation information DB 10. Management Server 11 Token ID information DB 12 Passing history information DB 13...Business information DB 20. Check-in terminal 30. Self-service baggage drop machine 40...Security inspection device 50. Automated gate device 60 Boarding gate equipment 70...Business terminal 80. Camera 100.... Information processing device 100A... Acquisition section 100B...Specific part 100C···Output section
Claims
1. an acquisition unit that acquires biometric information of a passenger from a captured image of the passenger who is boarding an aircraft and has not passed through a boarding gate corresponding to the aircraft; A receiving unit for receiving extraction conditions related to the passenger's boarding reservation information; an output unit that superimposes information identifying the passenger whose boarding reservation information is identified using the biometric information on the captured image and outputs the information; Equipped with Information processing device.
2. a control unit that issues a token ID corresponding to the registered biometric information of the passenger for each passenger and associates the registered biometric information with the boarding reservation information in advance via the token ID; an identification unit that identifies the boarding reservation information of the passenger based on the token ID corresponding to the registered biometric information that matches the biometric information; The information processing apparatus according to claim 1 , further comprising:
3. the information includes a priority for the passenger to be processed at the boarding gate; The information processing device according to claim 2 .
4. The boarding reservation information includes a seat class in the aircraft or a classification of the passenger set by an airline, The output unit outputs the priority based on the grade or the category. The information processing device according to claim 3 .
5. The output unit outputs a pre-boarding waiting location corresponding to the priority. The information processing device according to claim 4.
6. When the passengers waiting at the waiting area include a person having a priority different from the priority corresponding to the waiting area, the output unit outputs the information that prompts the passenger to be guided to another waiting area corresponding to the priority of the person. The information processing device according to claim 5 .
7. The boarding reservation information further includes registration information regarding a specified companion; The output unit outputs the priority based on the presence or absence of the accompanying person. The information processing device according to claim 3 .
8. the acquiring unit acquires other biometric information of the passenger from other captured images of the passenger at the boarding gate; The identification unit identifies the boarding reservation information of the passenger using the other biometric information, the output unit outputs the information prompting a user to confirm the companion when the companion recorded in the identified boarding reservation information is not included in the other photographed images. The information processing device according to claim 7.
9. the acquiring unit acquires other biometric information of the passenger from other captured images of the passenger at the boarding gate; The identification unit identifies the boarding reservation information of the passenger using the other biometric information, the output unit outputs the information prompting a user to confirm the companion when the companion recorded in the identified boarding reservation information does not match a person detected together with the passenger in the other photographed image. The information processing device according to claim 7.
10. The identification unit identifies the boarding reservation information of each of the passengers using the biometric information of all of the passengers included in the captured images, The output unit outputs a list screen including the specified boarding reservation information. The information processing device according to claim 2 .
11. A selection unit is further provided for selecting, from among images captured by photographing devices installed in the airport, the images from which the biometric information of the passenger to be searched can be obtained, The output unit outputs position information of the passenger within the airport based on the selected image. The information processing device according to claim 1 .
12. The computer Acquire biometric information of a passenger from a captured image of the passenger who is boarding an aircraft but has not passed through a boarding gate corresponding to the aircraft; receiving extraction conditions related to the passenger's boarding reservation information; outputting information for identifying the passenger whose boarding reservation information specified using the biometric information satisfies the extraction condition, by superimposing the information on the photographed image; Information processing methods.
13. On the computer, A step of acquiring biometric information of a passenger from a captured image of the passenger who is boarding an aircraft and has not passed through a boarding gate corresponding to the aircraft; receiving extraction conditions related to the passenger's boarding reservation information; a step of superimposing information for identifying the passenger whose boarding reservation information identified using the biometric information satisfies the extraction condition on the photographed image and outputting the information; A program to execute.
Citation Information
Patent Citations
Electronic ticket system and entrance check method using electronic ticket
JP2001256517A
Customer movement control system and customer movement control method
JP2006127322A
Customer guidance system
JP2006164073A
Identifying a specific person from a group
JP2009514107A
Passenger detection system
JP2014186650A
