Information processing device, information processing method, and recording medium

The information processing device and method efficiently verify user identity and eligibility for tax exemption by collating biometric and passport information, improving efficiency in tax-free procedures.

JP7582373B2Active Publication Date: 2024-11-13NEC CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023073592
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-04-21
Filing Date
2023-04-27
Publication Date
2024-11-13
Estimated Expiration
2041-03-26

AI Technical Summary

Technical Problem

Existing payment support systems, such as that described in Patent Document 1, do not efficiently determine user eligibility for tax exemption procedures, requiring manual visual confirmation by staff, which is inefficient.

Method used

An information processing device and method that acquires and collates biometric information from a user's body and passport, along with qualification information, to automatically verify user identity and eligibility for tax exemption.

Benefits of technology

Automatically verifies user identity and eligibility for tax exemption, reducing manual work and enhancing procedural efficiency at tax-free facilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007582373000001
    Figure 0007582373000001
  • Figure 0007582373000002
    Figure 0007582373000002
  • Figure 0007582373000003
    Figure 0007582373000003
Patent Text Reader

Abstract

To provide an information processing device capable efficiently performing a procedure that requires both identify verification and usage qualification verification of a user.SOLUTION: An information processing device of the present invention comprises a reader unit for reading residential status information on a passport presented by a user, a determination unit configured to determine whether an article purchase by the user satisfies tax exemption conditions or not on the basis of the residential status information, and a collation unit configured to collate a first face image obtained by photographing the user and a second face image read from the passport to perform identity verification of the user.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a recording medium. [Background technology]

[0002] Patent Document 1 discloses a payment support system that improves the efficiency of purchasing goods at a duty-free facility. The payment support system of Patent Document 1 determines whether or not payment can be made by biometric authentication using a traveler's biometric information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2017 / 033291 Summary of the Invention [Problem to be solved by the invention]

[0004] There are procedures, such as the procedure when a user purchases goods at a tax-free facility, that require by law both the identity verification of a user who holds a passport and the verification of the user's eligibility to use the facility. However, the payment support system illustrated in Patent Document 1 does not take into consideration a mechanism for automatically determining whether or not a user is eligible for the tax-free procedure. Therefore, it is necessary to verify whether or not a user is eligible for the tax-free procedure by another method, such as visual confirmation by an employee. Thus, there is room for efficiency improvement in procedures that require the identity verification of a user and the verification of the user's eligibility to use the facility.

[0005] In view of the above-mentioned problems, the present invention aims to provide an information processing device, an information processing method, and a recording medium that can efficiently carry out procedures that require both user identity verification and verification of user eligibility. [Means for solving the problem]

[0006] According to one aspect of the present invention, there is provided an information processing device comprising: a first acquisition unit that acquires first biometric information from the body of a user requesting a procedure; a second acquisition unit that acquires second biometric information of the user from a passport presented by the user; a third acquisition unit that acquires qualification information of the user; a matching unit that matches the first biometric information with the second biometric information; and a determination unit that determines whether the user is a target of the procedure based on a result of the matching and the qualification information.

[0007] According to another aspect of the present invention, there is provided an information processing method comprising the steps of acquiring first biometric information from the body of a user requesting a procedure, acquiring second biometric information of the user from a passport presented by the user, acquiring qualification information of the user, comparing the first biometric information with the second biometric information, and determining whether the user is a target of the procedure based on a result of the comparison and the qualification information.

[0008] According to yet another aspect of the present invention, there is provided a recording medium having recorded thereon a program for causing a computer to execute the steps of acquiring first biometric information from the body of a user requesting a procedure, acquiring second biometric information of the user from a passport presented by the user, acquiring qualification information of the user, comparing the first biometric information with the second biometric information, and determining whether the user is a target of the procedure based on the result of the comparison and the qualification information.

[0009] According to yet another aspect of the present invention, there is provided an information processing device comprising: a first acquisition unit that acquires first biometric information from the body of a user requesting a procedure; a second acquisition unit that acquires a passport number and second biometric information of the user from a passport presented by the user; a matching unit that compares the first biometric information with the second biometric information; a request unit that, when the identity of the user is successfully verified by the matching, outputs the passport number to an external device that determines whether the user is a target of the procedure based on the passport number; and a third acquisition unit that acquires a determination result as to whether the user is the target from the external device.

[0010] According to yet another aspect of the present invention, there is provided an information processing method comprising the steps of: acquiring first biometric information from the body of a user requesting a procedure; acquiring a passport number and second biometric information of the user from a passport presented by the user; matching the first biometric information with the second biometric information; if the identity of the user is successfully verified by the matching, outputting the passport number to an external device that determines whether the user is a target of the procedure based on the passport number; and acquiring from the external device a determination result as to whether the user is the target.

[0011] According to yet another aspect of the present invention, there is provided a recording medium having recorded thereon a program for causing a computer to execute the steps of acquiring first biometric information from the body of a user requesting a procedure; acquiring a passport number and second biometric information of the user from a passport presented by the user; matching the first biometric information with the second biometric information; if the identity of the user is successfully confirmed by the matching, outputting the passport number to an external device that determines whether the user is a target of the procedure based on the passport number; and acquiring from the external device a determination result as to whether the user is the target. Effect of the Invention

[0012] According to the present invention, there are provided an information processing device, an information processing method, and a recording medium that can efficiently carry out a procedure that requires both user identity verification and verification of user qualifications. [Brief description of the drawings]

[0013] [Figure 1] 1 is a schematic diagram showing an overall configuration of an information processing system according to a first embodiment. [Diagram 2] 1 is a block diagram showing a hardware configuration of a duty-free shop system according to a first embodiment. FIG. [Diagram 3] FIG. 2 is a block diagram showing a hardware configuration of a duty-free shop server according to the first embodiment. [Figure 4] 1 is a block diagram showing a hardware configuration of a vending machine according to a first embodiment. [Diagram 5] FIG. 1 is a functional block diagram of a vending machine according to a first embodiment. [Figure 6] 4 is a diagram showing an example of information stored in an item purchase information DB according to the first embodiment; FIG. [Figure 7] 4 is a flowchart showing a process performed in the vending machine according to the first embodiment. [Figure 8] FIG. 11 is a block diagram showing a hardware configuration of a duty-free shop system according to a second embodiment. [Figure 9] FIG. 11 is a block diagram showing a hardware configuration of a POS terminal according to a second embodiment. [Figure 10] FIG. 11 is a functional block diagram of a POS terminal according to a second embodiment. [Figure 11] 10 is a flowchart showing a process performed in a POS terminal according to the second embodiment. [Figure 12] FIG. 13 is a block diagram showing a hardware configuration of a duty-free shop system according to a third embodiment. [Figure 13] FIG. 11 is a block diagram showing a hardware configuration of a tax-free procedure terminal according to a third embodiment. [Figure 14] FIG. 11 is a functional block diagram of a tax-free procedure terminal according to a third embodiment. [Figure 15] 13 is a flowchart showing a process performed in the tax-free procedure terminal according to the third embodiment. [Figure 16] FIG. 13 is a schematic diagram showing the overall configuration of an information processing system according to a fourth embodiment. [Figure 17] FIG. 13 is a diagram showing an example of information stored in a tax exemption qualification confirmation DB according to the fourth embodiment. [Figure 18] FIG. 13 is a block diagram showing a hardware configuration of a KIOSK terminal according to a fourth embodiment. [Figure 19] FIG. 13 is a functional block diagram of a KIOSK terminal according to a fourth embodiment. [Figure 20] 13 is a flowchart showing a process performed in the KIOSK terminal according to the fourth embodiment. [Figure 21] FIG. 13 is a schematic diagram showing the overall configuration of an information processing system according to a fifth embodiment. [Figure 22] FIG. 13 is a functional block diagram of a vending machine according to a fifth embodiment. [Diagram 23] FIG. 13 is a functional block diagram of a tax exemption information management server according to the fifth embodiment. [Figure 24] 13 is a flowchart showing the processing carried out in the vending machine according to the fifth embodiment. [Diagram 25] FIG. 13 is a functional block diagram of an information processing device according to a sixth embodiment. [Figure 26] FIG. 13 is a functional block diagram of an information processing device according to a seventh embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. In the drawings, similar or corresponding elements are designated by the same reference numerals, and descriptions thereof may be omitted or simplified.

[0015] [First embodiment] An information processing system according to the present embodiment will be described. The information processing system according to the present embodiment is a system that supports tax-free processing (procedures related to tax-free) in tax-free facilities. Here, the tax-free facility may typically be a tax-free shop (export goods sales site) in a city.

[0016] In addition, "tax-free" means exemption from consumption tax when the information processing system of this embodiment is used for tax-free processing at tax-free shops in cities in Japan. However, when the information processing system of this embodiment is used in other tax-free facilities, "tax-free" may also include exemption from value-added tax, liquor tax, tobacco tax, customs duty, etc.

[0017] Unless otherwise specified, in the following description, the information processing system of this embodiment is applied to tax-free procedures at tax-free shops in cities in Japan. However, this is not limited to this, and the information processing system of this embodiment may also be used for tax-free procedures at tax-free shops in foreign countries other than Japan. In such cases, the content of the process may be changed as appropriate according to the tax system of each country.

[0018] 1 is a schematic diagram showing the overall configuration of an information processing system according to this embodiment. The information processing system includes a duty-free shop system 1, a payment server 2, and a tax-free information management server 3. The duty-free shop system 1, the payment server 2, and the tax-free information management server 3 are communicatively connected via a network NW.

[0019] The network NW may be various networks such as a local area network (LAN), a wide area network (WAN), etc. The network NW may be, for example, the Internet.

[0020] The duty-free shop system 1 is a system constructed in a duty-free shop, and may include a server, a POS (Point Of Sales) system, a KIOSK terminal, etc. In this embodiment, a case will be described in which the duty-free shop system 1 includes a vending machine, which will be described in detail later.

[0021] The payment server 2 is a server for making payments for purchases at duty-free shops. The payment server 2 provides a function for electronic payments using credit cards, debit cards, prepaid cards, electronic money, virtual currency, etc. in response to requests from the duty-free shop system 1.

[0022] The tax-free information management server 3 is a server that manages information related to tax-free procedures for people who do not reside in Japan (non-residents). The tax-free information server 3 has an item purchase information DB 31. The item purchase information DB 31 stores purchase information on tax-free items purchased by non-residents during their stay in Japan.

[0023] 2 is a block diagram showing a hardware configuration of the duty-free shop system 1. The duty-free shop system 1 includes a duty-free shop server 11 and a vending machine 12.

[0024] The duty-free shop server 11 is a store computer that stores data used within the duty-free shop, such as sales data obtained from the vending machines 12 and product (goods) data.

[0025] 3 is a block diagram showing the hardware configuration of the duty-free shop server 11. The duty-free shop server 11 includes a CPU (Central Processing Unit) 111, a RAM (Random Access Memory) 112, a ROM (Read Only Memory) 113, and a storage 114. The duty-free shop server 11 also includes a communication I / F (Interface) 115, an input device 116, and an output device 117. The various components of the duty-free shop server 11 are connected to each other via a bus, wiring, drive device, etc. (not shown).

[0026] 3, the components constituting the duty-free shop server 11 are illustrated as an integrated device, but some of these functions may be provided by external devices. For example, the input device 116 and the output device 117 may be external devices separate from the components constituting the functions of the computer including the CPU 111, etc.

[0027] The CPU 111 is a processor that performs predetermined calculations in accordance with programs stored in the ROM 113, storage 114, etc., and also has the function of controlling each part of the duty-free shop server 11. The RAM 112 is composed of a volatile storage medium, and provides a temporary memory area necessary for the operation of the CPU 111.

[0028] The ROM 113 is composed of a non-volatile storage medium, and stores necessary information such as programs used in the operation of the duty-free shop server 11. The storage 114 is composed of a non-volatile storage medium such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and is a storage device that stores a database, stores programs for operating the duty-free shop server 11, and the like.

[0029] The communication I / F 115 is a communication interface based on a standard such as Ethernet (registered trademark), etc. The communication I / F 115 is a module for communicating with other devices such as the payment server 2.

[0030] The input device 116 is a keyboard, a pointing device, etc., and is used by the administrator of the duty-free shop server 11 to operate the duty-free shop server 11. Examples of the pointing device include a mouse, a trackball, a touch panel, a pen tablet, etc.

[0031] The output device 117 is, for example, a display device. The display device is a liquid crystal display, an OLED (Organic Light Emitting Diode) display, etc., and is used to display information, a GUI (Graphical User Interface) for operation input, etc. The input device 116 and the output device 117 may be integrally formed as a touch panel.

[0032] The hardware configuration of the duty-free shop server 11 is an example, and other devices may be added, or some devices may not be provided. Some devices may be replaced with other devices having similar functions. Furthermore, some functions of this embodiment may be provided by other devices via a network, or the functions of this embodiment may be distributed and realized among multiple devices.

[0033] The hardware configurations of the payment server 2 and the tax exemption information management server 3 are similar to those shown in FIG. 3, and therefore the description thereof will be omitted.

[0034] The vending machine 12 is a device that, when a user performs an operation to purchase a tax-free item, automatically performs a process of verifying the user's identity, a process of determining whether the user is eligible for tax-free sales, a process of settling the sales price, etc. The functions of the vending machine 12 of this embodiment will be described in detail later.

[0035] 4 is a block diagram showing the hardware configuration of the vending machine 12. In the following description, devices that have the same name but different reference numerals are equivalent devices and therefore detailed description thereof may be omitted.

[0036] 3, the vending machine 12 includes a CPU 1201, a RAM 1202, a ROM 1203, a storage 1204, a communication I / F 1205, an input device 1206, and a display device 1207. The vending machine 12 also includes a camera 1208, a depth camera 1209, a passport reader 1210, a medium reader 1211, an automatic change dispenser 1212, a storage device 1213, and an article discharge device 1214. The components of the vending machine 12 are connected to each other via buses, wiring, drive devices, etc. (not shown).

[0037] The display device 1207 is a liquid crystal display, an OLED display, or the like, and is used to display information, a GUI for operation input, etc. In the vending machine 12, the input device 1206 and the display device 1207 are preferably formed integrally as a touch panel.

[0038] The camera 1208 is, for example, a digital camera that photographs the face of a user standing in front of the vending machine 12, and captures the user's face to obtain a facial image.

[0039] The depth camera 1209 acquires three-dimensional information of an object photographed by the camera 1208. The CPU 1201 determines whether or not the facial image of the user photographed by the camera 1208 was acquired by photographing a living human being, based on the three-dimensional information acquired by the depth camera 1209. That is, the CPU 1201 determines whether or not the facial image was acquired from an object other than a living human being (e.g., a photo of the user, etc.), based on the three-dimensional information. This makes it possible to prevent fraudulent acts in which a third party impersonates the user.

[0040] The passport reading device 1210 is a device that reads information recorded on a passport carried by a user. Examples of the passport reading device 1210 include an OCR (Optical Character Reader) device, an image scanner, and a contactless IC (Integrated Circuit) reader.

[0041] The passport reading device 1210 is configured, for example, with a reading unit for reading a passport facing upwards, and with a slot on the reading unit into which the passport is inserted. In this case, a user can insert a passport with the personal information page or visa section open into the slot with the page facing downwards and hold the passport over the reading unit of the passport reading device 1210 to have the passport read by the passport reading device 1210.

[0042] In the method of inserting a passport into a slot, once the passport is inserted into the slot, the user does not need to continue to hold the passport to keep the pages open, and the position of the passport can be accurately aligned with the reading section of the passport reading device 1210. This makes it possible to read the passport smoothly. Note that the configuration of the passport reading device 1210 is not limited to the above-mentioned configuration, and various configurations can be adopted.

[0043] The medium reading device 1211 is a device that reads information recorded on various media carried by a user. Examples of the medium reading device 1211 include an OCR device, an image scanner, a code reader, a non-contact IC reader, etc. Examples of the recording medium include a credit card, an electronic money card, and a smartphone that displays a barcode for payment.

[0044] The automatic change dispenser 1212 is a money dispenser that processes cash inserted by a user to pay for tax-free items and automatically dispenses change as necessary. The automatic change dispenser 1212 has a deposit / withdrawal device that processes the deposit and withdrawal of bills and coins.

[0045] The storage device 1213 is a device that stores tax-exempt goods. In this embodiment, the tax-exempt goods are stored in a pre-packaged state inside the storage device 1213. Data indicating the storage location of the tax-exempt goods in the storage device 1213 is stored in, for example, the storage 1204. The goods discharge device 1214 is a device that removes the goods purchased by the user from the storage device 1213 and discharges them from a discharge port.

[0046] 5 is a functional block diagram of the vending machine 12. The vending machine 12 includes a reception unit 12a, a biometric information acquisition unit 12b, a passport information acquisition unit 12c, a residence information acquisition unit 12d, a matching unit 12e, a determination unit 12f, a payment processing unit 12g, an item storage unit 12h, and an item discharge unit 12i.

[0047] The CPU 1201 performs predetermined arithmetic processing by loading a program stored in the ROM 1203, storage 1204, etc., into the RAM 1202 and executing it. The CPU 1201 also controls each unit of the vending machine 12, such as the communication I / F 1205, based on the program. In this way, the CPU 1201 realizes the functions of each functional block shown in Fig. 5. The specific processing contents performed by each functional block will be described later.

[0048] 5 may be provided in a device external to the vending machine 12. In other words, each of the above-mentioned functions may be realized by the vending machine 12 alone, or may be realized in cooperation with an external device.

[0049] FIG. 6 is a diagram showing an example of information stored in the product purchase information DB31. The product purchase information DB31 may include passport number, name, sex, nationality, code, name of purchased product, category, and amount as data items. Information written in the "passport number", "name", "gender", and "nationality" columns is passport information read by optical or electromagnetic means from the passport held by the user. Furthermore, "general goods" and "consumables" written in the "category" column are categories of tax-free goods under the tax-free system of Japan. It is assumed that a product database for acquiring various information associated with codes is stored in advance in the duty-free shop server 121.

[0050] 7 is a flowchart showing the process carried out in the vending machine 12. This process is executed when a user operates the vending machine 12 in a duty-free shop to purchase a tax-free item.

[0051] In step S101, the CPU 1201 (acceptor 12a) acquires the identification information of the item selected by the user.

[0052] In step S102, the CPU 1201 (passport information acquisition unit 12c and residence information acquisition unit 12d) reads the passport face image, passport number, date of entry, and residence status information from the passport. At this time, it is preferable that the CPU 1201 (determination unit 12f) further determines whether the passport is genuine or not based on information (first physical information) such as characters obtained from the passport, and the shape, thickness, and size of the passport. This makes it possible to prevent fraudulent use of counterfeit passports by third parties. Note that the method of determining whether a passport is genuine is not limited to this.

[0053] In step S103, the CPU 1201 (biometric information acquisition unit 12b) controls the camera 1208 and the depth camera 1209 to capture a facial image (hereinafter referred to as a "captured facial image") of a user standing in front of the vending machine 12. At this time, it is preferable that the CPU 1201 (determination unit 12f) further determines whether or not the captured facial image (first biometric information) is acquired from a person present in front of the device based on information (second physical information) such as three-dimensional shape and size obtained from the user's body. This makes it possible to prevent fraudulent acts in which a third party uses an image such as a photograph to impersonate a user. Note that the method for preventing impersonation is not limited to this. For example, a method may be used in which an instruction is given to the user to change the direction of the face, and a facial image is captured again for determination.

[0054] In step S104, the CPU 1201 (matching unit 12e) performs one-to-one face matching between the photographed face image and the passport face image. If a matching score indicating the similarity between the photographed face image and the passport face image is equal to or greater than a predetermined threshold, the matching unit 12e authenticates that the user is the same person as the person in the passport face image.

[0055] In step S105, the CPU 1201 (determination unit 12f) determines whether the user standing in front of the device and the person whose face image is printed on the passport are the same person. If the CPU 1201 (determination unit 12f) determines that they are the same person (step S105: YES), the process proceeds to step S107.

[0056] On the other hand, if the CPU 1201 (determination unit 12f) determines that the person is not the same (step S105: NO), it displays an authentication error message (step S106) and the process ends.

[0057] In step S107, the CPU 1201 (determination unit 12f) determines whether or not a predetermined number of days has passed since the date of entry by comparing the difference between the date of entry acquired in step S102 and the current date and time with a predetermined number of days. If the predetermined number of days has passed since the date of entry (step S107: YES), the process proceeds to step S110. On the other hand, if the predetermined number of days has not passed since the date of entry (step S107: NO), the process proceeds to step S108.

[0058] This prescribed number of days is determined based on laws and regulations related to tax exemption. For example, under the current tax exemption system in Japan, even if a person is a foreigner, if six months or more have passed since entering the country, he or she is treated as a resident and is therefore not eligible for tax exemption procedures. Therefore, this prescribed number of days could be, for example, six months.

[0059] In step S108, the CPU 1201 (determination unit 12f) determines whether the user's residence status is a predetermined status. If the CPU 1201 (determination unit 12f) determines that the user's residence status is a predetermined status (step S108: YES), the process proceeds to step S109. For example, if the residence status is "short-term visitor," the user is determined to be a non-resident and a person who has a predetermined status that is eligible for tax exemption.

[0060] On the other hand, if the CPU 1201 (determination unit 12f) determines that the user's status of residence is not a predetermined status (step S108: NO), the process proceeds to step S110. For example, if the status of residence is "permanent resident," the user is determined to be a resident who does not have the predetermined status to be eligible for tax exemption.

[0061] In step S109, the CPU 1201 (determination unit 12f) determines whether the price of the purchased goods is within a predetermined range. If the price of the purchased goods is within the predetermined range (step S109: YES), the process proceeds to step S111. On the other hand, if the price of the purchased goods is outside the predetermined range (step S109: NO), the CPU 1201 displays that the user is not eligible for the tax exemption procedure (step S112), and ends the process.

[0062] Here, the range of the amount of the purchased goods is determined based on the laws and regulations related to tax exemption. For example, in the current tax exemption system in Japan, the requirement for tax exemption for general goods is that the total amount of sales in one store in one day is 5,000 yen or more. In addition, the requirement for tax exemption for consumables is that the total amount of sales in one store in one day is 5,000 yen or more and 500,000 yen or less.

[0063] The determination process in step S109 may be, for example, determining whether the total amount for each of the general goods and consumables is within these ranges for each category of general goods and consumables. In the example of Fig. 6, "camera" is a tax-exempt item because the amount is 5,000 yen or more, and "medicine" is not a tax-exempt item because the amount is less than 5,000 yen.

[0064] In step S111, payment processing for tax-free sales is executed. Specifically, the vending machine 12 makes a payment request for the purchase of goods by the user to the payment server 2 via the duty-free shop server 11. In this payment request, information required for payment, such as the total amount of the purchased goods and payment information (credit card number, account number, PIN number, etc.), is transmitted to the payment server 2. When the payment request is made, the payment server 2 determines whether or not payment can be made and performs payment processing. In the explanation of FIG. 7, it is assumed that the payment for the purchase of goods by the user has been approved. Note that when payment processing is performed by cash, there is no need to inquire the payment server 2. After step S111, the process proceeds to step S113.

[0065] In step S112, the CPU 1201 displays that the purchased item is not a tax-free item and ends the process. If the item purchased by the user is not tax-free, the CPU 1201 may inform the user of the fact and cancel the sale of the item, or may sell the item using the same procedure as for the sale of general taxable items.

[0066] In step S113, the CPU 1201 (acceptor 12a) displays an explanation of the consent items and accepts input of a signature from the user. Based on the consent from the user, the CPU 1201 automatically inputs information read from the machine-readable area of ​​the passport into a predetermined input field for the tax-free procedure.

[0067] In step S114, the CPU 1201 (article discharge unit 12i) controls the article discharge device 1214 to take out the packaged purchased article (tax-exempt article) from inside the storage device 1213 and discharge it to the discharge port.

[0068] In step S115, the CPU 1201 registers the purchase information of the tax-free goods in the goods purchase information DB 31 of the tax-free information management server 3 via the tax-free shop server 11, and ends the process. The purchase information includes the passport number, name, sex, and nationality obtained from the passport, as well as a code for identifying the purchased goods, the purchase price, quantity, and purchase date of the goods.

[0069] In addition, purchase information (purchase record) regarding items purchased by a user is stored in the duty-free shop system 1 for a predetermined period of time. The purchase information may be provided to customs or a tax office as necessary. The purchase information may also be stored in writing at the duty-free shop. The above-mentioned processing order is merely an example. For example, the order of multiple determination processes may be changed as appropriate.

[0070] As described above, in this embodiment, the entry date and residence information of a person using a tax-free facility are acquired, and it is determined whether or not the person is eligible for tax-free procedures based on the entry date and residence information. This reduces manual work compared to a method in which a clerk at a tax-free facility checks whether or not a person is eligible for tax-free procedures by considering the entry in the visa column, etc.

[0071] In addition, in this embodiment, identity verification can be performed by biometric matching between biometric information such as a facial image of a user taken at a tax-free facility and biometric information such as a facial image recorded on a passport. This allows identity verification of a user to be performed automatically, simplifying the work of store clerks at the tax-free facility. Therefore, according to this embodiment, an information processing device is provided that can efficiently perform procedures that require both identity verification of a user and verification of user qualifications.

[0072] [Second embodiment] The information processing system of this embodiment is a modified example of the information processing system of the first embodiment. Explanations of parts that overlap with the first embodiment may be omitted or simplified. Note that, under the current tax exemption system in Japan, identity verification during the tax exemption procedure is not permitted at devices other than vending machines, but the following explanation will be given on the assumption that identity verification is permitted at the POS terminal 13.

[0073] 8 is a block diagram showing the hardware configuration of the duty-free shop system 1 according to this embodiment. The duty-free shop system 1 according to this embodiment further includes a POS terminal 13 in addition to the configuration shown in FIG.

[0074] The POS terminal 13 is a device that performs processes such as registering the items that the user wishes to purchase and settling the sales price. The POS terminal 13 may include a computer, a display, a barcode reader, a cash drawer, a card reader, operation buttons, a receipt printer, etc. The POS terminal 13 in this embodiment is a self-service type device in which the user performs some or all of the operations himself, and does not include a typical device in which all operations are performed by a clerk at a duty-free shop.

[0075] The duty-free shop server 11 stores data used in the duty-free shop, such as sales data and item (product) data obtained from the POS terminal 13.

[0076] 9 is a block diagram showing the hardware configuration of the POS terminal 13. The POS terminal 13 includes a CPU 1301, a RAM 1302, a ROM 1303, a storage 1304, a communication I / F 1305, an input device 1306, and a display device 1307. The POS terminal 13 further includes a camera 1308, a depth camera 1309, a passport reader 1310, a medium reader 1311, and an automatic change dispenser 1312. The components of the POS terminal 13 are connected to each other via a bus, wiring, a drive device, etc. (not shown).

[0077] Fig. 10 is a functional block diagram of the POS terminal 13. The POS terminal 13 includes a reception unit 13a, a biometric information acquisition unit 13b, a passport information acquisition unit 13c, a residence information acquisition unit 13d, a matching unit 13e, a determination unit 13f, a payment processing unit 13g, and a code reading unit 13h. The functions of the units denoted by 13a to 13g are similar to those of the units denoted by 12a to 12g in Fig. 3, and therefore will not be described.

[0078] The code reading unit 13h reads the barcode attached to the surface of the item. The barcode records the identification information of the item. The code reading unit 13h refers to a product data table (not shown) of the duty-free shop server 11 based on the identification information of the item, and acquires registered information such as the name and price of the item.

[0079] 11 is a flowchart showing the process performed in the POS terminal 13. This process is executed when a user operates the POS terminal 13 in a duty-free shop to purchase a tax-free item.

[0080] In step S201, the CPU 1301 (code reading unit 13h) reads the identification information of the item to be purchased in response to the user's operation of the medium reading device 1311. The processes in steps S102 to S113 are the same as those in FIG. 7, and therefore will not be described.

[0081] In step S202, when the CPU 1301 (reception unit 13a) receives input of a signature from the user (see step S113), it outputs packing instruction information for the purchased item to the display device 1307 etc. After that, the process proceeds to step S115.

[0082] As described above, in this embodiment, similarly to the first embodiment, when a user operates the POS terminal 13, the process of verifying the user's identity, the process of determining whether the user is a person eligible for tax exemption procedures, and the process of determining whether the amount of the purchased goods satisfies the tax exemption requirements can all be automatically executed. This provides the same effects as the first embodiment.

[0083] [Third embodiment] This embodiment differs from the first and second embodiments described above in that a customer at a duty-free shop performs the tax-free procedure for items purchased at a manned cash register, which have already been taxed, by himself / herself at a tax-free procedure terminal 14 installed within the same duty-free shop.

[0084] In this embodiment, the explanation of the overlapping parts with those described in the above embodiment may be omitted or simplified. Also, as in the second embodiment, the explanation will be given on the assumption that identity verification is permitted in devices other than vending machines.

[0085] 12 is a block diagram showing the hardware configuration of the duty-free shop system 1 according to this embodiment. The duty-free shop system 1 according to this embodiment further includes a tax-free procedure terminal 14 in addition to the configuration shown in FIG.

[0086] The tax-free procedure terminal 14 is a self-service terminal installed in a tax-free shop, and is used when a user carries out tax-free procedures for goods purchased under taxable conditions.

[0087] 13 is a block diagram showing a hardware configuration of the tax-free procedure terminal 14. The tax-free procedure terminal 14 includes a CPU 1401, a RAM 1402, a ROM 1403, a storage 1404, a communication I / F 1405, an input device 1406, and a display device 1407. The tax-free procedure terminal 14 further includes a camera 1408, a depth camera 1409, a passport reader 1410, a medium reader 1411, and a dispensing device 1412. The components of the tax-free procedure terminal 14 are connected to each other via a bus, wiring, a drive device, etc. (not shown).

[0088] The dispensing device 1412 is a device that outputs a calculated amount of cash to a dispensing port when the CPU 1401 determines that there is tax to be refunded to the user.

[0089] Fig. 14 is a functional block diagram of the tax exemption procedure terminal 14. The tax exemption procedure terminal 14 includes a reception unit 14a, a biometric information acquisition unit 14b, a passport information acquisition unit 14c, a residence information acquisition unit 14d, a matching unit 14e, a determination unit 14f, a receipt reading unit 14g, and a refund processing unit 14h. The functions of the units denoted by reference numerals 14a to 14f are the same as those of the units denoted by reference numerals 12a to 12f in Fig. 3, and therefore description thereof will be omitted.

[0090] The receipt reading unit 14g reads a receipt indicating the item purchased by the user and the purchase amount, or a barcode indicated on the receipt.

[0091] The refund processing unit 14h calculates the amount of tax to be refunded to the user, and executes a process of refunding the calculated amount to the user. Refund methods include a cash refund method and a refund method that changes the amount charged to the credit card.

[0092] 15 is a flowchart showing the process performed in the tax-free procedure terminal 14. This process is executed when a user who has purchased a tax-free item in a tax-free shop under tax conditions operates the tax-free procedure terminal 14 of the same tax-free shop to carry out the tax-free procedure.

[0093] In step S301, the CPU 1401 (acceptor 14a) accepts a tax exemption procedure request input by a user. Specifically, the acceptor 14a accepts the tax exemption procedure request when the user selects a tax exemption procedure request menu from the menu screen displayed on the tax exemption procedure terminal 14. At this time, the CPU 1401 (acceptor 14a) displays a guide screen that explains to the user how to present a passport. The user performs operations according to the guide screen.

[0094] In step S302, the CPU 1401 (receipt reading unit 14g) reads information on the purchased item from the receipt presented by the user. The CPU 1401 (receipt reading unit 14g) may obtain the information on the purchased item by reading a barcode printed on the receipt. After that, the process proceeds to step S102.

[0095] The processes in steps S102 to S110 and S112 are the same as those in Fig. 7, and therefore the description will be omitted. When the identity verification of the user is successful, the process proceeds to step S303.

[0096] In step S303, the CPU 1401 (refund processing unit 14h) cancels the taxable sale of the receipt recorded in the tax-free shop server 11, and registers the tax-free sale information. After that, the process proceeds to step S113.

[0097] In step S304, the CPU 1401 outputs packing instruction information for the purchased items. The packing instruction information in this embodiment is information that instructs the user or a salesperson at the duty-free store on how to pack the purchased items.

[0098] In step S305, the CPU 1401 (the refund processing unit 14h) executes a refund process for the collected tax. After that, the process proceeds to step S115.

[0099] As described above, in this embodiment, a user can carry out the tax-free procedure for purchased items that were taxed at a duty-free shop in a self-service format within the same or an affiliated duty-free shop, and request a refund for the difference between the tax-free sales price and the taxable sales price.

[0100] [Fourth embodiment] Unlike Japan, there are countries under legal systems where a tax is initially levied when a tax-free item is purchased, and the tax is refunded if a prescribed procedure is carried out at a tax-free processing area such as a refund counter at an airport, etc. The information processing system of this embodiment provides a function for supporting the procedure for refunding the tax to a person who has purchased a tax-free item before departure from the country.

[0101] In this embodiment, the description of parts that overlap with those described in the first embodiment may be omitted or simplified.

[0102] Fig. 16 is a schematic diagram showing the overall configuration of an information processing system according to this embodiment. In addition to the configuration of Fig. 1, the information processing system according to this embodiment further comprises an airport system 4 and an immigration control server 5. The airport system 4 is a core system of the airport that manages passengers, etc. The airport system 4 comprises a KIOSK terminal 41 installed within the airport. The airport system 4 and the KIOSK terminal 41 are connected to at least the duty-free information management server 3 so as to be able to communicate with each other via a network NW.

[0103] The immigration control server 5 is a server that manages whether immigration is being carried out appropriately in accordance with laws and regulations by storing the entry and departure dates of foreigners entering Japan and foreigners departing from Japan. The immigration control server 5 may further store information on Japanese people residing overseas. In other words, the immigration control server 5 stores information on non-residents who may be eligible for duty-free sales, regardless of whether they are Japanese or foreign.

[0104] Moreover, the information processing system according to this embodiment differs from the configuration in Fig. 1 in that the tax-free information management server 3 further includes a tax-free eligibility confirmation DB 32. The tax-free eligibility confirmation DB 32 is a database that stores information for confirming whether or not a user is a person qualified to undergo tax-free procedures. The tax-free information management server 3 acquires information on the entry date (date of landing) and residence status of an entrant from the immigration control server 5 at a predetermined timing, and updates the tax-free eligibility confirmation DB 32 based on this information.

[0105] Fig. 17 is a diagram showing an example of information stored in the tax-free status confirmation DB 32. The tax-free status confirmation DB 32 may include passport number, name, date of entry, and status of residence as data items. The date of entry is the date on which the user entered Japan (date of landing). Status of residence is the conditions of residence set for the user. There are several statuses of residence in addition to short-term visitor, technical internship, and permanent resident.

[0106] The KIOSK terminal 41 is a self-service terminal operated by a user in an airport, and displays information selected by the user from a menu. The KIOSK terminal 41 of this embodiment has a menu for inquiring about the presence or absence of tax refunds to the user.

[0107] 18 is a block diagram showing a hardware configuration of the KIOSK terminal 41. The KIOSK terminal 41 includes a CPU 4101, a RAM 4102, a ROM 4103, a storage 4104, a communication I / F 4105, an input device 4106, and a display device 4107. The KIOSK terminal 41 further includes a camera 4108, a depth camera 4109, a passport reader 4110, and a medium reader 4111. The components of the KIOSK terminal 41 are connected to each other via a bus, wiring, a drive device, and the like (not shown). The KIOSK terminal 41 may further include a dispensing device that dispenses a part of the collected tax to the user, as in the third embodiment.

[0108] Fig. 19 is a functional block diagram of the KIOSK terminal 41. The KIOSK terminal 41 includes a reception unit 41a, a biometric information acquisition unit 41b, a passport information acquisition unit 41c, a residence information acquisition unit 41d, a matching unit 41e, a determination unit 41f, a receipt reading unit 41g, and a guidance unit 41h. The functions of the units denoted by reference numerals 41a to 41g are the same as those of the units denoted by reference numerals 14a to 14g in Fig. 14, and therefore will not be described.

[0109] When a user needs to carry out a tax exemption procedure, the guidance unit 41h displays guidance information such as the location where the tax exemption procedure is carried out, the user's current location, the route from the current location to the procedure location, the amount of tax to be refunded to the user, etc.

[0110] 20 is a flowchart showing the process performed by the KIOSK terminal 41. This process is executed when a user who has purchased a tax-free item in a tax-free shop in the city and has taxed it operates the KIOSK terminal 41 installed in the airport to check whether or not the tax-free procedure is required.

[0111] In step S401, the CPU 4101 (acceptor 41a) accepts a request for confirmation of the tax exemption procedure.

[0112] In step S402, the CPU 4101 (receipt reading unit 41g) reads information about the purchased item from the receipt at the time of purchase.

[0113] In step S403, the CPU 4101 (passport information acquisition unit 41c) reads a passport face image and a passport number from the passport. Unlike the first embodiment, it is not necessary to read the entry date and the status of residence information from the passport. The processes in steps S103 to S106 are the same as those in FIG. 7.

[0114] In step S404, the CPU 4101 (determination unit 41f) inquires about the entry date and the status of residence information from the tax exemption qualification confirmation DB 32 of the tax exemption information management server 3. After that, the process proceeds to step S107. The processes of steps S107 to S110 and S112 are the same as those in FIG.

[0115] In step S405, the CPU 4101 (the guidance unit 41h) displays guidance information for the tax exemption procedure to the user and ends the process. The guidance information includes, for example, messages such as "Please complete the tax exemption procedure at the tax exemption procedure office located near the customs office" or "In your case, a total of xxxx yen in taxes will be refunded," a floor map showing the procedure location, and the like.

[0116] In this way, in this embodiment, a user can check whether or not a tax refund is available for a tax-free item that was purchased in a tax-free shop in the city while the tax was still being paid, by operating the KIOSK terminal 41 installed in the airport. This allows the user to remember to carry out the tax-free procedure before departure.

[0117] [Fifth embodiment] The information processing system of this embodiment is a modified example of the information processing system of the first embodiment. Descriptions of parts that overlap with the first embodiment may be omitted or simplified.

[0118] The information processing system of this embodiment differs from the first embodiment in that the process of determining whether or not a user is eligible for tax-free procedures is performed not by a vending machine 12 in a tax-free shop but by a tax-free information management server 3, which is an external device.

[0119] Fig. 21 is a schematic diagram showing the overall configuration of an information processing system according to this embodiment. The information processing system according to this embodiment is different from the configuration in Fig. 1 in that the tax exemption information management server 3 further includes a tax exemption qualification confirmation DB 32.

[0120] 22 is a functional block diagram of the vending machine 12 according to this embodiment. The vending machine 12 according to this embodiment includes a determination request unit 12j instead of the determination unit 12f shown in FIG.

[0121] The determination request unit 12j transmits the user's identification information to the tax exemption information management server 3, and transmits a determination request inquiring whether the user is a person eligible for the tax exemption procedure. The determination request unit 12j acquires the determination result returned from the tax exemption information management server 3 in response to the determination request. That is, in this embodiment, the vending machine 12 does not have a function of determining whether the user is a person eligible for the tax exemption procedure.

[0122] 23 is a functional block diagram of the tax exemption information management server 3 according to this embodiment. The tax exemption information management server 3 includes a storage unit 3a, an identification information acquisition unit 3b, a residence information acquisition unit 3c, and a tax exemption qualification determination unit 3d.

[0123] The memory unit 3a is a storage device having an item purchase information DB31 and a tax-exemption qualification confirmation DB32. The identification information acquisition unit 3b acquires identification information for identifying a user. In this embodiment, a passport number is used as the identification information. The residence information acquisition unit 3c acquires the user's entry date and residence status corresponding to the passport number from the tax-exemption qualification confirmation DB32. The tax-exemption qualification determination unit 3d determines whether or not the user is eligible for tax-exemption procedures based on the entry date and residence status, and outputs the determination result.

[0124] 24 is a flowchart showing the process performed in the vending machine 12 according to this embodiment. This process is executed when a user operates the vending machine 12 in a duty-free shop to purchase a tax-free item.

[0125] The processing in steps S101 to S106 is the same as in Fig. 7, and therefore the description will be omitted. After that, the processing proceeds to step S501.

[0126] In step S501, the CPU 1201 (determination request unit 12j) inquires whether the user is a person eligible for tax exemption procedures by transmitting a passport number to the tax exemption information management server 3. When the tax exemption information management server 3 receives a determination request including the passport number from the vending machine 12, it refers to the tax exemption qualification confirmation DB 32 to obtain information on the user's entry date and residence status. Then, the tax exemption information management server 3 executes the determination processes of steps S107 and S108 in FIG. 7, and returns the determination result to the vending machine 12.

[0127] In step S502, if the determination result returned from the tax exemption information management server 3 indicates that the user is a person eligible for the tax exemption procedure, the CPU 1201 executes the processes of steps S111 to S115, and ends the process.

[0128] As described above, in this embodiment, the process of determining whether or not a user is a person eligible for the tax-free procedure is performed not by the vending machine 12 in the tax-free shop, but by the tax-free information management server 3, which is an external device. In other words, the vending machine 12 can obtain the determination result simply by transmitting the passport number to the tax-free information management server 3, which has the advantage that the vending machine 12 can be implemented more easily than in the first embodiment. In addition, since the determination process is centrally executed by the tax-free information management server 3, it can flexibly respond to changes in the tax-free system.

[0129] [Sixth embodiment] FIG. 25 is a functional block diagram of an information processing device 6 according to the sixth embodiment. The information processing device 6 includes a first acquisition unit 601, a second acquisition unit 602, a third acquisition unit 603, a matching unit 604, and a determination unit 605. The first acquisition unit 601 acquires first biometric information from the body of a user requesting a procedure. The second acquisition unit 602 acquires second biometric information of the user from a passport presented by the user. The third acquisition unit 603 acquires qualification information of the user. The matching unit 604 matches the first biometric information with the second biometric information. The determination unit 605 determines whether or not the user is a target of the procedure based on the result of the matching and the qualification information.

[0130] According to this embodiment, an information processing device 6 is provided that can efficiently carry out a procedure that requires both user identity verification and verification of user qualifications.

[0131] [Seventh embodiment] FIG. 26 is a functional block diagram of an information processing device 7 according to the seventh embodiment. The information processing device 7 includes a first acquisition unit 701, a second acquisition unit 702, a matching unit 703, a request unit 704, and a third acquisition unit 705. The first acquisition unit 701 acquires first biometric information from the body of a user requesting a procedure. The second acquisition unit 702 acquires a passport number and the second biometric information of the user from a passport presented by the user. The matching unit 703 matches the first biometric information with the second biometric information. When the user's identity is successfully confirmed by matching, the request unit 704 outputs the passport number to an external device that determines whether or not the user is a person subject to the procedure based on the passport number. The third acquisition unit 705 acquires a determination result of whether or not the user is a person subject to the procedure from the external device.

[0132] According to this embodiment, an information processing device 7 is provided that can efficiently carry out a procedure that requires both user identity verification and verification of user qualifications.

[0133] [Modified embodiment] The present invention is not limited to the above-described embodiments, and can be modified as appropriate without departing from the spirit of the present invention. For example, an example in which a part of the configuration of any of the embodiments is added to another embodiment, or an example in which a part of the configuration of any of the embodiments is replaced with another embodiment, is also an embodiment of the present invention.

[0134] In the above embodiment, the embodiment is described assuming the tax exemption system of Japan, but the present invention is not limited to this and can be used for tax exemption procedures in any country other than Japan.

[0135] In the above embodiment, the tax-free procedure is described as a specific example of a procedure that requires both user identity verification and user qualification verification, but the procedures to which the configuration of the present invention can be applied are not limited to tax-free procedures. The configuration of the present invention can also be applied to various procedures such as check-in procedures at accommodation facilities, rental car application procedures, and declaration procedures when a person living in Japan takes an item overseas as a souvenir.

[0136] For example, when checking in at an accommodation facility or applying for a rental car, if a user's identity and residence status need to be verified by comparing a photographed facial image with the facial image recorded on their passport, the procedure can be easily carried out using a self-service terminal with the same hardware configuration as the POS terminal 13 described above.

[0137] Next, the declaration procedure when a person living in Japan takes an item overseas as a souvenir will be described. In this case, the user scans the item using a self-service terminal with the same hardware configuration as the above-mentioned POS terminal 13, and purchases the item at the taxed amount. After that, the user reads his / her passport and inputs destination information on the self-service terminal. The self-service terminal prints application documents related to the tax-free procedure after returning home. Then, if the user uses the application documents to request an export certificate application form at customs when leaving the country, he / she can receive a tax refund at a duty-free shop after returning home.

[0138] In the above embodiment, a case has been described in which information such as a passport number, a passport face image, a date of entry, and a status of residence is optically obtained from a passport held by a user using a passport reading device and a medium reading device, which are OCR devices. However, the reading method using the passport reading device and the medium reading device is not limited to this. For example, recorded information may be electromagnetically read from an IC tag embedded in the passport.

[0139] The scope of each embodiment also includes a processing method in which a program that operates the configuration of the embodiment to realize the functions of the above-mentioned embodiment is recorded on a storage medium, the program recorded on the storage medium is read as code, and executed on a computer. That is, a computer-readable storage medium is also included in the scope of each embodiment. In addition, not only the storage medium on which the above-mentioned program is recorded, but also the program itself is included in each embodiment. Furthermore, one or more components included in the above-mentioned embodiments may be circuits such as ASICs (Application Specific Integrated Circuits) and FPGAs (Field Programmable Gate Arrays) configured to realize the functions of each component.

[0140] Examples of the storage medium that can be used include a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD (Compact Disk)-ROM, a magnetic tape, a non-volatile memory card, and a ROM. In addition, the scope of each embodiment does not include those that execute processing by themselves recorded on the storage medium, but also those that execute processing by operating on an OS (Operating System) in cooperation with other software and functions of an expansion board.

[0141] The services realized by the functions of the above-described embodiments can also be provided to users in the form of SaaS (Software as a Service).

[0142] It should be noted that the above-mentioned embodiments are merely examples of the implementation of the present invention, and the technical scope of the present invention should not be interpreted as being limited by these embodiments. In other words, the present invention can be implemented in various forms without departing from its technical concept or main features.

[0143] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.

[0144] (Appendix 1) a first acquisition unit that acquires first biometric information from a body of a user requesting a procedure; a second acquisition unit that acquires second biometric information of the user from a passport presented by the user; a third acquisition unit that acquires the user's qualification information; a matching unit that matches the first biometric information with the second biometric information; a determination unit that determines whether or not the user is a target of the procedure based on a result of the matching and the qualification information; An information processing device comprising:

[0145] (Appendix 2) The first biometric information is a facial image of the user or a feature amount extracted from the facial image. 2. An information processing device according to claim 1.

[0146] (Appendix 3) The qualification information includes the user's date of entry and status of residence, the determination unit determines that the user is not an eligible person for tax exemption when a predetermined number of days have passed since the date of entry; 3. The information processing device according to claim 1 or 2.

[0147] (Appendix 4) and a payment processing unit that executes a payment process for an item that the user wishes to purchase when the user is determined to be the target person. 4. An information processing device according to any one of claims 1 to 3.

[0148] (Appendix 5) The determination unit further determines whether the item is subject to tax exemption based on the amount of the item. 5. The information processing device according to claim 4.

[0149] (Appendix 6) A reception unit that receives an input operation from the user is further provided, the first acquisition unit, the second acquisition unit, the third acquisition unit, the matching unit, the determination unit, and the payment processing unit each perform a process in response to the input operation; 6. The information processing device according to claim 4 or 5.

[0150] (Appendix 7) a storage unit for storing items subject to duty-free sales; and a discharge unit that discharges the item purchased by the user from the storage unit upon completion of the payment process. 7. The information processing device according to claim 6.

[0151] (Appendix 8) a calculation unit that calculates a refund amount according to a purchase amount of an item purchased by the user when the user is determined to be the eligible person; A refund unit that executes a refund process based on the refund amount; Further comprising: 4. An information processing device according to any one of claims 1 to 3.

[0152] (Appendix 9) The determination unit further determines whether or not the passport is authentic based on first physical information obtained from the passport. An information processing device according to any one of appendix 1 to 8.

[0153] (Appendix 10) The determination unit further determines whether or not the first biometric information is acquired from a person present in front of the device, based on second physical information acquired from the body of the user. 10. An information processing device according to any one of claims 1 to 9.

[0154] (Appendix 11) The third acquisition unit acquires the qualification information by optically reading the face of the passport. An information processing device according to any one of appendix 1 to 10.

[0155] (Appendix 12) The second acquisition unit further acquires a passport number from the passport, the third acquisition unit acquires the qualification information based on the passport number from a storage device that stores the passport number and the qualification information in association with each other. An information processing device according to any one of appendix 1 to 10.

[0156] (Appendix 13) The second acquisition unit acquires the second biometric information based on a facial photograph of the user printed on the face of the passport. 12. An information processing device according to any one of claims 1 to 11.

[0157] (Appendix 14) The second acquisition unit acquires the second biometric information from an electromagnetic recording medium embedded in the passport. 12. An information processing device according to any one of claims 1 to 11.

[0158] (Appendix 15) acquiring first biometric information from a body of a user requesting a procedure; acquiring second biometric information of the user from a passport presented by the user; obtaining credentials of said user; A step of matching the first biometric information with the second biometric information; determining whether the user is a target of the procedure based on a result of the matching and the qualification information; An information processing method comprising:

[0159] (Appendix 16) On the computer, acquiring first biometric information from a body of a user requesting a procedure; acquiring second biometric information of the user from a passport presented by the user; obtaining credentials of said user; A step of matching the first biometric information with the second biometric information; determining whether the user is a target of the procedure based on a result of the matching and the qualification information; A recording medium on which a program for executing the above is recorded.

[0160] (Appendix 17) a first acquisition unit that acquires first biometric information from a body of a user requesting a procedure; a second acquisition unit that acquires a passport number and second biometric information of the user from the passport presented by the user; a matching unit that matches the first biometric information with the second biometric information; a request unit that outputs the passport number to an external device that determines, when the identity of the user is successfully verified by the matching, whether or not the user is a person subject to the procedure based on the passport number; a third acquisition unit that acquires a determination result of whether the user is the target person from the external device; An information processing device comprising:

[0161] (Appendix 18) acquiring first biometric information from a body of a user requesting a procedure; acquiring a passport number and second biometric information of the user from a passport presented by the user; A step of matching the first biometric information with the second biometric information; a step of outputting the passport number to an external device that determines, when the identity of the user is successfully verified by the matching, whether or not the user is a person subject to the procedure based on the passport number; obtaining a determination result of whether the user is the target person from the external device; An information processing method comprising:

[0162] (Appendix 19) On the computer, acquiring first biometric information from a body of a user requesting a procedure; acquiring a passport number and second biometric information of the user from a passport presented by the user; A step of matching the first biometric information with the second biometric information; a step of outputting the passport number to an external device that determines, when the identity of the user is successfully verified by the matching, whether or not the user is a person subject to the procedure based on the passport number; obtaining a determination result of whether the user is the target person from the external device; A recording medium on which a program for executing the above is recorded.

[0163] This application claims priority based on Japanese Patent Application No. 2020-75514, filed on April 21, 2020, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0164] NW...Network 1. Duty-free shop system 2. Payment server 3. Tax-free information management server 4. Airport System 5. Immigration control server 6, 7: Information processing device 11. Duty-free store server 12. Vending machines 13. POS terminal 14 Tax-free terminal 31...Goods purchase information DB 32 Tax-free qualification confirmation DB 41 KIOSK terminal

Claims

1. A reading unit that reads the residence status information on the passport presented by the user; a determination unit that determines whether or not the purchase of an item by the user satisfies a condition for tax exemption based on the residence status information; a matching unit that performs identity verification of the user by matching a first facial image captured of the user with a second facial image read from the passport; An information processing device comprising:

2. a face image acquisition unit for acquiring the first face image of the user captured by a camera; The information processing apparatus according to claim 1 , further comprising:

3. the matching unit extracts feature amounts from each of the first face image and the second face image and performs the matching; 3. The information processing device according to claim 1 or 2.

4. The residence status information includes the user's date of entry and residence status, the determination unit determines that the purchase of the item by the user does not satisfy the condition for tax exemption if the number of days between the entry date and the current date exceeds the number of days specified by laws and regulations regarding tax exemption or if the residence status is not a predetermined status required for tax exemption; The information processing device according to claim 1 .

5. a payment processing unit that executes a payment process for the item that the user wishes to purchase at a tax-free amount when it is determined that the purchase of the item by the user satisfies the condition for tax exemption, The information processing device according to claim 1 .

6. the determination unit further determines whether the item is eligible for tax exemption based on a comparison result between the purchase amount of the item, which is obtained from a database that stores at least the identification code of the item in association with the purchase amount, and the range of the purchase amount for which tax exemption is permitted, using the identification code as a key; The information processing device according to claim 5 .

7. A storage unit that stores the tax-free target items; a discharge mechanism provided in the storage section and capable of discharging the target item by being driven; a control unit that controls the operation of the ejection mechanism unit upon completion of the payment process, and ejects the item purchased by the user from the storage unit among the target items; The information processing apparatus according to claim 6 , further comprising:

8. a calculation unit that calculates a refund amount according to the purchase amount based on the purchase amount of the item purchased by the user and information on laws and regulations related to the tax exemption when it is determined that the purchase of the item by the user satisfies the condition for the tax exemption; A refund unit that refunds the refund amount to the user by outputting cash or by electronic remittance processing; The information processing device according to claim 1 , further comprising:

9. the determination unit further determines whether or not the passport is authentic based on first physical information obtained from the passport, the first physical information including at least a shape and a size of the passport. The information processing device according to claim 1 .

10. The determination unit further determines whether or not the first face image is acquired from a person present in front of the device based on second physical information including at least a shape and a size of the user's body. The information processing device according to claim 1 .

11. The reading unit acquires the residence status information by optically reading the face of the passport. The information processing device according to claim 1 .

12. The reading unit acquires the second face image from a face photograph of the user printed on the face of the passport. The information processing device according to claim 1 .

13. the reading unit acquires the second face image recorded on an electromagnetic recording medium built into the passport by using an electromagnetic method; The information processing device according to claim 1 .

14. A step in which a computer reads the residence status information of a passport presented by a user; a step of determining by the computer whether or not the purchase of an item by the user satisfies a condition for tax exemption based on the residence status information; a step of the computer verifying the identity of the user by comparing a first face image of the user with a second face image read from the passport; An information processing method comprising:

15. On the computer, reading the residence status information of a passport presented by a user; determining whether the purchase of an item by the user satisfies a condition for tax exemption based on the residence status information; a step of verifying the identity of the user by comparing a first face image of the user with a second face image read from the passport; A program for executing the above.

16. A reading unit that reads the residence status information on the passport presented by the user; a determination unit that determines whether the user is a tax-exempt person based on the residence status information; a matching unit that performs identity verification of the user by matching a first facial image captured of the user with a second facial image read from the passport; An information processing device comprising:

17. a face image acquisition unit for acquiring the first face image of the user captured by a camera; The information processing apparatus according to claim 16 , further comprising:

18. A step in which a computer reads the residence status information of a passport presented by a user; a step of the computer determining whether or not the user is eligible for tax exemption based on the residence status information; a step of the computer verifying the identity of the user by comparing a first face image of the user with a second face image read from the passport; An information processing method comprising:

19. On the computer, reading the residence status information of a passport presented by a user; determining whether the user is a tax-exempt person based on the residence status information; a step of verifying the identity of the user by comparing a first face image of the user with a second face image read from the passport; A program for executing the above.

Citation Information

Patent Citations

  • Gate system and method of controlling passage of gate

    JP2016053896A

  • Transaction processor, transaction processing method, program and transaction system

    JP2016057992A

  • Settlement support system for traveler and settlement support method for traveler

    JP2017123202A

  • Passport information use system

    JP2017182387A

  • System and method for obtaining tax refunds associated with purchases

    JP2017505478A