Age verification system, age verification device, and program thereof

Abstract

We provide an efficient age verification technology that can reduce the burden on retailers. [Solution] The detection means detects the registration of products that require age verification of the buyer. The first shooting means photographs the buyer's face with a camera. The second shooting means photographs the identification document with a camera. The face age estimation means estimates the face age from the face image taken by the first shooting means. The age identification means identifies the age of the person being verified from the image of the identification document taken by the second shooting means. When the detection means detects the registration of products that require age verification of the buyer, the output means outputs the face image taken by the first shooting means, along with the face age estimated by the face age estimation means and the age of the person being verified identified by the age identification means, to a terminal where an operator visually verifies the buyer's age.

Description

Technical Field

[0001] Embodiments of the present invention relate to an age confirmation system, an age confirmation device, and a program thereof.

Background Art

[0002] In recent years, in retail stores such as supermarkets and convenience stores, full-self checkout terminals have become widely popular. By introducing full-self checkout terminals, purchasers can operate the checkout terminals themselves to process transaction settlement operations from registering purchased goods to paying the price, so labor reduction can be achieved and there is an advantage of reducing labor costs. However, on the other hand, when selling goods that require age confirmation, such as alcohol and tobacco, visual age confirmation work is essential, so a store clerk must wait near the checkout terminal. Moreover, regardless of the age of the purchaser, age confirmation work is required each time a product that requires age confirmation is registered at the checkout terminal. Therefore, when dealing with a small number of store clerks, the work burden is large. For this reason, it is necessary to secure personnel, and the reduction of labor costs is insufficient.

[0003] There is a technology for estimating age by processing facial images using AI (Artificial Intelligence). Therefore, it is considered to use this technology to improve the efficiency of age confirmation work. However, relying solely on facial age determination has a high possibility of making incorrect determinations, and there is a high risk of selling products that require age confirmation to purchasers younger than the target age.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] The problem that the embodiments of the present invention aim to solve is to provide an age verification technology that is efficient, can reduce the burden on retailers, and can minimize the risk of selling products requiring age verification to buyers younger than the target age. [Means for solving the problem]

[0006] In one embodiment, the age verification device comprises a detection means, a first shooting means, a second shooting means, a face age estimation means, and an output means. The detection means detects the registration of a product that requires age verification of the buyer. The first shooting means photographs the buyer's face with a camera. The second shooting means photographs the identification document with a camera. The face age estimation means estimates the face age from the image of the face captured by the first shooting means. The age identification means identifies the age of the person being verified from the image of the identification document captured by the second shooting means. When the detection means detects the registration of a product that requires age verification of the buyer, the output means outputs the face image captured by the first shooting means, along with the face age estimated by the face age estimation means and the age of the person being verified identified by the age identification means, to a terminal where an operator visually verifies the buyer's age. [Brief explanation of the drawing]

[0007] [Figure 1] Figure 1 is a block diagram illustrating the schematic configuration of the checkout system and age verification system in a retail store that has introduced a fully self-service payment terminal. [Figure 2] Figure 2 is a block diagram showing the main circuit configuration of a monitor with a camera. [Figure 3] Figure 3 is a block diagram showing the main circuit configuration of the remote terminal. [Figure 4] Figure 4 is a block diagram showing the main functional configuration of the processor in a camera-equipped monitor. [Figure 5] Figure 5 is a flowchart showing the main steps of the information processing performed by the processor of the camera-equipped monitor. [Figure 6]Figure 6 is a flowchart showing the essential steps of information processing performed by the processor in the camera-equipped monitor and the processor in the remote terminal. [Figure 7] Figure 7 shows an example of a screen displayed on the monitor with a camera. [Figure 8] Figure 8 shows an example of an authentication screen displayed on the touch panel of a remote terminal. [Figure 9] Figure 9 shows an example of a screen displayed on the camera-equipped monitor's display. [Figure 10] Figure 10 shows an example of a screen displayed on the camera-equipped monitor's display. [Figure 11] Figure 11 is an explanatory diagram of the masking process applied to an identification document image. [Figure 12] Figure 12 shows an example of an authentication screen displayed on the touch panel of a remote terminal. [Figure 13] Figure 13 is a block diagram illustrating the operation of the age verification system. [Modes for carrying out the invention]

[0008] The following describes, with reference to drawings, an embodiment of an age verification system and device that is efficient, can reduce the burden on retailers, and can minimize the risk of selling products requiring age verification to buyers younger than the target age.

[0009] [Outline of the Checkout System Configuration] Figure 1 is a block diagram illustrating the schematic configuration of a checkout system 100 and an age verification system 200 in a retail store equipped with fully self-service payment terminals. The checkout system 100 includes multiple self-service POS (Point of Sales) terminals 1, an attendant terminal 2, and a POS server 3. The checkout system 100 connects each self-service POS terminal 1, the attendant terminal 2, and the POS server 3 via a first communication network 4. The first communication network 4 is typically a LAN (Local Area Network). The LAN may be a wired LAN or a wireless LAN. Alternatively, the first communication network 4 may include the internet, and the POS server 3 may be located in a cloud environment.

[0010] Self-service POS terminal 1 is installed in a checkout area separate from the sales floor where the products are displayed. Self-service POS terminal 1 is a fully self-service payment terminal in which the customer who makes a purchase handles all transaction settlement operations themselves, from registering the purchased items to paying for them.

[0011] The attendant terminal 2 is an information device used by an employee, referred to as an attendant, to monitor the status of multiple self-service POS terminals 1 connected via the first communication network 4. Generally, the attendant terminal 2 has a display. The attendant terminal 2 displays information necessary for monitoring each self-service POS terminal 1 on its display. Although only one attendant terminal 2 is shown in Figure 1, two or more attendant terminals 2 may be incorporated into the checkout system 100 depending on the number of self-service POS terminals 1 to be monitored.

[0012] POS Server 3 is a server computer that centrally manages data for each product sold in a retail store, controls the registration process for purchased items performed at each self-service POS terminal 1, and collects the registered data to aggregate sales, inventory, etc., for the entire store. POS Server 3 has a product master file. The product master file is a storage area for saving product records created for each product. A product record consists of data items such as product code, product name, price, and attributes. The product code is unique identification information set for each product to identify each product individually. Incidentally, many products have a barcode symbol that represents their own product code as a barcode. The product name and price are the item name and unit price of the product identified by the product code. Attributes are information that indicates the nature of the product. Some products, such as alcohol and tobacco, cannot be purchased by anyone below a certain age. Such products require age verification of the purchaser at the time of purchase. Attributes include information to identify whether the product identified by the product code requires age verification of the purchaser. Hereinafter, products that require age verification of the purchaser will be referred to as age-verified products. Furthermore, the minimum age at which one can purchase age-verified products is referred to as the target age. The target age is, for example, 20 years old.

[0013] The age verification system 200 includes a camera-equipped monitor 5 connected one-to-one with the self-service POS terminal 1. The camera-equipped monitor 5 comprises a touch panel 61 as a monitor and an AI camera 62 as an imaging unit. The camera-equipped monitor 5 is incorporated into a housing such that the screen of the touch panel 61 and the lens of the AI ​​camera 62 are located on the same surface. This housing is attached to the self-service POS terminal 1 so that the surface of the housing faces the customer standing in front of the self-service POS terminal 1 and registering the purchased items.

[0014] Each monitor 5 with a camera is connected to the second communication network 10. The second communication network 10 is a wide - area network such as the Internet or an intranet. A mobile communication network, a public communication network, etc. may be used as part of the second communication network 10. The second communication network 10 is connected to an age estimation server 20, an identity card reading server 30, a remote server 40, etc., and each monitor 5 with a camera enables two - way data communication with these server groups.

[0015] The age estimation server 20 is an AI server that estimates the facial age of a person by processing facial images using AI. The identity card reading server 30 is an AI server that reads the characters on an identity card by processing identity card images using AI. The remote server 40 is a relay server that enables network connection between the monitor 5 with a camera installed in a retail store and the remote terminal 7 installed in a remote center. The remote server 40 may also be referred to as a remote access server.

[0016] Incidentally, in FIG. 1, a case where one monitor 5 with a camera of a retail store is connected to the second communication network 10 is illustrated. However, in actual operation, monitors 5 with cameras of multiple retail stores are connected to the second communication network 10. And the remote server 40 operates so that the monitor 5 with a camera of each retail store is appropriately connected to the remote terminal 7 of the remote center.

[0017] [Explanation of the Configuration of the Monitor with a Camera] The monitor 5 with a camera is a device used to confirm the age of a purchaser when the product registered on the self - service POS terminal 1 is an age - confirmation product. The monitor 5 with a camera is an embodiment of an age - confirmation device.

[0018] Figure 2 is a block diagram showing the main circuit configuration of the camera-equipped monitor 5. The camera-equipped monitor 5 comprises circuit components such as a processor 51, main memory 52, auxiliary storage device 53, clock 54, POS terminal interface 55, network interface 56, call circuit 57, and I / O (Input / Output) interface 58, as well as a system transmission line 59. The system transmission line 59 includes an address bus, data bus, control signal lines, etc. The camera-equipped monitor 5 constitutes a computer by connecting each circuit component to the system transmission line 59.

[0019] The processor 51 is the central part of the computer. The processor 51 controls various parts to realize various functions as a monitor with a camera 5, according to the operating system or application program (application software). The processor 51 is, for example, a CPU (Central Processing Unit).

[0020] Main memory 52 corresponds to the main memory portion of the computer described above. Main memory 52 includes non-volatile memory areas and volatile memory areas. In the non-volatile memory area, main memory 52 stores the operating system or application programs. Main memory 52 may also store data necessary for the processor 51 to perform processing to control each part in non-volatile or volatile memory areas. Main memory 52 uses the volatile memory area as a work area where data is rewritten as needed by the processor 51. The non-volatile memory area is, for example, ROM (Read Only Memory). The volatile memory area is, for example, RAM (Random Access Memory).

[0021] The auxiliary storage device 53 corresponds to the auxiliary storage portion of the computer described above. For example, EEPROM (Electric Erasable Programmable Read-Only Memory), HDD (Hard Disk Drive), or SSD (Solid State Drive) can be auxiliary storage devices 53. The auxiliary storage device 53 stores data used by the processor 51 in performing various processes, or data created by the processing performed by the processor 51. The auxiliary storage device 53 may also store the application programs described above.

[0022] The clock 54 measures the date and time. The camera-equipped monitor 5 processes the date and time measured by the clock 54 as the current date and time.

[0023] The POS terminal interface 55 manages bidirectional data communication between the camera-equipped monitor 5 and the self-service POS terminal 1, which are connected on a one-to-one basis. The connection between the camera-equipped monitor 5 and the self-service POS terminal 1 may be wired or wireless.

[0024] The network interface 56 is responsible for bidirectional data communication that takes place as needed between the age estimation server 20, the identity card reading server 30, and the remote server 40, which are connected via the second communication network 10.

[0025] The communication circuit 57 controls the speaker 63 and microphone 64, enabling communication between the operator of the camera-equipped monitor 5 and the operator of the remote terminal 7. Incidentally, the operator of the camera-equipped monitor 5 is, in principle, a buyer. A buyer can be rephrased as a customer, consumer, etc. The operator of the remote terminal 7 is an employee of the remote center who specializes in verifying the age of buyers. Note that the communication is not limited to voice calls; it may also be a video call.

[0026] The I / O interface 58 is a circuit for sending and receiving data signals with devices such as the touch panel 61 and the AI ​​camera 62. The touch panel 61 serves as both an input device and a display device for the camera-equipped monitor 5. The touch panel 61 displays a face image or identification document image captured by the AI ​​camera 62. The touch panel 61 accepts operation input from the purchaser. Alternatively, an input device such as a keyboard or pointing device and a display device such as a monitor may be connected to the I / O interface 58 instead of the touch panel 61.

[0027] The AI ​​camera 62 functions as a means of capturing the face of a buyer. That is, when the AI ​​camera 62 recognizes that the buyer's face has been captured, it takes in the image of that face. The AI ​​camera 62 also functions as a means of capturing the face of an identification document. That is, when the AI ​​camera 62 recognizes that an identification document has been captured, it takes in the image of that identification document. An identification document refers to a document that contains textual information such as the date of birth that can identify the age of the person being identified, such as a driver's license, health insurance card, or My Number card.

[0028] [Remote terminal configuration description] Remote terminal 7 is a device operated by an employee at the remote center who is responsible for age verification. Remote terminal 7 displays the purchaser's facial image captured by the AI ​​camera 62 of the camera-equipped monitor 5. The age verification process involves estimating the purchaser's age based on the facial image, determining whether the purchaser's age is above the target age for the age-verified product, and inputting the result into the remote terminal 7. Remote terminal 7, together with the camera-equipped monitor 5, constitutes the age verification system 200.

[0029] Figure 3 is a block diagram showing the main circuit configuration of the remote terminal 7. The remote terminal 7 comprises circuit components such as a processor 71, main memory 72, auxiliary storage device 73, clock 74, communication interface 75, call circuit 76, and I / O (Input / Output) interface 77, as well as a system transmission line 78. The system transmission line 78 includes an address bus, data bus, control signal lines, etc. The remote terminal 7 constitutes a computer by connecting each circuit component to the system transmission line 78.

[0030] The processor 71 corresponds to the central part of the computer. The processor 71 controls various parts to realize various functions as a remote terminal 7 according to the operating system or application program (application software). The processor 71 is, for example, a CPU.

[0031] Main memory 72 corresponds to the main memory portion of the computer described above. Main memory 72 includes a non-volatile memory area and a volatile memory area. In the non-volatile memory area, main memory 72 stores the operating system or application programs. Main memory 72 may also store data necessary for the processor 71 to perform processing to control each part in the non-volatile or volatile memory area. Main memory 72 uses the volatile memory area as a work area where data is rewritten as appropriate by the processor 71. The non-volatile memory area is, for example, ROM. The volatile memory area is, for example, RAM.

[0032] The auxiliary storage device 73 corresponds to the auxiliary storage portion of the computer described above. For example, an EEPROM, HDD, or SSD could be the auxiliary storage device 73. The auxiliary storage device 73 stores data used by the processor 71 in performing various processes, or data created by the processing performed by the processor 71. The auxiliary storage device 73 may also store the application program described above.

[0033] Clock 74 measures the date and time. Remote terminal 7 processes the date and time measured by clock 74 as the current date and time.

[0034] The communication interface 75 is responsible for bidirectional data communication between the remote terminal 7 and the remote server 40. This data communication between the remote terminal 7 and the remote server 40 may be via wired or wireless communication.

[0035] The communication circuit 76 controls the speaker 81 and microphone 82, enabling voice calls, video calls, etc., between the operator of the camera-equipped monitor 5, i.e., the buyer, and the operator of the remote terminal 7, i.e., the employee of the remote center.

[0036] The I / O interface 77 is a circuit for sending and receiving data signals with devices such as the touch panel 83. The touch panel 83 serves as both an input device and a display device for the remote terminal 7. The touch panel 83 displays, for example, a facial image of a purchaser captured by the AI ​​camera 62 of the camera-equipped monitor 5. The touch panel 83 receives an instruction input from an employee indicating whether or not to allow the registration of age-verified products as a result of the age verification process. Alternatively, instead of the touch panel 83, an input device such as a keyboard or pointing device and a display device such as a display may be connected to the I / O interface 77.

[0037] [Functional description of camera-equipped monitor] Figure 4 is a block diagram showing the main functional configuration of the processor 51 of the camera-equipped monitor 5. As shown, the processor 51 has the functions of a detection means 511, a face shooting control means 512, a first shooting means 513, a face age estimation means 514, an identification card shooting control means 515, a second shooting means 516, an image processing means 517, an age identification means 518, and an output means 519.

[0038] The detection means 511 has the function of detecting the registration of products that require age verification of the buyer. The registration of products that require age verification of the buyer, i.e., age verification products, is performed at the self-service POS terminal 1. When the self-service POS terminal 1 detects that a product registered by the buyer's self-operation is a product that includes attributes indicating that it is an age verification product, it outputs an execution command for age verification to the corresponding camera-equipped monitor 5. When the detection means 511 receives the execution command for age verification, it detects the registration of an age verification product.

[0039] The face capture control means 512 has the function of commanding the first shooting means 513 to capture a face in response to the detection means 511 detecting the registration of a product that requires age verification of the purchaser. When an age verification product is registered in the self-service POS terminal 1, the face capture control means 512 commands the first shooting means 513 to capture the purchaser's face.

[0040] The first shooting means 513 has the function of capturing the buyer's face using the AI ​​camera 62. When the face shooting control means 512 commands the first shooting means 513 to capture the buyer's face, it controls the AI ​​camera 62 to capture the buyer's face. The first shooting means 513 then captures the buyer's face image captured by the AI ​​camera 62.

[0041] The face age estimation means 514 is a function that estimates face age from a face image captured by the AI ​​camera 62 using the first shooting means 513. The face age estimation means 514 works in cooperation with the age estimation server 20, which is an AI server, to estimate the face age from the buyer's face image. Specifically, the face age estimation means 514 transmits the face image captured by the AI ​​camera 62 to the age estimation server 20 to estimate the buyer's face age.

[0042] The ID photograph control means 515 controls whether or not to photograph the ID using the second photographing means 516, based on the facial age estimated by the facial age estimation means 514. The ID photograph control means 515 instructs the second photographing means 516 to photograph the ID if the facial age estimated by the facial age estimation means 514 is an age defined as being close to the target age for the age verification product. The ID photograph control means 515 does not instruct the second photographing means 516 to photograph the ID if the facial age estimated by the facial age estimation means 514 is not an age defined as being close to the target age for the age verification product.

[0043] The second shooting means 516 has the function of taking a picture of the identification document using the AI ​​camera 62. When the second shooting means 516 is instructed by the identification document shooting control means 515 to take a picture of the identification document, it controls the AI ​​camera 62 to take a picture of the identification document. The second shooting means 516 then captures the image of the identification document taken by the AI ​​camera 62.

[0044] The image processing means 517 has the function of obscuring images of identification documents captured by the AI ​​camera 62 by the second shooting means 516, excluding images necessary for identifying the age of the person being identified. Many identification documents record the date of birth as textual information necessary for identifying the age of the person being identified, while they also record personal information that is not necessary for identifying the age, such as address, name, and facial photograph. Since this personal information can identify the person being identified, the image processing means 517 obscures the personal information that can identify the person being identified by overlaying a predetermined mask image onto the identification document image, for example, by blacking it out.

[0045] The age identification means 518 is a function that identifies the age of the person being identified from the image of the identification document captured by the AI ​​camera 62 by the second shooting means 516. The age identification means 518 works in cooperation with the identification document reading server 30, which is an AI server, to identify the age of the person being identified from the image of the identification document. Specifically, the age identification means 518 transmits the identification document image, which has been masked by the image processing means 517, to the identification document reading server 30 to identify the age of the person being identified.

[0046] The output means 519, when the detection means 511 detects the registration of an age-verification product, outputs the face image captured by the AI ​​camera 62 by the first shooting means 513, along with the face age estimated by the face age estimation means 514 and the age of the person being verified identified by the age identification means 518, to a terminal where an operator visually verifies the purchaser's age. The terminal is the remote terminal 7. In other words, the output means 519 outputs the face image data, face age data, and the age of the person being verified to the remote terminal 7 via the network interface 56. However, if the ID photograph control means 515 controls the output means 519 not to photograph the ID, it outputs only the face image data and face age data to the remote terminal 7.

[0047] Incidentally, the remote terminal 7 has the functions of a display means 711 that displays the face image, face age, and age of the person being verified received from the camera-equipped monitor 5, a reception means 712 that receives the results of the purchaser's age verification by the operator of the remote terminal 7, and a notification means 713 that notifies the camera-equipped monitor 5 of the purchaser's age verification results.

[0048] The functions of the camera-equipped monitor 5 as detection means 511, face shooting control means 512, first shooting means 513, face age estimation means 514, identity card shooting control means 515, second shooting means 516, image processing means 517, age identification means 518, and output means 519 are realized by the processor 51 executing information processing according to the age verification program.

[0049] The age verification program is a type of application program stored in the main memory 52 or the auxiliary storage device 53. The method of installing the age verification program in the main memory 52 or auxiliary storage device 53 is not particularly limited. The age verification program can be installed in the main memory 52 or auxiliary storage device 53 by recording it on a removable recording medium or by distributing it via network communication. The recording medium can take any form as long as it can store a program and is readable by the device, such as a CD-ROM or memory card.

[0050] [Explanation of information processing on a camera-equipped monitor] Next, we will describe the information processing procedure performed by the processor 51 of the camera-equipped monitor 5 in accordance with the age verification program.

[0051] Figures 5 and 6 are flowcharts showing the essential information processing steps performed by processor 51 in accordance with the age verification program, and the essential information processing steps performed by processor 71 of remote terminal 7 in response to this information processing. Processor 51 is waiting for an execution command for an age verification request as ACT101. The execution command is output from self-POS terminal 1 to camera-equipped monitor 5 when an age verification product is registered by the purchaser's self-operation at self-POS terminal 1.

[0052] When processor 51 receives a command to execute an age verification request, it proceeds to ACT102. As ACT102, processor 51 instructs the buyer to take a picture of their face. For example, as shown in Figure 7, processor 51 displays a face image display area ARa on the touch panel 61 screen, and also displays text prompting the buyer to take a picture of their face, such as "Please face the camera." Incidentally, in the camera-equipped monitor 5, the lens of the AI ​​camera 62 is located above the screen of the touch panel 61, and when the buyer faces the screen of the touch panel 61, the AI ​​camera 62 takes a picture of their face and displays the face image in the display area ARa.

[0053] The processor 51, which issued the instruction to capture a face, proceeds to ACT 103. As ACT 103, the processor 51 waits for the buyer's face to be captured by the AI ​​camera 62. Once the buyer's face is captured, the processor 51 proceeds to ACT 104. As ACT 104, the processor 51 outputs an execution command to the age estimation server 20 requesting age estimation. This execution command is transmitted to the age estimation server 20 via the second communication network 10. This execution command includes the face image captured by the AI ​​camera 62.

[0054] Upon receiving the execution command for the age estimation request, the age estimation server 20 estimates the facial age EA by processing the facial image using AI. The age estimation server 20 then sends a response command containing the estimated facial age EA data to the camera-equipped monitor 5.

[0055] In ACT104, the processor 51 of the camera-equipped monitor 5, which output the execution command for the age estimation request, proceeds to ACT105. As ACT105, the processor 51 waits for a response command from the age estimation server 20. Upon receiving a response command via the network interface 56, the processor 51 proceeds to ACT106. As ACT106, the processor 51 obtains the face age EA from the response command. Then, as ACT107, the processor 51 determines whether the face age EA is greater than or equal to the first threshold age Ax. The first threshold age Ax is the maximum age within the age range defined as being older than the target age of the age verification product and close to the target age. For example, the first threshold age Ax is 40 years old.

[0056] In ACT107, if the facial age EA is less than the first threshold age Ax, the processor 51 proceeds to ACT108. In ACT108, the processor 51 determines whether the facial age EA is less than the second threshold age Ay. The second threshold age Ay is an age lower than the target age of the age verification product and is the minimum age within the age range defined as being close to the target age. For example, the second threshold age Ay is 13 years old. It goes without saying that the first threshold age Ax and the second threshold age Ay are not limited to the above ages, but can be arbitrarily set within the age range defined as being close to the target age.

[0057] In ACT108, if the facial age EA is greater than or equal to the second threshold age Ay, the processor 51 proceeds to ACT1109. That is, if the facial age EA is less than the first threshold age Ax and greater than or equal to the second threshold age Ay, the processor 51 proceeds to ACT109. If the facial age EA is greater than or equal to the first threshold age Ax, or less than the second threshold age Ay, the processor 51 proceeds to ACT125 in Figure 6. The processing from ACT125 onward will be described later.

[0058] In ACT109, the processor 51 instructs the buyer to take a picture of their identification. For example, as shown in Figure 8, the processor 51 displays a frame FL corresponding to the size of the identification on the screen of the touch panel 61 where the face image is displayed, and also displays text prompting the buyer to hold the identification up to the lens of the AI ​​camera 62 so that it fits within the frame FL, such as "Please hold the identification up so that it fits within the frame." Incidentally, on the camera-equipped monitor 5, when the identification is held up so that it fits within the frame FL, the AI ​​camera 62 takes a picture of the identification. When the identification is successfully photographed, as shown in Figure 9, the image 90 of the identification is displayed within the frame FL, and text indicating that the photograph was successful, such as "Reading successful," is displayed.

[0059] As shown in Figure 8, the "No ID" button BTx is displayed on the touch panel 61 screen until the ID is photographed. The "No ID" button BTx is an operator for customers who do not have an ID or do not wish to have their ID photographed. As shown in Figure 9, the "No ID" button BTx disappears once the ID has been successfully photographed.

[0060] Let's return to the explanation of Figure 5. Processor 51, which instructed the system to photograph the identification document, proceeds to ACT110. Processor 51 checks whether the identification document has been photographed as ACT110. If the identification document has not been photographed, processor 51 proceeds to ACT111. Processor 51 checks whether the "No Identification Document" button BTx has been touched as ACT111. If the "No Identification Document" button BTx has not been touched, processor 51 returns to ACT110. In this way, processor 51 waits in ACT110 and ACT111 for the identification document to be photographed or for the "No Identification Document" button BTx to be touched.

[0061] If the IDless button BTx is touched while ACT110 and ACT111 are in standby mode, the processor 51 proceeds to ACT125 in Figure 6.

[0062] On the other hand, if the AI ​​camera 62 captures an image of the identification document while ACT110 and ACT111 are in standby mode, the processor 51 proceeds to ACT121 in Figure 6. The processor 51 performs masking as ACT121. That is, the processor 51 overlays a predetermined mask image onto the image of the identification document, making personal information unnecessary for age identification invisible.

[0063] Figure 10 is an explanatory diagram of masking when a driver's license is photographed as an example of an identification document. In Figure 10, the image Lia of the driver's license shows the person's name 91, date of birth 92, address 93, date of issuance 94, expiration date 95, and facial photograph 96. Of these items, the date of birth 92 is information necessary to identify the person's age. On the other hand, the name 91, address 93, and facial photograph 96 are personal information that can easily identify the person. Therefore, in this embodiment, as shown in the image Lib of Figure 10, the parts of the name 91, address 93, and facial photograph 96 are masked and blacked out to make them invisible. On the other hand, the part of the date of birth 92 that is necessary to identify the person's age is not masked and is made visible. The date of issuance 94 and expiration date 95, which do not lead to the identification of the person, may or may not be masked.

[0064] Returning to the explanation of Figure 6. After completing the masking process, processor 51 proceeds to ACT122. Processor 51 outputs an execution command for identity document reading request to identity document reading server 30 as ACT122. This execution command is transmitted to identity document reading server 30 via the second communication network 10. This execution command includes the identity document image captured by AI camera 62.

[0065] Upon receiving the command to execute the identity document reading request, the identity document reading server 30 uses AI-powered image processing to read textual information such as the date of birth necessary to identify the age of the person being identified from the identity document. The identity document reading server 30 then calculates the age of the person being identified from the read textual information. Hereinafter, the age of the person being identified calculated from the identity document will be referred to as the identity document age EB. The identity document reading server 30 sends a response command containing the identity document age EB data to the camera-equipped monitor 5.

[0066] In ACT122, processor 51, which output the command to execute the identity document reading request, proceeds to ACT123. Processor 51, as ACT123, waits for a response command from the identity document reading server 30. Upon receiving a response command via the network interface 56, processor 51 proceeds to ACT124. Processor 51, as ACT124, obtains the identity document age EB from the response command. Having obtained the identity document age EB, processor 51 proceeds to ACT125.

[0067] Thus, if the facial age EA estimated by the age estimation server 20 is an age defined as being close to the target age for the age verification product, that is, an age lower than the first threshold age Ax and an age higher than the second threshold age Ay, the processor 51 executes the processes of ACT109 to ACT111 and ACT121 to ACT124, and then proceeds to ACT125. If the IDless button BTx is touched, the processor 51 skips the processes of ACT121 to ACT124 and proceeds to ACT125. On the other hand, if the facial age EA is greater than or equal to the first threshold age Ax, or lower than the second threshold age Ay, the processor 51 skips the processes of ACT109 to ACT111 and ACT121 to ACT124 and proceeds to ACT125.

[0068] In ACT125, the processor 51 sends an authentication request execution command to the remote terminal 7. This execution command is sent to the remote server 40 via the second communication network 10, and then to the remote terminal 7. This execution command includes data of the buyer's face image captured by the AI ​​camera 62, along with data of the face age EA estimated by the age estimation server 20. Furthermore, if the processes of ACT109 to ACT111 and ACT121 to ACT124 are executed, the execution command also includes data of the masked identification document image, along with data of the identification document age EB identified from the identification document image by the identification document reading server 30.

[0069] The processor 71 of the remote terminal 7 is waiting for an authentication request execution command as ACT201. Upon receiving an authentication request execution command via the communication interface 75, the processor 71 proceeds to ACT202. As ACT202, the processor 71 sets the screen of the touch panel 83 to authentication screen SCa (see Figure 11) or authentication screen SCb (see Figure 12).

[0070] Figure 11 shows an example layout of the authentication screen SCa. The authentication screen SCa is displayed on the touch panel 83 when the processes ACT109 to ACT111 and ACT121 to ACT124 are executed on the camera-equipped monitor 5. As shown in the figure, a portion of the authentication screen SCa is designated as a face image display area ARb. Near this display area ARb, the face age EA estimated by the age estimation server 20 is displayed. The authentication screen SCa also displays the identification document image Lib and identification document age EB alongside the display area ARb. Furthermore, the authentication screen SCa includes images of the registration permission button BTa, the staff call button BTb, and the call button BTc. Each of the buttons BTa to BTc is a software key.

[0071] Figure 12 shows an example layout of the authentication screen SCb. The authentication screen SCa is displayed on the touch panel 83 when the processes ACT109 to ACT111 and ACT121 to ACT124 are not executed on the camera-equipped monitor 5. As shown in the figure, a portion of the authentication screen SCb is designated as a face image display area ARb. Near this display area ARb, the face age EA estimated by the age estimation server 20 is displayed. Similar to the authentication screen SCa, the authentication screen SCb also includes images of the registration permission button BTa, the staff call button BTb, and the call button BTc. Note that the identification card image Lib and identification card age EB are not displayed on the authentication screen SCb.

[0072] The remote center employee, who is the operator of the remote terminal 7, estimates whether the buyer's age is above the target age for the age-verified product based on the facial age EA and ID age EB displayed on the authentication screen SCa, or the facial age EA displayed on the authentication screen SCb. If the employee is confident that the buyer is above the target age, they touch the registration permission button BTa. If the employee is not confident that the buyer's age is above the target age for the age-verified product, they touch the staff call button BTb. If the employee wishes to speak with the buyer, who is the operator of the camera-equipped monitor 5, they touch the call button BTc.

[0073] When the authentication screen SCa or SCb is displayed on the touch panel 83, the processor 71 of the remote terminal 7 proceeds to ACT203. The processor 71 waits for the registration permission button BTa or the staff call button BTb to be touched as ACT203. If the call button BTc is touched in this waiting state, the processor 71 starts a predetermined call application software to control the call.

[0074] When the processor 71 detects that the registration permission button BTa or the staff call button BTb has been touched while ACT203 is in standby mode, it proceeds to ACT204. The processor 71 notifies the camera-equipped monitor 5 of the authentication result as ACT204. Specifically, if the processor 71 detects that the registration permission button BTa has been touched, it notifies that registration permission has been granted as the authentication result. If the processor 71 detects that the staff call button BTb has been touched, it notifies that staff call has been granted as the authentication result.

[0075] Here, the processor 71 of the remote terminal 7 realizes the function of a display means 711 through the processing of ACT202. The processor 71 realizes the function of a reception means 712 through the processing of ACT203. The processor 71 realizes the function of a notification means 713 through the processing of ACT204.

[0076] In ACT125, the processor 51 of the camera-equipped monitor 5, which sent an authentication request command to the remote terminal 7, proceeds to ACT126. Processor 51 waits for the authentication result to be notified as ACT126. When the authentication result is notified from the remote terminal 7, processor 51 proceeds to ACT127. Processor 51 outputs the authentication result to the self-POS terminal 1 as ACT127. Then processor 51 finishes processing the execution command for the age verification request.

[0077] Incidentally, if the self-service POS terminal 1 receives a notification of registration permission as an authentication result, it processes the registration of the age-verified product. On the other hand, if the self-service POS terminal 1 receives a notification of staff call as an authentication result, it puts the registration of the age-verified product on hold. The self-service POS terminal 1 then outputs a staff call signal to the attendant terminal 2. This staff call signal notifies the attendant terminal 2 that staff have been called, and the staff member referred to as the attendant verifies the age of the customer operating the self-service POS terminal 1 in person. If the staff member confirms that the customer's age is equal to or greater than the target age of the age-verified product, they proceed with the operation to permit the registration of the age-verified product. On the other hand, if the staff member confirms that the customer's age is less than the target age of the age-verified product, they proceed with the operation to cancel the registration of the age-verified product. In this way, the retail store prevents selling age-verified products to customers younger than the target age of the product.

[0078] Here, the processor 51 of the camera-equipped monitor 5 realizes the function of a detection means 511 by executing the process of ACT101 in Figure 5. The processor 51 realizes the function of a face shooting control means 512 by executing the process of ACT102 in Figure 5. The processor 51 realizes the function of a first shooting means 513 by working in cooperation with the AI ​​camera 62 to execute the process of ACT103 in Figure 5. The processor 51 realizes the function of a face age estimation means 514 by working in cooperation with the age estimation server 20 to execute the process of ACT104 in Figure 5. The processor 51 realizes the function of an identification card shooting control means 515 by executing the processes of ACT106 to ACT109 in Figure 5. The processor 51 realizes the function of a second shooting means 516 by working in cooperation with the AI ​​camera 62 to execute the process of ACT110 in Figure 5. The processor 51 realizes the function of an image processing means 517 by executing the process of ACT121 in Figure 6. The processor 51 works in cooperation with the identity card reading server 30 to execute the processes of ACT122 to ACT124 in Figure 6, thereby realizing the function of an age identification means 518. The processor 51 also works in cooperation with the process of ACT125 in Figure 6, thereby realizing the function of an output means 519.

[0079] [Explanation of how the age verification system works] In the camera-equipped monitor 5 and the remote terminal 7, the information processing procedures shown in the flowcharts of Figures 5 and 6 are executed, and the age verification system 200 operates as shown in Figure 13. Specifically, when an age verification product is registered by the purchaser through self-operation at the self-POS terminal 1 (ACT1), an execution command for age verification is sent from the self-POS terminal 1 to the camera-equipped monitor 5 (ACT2). In response to this execution command, the camera-equipped monitor 5 captures the purchaser's face using the AI ​​camera 62 (ACT3). Then, the camera-equipped monitor 5 sends an execution command for age estimation along with the purchaser's face image to the age estimation server 20 (ACT4). Upon receiving this execution command, the age estimation server 20 performs face age estimation processing (ACT5). Specifically, the face age EA is estimated from the purchaser's face image captured by the camera-equipped monitor 5.

[0080] Once the facial age EA is estimated, the camera-equipped monitor 5 determines whether the facial age EA is above the first threshold age Ax, which is higher than the target age, or below the second threshold age Ay, which is lower than the target age (ACT6). If the facial age EA is above the first threshold age Ax or below the second threshold age Ay, the authentication screen SCb is displayed on the touch panel 83 of the remote terminal 7 (ACT12).

[0081] On the other hand, if the facial age EA is less than the first threshold age Ax and greater than or equal to the second threshold age Ay, the AI ​​camera 62 takes a picture of the identification document (ACT7). Then, the captured image of the identification document is masked (ACT8). Subsequently, the camera-equipped monitor 5 sends an execution command for an identification document reading request to the identification document reading server 30, along with the masked image of the identification document (ACT9). Upon receiving this execution command, the identification document reading server 30 performs the identification document reading process (ACT10). That is, the identification document age EB is identified from the image of the identification document captured by the camera-equipped monitor 5. Once the identification document age EB is identified, the camera-equipped monitor 5 notifies the remote terminal 7 of the identification document age EB (ACT11). Upon notification of the identification document age EB, the authentication screen SCa is displayed on the touch panel 83 of the remote terminal 7 (ACT12).

[0082] The authentication screens SCa and SCb displayed on the touch panel 83 of the remote terminal 7 show the purchaser's facial age EA. The authentication screen SCa also displays the identification document age EB. The employee at the remote center then estimates the purchaser's age from the facial age EA or identification document age EB. If the employee is confident that the purchaser's age is equal to or greater than the target age for the age-verification product, the employee touches the registration permission button BTa. If the employee is not confident that the purchaser's age is equal to or greater than the target age for the age-verification product, the employee touches the staff call button BTb. In response to the employee's touch operation on the remote terminal 7, the remote terminal 7 sends a response command indicating the authentication result to the camera-equipped monitor 5 (ACT13).

[0083] Upon receiving the response command, the camera-equipped monitor 5 notifies the self-service POS terminal 1 of the authentication result (ACT14). As a result, the self-service POS terminal 1 performs either registration or staff call processing (ACT15). Specifically, if the registration permission button BTa is touched, the registration process for age-verified products is executed. Therefore, face-to-face age verification by a staff member is not performed. On the other hand, if the staff call button BTb is touched, the staff call processing is executed. Therefore, face-to-face age verification by a staff member is performed.

[0084] [Explanation of the effectiveness of the age verification system] As is clear from the above description of operation, according to this embodiment, when a purchaser operates the self-POS terminal 1 to register an age-verification product, the purchaser's face image and the estimated face age EA from that face image are displayed on the remote terminal 7. Furthermore, because the face age EA is defined as an age close to the target age for the age-verification product, when the purchaser holds their identification card up to the AI ​​camera 62, the identification card age EB, that is, the age of the person being verified identified from the date of birth on the identification card, are displayed on the remote terminal 7 along with an image of the identification card.

[0085] Therefore, employees at the remote terminal 7 can estimate the buyer's age not only from the buyer's facial image but also from the facial age EA or ID age EB, making it easy and highly accurate to determine whether the buyer is above the target age for age-recognized products. As a result, retail stores that have introduced the self-service POS terminal 1 can minimize the risk of selling age-recognized products to buyers younger than the target age.

[0086] Furthermore, retail store employees only have the opportunity to verify a customer's age in person if a remote center employee touches the employee call button BTb on the authentication screen SCa or SCb. In other words, it is limited to cases where the remote center employee is not confident that the customer's age is above the age requirement for the age-verified product. Therefore, the frequency of age verification is significantly reduced compared to a system where age verification was required every time an age-verified product was registered on the payment terminal, regardless of the customer's age. Consequently, the workload of retail store employees, such as attendants, who are responsible for age verification can be reduced. As a result, the attendant's duties, including age verification, can be handled by a smaller number of employees, leading to reduced manpower and lower personnel costs.

[0087] Furthermore, in this embodiment, when an identification document is read by the AI ​​camera 62, the image of the identification document is masked to make all images containing personal information that could identify the person being identified invisible, except for images necessary for determining age. Therefore, it is presumed that the buyer will be able to photograph their identification document with peace of mind without worrying about the leakage of personal information.

[0088] [Other embodiments] Although one embodiment has been described above, the embodiment is not limited to this. For example, in the above embodiment, the face age estimation means 514 works in cooperation with the age estimation server 20 to estimate the face age from the purchaser's face image. In this regard, the face age estimation process may be performed within the camera-equipped monitor 5. Similarly, the age identification means 518 works in cooperation with the ID reading server 30 to identify the age of the person being identified from the image of the ID, but the age of the person being identified may be identified by reading the date of birth of the person being identified from the ID within the camera-equipped monitor 5. Alternatively, the age identification means 518 may obtain the date of birth of the person being identified read by the ID reading server 30 and identify the age of the person being identified from that date of birth.

[0089] Furthermore, in ACT107 of the information processing shown in the flowcharts of Figures 5 and 6, if the purchaser's facial age EA is equal to or greater than the first threshold age Ax, instead of sending an authentication request execution command to the remote terminal 7, a registration permission notification may be output to the self-POS terminal 1. By doing so, for purchasers whose facial age EA is estimated to be equal to or greater than the first threshold age Ax, registration of age-verified products will be performed without the need for age verification work. Therefore, this is highly efficient and has the advantage of further reducing the workload of employees at the remote center and store clerks.

[0090] In addition, several embodiments of the present invention have been described, but these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be carried out in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included within the scope of the invention, as well as within the scope of the invention and its equivalents as described in the claims. [Explanation of Symbols]

[0091] 1...Self-service POS terminal, 2...Attendant terminal, 3...POS server, 4...Communication network, 5...Monitor with camera, 7...Remote terminal, 10...Communication network, 20...Age estimation server, 30...ID card reading server, 40...Remote server, 61...Touch panel, 62...AI camera, 63...Speaker, 64...Microphone, 81...Speaker, 82...Microphone, 83...Touch panel, 100...Checkout system, 200...Age verification system, 511...Detection means, 512...Face shooting control means, 513...Shooting means, 514...Face age estimation means, 515...ID card shooting control means, 516...Shooting means, 517...Image processing means, 518...Age identification means, 519...Output means, 711...Display means, 712...Reception means, 713...Notification means.

Claims

1. A detection means for detecting the registration of products that require age verification of the buyer, A first photographing means that photographs the face of the aforementioned buyer with a camera, A second photographing means for photographing an identification document with the aforementioned camera, A face age estimation means for estimating face age from the face image captured by the first imaging means, An age determination means for determining the age of the person being identified from the image of the identification document captured by the second photographing means, When the detection means detects the registration of a product requiring age verification of the purchaser, the output means outputs the face image captured by the first shooting means, along with the face age estimated by the face age estimation means and the age of the person being verified identified by the age identification means, to a terminal where an operator visually verifies the purchaser's age. An age verification device equipped with the following features.

2. In response to the detection means detecting the registration of a product requiring age verification of the purchaser, the face shooting control means commands the first shooting means to take a picture of the face. The age verification device according to claim 1, further comprising:

3. An identity document photography control means controls whether or not to photograph the identity document with the second photography means based on the facial age estimated by the facial age estimation means. Furthermore, it is equipped with, The age verification device according to claim 2, wherein the output means is controlled not to photograph the identification document by the second photographing means, and outputs the facial age estimated by the facial age estimation means to the terminal along with the facial image.

4. Image processing means for removing images necessary for identifying the person being identified from the image of the identification document captured by the second photographing means, and making invisible the images that could identify the person being identified. Furthermore, it is equipped with, The age verification device according to claim 1, wherein the age identification means identifies the age of the person being verified from the image of the identification document processed by the image processing means.

5. This includes an age verification device equipped with a camera and a terminal where an operator visually verifies the age of the purchaser. The aforementioned age verification device is A detection means for detecting the registration of products that require age verification of the buyer, A first shooting means for photographing the face of the buyer with the aforementioned camera, A second photographing means for photographing an identification document with the aforementioned camera, A face age estimation means for estimating face age from the face image captured by the first imaging means, An age determination means for determining the age of the person being identified from the image of the identification document captured by the second photographing means, When the detection means detects the registration of a product requiring age verification of the purchaser, the output means outputs the face image captured by the first shooting means, along with the face age estimated by the face age estimation means and the age of the person being verified identified by the age identification means, to a terminal where an operator visually verifies the purchaser's age. It is equipped with, The aforementioned terminal is A display means that displays the facial age and the age of the person being certified, along with the facial image of the purchaser captured by the camera, A notification means for notifying the age verification device of the results of the age verification of the purchaser by the operator, An age verification system equipped with the following features.

6. The computer in the age verification device equipped with a camera, A detection means for detecting the registration of products that require age verification of the buyer. A first shooting means that photographs the face of the buyer with the aforementioned camera, A second photographing means for photographing an identification document with the aforementioned camera, A face age estimation means for estimating the face age from the face image captured by the first imaging means, An age determination means for determining the age of the person being identified from the image of the identification document captured by the second photographing means, When the detection means detects the registration of a product requiring age verification of the purchaser, the output means outputs the face image captured by the first shooting means, along with the face age estimated by the face age estimation means and the age of the person being verified identified by the age identification means, to a terminal where an operator visually verifies the purchaser's age. A program designed to function as such.

Images