Age verification system

Abstract

To provide an age verification system which can efficiently perform age verification.SOLUTION: An age verification system comprises: a plurality of photographing devices which photograph user's images, and transmit age verification requests including the user's images; a plurality of age verification devices which perform the user's age verification; and a management device which receives the age verification request from the photographing device, and distributes the received age verification request to any one of the plurality of age verification devices. The age verification device returns the distributed age verification request to the management device, when an interruption cause occurs. The management device redistributes the age verification request returned from the age verification device to the age verification device other than the age verification device of a return source.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an age verification system for verifying the age of a user. [Background technology]

[0002] In recent years, convenience stores, supermarkets, and other stores have increasingly introduced self-checkout systems in which customers register the products they wish to purchase and make payments themselves. The introduction of self-checkout systems makes it possible to reduce the number of store clerks stationed at the storefront. However, when selling age-restricted products such as alcohol or tobacco, the seller must verify the age of the customer. In conventional age verification systems, the store clerk visually checks the customer's age, but in this case, a store clerk must be stationed at the storefront at all times, making it impossible to reduce the number of store staff.

[0003] Therefore, for example, Patent Document 1 proposes an age verification system that can verify the age of a user remotely. The age support system in Patent Document 1 is configured to transmit a photographed image of a user to be verified for age to a mobile terminal, and a store clerk verifies the age by looking at the image of the user displayed on the mobile terminal. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-81669 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the age assistance system of Patent Document 1, a request signal requesting age verification is sent simultaneously to multiple mobile terminals, and an age verification screen including an image of the user is displayed on the multiple mobile terminals. Then, when age verification is performed on any of the mobile terminals, a notification signal is sent to the mobile terminals for which age verification has not been performed, and the display of the age verification screen is terminated. In this case, if the number of users requiring age verification becomes very large, the frequency of simultaneous transmission of request signals and notification signals increases, and the efficiency of age verification decreases. As a result, users have to wait, and convenience decreases.

[0006] The present invention is intended to solve the above-mentioned problems, and has an object to provide an age verification system capable of efficiently performing age verification. [Means for solving the problem]

[0007] The age verification system of the present invention comprises a plurality of photographing devices that capture an image of a user and transmit an age verification request including the user's image, a plurality of age verification devices that verify the age of the user, and a management device that receives the age verification request from the photographing devices and distributes the received age verification request to one of the plurality of age verification devices, and in the event of an interruption, an age verification device returns the distributed age verification request to the management device, and the management device redistributes the age verification request returned from the age verification device to an age verification device other than the age verification device that returned the request. Effect of the Invention

[0008] In the present invention, if an interruption occurs, the age verification request distributed to the age verification device is returned to the management device, and then redistributed from the management device to another age verification device, thereby enabling age verification to be performed efficiently. [Brief description of the drawings]

[0009] [Figure 1] 1 is a schematic configuration diagram of an age verification system according to a first embodiment. [Diagram 2] 1 is a control block diagram of an age verification system according to a first embodiment. [Diagram 3] 4 is an example of an age verification screen displayed on the age verification device according to the first embodiment. [Figure 4] 4 is an example of a pop-up screen displayed on the age verification device according to the first embodiment during a call. [Diagram 5] 4 is a sequence diagram showing the flow of age verification processing in the age verification system according to the first embodiment. FIG. [Figure 6] 4 is a flowchart showing the flow of age verification processing in the self-checkout apparatus according to the first embodiment. [Figure 7] 5 is a flowchart showing a flow of age verification processing in the photographing device according to the first embodiment. [Figure 8] 10 is a flowchart showing a flow of age verification processing in the management device according to the first embodiment. [Figure 9] 4 is a flowchart showing a flow of age verification processing in the age verification device according to the first embodiment. [Figure 10] FIG. 2 is a diagram showing an example of an installation state of a photographing device. [Figure 11] 13 is a flowchart showing a flow of age verification processing in the photographing device according to the second embodiment. [Figure 12] 13 is an example of an age verification screen displayed on the age verification device according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an age verification system 100 according to an embodiment of the present invention will be described with reference to the drawings. In each drawing, the same or corresponding parts are denoted by the same reference numerals, and their description will be omitted or simplified as appropriate. In addition, the shape, size, arrangement, etc. of the configurations shown in each drawing may be changed as appropriate within the scope of the present invention.

[0011] Embodiment 1 FIG. 1 is a schematic diagram of an age verification system 100 according to the first embodiment. The age verification system 100 according to the present embodiment is a system used for verifying the age of a user in a store such as a convenience store or a supermarket. As shown in FIG. 1, the age verification system 100 includes a plurality of self-checkout devices 1, a plurality of photographing devices 2, a management device 3, and a plurality of age verification devices 4. The plurality of self-checkout devices 1 and the plurality of photographing devices 2 are installed in one or a plurality of stores. The management device 3 may be installed in any of the stores in which the plurality of self-checkout devices 1 and the plurality of photographing devices 2 are installed, or may be installed in a location away from the store. The plurality of age verification devices 4 are installed in a call center or the like away from the stores in which the plurality of self-checkout devices 1 and the plurality of photographing devices 2 are installed.

[0012] The self-checkout device 1 and the photographing device 2 are connected to each other via a USB cable, Bluetooth (registered trademark), etc. The photographing device 2, the management device 3, and the age verification device 4 are connected to each other via a network 200 such as a WAN or the Internet, to enable wired or wireless communication.

[0013] The self-checkout device 1 is a POS terminal used by customers who come to the store to shop to register products and make payments themselves. The photographing device 2 is a communication terminal such as a smartphone or tablet equipped with a camera function and a communication function. The photographing device 2 is installed on the top or side of the self-checkout device 1, and based on instructions from the self-checkout device 1, photographs an image of the user operating the self-checkout device 1 and transmits an age verification request including the photographed image to the management device 3.

[0014] The management device 3 is a server that receives and manages age verification requests from multiple photographing devices 2. The management device 3 receives age verification requests from the photographing devices 2 and distributes the received age verification requests to any of multiple age verification devices 4.

[0015] The age verification device 4 is a communication terminal such as a tablet or PC operated by an operator who performs age verification. The age verification device 4 displays an image of the user included in the age verification request distributed by the management device 3 on an age verification screen, and transmits the result of the age verification performed by the operator to the photographing device 2.

[0016] Fig. 2 is a control block diagram of the age verification system 100 according to the embodiment 1. For simplicity, Fig. 2 shows one self-checkout device 1, one photographing device 2, and one age verification device 4 as representatives. As shown in Fig. 2, the self-checkout device 1 includes a control device 11, a display device 12, an operation device 13, a reading device 14, a printing device 15, a payment device 16, and a communication device 17.

[0017] The control device 11 controls each device of the self-checkout device 1. The control device 11 is composed of a computer including a memory that stores data and programs necessary for control and a processor such as a CPU that executes the program, a dedicated processing circuit such as an ASIC or FPGA, or both.

[0018] The control device 11 registers the product read by the reading device 14 as a purchased product and settles the bill. The control device 11 also determines whether the product read by the reading device 14 is an age-restricted product. Age-restricted products are, for example, alcoholic beverages and tobacco. The control device 11 then performs payment processing for the registered product depending on the age verification result. The self-checkout device 1 of this embodiment allows payment by cash, prepaid card, credit card, electronic money, or barcode. When the user selects payment by cash, prepaid card, credit card, electronic money, or barcode, the control device 11 performs payment processing for the input to the payment device 16.

[0019] The display device 12 is, for example, a liquid crystal display, and displays information on the product to be registered, information on payment for the product, an initial screen, a confirmation screen, an error screen, etc. The operation device 13 is, for example, a touch panel formed integrally with the display device 12.

[0020] The operation device 13 is operated by a user to input payment instructions, selection of a payment method, selection of age verification, and the like.

[0021] The reading device 14 is a device that irradiates a laser scanning line onto a product to read a barcode attached to the product. The reading device 14 is a fixed scanner or a handheld scanner, or both. Product information read by the reading device 14 is transmitted to the control device 11.

[0022] When the payment is completed by the control device 11, the printing device 15 prints and outputs a receipt that lists information such as the name of the product purchased by the user, the selling price of the product, the amount of the deposit, and the amount of change.

[0023] The settlement device 16 includes a card reader, a barcode reader, a change machine, and a change dispenser, and accepts payments by cash, credit card, prepaid card, electronic money, or barcode, and returns change as necessary.

[0024] The communication device 17 is a network interface that performs two-way communication with the photographing device 2. The communication device 17 transmits a photographing instruction to the photographing device 2 and receives an age verification result from the photographing device 2. The communication device 17 may perform two-way communication with the management device 3 or the age verification device 4 via the network 200.

[0025] The photographing device 2 includes a control device 21, a camera 22, a communication device 23, and a communication device 24. The control device 21 controls each device of the photographing device 2. The control device 21 is composed of a computer including a memory for storing data and programs required for control and a processor such as a CPU for executing the program, a dedicated processing circuit such as an ASIC or an FPGA, or both. The control device 21 obtains an image of a user according to an instruction from the self-checkout device 1, and transmits an age confirmation request including the image of the user and the identification information of the photographing device 2 to the management device 3. The control device 21 also transfers the age confirmation result received from the age confirmation device 4 to the self-checkout device 1. Furthermore, the control device 21 performs call processing between the communication device 23 and the age confirmation device 4 in response to a call request from the age confirmation device 4.

[0026] The camera 22 captures an image of a user operating the self-checkout device 1. The image captured by the camera 22 is transmitted to the control device 21. The image captured by the camera 22 may be either a still image or a video image.

[0027] The communication device 23 includes a microphone and a speaker, and performs voice communication with the age verification device 4 based on instructions from the control device 21. In the voice communication, the communication device 23 transmits a voice signal input from the microphone to the age verification device 4 via the network 200, and outputs a voice signal received from the age verification device 4 via the network 200 from the speaker.

[0028] The communication device 24 is a network interface that performs two-way communication with the self-checkout device 1, the management device 3, and the age verification device 4. The communication device 24 receives a photographing instruction from the self-checkout device 1, and transmits an age verification request to the management device 3. The communication device 24 also receives an age verification result from the age verification device 4 and transmits it to the self-checkout device 1. The communication device 24 may also perform two-way communication with the management device 3 and the age verification device 4 via the self-checkout device 1.

[0029] The management device 3 has a control device 31 and a communication device 32. The control device 31 is composed of a computer having a memory for storing data and programs required for control and a processor such as a CPU for executing the programs, a dedicated processing circuit such as an ASIC or an FPGA, or both. The control device 31 distributes the age verification request received from the photographing device 2 to the multiple age verification devices 4. Specifically, the control device 31 creates a queue for managing the age verification request for each of the multiple age verification devices 4, and distributes the age verification request received from the photographing device 2 to one of the multiple queues according to a predetermined condition.

[0030] As an example, the control device 31 allocates the received age verification requests to the queues of each age verification device 4 so that the number of age verification requests stored in the queue of each age verification device 4 is equal. Alternatively, the control device 31 may calculate the average processing time per age verification request of each age verification device 4 and allocate the age verification requests according to the calculated average. Specifically, the control device 31 allocates the age verification requests to each queue so that the product of the average processing time of each age verification device 4 and the number of age verification requests is equal. In the queue of each age verification device 4, the distributed age verification requests are stored in the order of the date and time of reception of the age verification requests.

[0031] The control device 31 also has a Web server function, and provides a login screen, an age verification screen, and the like for carrying out age verification processing to the age verification device 4 connected to the management device 3 via a Web browser.

[0032] The communication device 32 is a network interface that performs bidirectional communication with the photographing device 2 and the age verification device 4 via the network 200. The communication device 32 receives an age verification request from the photographing device 2 and performs bidirectional communication with the age verification device 4. A communication protocol used in the bidirectional communication between the communication device 32 and the age verification device 4 is, for example, the HTTP protocol or the MQTT protocol.

[0033] The age verification device 4 includes a control device 41, a display device 42, an operation device 43, a call device 44, and a communication device 45. The control device 41 is composed of a computer including a memory for storing data and programs required for control and a processor such as a CPU for executing the program, a dedicated processing circuit such as an ASIC or an FPGA, or both. The control device 41 has a Web browser function and connects to the management device 3 to display a login screen and an age verification screen for performing age verification processing. Alternatively, the control device 41 may display the login screen and the age verification screen by executing an application program for performing age verification processing. The control device 41 also transmits the age verification result inputted on the age verification screen displayed on the display device 42 to the photographing device 2.

[0034] The display device 42 is, for example, a liquid crystal display. The display device 42 displays a login screen and an age verification screen for carrying out age verification processing.

[0035] The operation device 43 is a mouse, a keyboard, or a touch panel formed integrally with the display device 42. The operation device 43 is operated by an operator when logging in, determining age, etc.

[0036] The communication device 44 includes a microphone and a speaker, and performs voice communication with the photographing device 2 based on an instruction from the control device 41. In the voice communication, the communication device 44 transmits a voice signal input from the microphone to the photographing device 2 via the network 200, and outputs a voice signal received from the photographing device 2 via the network 200 from the speaker.

[0037] The communication device 45 is a network interface that performs two-way communication with the photographing device 2 and the management device 3. The communication device 45 connects to a Web server to receive an age confirmation screen and the like, and transmits an age confirmation result and a call request to the photographing device 2.

[0038] FIG. 3 is an example of an age verification screen 5 displayed on the age verification device 4 according to the first embodiment. As shown in FIG. 3, the age verification screen 5 displays one or more age verification cards 50 corresponding to one or more age verification requests stored in the queue of the age verification device 4. In the example of FIG. 3, a maximum of six age verification cards 50 are displayed on one age verification screen 5, but the number of age verification cards 50 displayed on one age verification screen 5 is not limited to the example of FIG. 3. In the age verification screen 5, the number of age verification cards 50 to be displayed is set according to the size of the display device 42 of the age verification device 4 so that the image 51 of the user included in each age verification card 50 is displayed in a size that is easy to view. When multiple age verification cards 50 are displayed, they are arranged from left to right on the age verification screen 5 in order of the oldest received date and time of the age verification requests stored in the queue.

[0039] Each age verification card 50 includes an image 51 of the user included in the age verification request, an OK button 52 and an NG button 53 which are age verification result buttons for inputting the age verification result, a call button 54 for making a call request to the photographing device 2, and additional information 55. The additional information 55 is identification information of the sending photographing device 2 included in the age verification request corresponding to the age verification card 50, such as the name of the store where the photographing device 2 is installed, the identification number of the photographing device 2 or the self-checkout device 1 connected to the photographing device 2, and the time since the age verification request was received.

[0040] The control device 31 may enlarge the image so that the size of the face in the image 51 of each age verification card 50 becomes uniform. The control device 31 may also change the size of each age verification card 50 and the number of images to be displayed according to the size of the image 51. The control device 31 may also apply super-resolution processing to the enlarged image. In addition, when the operation device 43 is a keyboard, the OK button 52 and the NG button 53 may be omitted, and OK or NG may correspond to a specific key bind of the keyboard.

[0041] The operator of the age verification device 4 enters an identification number and a password to perform age verification processing, and performs login processing. At this time, a toolbar including a rest button, a logout button, and login information is displayed on the display device 42. After logging in, when an age verification request is assigned by the management device 3 to the logged-in age verification device 4, an age verification screen 5 shown in FIG. 3 is displayed on the display device 42 of the age verification device 4.

[0042] The operator performs age verification starting with the age verification cards 50 arranged on the left side of the age verification screen 5. In detail, the operator visually checks the user's image 51 included on the age verification card 50, and presses the OK button 52 if the user is not subject to the age restriction, and presses the NG button 53 if the user is subject to the age restriction. The control device 41 transmits the age verification result of OK or NG to the corresponding photographing device 2, and erases the age verification card 50 for which verification has been completed from the age verification screen 5. Then, the display positions of the remaining age verification cards 50 are shifted to the left.

[0043] Furthermore, if the user's image 51 shows that the user is not facing the camera 22, or is wearing a hat or mask and the user's face cannot be seen, or if it is difficult to determine the user's age, the operator presses the call button 54 included in the age verification card 50. The control device 41 transmits a call request to the corresponding photographing device 2 and activates the call device 44. This starts a call between the operator operating the age verification device 4 and the user of the photographing device 2. The call button 54 is an interrupt button that indicates the occurrence of an interruption event.

[0044] Fig. 4 is an example of a pop-up screen 6 displayed on the age verification device 4 according to the first embodiment during a call. When a call with the photographing device 2 is started, the pop-up screen 6 shown in Fig. 4 is displayed on the age verification screen 5. On the pop-up screen 6, an image 51 of a user on the age verification card 50 of the call target, an OK button 52, an NG button 53, additional information 55, and a microphone button 56 are displayed in an enlarged manner. The microphone button 56 is operated to mute or unmute the sound.

[0045] During the call, the operator requests the user to face the camera 22, remove a hat or mask, or present an identification card such as a driver's license that can be used to verify the user's age. The camera 22 then photographs the user again, and the photographed image is displayed as an image 51 on the pop-up screen 6 of the age verification device 4. The operator then visually confirms the image 51 on the pop-up screen 6 and presses the OK button 52 or the NG button 53. This causes the control device 41 to end the call with the photographing device 2 and transmit the age verification result to the photographing device 2. The pop-up screen 6 is also erased, and the age verification screen 5 returns to the state shown in FIG. 3. At this time, the age verification cards 50 for which verification has been completed are erased, and the remaining age verification cards 50 are displayed shifted to the left.

[0046] Next, the flow of the age verification process of this embodiment will be described with reference to FIG. 5. FIG. 5 is a sequence diagram showing the flow of the age verification process in the age verification system 100 according to the first embodiment. In FIG. 5, in order to distinguish between the multiple age verification devices 4, the multiple age verification devices 4 are shown as age verification devices 4a and 4b, respectively. As shown in FIG. 5, when the products registered in the self-checkout device 1 include age-restricted products such as alcoholic beverages or tobacco, the self-checkout device 1 instructs the photographing device 2 to take a photograph. When the photographing device 2 receives the photographing instruction from the self-checkout device 1, it photographs an image of the user with the camera 22 and transmits an age verification request including the image and identification information to the management device 3.

[0047] The management device 3 distributes the age verification request received from the photographing device 2 to one of the queues of the multiple logged-in age verification devices 4a and 4b. In the example of FIG. 5, the management device 3 distributes the age verification request to the age verification device 4a. The age verification device 4a displays the distributed age verification request on the display device 42 and transmits the age verification result to the photographing device 2. The photographing device 2 transfers the age verification result received from the age verification device 4a to the self-checkout device 1, and the self-checkout device 1 performs a payment process according to the received age verification result. The age verification device 4a may transmit the age verification result to the management device 3, and the management device 3 may transmit it to the photographing device 2.

[0048] In addition, when an interruption event of age verification occurs in the age verification device 4a, the age verification request distributed to the queue of the age verification device 4a is returned to the management device 3. The interruption event is, for example, when the call button 54 included in the age verification card 50 is pressed in the age verification device 4a, and a call with the photographing device 2 is instructed. In this case, the management device 3 redistributes the age verification request returned from the age verification device 4a that performs the call to the age verification device 4b other than the return source age verification device 4a. This prevents the waiting time of other age verification requests stored in the queue of the age verification device 4a from becoming long due to an interruption event such as a call. The age verification device 4b displays the redistributed age verification request on the display device 42 and transmits the age verification result to the photographing device 2. The photographing device 2 transfers the age verification result received from the age verification device 4b to the self-checkout device 1, and the self-checkout device 1 performs the payment process according to the received age verification result.

[0049] Next, specific operations in the age verification process of each device in the age verification system 100 will be described. Fig. 6 is a flowchart showing the flow of the age verification process in the self-checkout device 1 according to the first embodiment. First, a user registers an item using the self-checkout device 1 (S11). Here, the user holds the barcode of the item over the reading device 14, which reads the barcode, and the control device 11 registers the item. Information on the registered item (such as the item name and unit price) is displayed on the display device 12.

[0050] Then, when the registration of the products is completed and the user instructs payment, the control device 11 judges whether the products to be registered include age-restricted products (S12). If the products to be registered do not include age-restricted products (S12: NO), payment processing for the registered products is performed (S18). In the payment processing, the registered products are paid for based on the information input to the payment device 16, such as cash, credit card, prepaid card, electronic money, or barcode.

[0051] On the other hand, if the products to be registered include an age-restricted product (S12: YES), the control device 11 causes the display device 12 to display a confirmation screen for confirming whether the user is above the target age (S13). The confirmation screen is a screen including, for example, a message such as "Are you over 20 years old?" and buttons for "Yes" and "No."

[0052] If "YES" is selected on the confirmation screen, that is, if the user is over the target age (S14: YES), a shooting instruction is sent to the photographing device 2 (S15). Then, the control device 11 waits until it receives an age confirmation result from the photographing device 2 (S16: NO). When it receives the age confirmation result from the photographing device 2 (S16: YES), the control device 11 determines whether the user is subject to the age restriction based on the age confirmation result received from the photographing device 2 (S17).

[0053] If the user is not subject to the age restriction, i.e., if the operator of the age verification device 4 determines that the user is not subject to the age restriction (S17: NO), payment processing for the registered product is performed (S18). On the other hand, if the user is subject to the age restriction, i.e., if the operator of the age verification device 4 determines that the user is subject to the age restriction (S17: YES), or if "No" is selected on the confirmation screen (S14: NO), error processing is performed (S19).

[0054] In the error processing, the control device 11 causes the display device 12 to display an error screen, and cancels the registration of the age-restricted product. The error screen is a screen including a message notifying the user that the age-restricted product cannot be purchased, and that the age-restricted product should be returned to its designated position. The control device 11 may also call a store clerk in the error processing. Once the registration of the age-restricted product has been cancelled and the age-restricted product has been returned to its designated position by the error processing, the process proceeds to step S18, and payment processing is performed for products other than the age-restricted product.

[0055] 7 is a flowchart showing the flow of age verification processing in the photographing device 2 according to the first embodiment. When the photographing device 2 has not received a photographing instruction from the self-checkout device 1 (S21: NO), the photographing device 2 waits in a sleep state. When the photographing instruction is received from the self-checkout device 1 (S21: YES), the control device 21 starts up the camera 22 and photographs the user (S22). The control device 21 then transmits an age verification request including an image of the user generated by the camera 22 and identification information of the photographing device 2 to the management device 3 (S23).

[0056] The control device 21 judges whether or not an age verification result has been received from the age verification device 4 (S24), and if an age verification result has been received from the age verification device 4 (S24: YES), the control device 21 transmits the received age verification result to the self-checkout device 1 (S25). If an age verification result has not been received from the age verification device 4 (S24: NO), the control device 21 judges whether or not a call request has been received from the age verification device 4 (S26).

[0057] If a call request is received from the age verification device 4 (S26: YES), the communication device 23 is started and a call with the age verification device 4 is established (S27). If a call request is not received from the age verification device 4 (S26: NO) or if the call is ended, the process returns to step S24. After transmitting the age verification result to the self-checkout device 1, the photographing device 2 goes into a sleep state until a photographing instruction is received.

[0058] 8 is a flowchart showing the flow of age verification processing in the management device 3 according to the embodiment 1. When the management device 3 does not receive an age verification request from the photographing device 2 (S31: NO), the management device 3 proceeds to step S33. Then, when the management device 3 receives an age verification request from the photographing device 2 (S31: YES), the control device 31 distributes the received age verification request to any one of the multiple age verification devices 4 that are logged in (S32).

[0059] Then, the control device 31 judges whether or not an age confirmation request has been returned from the age confirmation device 4 (S33). The age confirmation request is returned to the management device 3 when an interruption occurs in the age confirmation device 4. When an age confirmation request is returned from the age confirmation device 4 (S33: YES), the control device 31 redistributes the returned age confirmation request to logged-in age confirmation devices 4 other than the return source age confirmation device 4 (S34). At this time, the control device 31 compares the reception date and time of the returned age confirmation request with the reception date and time of the age confirmation request stored in the queue of the redistribution destination age confirmation device 4, and interrupts the returned age confirmation request in each queue so that the reception date and time of the age confirmation request in the queue is processed in order of the oldest. When an age confirmation request has not been returned from the age confirmation device 4 (S33: NO) and when the redistribution of the returned age confirmation request is completed, the control device 31 returns to step S31 and repeats the subsequent processing.

[0060] FIG. 9 is a flowchart showing the flow of age verification processing in the age verification device 4 according to the first embodiment. After logging in, the control device 41 of the age verification device 4 judges whether there is an age verification request distributed to the queue of the device itself (S41). If there is no age verification request in the queue of the device itself (S41: NO), the device waits until an age verification request is distributed. If there is an age verification request in the queue of the device itself (S41: YES), the age verification card 50 corresponding to the age verification request distributed to the queue is displayed on the age verification screen 5 of the display device 42 (S42). At this time, the age verification device 4 may output a notification sound to attract the operator's attention. The age verification request displayed on the age verification screen 5 is deleted from the queue.

[0061] Then, it is determined whether the operator has input a confirmation result of OK or NG on the age verification card 50 (S43). If OK or NG has been input on the age verification screen 5 (S43: YES), the control device 41 transmits the input age verification result to the photographing device 2 which is the sender of the corresponding age verification request (S44). Then, the age verification card 50 corresponding to the age verification request for which age verification has been completed is deleted from the age verification screen 5 (S45), and the process returns to step S41. Note that the age verification request may be deleted from the queue when the age verification result is transmitted.

[0062] On the other hand, if the operator has not input OK or NG on the age verification card 50 (S43: NO), the control device 41 judges whether or not a call instruction has been input (S46). If a call instruction has not been input on the age verification screen 5 (S46: NO), the process returns to step S43. On the other hand, if a call instruction has been input on the age verification screen 5 (S46: YES), the control device 41 returns to the management device 3 the age verification requests corresponding to the age verification cards 50 displayed on the age verification screen 5 other than the age verification request that is the target of the call, and the age verification requests remaining in the queue (S47).

[0063] Then, the control device 41 transmits a call request to the photographing device 2 that is the sender of the age verification request that is the target of the call (S48). Then, the control device 41 starts the communication device 44 to carry out a call with the target photographing device 2 (S49). After that, the process returns to step S43 and the subsequent processes are repeated.

[0064] As described above, in the age verification system 100 of this embodiment, the management device 3 distributes age verification requests to multiple age verification devices 4. This allows the remote age verification device 4 to process age verification requests from multiple stores in a batch. In addition, if an interruption such as a call occurs in the age verification device 4, the distributed age verification requests are returned to the management device 3, and the age verification requests returned from the management device 3 to age verification devices 4 that have not experienced an interruption are redistributed. This allows the processing to be appropriately distributed to multiple age verification devices 4 even if the number of age verification requests increases, and age verification can be performed efficiently. As a result, the waiting time of the user can be reduced and convenience can be improved.

[0065] In addition, the interruption reason for returning the age verification request to the management device 3 in the age verification device 4 is not limited to a call. For example, when a temporary interruption occurs such as when the age verification device 4 logs out or enters a sleep mode, the control device 41 returns the age verification requests corresponding to all age verification cards 50 displayed on the age verification screen 5 and all age verification requests remaining in the queue to the management device 3, and the management device 3 redistributes these to other age verification devices 4. In this case, the button operated to log out or enter the sleep mode becomes the interrupt button. Alternatively, if the age verification request is not processed for a predetermined time (for example, 10 seconds) or more after being distributed to the queue of the age verification device 4, it may be returned to the management device 3 as an interruption reason.

[0066] Embodiment 2 A description will be given of the second embodiment. The age verification system 100 of the second embodiment differs from the first embodiment in that age verification is performed based on images captured by a plurality of image capture devices 2. The differences from the first embodiment will be described below.

[0067] FIG. 10 is a diagram showing an example of the installation state of the photographing device 2. FIG. 10 is a plan view of the cash register space of a store seen from above. As shown in FIG. 10, six self-checkout devices 1a to 1f and photographing devices 2a to 2f are arranged in two rows of three devices each facing each other in the cash register space. In this case, the figure of a user P using the self-checkout device 1b can be photographed not only by the photographing device 2b but also by the photographing devices 2e and 2f located behind the user P. In addition, the photographing devices 2e and 2f can photograph the image of the user P at an angle different from that of the photographing device 2b. Therefore, in the age verification system 100 of this embodiment, age verification is performed using multiple images of the user P photographed at different angles (for example, an image photographed by the photographing device 2b and images photographed by the surrounding photographing devices 2e and 2f).

[0068] 11 is a flowchart showing the flow of age verification processing in the photographing device 2 according to the embodiment 2. As in the embodiment 1, the photographing device 2 waits until it receives a photographing instruction from the self-checkout device 1 (S201: NO). Then, when it receives a photographing instruction from the self-checkout device 1 (S201: YES), the control device 21 starts up the camera 22 and photographs the user (S202).

[0069] The control device 21 also transfers a photographing instruction to at least one photographing device 2 installed in the vicinity (S203) and receives an image of the user from at least one photographing device 2 installed in the vicinity (S204). In the example of FIG. 10, when age verification of user P is required at the self-checkout device 1b, a photographing instruction is transmitted from the self-checkout device 1b to the photographing device 2b. When the photographing device 2b receives the photographing instruction from the self-checkout device 1b, it photographs user P with its own camera 22 and transfers the photographing instruction to the photographing devices 2f and 2d that are installed in the vicinity of the photographing device 2b and include user P in their photographing range. When the photographing devices 2f and 2d receive the photographing instruction from the photographing device 2b, they photograph user P with their own camera 22 and transmit the image to the photographing device 2b.

[0070] Then, the control device 21 transmits an age verification request including an image of the user captured by its own camera 22, an image received from at least one of the surrounding photographing devices 2, and the identification information to the management device 3 (S205). The following steps S206 to S209 are the same as steps S24 to S27 in the first embodiment.

[0071] Fig. 12 is an example of an age verification screen 5A displayed on the age verification device 4 according to the embodiment 2. As shown in Fig. 12, an age verification card 50A displayed on the age verification screen 5A of the present embodiment includes a user's image 51, an OK button 52, an NG button 53, a call button 54, additional information 55, and an image change button 57.

[0072] The operator performing age verification visually checks the image 51 of the user displayed on the age verification screen 5A, and if the displayed image is unclear, presses the image change button 57. In this case, the control device 41 of the age verification device 4 displays the image of the user photographed by the nearby photographing device 2 and included in the age verification request as the image 51 of the user on the age verification card 50A. Each time the image change button 57 is pressed, the control device 41 displays the multiple images included in the age verification request in order.

[0073] As described above, in the age verification system 100 of this embodiment, in addition to the effects of embodiment 1, images of the user taken from multiple different angles can be used to assist the operator in verifying the age, thereby further improving the efficiency of age verification.

[0074] In the above-mentioned second embodiment, the image is acquired from the camera 2 in the vicinity of the camera 2 that received the shooting instruction, but the present invention is not limited to this. For example, an image captured by a camera for a different purpose, such as a security camera installed in a store, may be transmitted to the management device 3 together with the age verification request and displayed on the age verification screen 5A of the age verification device 4.

[0075] The above is a description of the embodiment of the present invention, but the above embodiment can be modified and combined as appropriate. For example, all or part of the functions of the self-checkout device 1, the photographing device 2, the management device 3, and the age verification device 4 may be provided by other devices or servers. As a specific example, the self-checkout device 1 and the photographing device 2 may be integrated, and the control device 11 of the self-checkout device 1 may control the control device 21 of the photographing device 2. In addition, in the above embodiment, the multiple photographing devices 2 are each configured to have a communication device 24, but a communication device that performs two-way communication between the multiple photographing devices 2 and the management device 3 may be provided separately. In addition, the multiple age verification devices 4 may be owned by employees of the store where the self-checkout device 1 and the photographing device 2 are installed.

[0076] Furthermore, the method of distributing age verification requests to multiple age verification devices 4 by the management device 3 is not limited to the example of the above embodiment. For example, the management device 3 may calculate an evaluation value or a predicted verification time according to the registration information of the user to be age verified, past purchase data, or the number of past age verifications, and may allocate the evaluation values ​​or predicted verification times of the age verification requests stored in the queues of each age verification device 4 so that the total values ​​are equal.

[0077] For example, if the age in the user's registration information is 20 years or older, the evaluation value is set higher or the prediction time is set shorter than when the age is under 20. Furthermore, if the user has purchased age-restricted products in the past, the evaluation value is set higher or the prediction time is set shorter than when the user has not purchased age-restricted products in the past. Furthermore, if the user has been verified many times in the past, the evaluation value is set higher or the prediction time is set shorter than when the number of age verifications in the past is zero or few.

[0078] The above modification is applied to cases where a user using the self-checkout device 1 can be identified, for example, by reading a prepaid card or a membership card when using the self-checkout device 1, and where registration information including the user's age, past purchase data, and the number of times of past age confirmation are stored in advance in the management device 3 or another management server. Then, when an age confirmation request is transmitted from the photographing device 2, the photographing device 2 transmits the user's identification information to the management device 3, and the management device 3 acquires the registration information, past purchase data, or the number of times of past age confirmation based on the user's identification information. Alternatively, when an age confirmation request is transmitted from the photographing device 2, the self-checkout device 1 or the photographing device 2 may acquire the user's registration information, past purchase data, or the number of times of past age confirmation from the management server, and transmit them to the management device 3.

[0079] Alternatively, the management device 3 may obtain an evaluation value or a predicted confirmation time according to the reliability of the face area of ​​the image included in the age confirmation request, and may allocate the evaluation value or predicted confirmation time of the age confirmation request stored in the queue of each age confirmation device 4 so that the total value of the evaluation value or predicted confirmation time of the age confirmation request stored in the queue of each age confirmation device 4 is equal. The reliability of the face area is determined according to how correctly key features such as eyes, nose, and mouth are recognized. When the reliability of the face area is low, the face is difficult for the operator to recognize, so the evaluation value is set low or the predicted time is set long compared to when the reliability of the face area is high. Alternatively, the management device 3 may analyze the image included in the age confirmation request, and when the size of the face included in the image is small, the management device 3 may allocate the age confirmation request to the age confirmation device 4 with the highest performance among the multiple age confirmation devices 4. This allows the image processing when enlarging and displaying on the age confirmation screen 5 to be performed quickly.

[0080] Alternatively, the management device 3 may estimate the user's age from the image included in the age verification request using a trained model, and obtain an evaluation value or a predicted verification time. The trained model used here is a model trained by deep learning or the like, and calculates features such as skin color or wrinkles from a face image to estimate the age. For example, if the trained model estimates that the user is clearly over 50 years old, the evaluation value is set higher or the predicted time is set shorter than if the user is clearly estimated to be a child.

[0081] Furthermore, the age verification screen 5 displayed on the age verification device 4 is not limited to the example of the above embodiment. For example, the number of times the user has been verified in the past or an estimated age value may be displayed as the additional information 55. The estimated age value is obtained by analyzing an image included in the age verification request in the age verification device 4 or the management device 3.

[0082] In addition, the age verification device 4 or the management device 3 may store an image previously used for age verification together with the user's identification information, and the image previously used for age verification may be displayed as a supporting image on the age verification card 50. Alternatively, if the user has previously provided proof of age at a store, such as by registering for face recognition, the registered image from that time may be obtained from the management device 3 or an external management server and displayed on the age verification card 50 as a supporting image.

[0083] In addition, an evaluation value may be calculated based on the registration information of the user who requires age verification, past purchase data, or the number of past age verifications, and the display of each age verification card 50 may be changed according to the evaluation value. For example, the color of cards with high evaluation values ​​may be changed to make them stand out, allowing the operator to verify the card more quickly. This allows age verification to be performed more efficiently.

[0084] The layout of the buttons on the age verification card 50 is not limited to the examples in Fig. 3 and Fig. 11, and may be changed to make it easier for the operator to operate. A detailed information button may be provided on the age verification card 50, and detailed information such as the identification information of the corresponding photographing device 2 and self-checkout device 1 may be displayed when the button is operated. The number of age verification requests remaining in the queue of the device itself may be displayed on the age verification screen 5. [Explanation of symbols]

[0085] 1, 1a-1f self-checkout device, 2, 2a-2f photographing device, 3 management device, 4, 4a, 4b age verification device, 5, 5A age verification screen, 6 pop-up screen, 11, 21, 31, 41 control device, 12, 42 display device, 13, 43 operation device, 14 reading device, 15 printing device, 16 payment device, 17, 24, 32, 45 communication device, 22 camera, 23, 44 calling device, 50, 50A age verification card, 51 image, 52 OK button, 53 NG button, 54 calling button, 55 additional information, 56 microphone button, 57 image change button, 100 age verification system, 200 network.

Claims

1. a plurality of image capture devices for capturing images of users and transmitting an age verification request including the images of the users; A plurality of age verification devices for verifying the age of the user; a management device that receives the age verification request from the photographing device and distributes the received age verification request to any one of the plurality of age verification devices; When an interruption event occurs, the age verification device returns the distributed age verification request to the management device; The management device redistributes the age verification request returned from the age verification device to an age verification device other than the age verification device that returned the request.

2. The age verification device includes: a display device that displays an age verification screen; an operation device for inputting an age verification result; The age verification screen is an image of the user included in the age verification request; a confirmation result button for inputting the age confirmation result; 2. The age verification system according to claim 1, further comprising an interrupt button for indicating the occurrence of the interruption event.

3. The age verification system described in claim 2, wherein when the interrupt button is operated, the age verification device determines that an interruption event has occurred and returns to the management device the age verification requests distributed, other than the age verification request of the call target.

4. the interrupt button is a call button for calling the user, When the call button is operated, the age verification device transmits a call request to the photographing device which is a sender of the age verification request of the call target; 4. The age verification system according to claim 2, wherein a telephone call is carried out between the age verification device and the photographing device.

5. An age verification system as described in any one of claims 1 to 3, wherein the management device distributes the age verification request based on at least one of the age, past purchasing data, and number of past age verifications contained in the user's registration information.

6. An age verification system as described in any one of claims 1 to 3, wherein the management device redistributes the returned age verification request to another age verification device based on the date and time of receipt of the returned age verification request.

7. the age verification request includes a plurality of images of the user taken by a plurality of the image capture devices; 4. The age verification system according to claim 1, wherein the age verification device selectively displays the plurality of images.

Images