SALES SYSTEM, SALES SUPPORT DEVICE, SALES SUPPORT METHOD, AND PROGRAM

Abstract

A sales support device (100) is provided with an age estimation unit (102), an age confirmation unit (104), a processing unit (106), and a storage device (200). The age estimation unit (102) acquires a face image by capturing an image of the face of a person in front of equipment (7) in which specific products (22) are displayed, and executes age estimation for the person by using the face image. When the result of the age estimation by the age estimation unit (102) does not satisfy a criterion, the age confirmation unit (104) requests the person to present age certification information, and determines whether the acquired age certification information satisfies the criterion. When the result of the determination by the age confirmation unit (104) satisfies the criterion, the processing unit (106) allows the specific products (22) to be taken out of the equipment (7), and registers the face image as a master face image, together with the age certification information, in the storage device (200) for subsequent occasions of authentication.

Description

[Technical field]

[0001] The present invention relates to a sales system, a sales support device, a sales support method, and a program. [Background technology]

[0002] It is known that in unmanned or staff-limited stores that sell products with age restrictions, such as alcohol and tobacco, the age of a customer is estimated from a facial image, and then the customer's identity is verified.

[0003] Patent document 1 describes a sales support system that, when a barcode of an age-restricted product is read at a POS (Point Of Sales) register, estimates a customer's age using the customer's biometric information, and if the estimated age is below a specified age, scans the customer's ID card to obtain the customer's actual age and determine the customer's age.

[0004] Patent document 2 describes how, when a visitor is detected at a product exchange booth, an image captured by a camera is sent to a centralized sales center to verify the visitor's age, after which the visitor is allowed to purchase age-restricted products. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] International Publication No. 2017 / 046995 [Patent Document 2] JP 2008-171083 A Summary of the Invention [Problem to be solved by the invention]

[0006] On the other hand, in unmanned or staff-limited stores, customers cannot freely remove fixtures that hold age-restricted products, which reduces customer convenience.

[0007] The present invention has been made in consideration of the above circumstances, and an object of the present invention is to improve convenience for customers when a specific product is sold in an unmanned or manned-less store. [Means for solving the problem]

[0008] In order to solve the above-mentioned problems, each aspect of the present invention employs the following configuration.

[0009] The first aspect relates to a sales support device. A first sales support device according to a first aspect of the present invention comprises: The apparatus includes an age estimation means, an age verification means, a processing means, and a storage means, The age estimation means acquires a facial image of a person in front of a display unit on which a specific product is displayed, and estimates the age of the person using the facial image. the age verification means, when the result of the age estimation by the age estimation means does not satisfy a standard, requests age verification information from the person and judges whether the obtained age verification information satisfies a standard; When the result of the judgment by the age verification means meets a standard, the processing means enables the specific product to be removed from the fixture, and registers the facial image as a master facial image together with the age proof information in the memory means for subsequent authentication.

[0010] A second sales support device according to the first aspect includes: The apparatus includes an age estimation means, a processing means, a comparison means, and a storage means, The age estimation means acquires a facial image of a person when the person enters the store, and estimates the person's age using the facial image; the processing means registers the facial image in the storage means as a master facial image in a state in which it is possible to specify whether or not the result of the age estimation satisfies a standard; the matching means acquires a face image to be matched by capturing an image of the face of the person standing in front of a display unit on which a specific commodity is displayed, and matches the face image to be matched with the master face image registered in the storage means; the processing means, when the storage means has the master face image that matches the matched face image and the result of the age estimation satisfies a criterion, enables removal of the specific product from the fixture; the age estimation means, when the matching means detects that the master face image coincides with the matched face image in the storage means, performs age estimation using the matched face image; If the result of the age estimation satisfies the criterion, the processing means enables the specific product to be removed from the fixture, and registers the facial image to be matched as the master facial image in the memory means together with the result of the age estimation.

[0011] A second aspect relates to a method of sales assistance implemented by at least one computer. A first sales support method according to a second aspect of the present invention includes: Sales support device, A facial image is acquired by capturing an image of a person's face in front of a display unit on which a specific product is being displayed, and an age estimation is performed on the person using the facial image. If the result of the age estimation does not meet the criteria, request age verification information from the person and determine whether the obtained age verification information meets the criteria; If the result of the judgment satisfies a standard, the specific product is allowed to be removed from the fixture, and the facial image is registered in a memory means as a master facial image together with the age proof information for subsequent authentication.

[0012] A second sales support method according to the second aspect includes: Sales support device, When a person enters a store, a facial image of the person is captured, and age estimation is performed using the facial image. registering the face image as a master face image in a storage means in a state in which it is possible to specify whether or not the result of the age estimation satisfies a standard; When a person stands in front of a display unit on which a specific commodity is displayed, a face image to be matched is acquired by capturing an image of the face of the person in front of the display unit, and the face image is matched with the master face image registered in the storage means; When the storage means contains the master face image that matches the matched face image and the result of the age estimation satisfies a standard, the specific product can be taken out from the fixture; When the storage means does not contain the master face image that matches the subject face image, age estimation is performed using the subject face image; If the result of the age estimation satisfies the criterion, the specific product can be removed from the fixture, and the facial image to be matched is registered as the master facial image in the memory means together with the result of the age estimation.

[0013] The third aspect concerns the sales system. A first sales system according to the third aspect of the present invention comprises: Fixtures for displaying specific products; A sales support device, The sales support device includes: The apparatus includes an age estimation means, an age verification means, a processing means, and a storage means, The age estimation means acquires a facial image of a person standing in front of a display unit on which a specific product is displayed, and estimates the age of the person using the facial image. the age verification means, when the result of the age estimation by the age estimation means does not satisfy a standard, requests age verification information from the person and judges whether the obtained age verification information satisfies a standard; When the result of the judgment by the age verification means meets a standard, the processing means enables the specific product to be removed from the fixture, and registers the facial image as a master facial image together with the age proof information in the memory means for subsequent authentication.

[0014] The second sales system relating to the third aspect is Fixtures for displaying specific products; A sales support device, The sales support device includes: The apparatus includes an age estimation means, a processing means, a comparison means, and a storage means, The age estimation means acquires a facial image of a person when the person enters the store, and estimates the person's age using the facial image; the processing means registers the facial image in the storage means as a master facial image in a state in which it is possible to specify whether or not the result of the age estimation satisfies a standard; the matching means acquires a face image to be matched by capturing an image of the face of the person standing in front of a display unit on which a specific commodity is displayed, and matches the face image to be matched with the master face image registered in the storage means; the processing means, when the storage means has the master face image that matches the matched face image and the result of the age estimation satisfies a criterion, enables removal of the specific product from the fixture; the age estimation means, when the matching means detects that the master face image coincides with the matched face image in the storage means, performs age estimation using the matched face image; If the result of the age estimation satisfies the criterion, the processing means enables the specific product to be removed from the fixture, and registers the facial image to be matched as the master facial image in the memory means together with the result of the age estimation.

[0015] Another aspect of the present invention may be a program for causing at least one computer to execute the method of the second aspect, or a computer-readable recording medium having such a program recorded thereon. This recording medium includes a non-transitory tangible medium. The computer program includes computer program code which, when executed by a computer, causes the computer to carry out the sales support method on a sales support device.

[0016] Any combination of the above components, and any transformation of the present invention into a method, device, system, recording medium, computer program, etc., are also effective as aspects of the present invention.

[0017] Furthermore, the various components of the present invention do not necessarily have to be independent entities, but may be formed as a single member by multiple components, one component may be formed from multiple components, one component may be a part of another component, or part of one component may overlap with part of another component, etc.

[0018] In addition, although the method and computer program of the present invention describe a number of steps in a sequential order, the order does not limit the order in which the steps are executed. Therefore, when implementing the method and computer program of the present invention, the order of the steps can be changed as long as it does not affect the content.

[0019] Furthermore, the steps of the method and computer program of the present invention are not limited to being executed at different times, and therefore a step may occur while another step is being executed, or the execution timing of a step may overlap partially or entirely with the execution timing of another step, etc. Effect of the Invention

[0020] According to each of the above aspects, it is possible to improve convenience for customers when a specific product is sold in an unmanned or staff-reduced store. [Brief description of the drawings]

[0021] [Figure 1] 1 is a diagram conceptually illustrating a system configuration of a sales system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram illustrating a hardware configuration of a computer that realizes the sales support device. [Diagram 3] 1 is a functional block diagram logically illustrating a configuration of a sales support device according to an embodiment; [Figure 4] FIG. 11 is a diagram illustrating an example of a data structure of authentication information. [Diagram 5] 4 is a flowchart showing an example of the operation of the sales support device according to the embodiment. [Figure 6] 6 is a flowchart showing an example of a subsequent process of FIG. 5. [Figure 7] 1 is a functional block diagram illustrating an example of a logical configuration of a sales support device according to an embodiment. [Figure 8] FIG. 11 is a diagram showing an example of a data structure of age estimation result information. [Figure 9] 4 is a flowchart showing an example of an operation of the sales support device according to the embodiment. [Figure 10] 4 is a flowchart showing an example of an operation of the sales support device according to the embodiment. [Figure 11] 1 is a functional block diagram illustrating an example of a logical configuration of a sales support device according to an embodiment. [Figure 12] 4 is a flowchart showing an example of an operation of the sales support device according to the embodiment. [Figure 13] FIG. 1 is a diagram conceptually illustrating a system configuration of a sales system according to an embodiment. [Figure 14] 4 is a flowchart showing an example of an operation of the sales support device according to the embodiment. [Figure 15] 4 is a flowchart showing an example of the operation of the sales support device according to the embodiment. [Figure 16] 4 is a flowchart showing an example of the operation of the sales support device according to the embodiment. [Figure 17] 13 is a flowchart showing an example of an operation of a procedure for acquiring age certification information. [Figure 18] FIG. 13 is a diagram for explaining a method of acquiring age certification information using an identification card. [Figure 19] FIG. 13 is a diagram for explaining a method of opening and closing a door of a fixture using a barcode. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are given the same reference numerals, and the description will be omitted as appropriate. In the following drawings, the configuration of the parts that are not related to the essence of the present invention is omitted and is not shown.

[0023] In the embodiment, "acquisition" includes at least one of the following: a device goes to retrieve data or information stored in another device or storage medium (active acquisition), and inputs data or information output from another device to the device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a reply, and accessing and reading information from another device or storage medium. Examples of passive acquisition include receiving information that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.

[0024] (First embodiment) <System Overview> FIG. 1 is a diagram conceptually showing a system configuration of a sales system 1 according to an embodiment of the present invention. The sales system 1 includes a sales support device 100, a storage device 200, and a camera 5. It is assumed that the store 10 is unmanned or operates with few staff. An unmanned or staff-less operation also includes a situation where the store is operated by a single clerk. The store 10 is equipped with fixtures 7 on which products 20 are displayed. Furthermore, specific products 22, such as alcohol and tobacco, that are subject to age restrictions, are also displayed on the fixtures 7.

[0025] The storage device 200 is connected to the sales support device 100 via the communication network 3. However, the storage device 200 may be a device included inside the sales support device 100, or may be a device separate from the sales support device 100, or may be a combination of these.

[0026] The fixture 7 on which the specific product 22 is displayed has, for example, a door, and is designed to prevent the customer C from freely taking out the specific product 22. For example, the door may be controlled by the sales support device 100 so as not to open, or the door may be locked by a key that restricts the door from being opened or closed, or the specific product 22 may be held by a mechanism that holds the specific product 22 so as not to be taken out.

[0027] The sales system 1 further communicates with a mobile terminal 30. The mobile terminal 30 is, for example, a smartphone or a tablet terminal. The mobile terminal 30 may be owned by the customer C, or may be prepared in the store 10 and lent to the customer C. A specific application is installed in the mobile terminal 30. The specific application has a function of taking a picture of the face and identification card of the customer C with the camera of the mobile terminal 30 and transmitting the image to the sales support device 100. The sales system 1 may include the mobile terminal 30.

[0028] The camera 5 photographs the customer C and generates an image. The camera 5 includes an imaging element such as a lens and a CCD (Charge Coupled Device) image sensor. The camera 5 may include a mechanism for controlling the orientation of the camera body and lens, zoom control, focusing, etc., by tracking the movement of a person entering the field of view.

[0029] The images generated by the camera 5 are preferably taken in real time and transmitted to the sales support device 100 via the communication network 3. However, the images transmitted to the sales support device 100 do not have to be transmitted directly from the camera 5, and may be images delayed by a predetermined time. The images taken by the camera 5 may be temporarily stored in another storage device, and the sales support device 100 may read them out from the storage device sequentially or at predetermined intervals. Furthermore, the images transmitted to the sales support device 100 are preferably moving images, but may be frame images at predetermined intervals or still images.

[0030] <Hardware configuration example> 2 is a block diagram illustrating a hardware configuration of a computer 1000 that realizes the sales support device 100. The mobile terminal 30 in FIG.

[0031] The computer 1000 has a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0032] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to a bus connection.

[0033] The processor 1020 is implemented by a central processing unit (CPU) or a graphics processing unit (GPU).

[0034] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0035] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like. The storage device 1040 stores program modules that realize each function of the sales support device 100 (for example, an age estimation unit 102, an age verification unit 104, a processing unit 106, a matching unit 108, etc., which will be described later). The processor 1020 loads each of these program modules onto the memory 1030 and executes them, thereby realizing each function corresponding to the program module. The storage device 1040 may also store each data of the storage device 200.

[0036] The program module may be recorded in a recording medium. The recording medium for recording the program module may include a non-transitory tangible medium usable by the computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.

[0037] The input / output interface 1050 is an interface for connecting the computer 1000 to various input / output devices. The input / output interface 1050 also functions as a communication interface for performing short-range wireless communication such as Bluetooth (registered trademark) and NFC (Near Field Communication).

[0038] The network interface 1060 is an interface for connecting the computer 1000 to a communication network. This communication network is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The method for connecting the network interface 1060 to the communication network may be a wireless connection or a wired connection.

[0039] The computer 1000 is then connected to necessary devices (eg, the mobile terminal 30, the camera 5, etc.) via the input / output interface 1050 or the network interface 1060.

[0040] The sales support device 100 includes a plurality of computers. 1000 or may be realized by a virtual server. <Example of functional configuration> Fig. 3 is a functional block diagram logically showing the configuration of sales support device 100 of this embodiment. Each component of sales support device 100 of this embodiment shown in Fig. 3 is realized by any combination of hardware and software of computer 1000 shown in Fig. 2. Those skilled in the art will understand that there are various variations in the realization method and device. The functional block diagram showing sales support device 100 of each embodiment described below shows logical functional blocks rather than a hardware-based configuration.

[0041] The sales support device 100 includes an age estimation unit 102, an age verification unit 104, a processing unit 106, and a storage device 200. The age estimation unit 102 acquires a facial image of a person (e.g., customer C) in front of the fixture 7 on which the specific product 22 is displayed, and performs age estimation of the person (customer C) using the facial image. If the result of age estimation by the age estimation unit 102 does not satisfy a standard, the age verification unit 104 requests age certification information from the person, and judges whether the acquired age certification information satisfies the standard. If the result of judgment by the age verification unit 104 satisfies the standard, the processing unit 106 enables removal of the specific product 22 from the fixture 7, and registers the facial image as a master facial image in the storage device 200 together with the age certification information for subsequent authentication.

[0042] The age estimation unit 102 acquires a facial image of the customer C captured by the camera 5, transmits the facial image to an image analysis device (not shown) to execute age estimation, and receives the estimation result from the image analysis device.

[0043] The age estimated by the age estimation unit 102 may have a range. For example, it may be an age range such as 16 to 19 years old or 20 to 30 years old, or it may be a specific numerical value such as 18 years old or 35 years old.

[0044] The "standard" used by the age verification unit 104 for the judgment is, for example, an age above which the sale of the specific product 22 is not permitted as a result of the age estimation, for example, "20 years old or older." Depending on the type of specific product 22 and the sales region, the "standard" may vary, such as "21 years old or older," "18 years old or older," "3 years old or older," and the "standard" may be changeable by accepting appropriate settings. The "standard" may be set for each type of specific product 22.

[0045] The age certification information includes, for example, various information read from a photo ID such as a driver's license or a My Number card of the customer C. The age verification unit 104, for example, photographs the ID of the customer C using the camera 5 or the mobile terminal 30 to obtain an image of the ID. As described above, an application is pre-installed on the mobile terminal 30, and the application is started. The application allows the customer C to take a photo with the camera of the mobile terminal 30, and the generated image may be transmitted from the mobile terminal 30 to the sales support device 100.

[0046] The age certification information may be an image generated by photographing an identification card. The age certification information may include a facial photograph of the customer C extracted from the image or feature amounts extracted from the facial photograph of the customer C. Furthermore, the age certification information may include the date of birth of the customer C read from the image by an OCR (Optical Character Reader) or the like. Alternatively, the age certification information may include the age calculated from the date of birth of the customer C, or information indicating whether the age of the customer C is an age at which the sale of the specific product 22 can be permitted.

[0047] In the processing unit 106, "enabling the removal of a specific product 22 from the fixture 7" may mean that the door of the fixture 7 is controlled by the sales support device 100 to open, or that a door that is locked with a key that restricts the opening and closing of the door is unlocked, or that the mechanism holding the specific product 22 is released from its grip.

[0048] 4 is a diagram showing an example of the data structure of the authentication information 210. The authentication information 210 associates at least a face image and age certification information of the customer C. Furthermore, the authentication information 210 may associate a date and time. The associated date and time is, for example, at least one of the date and time when the customer C visits the store, the date and time when the face image of the customer C is captured, the date and time when the age certification information is acquired, and the date and time when the record of the authentication information 210 is stored in the storage device 200.

[0049] The facial image registered in the authentication information 210 may be facial feature amounts. The master facial image is registered in the storage device 200 by the processing unit 106 for the next and subsequent authentications by the age verification unit 104. The next time refers to the time when the customer C is allowed to take out the specific product 22 from the fixture 7 once, has taken out the specific product 22, and then tries to take out the specific product 22 from the fixture 7 again.

[0050] However, after the specific product 22 becomes available for removal, for example, the door of the fixture 7 may be unlocked and opened in order to remove the specific product 22 from the fixture 7, without actually removing the specific product 22. In other words, it may be the case that, after the door is unlocked, customer C opens the door of the fixture 7 to look at the product, but decides not to purchase the specific product 22, closes the door without removing the specific product 22 from the fixture 7, and then the door is locked. If customer C subsequently attempts to remove the specific product 22 from the fixture 7 again, authentication is required.

[0051] In addition, during the period from the next purchase to the next purchase, customer C may be outside the store or may remain in the store. This may be after the payment process for other products has been completed, or before the payment process has been completed.

[0052] <Example of operation> FIG. 5 is a flowchart showing an example of the operation of the sales support device 100 of this embodiment. The age estimation unit 102 acquires a facial image of a person (e.g., customer C) in front of the fixture 7 on which the specific product 22 is displayed (step S101). The age verification unit 104 executes age estimation of the person (customer C) using the facial image (step S103). If the result of age estimation by the age estimation unit 102 does not satisfy the criteria (NO in step S105), the age verification unit 104 requests age certification information from the person (step S107) and judges whether the acquired age certification information satisfies the criteria (step S109). If the result of the judgment by the age verification unit 104 satisfies the criteria (YES in step S109), the processing unit 106 enables the removal of the specific product 22 from the fixture 7 (step S111) and registers the facial image as a master facial image together with the age certification information in the storage device 200 for the next and subsequent authentication (step S113). Then, this process ends.

[0053] On the other hand, if the result of age estimation by the age estimation unit 102 in step S105 meets the criteria (YES in step S105), the process proceeds to step S111. If the result of the determination by the age verification unit 104 in step S109 does not meet the criteria (NO in step S109), steps S111 and S113 are bypassed and the process ends. In other words, if the estimated age in step S109 does not meet the criteria (NO in step S109), the customer C cannot take out the specific product 22 from the fixture 7.

[0054] In the process of step S103, for example, when customer C stands in front of the fixture 7 displaying the specific product 22, the camera 5 automatically starts taking pictures and performs age estimation. In other words, customer C is not aware that age estimation processing is being performed. However, the camera 5 does not start taking pictures when a person stands in front of the fixture 7, but may constantly take pictures of the range in which a person standing in front of the fixture 7 can be photographed.

[0055] The front of the fixture 7 includes a place where customer C can see the specific product 22 displayed on the fixture 7, a place where customer C can approach and stand near the fixture 7 in order to remove the specific product 22 from the fixture 7, and a place where operations can be performed to remove the specific product 22 from the fixture 7.

[0056] According to this embodiment, when the result of age estimation by the age estimation unit 102 meets the standard, the specific product 22 can be taken out from the fixture 7, improving the convenience of the customer when selling the specific product in an unmanned or labor-saving store. Furthermore, when the result of age estimation by the age estimation unit 102 does not meet the standard, age verification information is requested from the customer C, and age confirmation is performed, so that the sale of the specific product 22 can be performed appropriately. Furthermore, the processing unit 106 registers the face image of the customer C who has become able to take out the specific product 22 as a master face image in the storage device 200. Therefore, when the customer C stands in front of the fixture 7 again and tries to take out the specific product 22, the master face image has already been saved, so that the next authentication process can be omitted. This further improves the convenience of the customer C.

[0057] Second embodiment The sales support device 100 of this embodiment is similar to the above-mentioned embodiments, except that it has a configuration that eliminates the need for customer C to undergo age verification procedures when attempting to remove a specific product 22 from the fixture 7 again after the specific product 22 has already been removed from the fixture 7. The following description will be given using the functional block diagram of FIG. 3 of the first embodiment. However, the configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0058] <Example of functional configuration> If the result of the age estimation does not satisfy the criteria, the processing unit 106 accesses the storage device 200, and if a master face image matching the face image is registered together with age verification information, enables removal of a specific product 22 from the fixture 7.

[0059] <Example of operation> FIG. 6 is a flowchart showing an example of processing to be performed when it is determined in step S105 of FIG. 5 that the result of age estimation does not satisfy the criteria. In step S105 of FIG. 5, if the result of age estimation does not satisfy the criteria (NO in step S105), the processing unit 106 accesses the storage device 200 (step S121 in FIG. 6). Then, if a master face image that matches the face image is registered together with the age certification information (YES in step S123), the processing unit 106 proceeds to step S111 of FIG. 5 and enables removal of the specific product 22 from the fixture 7 (step S111). That is, the authentication process of the age certification information in steps S107 to S109 can be bypassed. In this case, step S113 following step S111 may be omitted to end the process.

[0060] On the other hand, if a master face image that matches the face image is not registered together with the age certification information (NO in step S123), the processing unit 106 proceeds to step S107 in Fig. 5 and requests age certification information from the customer C. The subsequent processing is the same as in the first embodiment.

[0061] In steps S107 to S109, for example, customer C needs to take out his / her identification card, take a picture of the identification card using the mobile terminal 30, and transmit the picture to the sales support device 100. This is a cumbersome task for customer C.

[0062] According to this embodiment, the same effects as those of the above embodiment are achieved, and in the case where a master face image has already been registered in the storage device 200, the processing unit 106 enables removal of a specific product 22 from the fixture 7 without requesting age verification information, thereby eliminating the need for cumbersome procedures and improving convenience for customer C.

[0063] Third embodiment <Example of functional configuration> 7 is a functional block diagram showing an example of a logical configuration of a sales support device 100 according to an embodiment of the present invention. In the above embodiment, when a customer C stands in front of a fixture 7 on which a specific product 22 is displayed, age estimation of the customer C is performed. The sales support device 100 of this embodiment differs from the above embodiment in that age estimation is also performed when the customer C enters the store 10. However, the sales support device 100 of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0064] The sales support device 100 includes an age estimation unit 102 , a processing unit 106 , a matching unit 108 , and a storage device 200 . When a person enters the store, the age estimation unit 102 acquires a facial image of the person's face, and performs age estimation using the facial image. The processing unit 106 registers the facial image as a master facial image in the storage device 200 in a state in which it is possible to specify whether the result of age estimation satisfies a criterion. The matching unit 108 acquires a matched facial image of the face of the person in front of the fixture 7 when the person stands in front of the fixture 7 on which the specific product 22 is displayed, and matches the matched facial image with the master facial image registered in the storage device 200. When the storage device 200 contains a master facial image that matches the matched facial image and the estimated age satisfies the criterion, the processing unit 106 enables the specific product 22 to be taken out from the fixture 7. When the matching unit 108 finds that the storage device 200 does not contain a master facial image that matches the matched facial image, the age estimation unit 102 performs age estimation using the matched facial image. If the result of the age estimation satisfies the criteria, the processing unit 106 enables removal of the specific product 22 from the fixture 7, and registers the face image to be matched as a master face image in the storage device 200 together with the result of the age estimation.

[0065] In this embodiment, a camera 5 may be installed at the entrance of the store 10 to estimate the age of the customer C when the customer C enters the store 10. Alternatively, the camera 5 may capture an image of both the entrance of the store 10 and the front of the fixture 7 on which the specific product 22 is displayed.

[0066] 8 is a diagram showing an example of the data structure of the age estimation result information 220. The age estimation result information 220 associates at least a master face image of customer C with an age estimation result. Furthermore, the age estimation result information 220 may associate a date and time. The associated date and time is, for example, at least one of the date and time when customer C visits the store, the date and time when the face image of customer C is captured, the date and time when age estimation is performed (the age estimation result is obtained), and the date and time when the record of the age estimation result information 220 is stored in the storage device 200.

[0067] The master face image registered in the age estimation result information 220 may be a facial feature amount. After the age estimation is performed by the age estimation unit 102, the age estimation result information 220 is stored in the storage device 200 by the processing unit 106 in association with the face image of the customer C used for the age estimation and the result of the age estimation.

[0068] Here, storing the result of age estimation in the storage device 200 in a state in which it is possible to specify whether the result of age estimation satisfies the criteria means storing the following age estimation result information 220 in the storage device 200. For example, the age estimation result information 220 includes information on whether the estimated age of the customer C satisfies the criteria of the age limit of the specific product 22, or information indicating the estimated age itself. The information on whether the age of the customer C satisfies the criteria of the age limit of the specific product 22 may include, for example, information indicating whether the age of the customer C is above or below a reference age, information indicating whether the customer C is an adult or a minor, information indicating whether the specific product 22 can be sold to the customer C, and the like. The information indicating the estimated age of the customer C may include, for example, information indicating a specific age (35 years old), information indicating an age range (20 years old or above, 15 to 18 years old, etc.), information indicating an age group (40s, etc.), and the like.

[0069] <Example of operation> 9 and 10 are flowcharts showing an example of the operation of the sales support device 100. FIG. First, when a person enters a store (YES in step S201), the age estimation unit 102 acquires a facial image of the person's face and performs age estimation using the facial image (step S203). Here, the age estimation unit 102 acquires a facial image captured by the camera 5. The processing unit 106 registers the facial image in the storage device 200 as a master facial image in a state in which it is possible to specify whether the result of age estimation satisfies a criterion (step S205).

[0070] Next, when a person stands in front of the fixture 7 on which the specific commodity 22 is displayed (YES in step S207), the matching unit 108 acquires a face image to be matched that captures the face of the person in front of the fixture 7, and matches the face image to be matched with a master face image registered in the storage device 200 (step S209). Here, the matching unit 108 acquires a face image captured by the camera 5. If the storage device 200 contains a master face image that matches the face image to be matched, and the estimated age satisfies a standard (YES in step S211), the processing unit 106 enables removal of the specific commodity 22 from the fixture 7 (step S213). Then, this process ends.

[0071] In step S211, the matching unit 108 refers to the age estimation result information 220 and finds, for example, a master face image whose similarity to the matched face image is equal to or greater than a predetermined threshold. The matching unit 108 then reads out the age estimation result associated with the master face image. The matching unit 108 then determines whether the estimated age of the customer C satisfies a criterion based on the age estimation result.

[0072] On the other hand, if the matching unit 108 finds that there is no master face image matching the matched face image in the storage device 200 (NO in step S211), the process proceeds to step S221 in FIG. 10. The age estimation unit 102 executes age estimation using the matched face image acquired in step S209 (step S221). If the result of age estimation satisfies the criteria (YES in step S223), the processing unit 106 enables removal of the specific product 22 from the fixture 7 (step S225) and registers the matched face image as a master face image in the storage device 200 together with the result of age estimation (step S227). Then, this process ends.

[0073] If the estimated age does not satisfy the criteria in step S223 (NO in step S223), steps S225 and S227 are bypassed and the process ends. In other words, if the estimated age does not satisfy the criteria in step S223 (NO in step S223), the customer C cannot take out the specific product 22 from the fixture 7.

[0074] Furthermore, in this embodiment, the sales support device 100 may have the age verification unit 104 of the above embodiment. In that case, similarly to the above embodiment, if the estimated age does not satisfy the criteria in step S223 (NO in step S223), the age verification unit 104 may request age certification information and perform a determination process of whether the acquired age certification information satisfies the criteria.

[0075] According to this embodiment, the same effects as those of the above embodiment are achieved, and further, if the estimated age meets the standard in the age estimation process upon entering the store, the customer C can take out a specific product 22 from the fixture 7 without undergoing age determination in front of the fixture 7, thereby improving convenience for the customer C.

[0076] (Fourth embodiment) <Example of functional configuration> Fig. 11 is a functional block diagram showing an example of a logical configuration of a sales support device 100 according to an embodiment of the present invention. The sales support device 100 of this embodiment is similar to the above-mentioned embodiments, except that it has a configuration for confirming that the facial image of customer C is not a photograph but a real person before registering the facial image of the customer C in the storage device 200. The sales support device 100 of this embodiment has the same configuration as the third embodiment of Fig. 7, and further includes an authentication unit 130. However, the configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0077] Before registering a master face image in the storage device 200, the authentication unit 130 performs iris authentication or liveness determination of a person.

[0078] In the case of iris authentication, when customer C enters the store, the authentication unit 130 photographs the iris of the customer C, for example, using an iris photographing camera (not shown), and registers the iris image or features as an iris image to be authenticated in the age estimation result information 220, further associated with a master face image.

[0079] Then, before registering the master facial image in the storage device 200, the authentication unit 130 photographs the iris of customer C using an iris photographing camera (not shown) and transmits the iris image to be authenticated to an iris authentication device (not shown), and also transmits to the iris authentication device the master iris image or its feature amount that is registered in association with the master facial image in the age estimation result information 220. The iris authentication device compares the received iris image to be authenticated with the master iris image, and returns the authentication result to the sales support device 100. The authentication unit 130 receives the authentication result from the iris authentication device.

[0080] In the case of liveness judgment, the authentication unit 130 acquires video images captured by, for example, the camera 5 when entering the store, and acquires movement characteristics of customer C, such as blinking, gaze, and lips, and registers these as features to be authenticated in the age estimation result information 220, further associated with the master face image.

[0081] Then, before registering the master facial image in the storage device 200, the authentication unit 130 acquires a video image captured by the camera 5, acquires movement characteristics of customer C, such as blinking, gaze, and lips, and transmits the features to be authenticated to an image analyzing device (not shown), and also transmits the master features registered in association with the master facial image in the age estimation result information 220 to the image analyzing device. The image analyzing device compares the received features to be authenticated with the master features, and returns the authentication result to the sales support device 100. The authentication unit 130 receives the authentication result from the image analyzing device.

[0082] <Example of operation> Fig. 12 is a flowchart showing an example of the operation of sales support device 100. The flowchart in Fig. 12 is executed after any one of the processes of step S111 in Fig. 5, step S203 in Fig. 9, and step S225 in Fig. 10, in other words, before the process of registering a master face image in storage device 200 in any one of step S113 in Fig. 5, step S205 in Fig. 9, and step S227 in Fig. 10.

[0083] After step S111 in FIG. 5, step S203 in FIG. 9, or step S225 in FIG. 10, the authentication unit 130 performs iris authentication or liveness determination of the person (step S131) ​​before registering the master face image in the storage device 200 (step S113 in FIG. 5, step S205 in FIG. 9, or step S227 in FIG. 10). If the result of the iris authentication or liveness determination of the person satisfies the criteria (YES in step S133), the process proceeds to step S113 in FIG. 5, step S205 in FIG. 9, or step S227 in FIG. 10, and a process of registering the master face image in the storage device 200 is performed. On the other hand, if the result of the iris authentication or liveness determination of the person does not satisfy the criteria (NO in step S133), the process of step S113 in FIG. 5, step S205 in FIG. 9, or step S227 in FIG. 10 is not executed. That is, the master face image of the customer C is not registered in the storage device 200.

[0084] According to this embodiment, the same effects as those of the above embodiment can be obtained, and further, before registering the master face image, it is possible to confirm that the customer C is actually present, without using a face photo or the like. tree This helps prevent fraud.

[0085] Fifth embodiment <Example of functional configuration> Fig. 13 is a diagram conceptually showing the system configuration of a sales system 1 according to an embodiment of the present invention. The sales system 1 of this embodiment is similar to the sales system 1 of Fig. 1, except that it further includes a payment device 40 in addition to the configuration of the sales system 1 of Fig. 1. Also, since the sales support device 100 of this embodiment has the same configuration as the sales support device 100 of Fig. 11, it will be described using the functional block diagram of Fig. 11. However, the sales support device 100 of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0086] The payment device 40 is, for example, a POS terminal that performs registration processing and payment processing for products purchased by the customer C. However, the product registration processing may be performed in a manner other than the POS terminal, and is not particularly limited. For example, the product may be identified when it is detected that a product has been placed in a shopping cart, and the product registration processing may be performed. Alternatively, the product may be attached with an IC tag such as an RFID (Radio Frequency Identification) tag having an IC chip with a product code recorded thereon, and the product code may be read by an IC tag reader before the product arrives at the payment device 40, and the product registration processing may be performed.

[0087] The settlement device 40 performs settlement processing for registered products. There is no particular limitation on the settlement method (cash, credit card, electronic money, etc.).

[0088] The processing unit 106 associates the master face image with store visit information indicating that a certain period of time has elapsed after the payment process for the purchased item, or that the customer has left the store, and registers this information in the storage device 200. When the store visit information is registered in the storage device 200, the authentication unit 130 further performs iris authentication or liveness determination.

[0089] <Example of operation> Fig. 14 is a flowchart showing an example of the operation of the sales support device 100. Fig. 14(a) is a flowchart showing a processing procedure for registering store visit information in association with a master face image. Fig. 14(b) is a flowchart showing a processing procedure according to the presence or absence of the store visit information.

[0090] In FIG. 14(a), if any of the following conditions is met, the process proceeds to step S143 and the store visit information is registered. (a1) After the settlement process for the purchased item of customer C is completed by the settlement device 40 (a2) A certain period of time after the payment process is completed Progress rear (a3) After a certain time has elapsed since it became possible to take out the specific product 22 from the fixture 7 (a4) After a certain time has elapsed since the master face image of customer C was registered in the storage device 200 (a5) When customer C leaves the store

[0091] In the cases of (a1) and (a2), the processing unit 106 acquires a facial image of the customer C who is performing payment processing at the payment device 40. In the case of (a5), the processing unit 106 acquires, for example, a facial image of a person who has left through an exit of the store 10. Then, in the cases of (a1), (a2), and (a5), the processing unit 106 compares the acquired facial image with the master facial images registered in the storage device 200. Then, when a master facial image with a similarity equal to or greater than a threshold is found, the processing unit 106 associates the master facial image with store visit information and registers the master facial image.

[0092] In the case of (a3) ​​or (a4), after it becomes possible to take out the specific product 22 from the fixture 7, when the master face image is registered, the passage of time is monitored, and when a certain time has passed, the master face image and Link and register store visit information.

[0093] The flow of FIG. 14(b) is executed after any one of step S111 of FIG. 5, step S203 of FIG. 9, and step S225 of FIG. 10, in other words, before the process of registering a master facial image in storage device 200 in any one of step S113 of FIG. 5, step S205 of FIG. 9, and step S227 of FIG. 10.

[0094] When the store visit information is registered in the storage device 200 (YES in step S151), the authentication unit 130 proceeds to step S131 in Fig. 12 to further perform iris authentication or liveness determination. If the authentication result satisfies the criteria, the authentication unit 130 proceeds to step S113 in Fig. 5, step S205 in Fig. 9, or step S227 in Fig. 10 to register a master face image in the storage device 200.

[0095] According to this embodiment, the same effects as those of the above embodiment can be achieved, and further, if customer C leaves the store and then returns to store 10, or after the payment process has been completed, or after having once removed a specific product 22 from the fixture 7, and then attempts to remove the specific product 22 from the fixture 7 again, age verification information is not again requested from customer C, and fraudulent activities such as authentication using photographs, etc. can be prevented.

[0096] Sixth embodiment <Example of functional configuration> The sales support device 100 of this embodiment is the same as the above-mentioned embodiment, except that it has a configuration for deleting a master face image registered in the storage device 200 when a predetermined condition is satisfied. This embodiment will be described using the functional block diagram of the sales support device 100 of the third embodiment in Fig. 7. However, the configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0097] <Example of functional configuration> The processing unit 106 deletes the master face image of customer C from the storage device 200 when any of the following conditions is met. (b1) When it is detected that a payment process for a product purchased at the store has been completed Specifically, a notification that the payment process has been completed is received from payment device 40. (b2) When it is detected that a person has left the store Specifically, the camera 5 tracks the customer C within the store 10 using image analysis processing, and detects when the customer C leaves the store 10. (b3) When a certain time has elapsed after the master face image is registered in the storage device 200 Specifically, after the processing unit 106 registers the master face image in the storage device 200, it monitors the passage of a certain period of time.

[0098] <Example of operation> 15 and 16 are flowcharts showing an example of the operation of the sales support device 100. FIG. 15(a), the processing unit 106 determines whether or not the payment process for the purchased item in the store is completed (step S161). For example, when the processing unit 106 receives a notification from the payment device 40 that the payment process is completed (YES in step S161), the processing unit 106 erases the master face image of the customer C from the storage device 200 (step S163).

[0099] 15(b), it is determined whether or not a person has left the store 10 (step S171). For example, when tracking customer C with the camera 5, it is detected that customer C has left the store 10 (YES in step S171), and the processing unit 106 erases the master face image of customer C from the storage device 200 (step S163).

[0100] In the example of Fig. 16, this process is executed after the process of registering a master face image in the storage device 200 is performed in any one of step S113 of Fig. 5, step S205 of Fig. 9, and step S227 of Fig. 10. The processing unit 106 determines whether or not a certain time has elapsed after the process of registering a master face image in the storage device 200 is performed in any one of step S113 of Fig. 5, step S205 of Fig. 9, and step S227 of Fig. 10 (step S181). If the certain time has elapsed (YES in step S181), the processing unit 106 erases the master face image of customer C from the storage device 200 (step S163).

[0101] According to this embodiment, it is possible to obtain the same effects as the above-mentioned embodiment, and furthermore, it is possible to erase personal information at an appropriate timing.

[0102] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than those described above can also be adopted. <Acquisition of age verification information by ID card> For example, a specific example of the method of acquiring age certification information from an identification card in the above embodiment (steps S107 to S109 in FIG. 5) will be described. Fig. 17 is a flow chart showing an example of the operation of the procedure for acquiring age certification information, which will be explained below with reference to Figs.

[0103] First, an application is started on the mobile terminal 30. This application realizes part of the functions of the age verification unit 104. The age verification unit 104 instructs the customer C to take a picture of the identification card V and the face of the customer C in the same image.

[0104] The age verification unit 104 activates the camera of the mobile terminal 30 and displays on the display of the mobile terminal 30 a message such as "Please take a photo so that both your face and your identification card are included," along with a shooting view, a frame indicating the shooting area, and a shooting button.

[0105] As shown in Fig. 18(a), customer C uses the mobile terminal 30 to photograph the identification card V and customer C's face together in the image (step S301). A message may be output (audio or display) to instruct customer C to include at least the photograph and date of birth written on the identification card in the photographed range. Alternatively, a message may be output (audio or display) to instruct customer C to photograph both the front and back of the identification card in turn.

[0106] The mobile terminal 30 acquires the captured image and transmits it to the sales support device 100 (step S303).

[0107] In the sales support device 100, when the age verification unit 104 receives the image transmitted from the mobile terminal 30 (step S311), the age verification unit 104 performs the processes from step S313 onwards. Specifically, the age verification unit 104 first extracts the face image of customer C from the received image (step S313). Furthermore, the age verification unit 104 extracts the area of ​​the face photo on the identification card from the received image (step S315). Then, the age verification unit 104 compares the face image extracted in step S313 and the face photo extracted in step S315 to obtain the face image of customer C. Area The images are compared (step S317).

[0108] If the comparison result between the two images satisfies the criteria (YES in step S319), the age verification unit 104 proceeds to step S321. For example, if the comparison result shows that the similarity between the two images is equal to or greater than a threshold, the criteria may be satisfied. If the criteria is not satisfied (NO in step S319), the process ends. For example, FIG. 18(b) is an example of a screen of the mobile terminal 30 indicating that the face image and the photo on the identification card match.

[0109] The age verification unit 104 further extracts an area image of the age verification information (date of birth) of the identification card from the image received in step S311, and further converts the date of birth written in the extracted image area into date of birth data using OCR and obtains it (step S321).

[0110] The age verification unit 104 determines whether the acquired date of birth data satisfies the criteria (step S323). Specifically, the age of the customer C may be calculated from the date of birth data and the current date, and whether the criteria are satisfied may be determined. Alternatively, the date of birth that is the reference age may be calculated on the day, and the acquired date of birth may be determined. did It may be determined whether the date of birth data is before or after the date of birth.

[0111] If the criteria are met (YES in step S323), the process proceeds to step S111 in Fig. 5. In step S111, the specific product 22 is allowed to be removed from the fixture 7. On the other hand, if the criteria are not met (NO in step S323), the process ends. In other words, since the specific product 22 is not allowed to be removed from the fixture 7, customer C cannot purchase the specific product 22.

[0112] However, the order of the processes in steps S313 to S319 and the processes in steps S321 to S323 may be interchanged.

[0113] According to this configuration, by having the customer C operate the mobile terminal 30, the age certification information of the customer C can be easily obtained.

[0114] <Opening and closing fixture doors using barcodes> In another embodiment, a configuration example will be described in which the door of the fixture 7 is opened and closed by a barcode displayed on the mobile terminal 30. This configuration is an example in which, when the customer C stands in front of the fixture 7 of the specific product 22 in step S207 of Fig. 9, the processes of steps S209 to S213 are realized by an application of the mobile terminal 30.

[0115] For example, in step S209 of FIG. 9, the matching unit 108 has the customer C take an image of his / her face using the mobile terminal 30 (FIG. 19(a)). The image captured by the mobile terminal 30 is transmitted to the sales support device 100, and the matching unit 108 acquires a face image to be matched from the mobile terminal 30. Then, the matching unit 108 matches the face image to be matched with a master face image registered in the storage device 200 (step S209 of FIG. 9).

[0116] If the storage device 200 contains a master face image that matches the matched face image and the estimated age satisfies the criteria (YES in step S211) (FIG. 19(b)), the processing unit 106 enables removal of the specific product 22 from the fixture 7 (step S213). At this time, the processing unit 106 displays a screen 400 indicating that identity verification has been completed on the mobile terminal 30. The screen 400 includes a display section 402 for information indicating that identity verification has been completed, a display section 404 for a barcode on which key information for enabling removal of the specific product 22 from the fixture 7 is recorded, and a display section 406 for the expiration date of the barcode.

[0117] However, the barcode may be another two-dimensional code or may be a QR code (registered trademark).

[0118] For example, a code reader (not shown) is installed on the fixture 7, and when the customer C holds the barcode displayed on the mobile terminal 30 over the code reader of the fixture 7, the code reader reads key information from the barcode. The key information read by the code reader of the fixture 7 performs a process such as unlocking the door of the fixture 7, enabling the specific product 22 to be taken out of the fixture 7.

[0119] The barcode becomes invalid, for example, after the expiration date. For example, the barcode is erased. The barcode may also be used for payment processing in the payment device 40. For example, the barcode may include information on the credit card used by the customer C for payment. Alternatively, the barcode for so-called QR code payment may include key information that enables removal of a specific product 22 from the fixture 7.

[0120] Although the present invention has been described above with reference to the embodiments and examples, the present invention is not limited to the above-mentioned embodiments and examples. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In the present invention, when information about a user is acquired and used, this shall be done lawfully.

[0121] A part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes. 1. An age estimation means, an age verification means, a processing means, and a storage means; The age estimation means acquires a facial image of a person standing in front of a display unit on which a specific product is displayed, and estimates the age of the person using the facial image. The age confirmation means, when the result of the age estimation by the age estimation means does not satisfy a standard, requests age verification information from the person, and the obtained age verification information The above Determine whether the criteria are met, The processing means determines whether the result of the determination by the age verification means is The above If the criteria are met, the sales support device enables removal of the specific product from the fixture, and registers the facial image as a master facial image together with the age proof information in the storage means for subsequent authentication. 2. In the sales support device according to 1., The processing means, when the result of the age estimation does not satisfy the criterion, accesses the memory means, and when the master facial image matching the facial image is registered together with the age certification information, enables the specific product to be removed from the fixture. 3. An age estimation means, a processing means, a matching means, and a storage means; The age estimation means acquires a facial image of a person when the person enters the store, and estimates the person's age using the facial image; the processing means registers the facial image in the storage means as a master facial image in a state in which it is possible to specify whether or not the result of the age estimation satisfies a standard; the matching means, when a person stands in front of a display unit on which a specific commodity is displayed, acquires a face image to be matched by capturing an image of the face of the person in front of the display unit, and matches the face image with the master face image registered in the storage means; The processing means detects that the master face image that matches the matched face image is stored in the storage means and the result of the age estimation is The above When the criteria are met, the specific product can be removed from the fixture; The age estimation means ,before If the storage means does not contain the master face image that matches the subject face image, age estimation is performed using the subject face image; The processing means, when the result of the age estimation satisfies the criterion, enables the specific product to be removed from the fixture, and registers the facial image to be matched as the master facial image in the memory means together with the result of the age estimation. 4. In the sales support device according to any one of 1. to 3., The sales support device further comprises an authentication means for performing iris authentication or liveness determination of the person before registering the master face image in the storage means. 5. In the sales support device according to 4., the processing means registers in the storage means store visit information, which indicates that a certain time has elapsed after a payment process for a purchased item, or that the customer has left the store, in association with the master face image; The authentication means further performs the iris authentication or the liveness determination when the store visit information is registered in the storage means. 6. In the sales support device according to any one of 1. to 4., The sales support device, wherein the processing means erases the master facial image from the storage means when it detects that a payment process for a purchased item in the store has been completed. 7. In the sales support device according to any one of 1. to 4., The sales support device, wherein the processing means erases the master face image from the storage means when it detects that the person has gone outside the store. 8. In the sales support device according to any one of 1. to 7., The processing means deletes the master face image from the storage means when a certain time has elapsed after the master face image is registered in the storage means.

[0122] 9. Fixtures for displaying specific products; A sales support device, The sales support device includes: The apparatus includes an age estimation means, an age verification means, a processing means, and a storage means, The age estimation means includes: The above Specific products are on display The above A facial image of a person in front of the fixture is acquired, and an age estimation is performed on the person using the facial image. The age confirmation means, when the result of the age estimation by the age estimation means does not satisfy a standard, requests age verification information from the person, and the obtained age verification information The above Determine whether the criteria are met, The processing means determines whether the result of the determination by the age verification means is The above When the criteria are met, the sales system enables removal of the specific product from the fixture, and registers the facial image as a master facial image together with the age proof information in the storage means for subsequent authentication. 10. In the sales system described in 9., In the sales support device, A sales system in which, if the result of the age estimation does not satisfy the standard, the processing means accesses the memory means, and if the master facial image matching the facial image is registered together with the age verification information, enables the specific product to be removed from the fixture. 11. Fixtures for displaying specific products; A sales support device, The sales support device includes: The apparatus includes an age estimation means, a processing means, a comparison means, and a storage means, The age estimation means acquires a facial image of a person when the person enters the store, and estimates the person's age using the facial image; the processing means registers the facial image in the storage means as a master facial image in a state in which it is possible to specify whether or not the result of the age estimation satisfies a standard; The collation means is The above Specific products are on display The above When a person stands in front of the fixture, a face image to be matched is acquired by capturing an image of the face of the person in front of the fixture, and the face image is matched with the master face image registered in the storage means; the processing means, when the storage means has the master face image that matches the matched face image and the result of the age estimation satisfies a criterion, enables removal of the specific product from the fixture; the age estimation means, when the matching means detects that the master face image coincides with the matched face image in the storage means, performs age estimation using the matched face image; A sales system in which, when the result of the age estimation satisfies the criterion, the processing means enables the specific product to be removed from the fixture, and registers the facial image to be matched as the master facial image in the memory means together with the result of the age estimation. 12. In the sales system according to any one of 9. to 11., The sales support device includes: The sales system further comprises an authentication means for performing iris authentication or liveness determination of the person before registering the master face image in the storage means. 13. In the sales system described in 12., In the sales support device, the processing means registers in the storage means store visit information, which indicates that a certain time has elapsed after a payment process for a purchased item, or that the customer has left the store, in association with the master face image; A sales system, wherein the authentication means further performs the iris authentication or the liveness determination when the store visit information is registered in the storage means. 14. In the sales system according to any one of 9. to 12., In the sales support device, The processing means, when detecting that a payment process for a purchased item has been completed in the store, erases the master facial image from the storage means. 15. In the sales system according to any one of 9. to 12., In the sales support device, A sales system, wherein the processing means erases the master facial image from the storage means when it detects that the person has left the store. 16. In the sales system according to any one of 9. to 15., In the sales support device, The processing means deletes the master facial image from the storage means when a certain time has elapsed after the master facial image is registered in the storage means.

[0123] 17. The sales support device is A facial image is acquired by capturing an image of a person's face in front of a display unit on which a specific product is being displayed, and an age estimation is performed on the person using the facial image; If the result of the age estimation does not meet the criteria, request age verification information from the person and determine whether the obtained age verification information meets the criteria; In a sales support method, if the result of the judgment satisfies a standard, the specific product can be removed from the fixture, and the facial image is registered in a memory means as a master facial image together with the age proof information for subsequent authentication. 18. In the sales support method described in 17., The sales support device, A sales support method in which, if the result of the age estimation does not satisfy the standard, the storage means is accessed, and if the master facial image matching the facial image is registered together with the age certification information, the specific product can be removed from the fixture. 19. The sales support device is When a person enters a store, a facial image of the person is captured, and age estimation is performed using the facial image. registering the face image as a master face image in a storage means in a state in which it is possible to specify whether or not the result of the age estimation satisfies a standard; When a person stands in front of a display unit on which a specific commodity is displayed, a face image to be matched is acquired by capturing an image of the face of the person in front of the display unit, and the face image is matched with the master face image registered in the storage means; When the storage means contains the master face image that matches the matched face image and the result of the age estimation satisfies a standard, the specific product can be taken out from the fixture; When the storage means does not contain the master face image that matches the subject face image, age estimation is performed using the subject face image; A sales support method in which, if the result of the age estimation satisfies the criterion, the specific product is made available for removal from the fixture, and the facial image to be matched is registered in the memory means as the master facial image together with the result of the age estimation. 20. In the sales support method according to any one of 17 to 19, The sales support device further comprises: A sales support method, comprising: performing iris authentication or liveness determination of the person before registering the master face image in the storage means. 21. In the sales support method described in 20., The sales support device, registering store visit information, which indicates that a certain time has elapsed after payment for the purchased product has been processed, or that the customer has left the store, in the storage means in association with the master face image; When the store visit information is registered in the storage means, the iris authentication or the liveness determination is further performed. 22. In the sales support method according to any one of 17. to 20., The sales support device, When it is detected that a payment process for the purchased item has been completed in the store, the master face image is erased from the storage means. 23. In the sales support method according to any one of 17. to 20., The sales support device, When it is detected that the person has gone outside the store, the master face image is erased from the storage means. 24. In the sales support method according to any one of 17. to 23., The sales support device, The sales support method further comprises the steps of: deleting the master face image from the storage means after a certain period of time has elapsed since the master face image was registered in the storage means.

[0124] 25. To the computer: A step of acquiring a facial image of a person standing in front of a display unit on which a specific product is being displayed, and estimating the age of the person using the facial image; if the result of the age estimation does not satisfy the criteria, requesting age verification information from the person and determining whether the obtained age verification information satisfies the criteria; A program for executing a procedure in which, if the result of the judgment satisfies a standard, the specific product can be removed from the fixture, and the facial image is registered in a memory means as a master facial image together with the age proof information for subsequent authentication. 26. In the program according to 25., A program for causing a computer to execute a procedure that, if the result of the age estimation does not satisfy the standard, accesses the memory means, and if the master facial image that matches the facial image is registered together with the age certification information, enables the specific product to be removed from the fixture. 27. To the computer, A step of acquiring a facial image of a person when the person enters a store, and performing age estimation using the facial image; a step of registering the facial image as a master facial image in a storage means in a state in which it is possible to specify whether or not the result of the age estimation satisfies a criterion; a step of acquiring a face image to be matched by capturing an image of the face of a person standing in front of a display unit on which a specific commodity is displayed, and matching the face image to be matched with the master face image registered in the storage means; a step of enabling removal of the specific product from the fixture when the storage means contains the master face image that matches the matched face image and the result of the age estimation satisfies a criterion; a step of performing age estimation using the face image to be matched when the master face image that matches the face image to be matched is not stored in the storage means; A program for executing a procedure in which, if the result of the age estimation satisfies the criterion, the specific product can be removed from the fixture, and the subject facial image is registered in the memory means as the master facial image together with the result of the age estimation. 28. In the program according to any one of 25. to 27., Furthermore, the program causes a computer to execute a procedure for performing iris authentication or liveness determination of the person before registering the master face image in the storage means. 29. In the program according to 28., a step of registering store visit information, which indicates that a certain time has elapsed after the payment process for the purchased goods, or that the customer has left the store, in the storage means in association with the master face image; A program for causing a computer to execute a procedure for further performing the iris authentication or the liveness determination when the store visit information is registered in the storage means. 30. In the program according to any one of 25. to 28., A program for causing a computer to execute a procedure for deleting the master facial image from the storage means when it is detected that a payment process for a purchased item in the store has been completed. 31. In the program according to any one of 25. to 28., A program for causing a computer to execute a procedure for deleting the master face image from the storage means when it is detected that the person has left the store. 32. In the program according to any one of 25. to 31., A program for causing a computer to execute a procedure for deleting the master facial image from the storage means when a certain time has elapsed after the master facial image has been registered in the storage means.

[0125] This application claims priority based on Japanese Patent Application No. 2020-084544, filed on May 13, 2020, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0126] 1. Sales System 3. Communication Network 5. Camera 7. Fixtures 10 stores 20 items 22 Specific products 30 Mobile Devices 40 Payment Equipment Place 1 00 Sales Support Equipment 102 Age Estimation Department 104 Age Verification Department 106 Processing section 108 Collation Unit 130 Authentication Department 200 Storage device 210 Authentication Information 220 Age Estimation Result Information 400 screens 1000 Computers 1010 Bus 1020 Processor 1030 Memory 1040 Storage Device 1050 Input / Output Interface 1060 Network Interface

Claims

1. The apparatus includes an age estimation means, an age verification means, a processing means, a storage means, and an authentication means, The age estimation means acquires a facial image of a person standing in front of a display unit on which a specific product is displayed, and estimates the age of the person using the facial image. the age verification means, when the result of the age estimation by the age estimation means does not satisfy a criterion, requests age verification information from the person and judges whether the obtained age verification information satisfies the criterion; When the result of the determination by the age verification means satisfies the criterion, the processing means enables removal of the specific product from the fixture, and registers the facial image as a master facial image together with the age certification information in the storage means for subsequent authentication. the authentication means performs iris authentication or liveness determination of the person before registering the master face image in the storage means; the processing means registers in the storage means store visit information, which indicates that a certain time has elapsed after a payment process for a purchased item, or that the customer has left the store, in association with the master face image; The authentication means further performs the iris authentication or the liveness determination when the store visit information is registered in the storage means.

2. 2. The sales support device according to claim 1, The processing means, when the result of the age estimation does not satisfy the criterion, accesses the memory means, and when the master facial image matching the facial image is registered together with the age certification information, enables the specific product to be removed from the fixture.

3. The apparatus includes an age estimation means, a processing means, a comparison means, and a storage means, The age estimation means acquires a facial image of a person when the person enters the store, and estimates the person's age using the facial image; the processing means registers the facial image in the storage means as a master facial image in a state in which it is possible to specify whether or not the result of the age estimation satisfies a standard; the matching means, when a person stands in front of a display unit on which a specific commodity is displayed, acquires a face image to be matched by capturing an image of the face of the person in front of the display unit, and matches the face image with the master face image registered in the storage means; the processing means, when the storage means has the master face image that matches the matched face image and the result of the age estimation satisfies the criterion, enables removal of the specific product from the fixture; when the storage means does not contain the master face image that matches the matched face image, the age estimation means performs age estimation using the matched face image; The processing means, when the result of the age estimation satisfies the criterion, enables the specific product to be removed from the fixture, and registers the facial image to be matched as the master facial image in the memory means together with the result of the age estimation.

4. 4. The sales support device according to claim 3, The sales support device further comprises an authentication means for performing iris authentication or liveness determination of the person before registering the master face image in the storage means.

5. 5. The sales support device according to claim 4, the processing means registers in the storage means store visit information, which indicates that a certain time has elapsed after a payment process for a purchased item, or that the customer has left the store, in association with the master face image; The authentication means further performs the iris authentication or the liveness determination when the store visit information is registered in the storage means.

6. 5. The sales support device according to claim 1, The sales support device, wherein the processing means erases the master facial image from the storage means when it detects that a payment process for a purchased item in a store has been completed.

7. 5. The sales support device according to claim 1, The processing means processes an image of the person, and when it detects that the person has left the store, erases the master face image from the storage means.

8. Fixtures for displaying specific products; A sales support device, The sales support device includes: The apparatus includes an age estimation means, an age verification means, a processing means, a storage means, and an authentication means, The age estimation means acquires a facial image of a person standing in front of a display unit on which a specific product is displayed, and estimates the age of the person using the facial image. the age verification means, when the result of the age estimation by the age estimation means does not satisfy a criterion, requests age verification information from the person and judges whether the obtained age verification information satisfies the criterion; When the result of the determination by the age verification means satisfies the criterion, the processing means enables removal of the specific product from the fixture, and registers the facial image as a master facial image together with the age certification information in the storage means for subsequent authentication. the authentication means performs iris authentication or liveness determination of the person before registering the master face image in the storage means; the processing means registers in the storage means store visit information, which indicates that a certain time has elapsed after a payment process for a purchased item, or that the customer has left the store, in association with the master face image; A sales system, wherein the authentication means further performs the iris authentication or the liveness determination when the store visit information is registered in the storage means.

9. A display fixture for displaying a specific commodity; A sales support device, The sales support device includes: The apparatus includes an age estimation means, a processing means, a comparison means, and a storage means, The age estimation means acquires a facial image of a person when the person enters the store, and estimates the person's age using the facial image; the processing means registers the facial image in the storage means as a master facial image in a state in which it is possible to specify whether or not the result of the age estimation satisfies a standard; the matching means, when a person stands in front of a display unit on which a specific commodity is displayed, acquires a face image to be matched by capturing an image of the face of the person in front of the display unit, and matches the face image with the master face image registered in the storage means; the processing means, when the storage means has the master face image that matches the matched face image and the result of the age estimation satisfies the criterion, enables removal of the specific product from the fixture; when the storage means does not contain the master face image that matches the matched face image, the age estimation means performs age estimation using the matched face image; A sales system in which, when the result of the age estimation satisfies the criterion, the processing means enables the specific product to be removed from the fixture, and registers the facial image to be matched as the master facial image in the memory means together with the result of the age estimation.

10. Sales support device, A facial image is acquired by capturing an image of a person's face in front of a display unit on which a specific product is being displayed, and an age estimation is performed on the person using the facial image. If the result of the age estimation does not meet the criteria, request age verification information from the person and determine whether the obtained age verification information meets the criteria; If the result of the determination satisfies the criterion, the specific product is allowed to be removed from the fixture, and the facial image is registered in a storage means as a master facial image together with the age certification information for subsequent authentication. before registering the master face image in the storage means, performing iris authentication or liveness determination of the person; registering store visit information, which indicates that a certain time has elapsed after payment for the purchased product has been processed, or that the customer has left the store, in the storage means in association with the master face image; When the store visit information is registered in the storage means, the iris authentication or the liveness determination is further performed.

11. A sales support device comprising: When a person enters a store, a facial image of the person is captured, and age estimation is performed using the facial image. registering the face image as a master face image in a storage means in a state in which it is possible to specify whether or not the result of the age estimation satisfies a standard; When a person stands in front of a display unit on which a specific commodity is displayed, a face image to be matched is acquired by capturing an image of the face of the person in front of the display unit, and the face image is matched with the master face image registered in the storage means; When the storage means contains the master face image that matches the matched face image and the result of the age estimation satisfies the criterion, the specific product can be removed from the fixture; When the storage means does not contain the master face image that matches the subject face image, age estimation is performed using the subject face image; A sales support method in which, if the result of the age estimation satisfies the criterion, the specific product is made available for removal from the fixture, and the facial image to be matched is registered in the memory means as the master facial image together with the result of the age estimation.

12. On the computer, A step of acquiring a facial image of a person standing in front of a display unit on which a specific product is being displayed, and estimating the age of the person using the facial image; if the result of the age estimation does not satisfy the criteria, requesting age verification information from the person and determining whether the obtained age verification information satisfies the criteria; a step of enabling removal of the specific product from the fixture when the result of the determination satisfies the criterion, and registering the facial image as a master facial image together with the age proof information in a storage means for subsequent authentication; executing a procedure for performing iris authentication or liveness determination of the person before registering the master face image in the storage means; In the step of registering, store visit information indicating that a certain time has elapsed after the payment process for the purchased product, or that the customer has left the store once is associated with the master face image and registered in the storage means; In the step of performing the iris authentication or the liveness determination, when the store visit information is registered in the storage means, the iris authentication or the liveness determination is further performed. A program for

13. A computer comprising: A step of acquiring a facial image of a person when the person enters a store, and performing age estimation using the facial image; a step of registering the facial image as a master facial image in a storage means in a state in which it is possible to specify whether or not the result of the age estimation satisfies a criterion; a step of acquiring a face image to be matched by capturing an image of the face of a person standing in front of a display unit on which a specific commodity is displayed, and matching the face image to be matched with the master face image registered in the storage means; a step of enabling removal of the specific product from the fixture when the storage means contains the master face image that matches the matched face image and the result of the age estimation satisfies the criterion; a step of performing age estimation using the face image to be matched when the master face image that matches the face image to be matched is not stored in the storage means; A program for executing a procedure in which, if the result of the age estimation satisfies the criterion, the specific product can be removed from the fixture, and the subject facial image is registered in the memory means as the master facial image together with the result of the age estimation.

Images