Sales data processing system, sales data processing device and program

Abstract

To provide a system, device, and program that prevent reduction in the accuracy of identification of customers who purchase age verification products.SOLUTION: A sales data processing system comprises a sales data processing device and a server. The server includes storage means for storing facial feature data for customers and age verification information in association with each other. The sales data processing device includes: imaging information acquisition means for acquiring face information for a customer; feature data acquisition means for acquiring facial feature data and age verification information from the server; age verification product determination means for determining whether or not a product being purchased is an age verification product; identity verification means for verifying the identity of the customer by comparing the facial feature data acquired by the imaging information acquisition means with the facial feature data acquired by the feature data acquisition means; age verification means for determining whether or not the customer is at or above the age that allows purchase of an age verification product; product registration means for executing a product registration process for the age verification product; and update transmission means for transmitting the feature data for a captured facial image to the server. The server includes update means for overwriting and storing the transmitted facial feature data.SELECTED DRAWING: Figure 10

Description

[Technical field]

[0001] An embodiment of the present invention relates to a sales data processing system, a sales data processing device, and a program. [Background technology]

[0002] For example, when selling age-verification products such as alcohol and tobacco at shopping centers, mass retailers, department stores, and other stores, store clerks check the identification documents (e.g., driver's license, My Number card, passport, etc.) of the customer purchasing the product to confirm that the customer is the person in question.

[0003] Recently, self-service POS terminals where customers themselves can register their products have become widespread, and identity verification is now performed automatically. For example, facial feature data of a customer is stored in advance based on an image of the customer taken in advance, and when the customer purchases an age verification product, an image of the customer taken on the spot is compared with the stored facial feature data to verify the customer's identity.

[0004] However, a person's face may change with age, etc. Therefore, the accuracy of identity verification may decrease as the number of years passes since the facial feature data was stored. Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the present invention is to provide a sales data processing system, a sales data processing device, and a program that are capable of preventing a decrease in the accuracy of identity verification of customers who purchase age-verification products. [Means for solving the problem]

[0006] A sales data processing system according to an embodiment of the present invention is a sales data processing system having a sales data processing device which performs product registration processing of products sold in a store by operation of a customer, and a server, the server being provided with a feature data storage means for storing face feature data indicating the features of a customer's face in association with age verification information of the customer, the sales data processing device being provided with an image information acquisition means for acquiring face information of an image of a customer's face, a feature data acquisition means for acquiring the face feature data and age verification information of the customer stored in the server, an age verification product determination means for determining whether a product to be purchased is an age verification product, and, when it is determined that the product is an age verification product, a face feature data based on the face image acquired by the image information acquisition means and a feature data acquisition means for acquiring the face feature data and the age verification information of the customer stored in the server, The system comprises an identity verification means for verifying the identity of the customer by comparing the facial feature data acquired by the customer identification means, an age verification means for determining, if the identity of the customer is verified, based on the age verification information, whether the customer is over the age at which the customer can purchase the age verification product, a product registration means for performing the product registration process for the age verification product if it is determined that the customer is over the age at which the customer can purchase the age verification product, and an update transmission means for transmitting facial feature data of the captured facial image to the server if the identity of the customer is verified, and the server comprises an update means for overwriting and storing the facial feature data of the customer stored in the feature data storage means based on the facial feature data transmitted by the update transmission means. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing a system according to an embodiment. [Diagram 2] FIG. 2 is a sequence diagram showing the main processes of each device and the data flow between the devices. [Diagram 3] FIG. 3 is a block diagram showing the hardware configuration of the registration POS. [Figure 4] FIG. 4 is a block diagram showing the hardware configuration of the POS terminal. [Diagram 5] FIG. 5 is a memory map showing the memory configuration of the personal identification information section. [Figure 6]FIG. 6 is a block diagram showing a hardware configuration of the server. [Figure 7] FIG. 7 is a memory map showing the memory configuration of the personal authentication storage unit. [Figure 8] FIG. 8 is a functional block diagram showing the functional configuration of the registration POS, the POS terminal, and the server. [Figure 9] FIG. 9 is a flowchart showing the flow of the control process of the registration POS. [Figure 10] FIG. 10 is a flowchart showing the flow of the control process of the POS terminal. [Figure 11] FIG. 11 is a flowchart showing the flow of identity verification and age verification in the control process of the POS terminal. [Figure 12] FIG. 12 is a flowchart showing the flow of the control process of the server. [Figure 13] FIG. 13 is a diagram showing a system according to a first modified example. [Figure 14] FIG. 14 is a diagram showing a display example of a mobile terminal. [Figure 15] FIG. 15 is a block diagram showing a hardware configuration of a POS terminal according to the second modified example. [Figure 16] FIG. 16 is a flowchart showing the flow of control processing of the POS terminal according to the second modified example. [Figure 17] FIG. 17 is a flowchart showing a flow of identity verification and age verification in the control process of the POS terminal according to the second modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the embodiment, a POS terminal that performs product registration processing of products sold in a store will be described as an example of a sales data processing device. As an example, the POS terminal in the embodiment is a fully self-service POS terminal in which the customer himself performs product registration operation and payment operation. Also, in the embodiment, a customer who purchases products at store T will be described as an example of a person. Note that the present invention is not limited to the embodiment described below.

[0009] For example, when a customer purchases an age verification product at store T, store T checks whether the customer is the customer who can sell the age verification product. If the customer's identity is confirmed, store T can determine whether the customer can purchase the age verification product based on the age verification information related to the customer that was registered in advance.

[0010] Identity verification may be performed using biometric authentication, and as an example, it is performed based on the face of the customer. Facial authentication may be used for identity verification for reasons such as high security, ease of implementation, and high usability. Facial authentication is performed, for example, by detecting the area of ​​the face and detecting the contours of the eyes, nose, mouth, chin, etc. within the area. For example, when registering as a member at a store, the face of the customer is photographed, and the facial features of the customer, such as the contour of the face, the positions of the eyes, nose, mouth, chin, etc., are stored (registered) as facial feature data (for example, feature amount or feature vector) that are digitized. Then, when the customer performs identity verification at the store, an image of the customer's face is photographed, and the facial feature data extracted based on the photographed facial image is compared with facial feature data registered in advance, and a similarity indicating the degree of similarity is calculated. If a similarity equal to or greater than a preset reference value is calculated, it is confirmed (determined) that the customer is the person who registered the facial feature data in advance.

[0011] However, it is known that a customer's face changes over time, for example, due to aging. In particular, areas around the eyes, mouth, forehead, cheeks, etc. are known to be prone to change over time. For example, around the eyes, eye bags and dark circles are more likely to appear with age, and the cheeks may become sagging or have nasolabial folds with age. When such a sudden change occurs in a person's face, a difference occurs between facial feature data captured from an image of the current face and facial feature data registered in advance, and a phenomenon occurs in which the calculated similarity does not exceed a reference value even though the person is the person in question, and the person cannot be identified (the accuracy of identity verification decreases).

[0012] The embodiment described below can maintain the accuracy of identity verification even if the face changes over time. Note that the invention according to this embodiment is not suitable for identity verification in which facial feature data once registered is treated as the only data. For example, in cases where high security is required to prevent a person once registered from being replaced by another person (impersonation), identity verification according to this proposal may not be suitable.

[0013] 1 is a diagram showing a system according to an embodiment. A sales data processing system 10 is installed in a store T, such as a supermarket, a mass retailer, a convenience store, or a specialty store. The sales data processing system 10 is a system that performs product registration processing, payment processing, and the like for products sold in the store T.

[0014] The sales data processing system 10 includes a POS (Point of Sales) terminal 1, a server 3, and a registration POS 5. The registration POS 5, the POS terminal 1, and the server 3 are interconnected by a communication line 2 such as a LAN (Local Area Network).

[0015] The registration POS 5 is one or more POS terminals (one in the embodiment) installed at, for example, a service counter in the store T. The registration POS 5 is a device that registers customer information (customer ID (person identification information, identity), customer facial feature data, and registration date) in advance.

[0016] The registration POS 5 uses a reader / writer 60 (see FIG. 3) to acquire a customer ID and age verification information for identifying the customer, for example, read from a customer card owned by the customer. The registration POS 5 also uses an imaging unit 59 (see FIG. 3) to capture an image of the customer's face, and calculates facial feature data from the facial image, for example, using a known general object recognition technique. The registration POS 5 associates the acquired customer ID and age verification information with the calculated facial feature data, and transmits them to the server 3 together with the associated date information. The server 3 registers the customer's identity verification information related to the received customer information. In the embodiment, the identity verification information also includes various information such as the customer's name, address, and mobile terminal address information.

[0017] Here, the age verification information may be any of the following: the customer's date of birth, information indicating that the customer is over a specified age (e.g., 20 years old) at the time of registration, information indicating that a specified period of time (e.g., 20 years) has passed since the customer was born, etc. Any information that can verify that the customer is over a specified age is sufficient.

[0018] The generic object recognition technology is described, for example, in "Yanai Keiji, 'The Current State and Future of Generic Object Recognition,' Transactions of the Information Processing Society of Japan, Vol. 48, No. SIG16 [searched August 10, 2010], Internet <URL: http: / / mm.cs.uec.ac.jp / IPSJ-TCVIM-Yanai.pdf>".

[0019] The POS terminal 1 is a fully self-service sales data processing device in which, for example, a customer performs product registration and payment operations. The customer uses the POS terminal 1 to perform product registration and payment operations for products purchased at the store T. The POS terminal 1 captures an image of the product based on the customer's product registration operation, and identifies the captured product using a general object recognition technology. The POS terminal 1 then executes product registration processing for the identified product. The POS terminal 1 also executes payment processing based on the customer's payment operation.

[0020] The product registration process refers to a process of acquiring a product code (product identification information) that identifies a product sold at store T, displaying product information such as the product name and price of the product based on the acquired product code, and storing the product information in product information unit 132 (see FIG. 4). The payment process refers to a process of closing the transaction based on the product information stored in product information unit 132 in conjunction with the product registration process, specifically, displaying the total amount, processing the payment by cash, credit card, gift certificates, etc., calculating and displaying the change based on the deposit in the case of cash payment, and issuing a receipt on which product information and accounting information (total amount, deposit amount, change amount, point information, etc.) of the product for which payment has been processed are printed.

[0021] When a customer purchases an age verification product (performing product registration processing for the age verification product), the POS terminal 1 performs identity verification of the customer. Identity verification is performed by comparing facial feature data calculated based on a facial image of the customer captured when purchasing the age verification product with facial feature data included in the pre-registered identity verification information, and judging whether the similarity is a reference value (e.g., 90%) or more. If the similarity is the reference value or more, the POS terminal 1 confirms that the customer who is purchasing the age verification product is the pre-registered customer. Note that if the similarity is close to 100% (e.g., 98% or more), it indicates that the customer is the same as the customer and that no changes in the face due to aging or the like have been observed. If the similarity is not the reference value or more, the POS terminal 1 judges that the customer who is purchasing the age verification product is not the pre-registered customer.

[0022] Furthermore, when the customer's identity is confirmed, the POS terminal 1 confirms whether the customer's age is equal to or greater than a predetermined age based on the age confirmation information included in the customer's identity confirmation information. When the POS terminal 1 confirms that the customer's age is equal to or greater than a predetermined age, it executes a product registration process for the age confirmation product.

[0023] Age verification products are products such as tobacco and alcohol that can only be sold to customers of a certain age or above after verifying the customer's age.

[0024] In addition, the POS terminal 1 transmits to the server 3 product information relating to the product for which payment has been processed and payment information.

[0025] The server 3 is, for example, a store server installed in the back yard of the store T. The server 3 creates and stores customer identification information (such as customer ID, facial feature data, age verification information, registration date, customer name, address, mobile terminal address, etc.) based on the customer information received from the registration POS 5.

[0026] Furthermore, when the server 3 receives an inquiry about identity verification from the POS terminal 1, the server 3 transmits stored facial feature data, age verification information, registration date, etc. to the POS terminal 1 that made the inquiry.

[0027] Furthermore, based on the customer ID and facial feature data received from the POS terminal 1, the server 3 updates the facial feature data stored in the server 3 and corresponding to the customer ID. That is, the server 3 overwrites the facial feature data stored in the server 3 with the new facial feature data received from the POS terminal 1. In this way, the server 3 can always store new facial feature data.

[0028] The following describes the main processes and data flows between the devices of the registration POS 5, the server 3, and the POS terminal 1. Fig. 2 is a sequence diagram showing the main processes of each device and the data flows between the devices.

[0029] First, the customer performs a customer information registration operation at the registration POS 5. The registration operation may be performed simultaneously with the member registration in which a customer ID is issued, or may be performed separately after the member registration. As shown in FIG. 2, the registration POS 5 acquires customer information (T1). Specifically, the registration POS 5 reads the customer ID and age verification information of the customer by inserting a customer card (a card issued when the customer registers as a member, such as a point card or credit card) into the reader / writer 60, and acquires the customer information. The customer's personal information, such as the name, address, and mobile terminal address information, may be acquired from a customer server (not shown) that is stored in correspondence with the read customer ID. In addition, the customer's facial feature data is acquired as customer information based on the face image of the customer captured by the imaging unit 59. The registration POS 5 then transmits the acquired customer information to the server 3 (T2).

[0030] The server 3 creates personal identification information (T3) based on the customer information transmitted by the registered POS 5. The server 3 then stores the created personal identification information in the personal identification storage unit 342 (see FIG. 6) (T4).

[0031] A customer who purchases a product operates the POS terminal 1 by himself / herself. The POS terminal 1 captures an image of the customer's face using the imaging unit 19 (T5). Next, the POS terminal 1 identifies the product captured by the customer and executes product registration processing (T6). In the process of T6, if the identified product is an age verification product, the POS terminal 1 inquires the server 3 about the customer's identity before performing the product registration processing (T7). When the server 3 receives an inquiry about identity verification from the POS terminal 1, the server 3 extracts the identity verification information of the customer from the identity verification storage unit 342 based on the customer ID received at the same time, and responds to the inquired POS terminal 1 (T8). The POS terminal 1 that has received the identity verification information collates the facial feature data calculated based on the captured image captured at T5 with the facial feature data included in the received identity verification information to perform identity verification (T9). When identity verification is successful, the POS terminal 1 confirms whether the customer is over a predetermined age based on the age verification information included in the received identity verification information (T10). If it is confirmed that the customer is over a certain age, the POS terminal 1 executes a product registration process for the age verification product (T6).

[0032] After the customer has registered all the products, the customer performs a payment operation. When the customer has registered the products, the POS terminal 1 executes the payment process for the products (T11). If the customer's identity is verified at T9 and a predetermined period (a second predetermined period) has elapsed since the last update, the POS terminal 1 transmits the facial feature data calculated based on the facial image captured at T5 to the server 3 together with information on the date when the facial image was captured at T5 (T12).

[0033] The server 3 overwrites the personal identification information stored at T4 with the facial feature data and date information received from the POS terminal 1, thereby updating the personal identification information (T13).

[0034] Next, the hardware configuration of the registration POS 5 will be described. FIG. 3 is a block diagram showing the hardware configuration of the registration POS 5. As shown in FIG. 3, the registration POS 5 includes a CPU (Central Processing Unit) 51, which is an example of a processor, a ROM (Read Only Memory) 52, a RAM (Random Access Memory) 53, a memory section 54, and the like. The CPU 51 is the main controller of the registration POS 5. The ROM 52 stores various programs. The RAM 53 loads programs and various data. The memory section 54 stores various programs. The CPU 51, the ROM 52, the RAM 53, and the memory section 54 are connected to one another via a bus 55. The CPU 51, the ROM 52, and the RAM 53 constitute a control section 500. That is, the control section 500 executes a control process of the registration POS 5, which will be described later, by the CPU 51 operating in accordance with a control program stored in the ROM 52 or the memory section 54 and loaded in the RAM 53.

[0035] The RAM 53 has a customer ID section 531 and a customer information section 532. The customer ID section 531 stores a customer ID and age verification information acquired from the reader / writer 60. The customer information section 532 stores face identification data calculated based on information of a face image of a customer captured by the imaging section 59.

[0036] The memory unit 54 is configured with a non-volatile memory such as a hard disk drive (HDD) or a flash memory that retains stored information even when the power is turned off, and has a control program unit 541 that stores a control program.

[0037] In addition, the control unit 500 is connected to an operation unit 57 , a display unit 58 , an imaging unit 59 , a reader / writer 60 , and a printer 61 via a bus 55 and a controller 56 .

[0038] The operation unit 57 has a start key 571, a registration key 572, and an end key 573. The start key 571 is operated when starting registration of customer information by the registration POS 5. The registration key 572 is operated when transmitting acquired customer information to the server 3. The end key 573 is operated when ending the operation of registering customer information by the registration POS 5.

[0039] The display unit 58 is, for example, a liquid crystal display, and displays information to a store clerk or a customer who operates the registration POS 5. The operation unit 57 may be a touch panel provided on the display unit 58.

[0040] The imaging unit 59 is, for example, a camera using a CCD (Charge Coupled Device) image sensor, and captures an image of the customer's face. The reader / writer 60 reads a customer ID and age verification information that identify the customer from a customer card held by the customer. The printer 61 prints the registered information and issues a receipt.

[0041] The control unit 500 is also connected to a communication unit 62 via a bus 55. The communication unit 62 is connected to the POS terminal 1 and the server 3 via a communication line 2 so as to be able to communicate with each other.

[0042] Next, the hardware configuration of the POS terminal 1 will be described. FIG. 4 is a block diagram showing the hardware configuration of the POS terminal 1. As shown in FIG. 4, the POS terminal 1 includes a CPU 11, which is an example of a processor, a ROM 12, a RAM 13, a memory unit 14, and the like. The CPU 11 is the main controller of the POS terminal 1. The ROM 12 stores various programs. The RAM 13 expands programs and various data. The memory unit 14 stores various programs. The CPU 11, the ROM 12, the RAM 13, and the memory unit 14 are connected to one another via a bus 15. The CPU 11, the ROM 12, and the RAM 13 constitute a control unit 100. That is, the control unit 100 executes a control process of the POS terminal 1, which will be described later, by the CPU 11 operating in accordance with a control program stored in the ROM 12 or the memory unit 14 and expanded in the RAM 13.

[0043] The RAM 13 has a customer ID section 131, a product information section 132, a captured image section 133, and a personal identification information section 134. The customer ID section 131 stores a customer ID acquired from the reader / writer 20. The product information section 332 stores product information (product name, price, etc.) of a product for which product registration processing has been performed. The captured image section 133 stores a facial image of the customer captured by the imaging section 19. The personal identification information section 134 stores personal identification information received from the server 3. The personal identification information section 134 will be described later with reference to FIG. 5.

[0044] The memory unit 14 is composed of a non-volatile memory such as a HDD or a flash memory that retains stored information even when the power is turned off, and includes a control program unit 141, a product master 142, and a predetermined period unit 143. The control program unit 141 stores a control program for driving the POS terminal 1. The product master 142 stores product information (product code that identifies the product, product name, price, etc.) related to each product sold in the store T. The predetermined period unit 143 stores a first predetermined period and a second predetermined period. The first predetermined period is period information for a predetermined long period (for example, several decades). If a too long first predetermined period or more has passed since the customer registered as a customer (since the facial feature data was first stored or since the facial feature data was last updated), the update of the facial feature data is not accepted and the customer is asked to register again. The second predetermined period is a period of time (for example, one month, half a year, one year, etc.) that has passed since the facial feature data was last updated. It is not necessary to update the face identification data for a short period (e.g., every day), and this causes an increase in the processing load of the POS terminal 1 and the server 3. Therefore, it is desirable to provide a second predetermined period, and if the first predetermined period and the second predetermined period have elapsed since the facial feature data was registered or the facial feature data was last updated, to overwrite the old facial feature data with new facial feature data calculated from the captured facial image, thereby updating the personal identification information. Note that the first predetermined period and the second predetermined period may be periods other than those mentioned above, and can be set arbitrarily.

[0045] In addition, the control unit 100 is connected to an operation unit 17, a display unit 18, an imaging unit 19, a reader / writer 20, and a printer 21 via a bus 15 and a controller 16. The operation unit 17 has a start key 171 and a settlement key 172. The start key 171 is operated when starting the operation of the POS terminal 1. The settlement key 172 is operated when performing a settlement process for a product that has been registered.

[0046] The display unit 18 is, for example, a liquid crystal display, and displays information to a customer who operates the POS terminal 1. The operation unit 17 may be a touch panel provided on the display unit 18.

[0047] The imaging unit 19 is, for example, a camera using a CCD image sensor, and captures the product to be purchased and the customer's face. The reader / writer 20 reads the customer ID that identifies the customer from the customer card held by the customer. The printer 21 issues a receipt on which product information and payment information related to the product for which payment has been processed are printed.

[0048] The control unit 100 is also connected to a communication unit 22 via a bus 15. The communication unit 22 is connected to the registration POS 5 and the server 3 via a communication line 2 so as to be able to communicate with each other.

[0049] Next, the personal identification information unit 134 will be described. The personal identification information unit 134 stores personal identification information received from the server 3, which is related to the customer of the customer ID stored in the customer ID unit 131. FIG. 5 is a memory map showing the memory configuration of the personal identification information unit 134. Note that FIG. 5 shows as an example the personal identification information of customer A received from the server 3. As shown in FIG. 5, the personal identification information unit 134 has a customer ID unit 1341, a facial feature data unit 1342, an age information unit 1343, an update date unit 1344, a customer information unit 1345, a personal identification flag unit 1346, and a no-transmission flag unit 1347.

[0050] The customer ID section 1341 stores a customer ID for identifying a customer. The facial feature data section 1342 stores registered customer facial feature data or updated facial feature data related to the customer of the customer ID stored in the customer ID section 1341. The age information section 1343 stores age verification information for verifying that the customer of the customer ID stored in the customer ID section 1341 is a predetermined age or older. The age information section 1343 stores, for example, the customer's date of birth as the age verification information. The age information section 1343 stores, for example, information (for example, flag information) indicating that the customer is a predetermined age or older as the age verification information. The age information section 1343 stores, for example, information (for example, flag information) indicating that a predetermined number of years have passed since the customer was born as the age verification information. The update date section 1344 stores the update date when the latest facial feature data was stored in the facial feature data section 1342. The customer information section 1345 stores various information (such as name, address, mobile terminal address, etc.) related to the customer of the customer ID stored in the customer ID section 1341. The identity confirmation flag section 1346 stores flag information (such as flag "1") indicating that the identity has been confirmed when it is confirmed that the customer whose face image is captured by the imaging section 19 is the customer whose customer ID is stored in the customer ID section 1341. The no-transmission flag section 1347 stores information (such as a flag) indicating that it is not necessary to replace the face feature data of the newly captured face image with the face feature data stored in the feature data section 1342 when the face feature data calculated based on the face image of the customer captured by the imaging section 19 matches or nearly matches the face feature data stored in the feature data section 1342 (i.e., when the similarity indicating that no change in the face image is observed and that the face images are nearly the same is equal to or greater than an upper limit (such as 98% to 100%)). When the no-transmission flag "1" is stored in the no-transmission flag section 1347, it indicates that the facial feature data calculated based on the customer's facial image captured by the imaging section 19 is approximately the same as the facial feature data stored in the feature data section 1342, and there is no need to replace the facial feature data of the newly captured facial image with the facial feature data stored in the feature data section 1342.

[0051] Next, the hardware configuration of the server 3 will be described. FIG. 6 is a block diagram showing the hardware configuration of the server 3. As shown in FIG. 6, the server 3 includes a CPU 31, which is an example of a processor, a ROM 32, a RAM 33, a memory unit 34, and the like. The CPU 31 is the main controller of the server 3. The ROM 32 stores various programs. The RAM 33 expands programs and various data. The memory unit 34 stores various programs. The CPU 31, the ROM 32, the RAM 33, and the memory unit 34 are connected to each other via a bus 35. The CPU 31, the ROM 32, and the RAM 33 constitute a control unit 300. That is, the control unit 300 executes the control process of the server 3, which will be described later, by the CPU 31 operating according to the control program stored in the ROM 32 or the memory unit 34 and expanded in the RAM 33.

[0052] The RAM 33 includes a sales management unit 331. The sales management unit 331 cumulatively stores product information and payment information received from the POS terminal 1, and manages sales of the store T.

[0053] The memory unit 34 is composed of a non-volatile memory such as a HDD or flash memory that retains stored information even when the power is turned off, and has a control program unit 341 and a personal identification storage unit 342. The control program unit 341 stores a control program for driving the server 3. The personal identification storage unit 342 stores personal identification information for each customer ID. The personal identification storage unit 342 will be described later with reference to FIG. 7.

[0054] In addition, the control unit 300 is connected to a display unit 37 and an operation unit 38 via a bus 35 and a controller 36. The display unit 37 is, for example, a liquid crystal display, and displays information to an operator of the server 3. The operation unit 38 is a keyboard operated by the operator.

[0055] The control unit 300 is also connected to a communication unit 39 via a bus 35. The communication unit 39 is connected to the registration POS 5 and the POS terminal 1 via a communication line 2 so as to be able to communicate with each other.

[0056] Next, the personal identification storage unit 342 will be described. The personal identification storage unit 342 stores personal identification information created based on customer information received from the registered POS 5 for each customer ID. The personal identification storage unit 342 also overwrites and stores facial feature data and date information received from the POS terminal 1. FIG. 7 is a memory map showing the memory configuration of the personal identification storage unit 342. As shown in FIG. 7, the personal identification storage unit 342 has a customer ID section 3421, a facial feature data section 3422, an age information section 3423, an update date section 3424, and a customer information section 3425.

[0057] The customer ID section 3421 stores a customer ID for identifying a customer. The facial feature data section 3422 stores the facial feature data of a registered customer or updated facial feature data in association with the customer ID stored in the customer ID section 3421. The age information section 3423 stores age verification information for verifying that the customer of the customer ID stored in the customer ID section 1341 is a predetermined age or older for each customer ID. The age information section 3423 stores, for example, the date of birth of the customer as the age verification information. The age information section 3423 stores, for example, information indicating that the customer is a predetermined age or older (for example, flag information) as the age verification information. The age information section 3423 stores, for example, information indicating that a predetermined number of years have passed since the customer was born (for example, flag information) as the age verification information. The update date section 3424 stores, for each customer ID, the update date when the latest facial feature data was stored in the facial feature data section 1342. The customer information section 3425 stores various information (such as name, address, mobile terminal address, etc.) relating to the customer of the customer ID stored in the customer ID section 3421 for each customer ID.

[0058] Next, a description will be given of the functional configuration of the registration POS 5, the POS terminal 1, and the server 3. FIG.

[0059] The control unit 500 of the registration POS 5 functions as a customer information acquisition unit 501, an image capture information acquisition unit 502, and a transmission unit 503 by following a control program stored in the ROM 52 or a control program unit 541 of the memory unit .

[0060] The customer information acquiring means 501 acquires customer information of the customer to be registered. Specifically, the customer information acquiring means 501 acquires the customer ID and age verification information of the customer stored in the customer card from the reader / writer 60.

[0061] The imaging information acquisition means 502 acquires facial feature data of the customer calculated based on the facial image of the customer captured by the imaging unit 59 .

[0062] The transmission means 503 transmits the acquired customer information (customer ID, age verification information, facial feature data, and information on the date when the facial feature data was calculated) to the server 3.

[0063] In addition, the control unit 100 of the POS terminal 1 functions as a feature data acquisition means 101, an image information acquisition means 102, a personal identification means 103, an update transmission means 104, a person identification information acquisition means 105, an inquiry means 106, and an age verification means 107 by following the control program stored in the ROM 12 or the control program section 141 of the memory unit 14.

[0064] The feature data acquisition means 101 acquires the facial feature data and age verification information of the person stored in the server 3. Specifically, the feature data acquisition means 101 acquires the identity verification information including the facial feature data and age verification information of the person stored in the server 3 in response to an inquiry by the inquiry means 106 described below.

[0065] The image capturing information acquiring unit 102 acquires facial information of the captured image of the customer's face. Specifically, the image capturing information acquiring unit 102 acquires facial information of the customer's face captured by the image capturing unit 19.

[0066] The identity verification means 103 verifies the identity of the person by comparing face feature data based on the face image acquired by the imaging information acquisition means 102 with face feature data acquired by the feature data acquisition means 101. Specifically, the identity verification means 103 verifies the face feature data based on the face image acquired by the imaging information acquisition means 102 with face feature data acquired by the feature data acquisition means 101, and verifies the identity of the person if the similarity is equal to or greater than a reference value (e.g., equal to or greater than 90%). More specifically, when the product imaged by the imaging unit 19 is an age verification product, the identity verification means 103 verifies the face feature data based on the face image acquired by the imaging information acquisition means 102 with face feature data acquired by the feature data acquisition means 101, and verifies the identity of the person if the similarity is equal to or greater than a reference value.

[0067] When the imaging information acquisition means 102 captures a plurality of face images, the personal identification means 103 may compare face feature data based on each face image with face feature data acquired by the feature data acquisition means 101 to calculate the respective similarities, and confirm the identity of the person when the highest similarity is equal to or greater than a reference value. When the imaging information acquisition means 102 captures a plurality of face images, the personal identification means 103 may compare face feature data based on each face image with face feature data acquired by the feature data acquisition means 101 to calculate the respective similarities, and confirm the identity of the person when the number of times the similarity is equal to or greater than the reference value is equal to or greater than a predetermined number of times.

[0068] When the identity verification means 103 verifies the identity of the person, the update transmission means 104 transmits the facial feature data of the facial image captured by the imaging information acquisition means 102 to the server 3. When the imaging information acquisition means 102 captures a plurality of facial images, the update transmission means 104 transmits the facial feature data with the highest similarity to the server 3. In the embodiment, when the identity verification means 103 verifies the identity of the person and the transmission unnecessary flag "1" is not stored in the transmission unnecessary flag section 1347, the update transmission means 104 transmits the facial feature data of the facial image captured by the imaging information acquisition means 102 to the server 3. When the identity verification means 103 verifies the identity of the person and the transmission unnecessary flag "1" is stored in the transmission unnecessary flag section 1347, the update transmission means 104 does not transmit the facial feature data of the facial image captured by the imaging information acquisition means 102 to the server 3.

[0069] The person identification information acquiring means 105 acquires a customer ID. Specifically, the person identification information acquiring means 105 reads a customer card with the reader / writer 20 to acquire the customer ID.

[0070] The inquiry means 106 inquires of the server 3 about the facial feature data based on the acquired customer ID. Specifically, the inquiry means 106 inquires of the server 3 about the facial feature data and age verification information based on the customer ID acquired by the reader / writer 20.

[0071] When the identity verification means 103 has verified the identity of the person, the age verification means 107 verifies whether the age of the person is equal to or greater than a predetermined age based on the age verification information. Specifically, when the product imaged by the imaging unit 19 is an age verification product and the identity verification means 103 has verified the identity of the person, the age verification means 107 verifies whether the age of the person is equal to or greater than a predetermined age based on the age verification information stored in the age information unit 1343.

[0072] Moreover, the control unit 300 of the server 3 functions as a feature data storage unit 301, an update unit 302, and a first response unit 303 by following the control program stored in the ROM 32 or the control program unit 341 of the memory unit .

[0073] The feature data storage unit 301 stores facial feature data indicating the facial features of a customer and age verification information. Specifically, the feature data storage unit 301 stores the facial feature data indicating the facial features of a customer and age verification information received from the registered POS 5.

[0074] The update means 302 updates the facial feature data stored by the feature data storage means 301 based on the facial feature data transmitted by the update transmission means 104. Specifically, the update means 302 overwrites and updates the facial feature data stored by the feature data storage means 301 based on the facial feature data transmitted by the update transmission means 104. When overwriting the facial feature data, the update means 302 overwrites and stores update date information indicating the update date indicating the date of overwriting in the update date section 3424.

[0075] The first response means 303 transmits the facial feature data and age verification information corresponding to the customer ID received in the inquiry by the inquiry means 106 to the POS terminal 1 that has made the inquiry. In the case of a first modified example described later, the control unit 300 of the server 3 functions as a second response means 304 instead of the first response means 303. In the case of the first modified example, the first response means 303 does not exist.

[0076] Next, the control of the registration POS 5 will be described. FIG. 9 is a flow chart showing the flow of the control process of the registration POS 5. As shown in FIG. 9, the control unit 500 of the registration POS 5 judges whether the start key 571 has been operated (S11). It waits until it is operated (No in S11), and if it is judged that the start key 571 has been operated (Yes in S11), the control unit 500 judges whether it has acquired the customer ID and age verification information stored in the customer card by the reader / writer 60 (S12). If it is judged that the customer ID and age verification information have been acquired (Yes in S12), the customer information acquisition means 501 stores the acquired customer ID and age verification information in the customer ID section 531 (S13). Then, the control unit 500 returns to S12.

[0077] If it is determined that the customer ID and age verification information are not to be acquired (No in S12), the control unit 500 determines whether the image capturing unit 59 has acquired a facial image of the customer (S14). If it is determined that a facial image has been acquired (Yes in S14), the control unit 500 calculates facial feature data of the customer based on the acquired facial image (S15). Then, the captured image acquisition means 502 stores the calculated facial feature data in the customer information unit 532 (S16). Then, the control unit 500 returns to S12.

[0078] Furthermore, if it is determined that a face image has not been acquired (No in S14), the control unit 500 determines whether various information of the customer (such as the customer's name, address, and mobile terminal address) corresponding to the acquired customer ID has been acquired from a customer server (not shown) or the like (S17). If it is determined that various information of the customer has been acquired (Yes in S17), the acquired various information is stored in the customer information unit 532 (S18). Then, the control unit 500 returns to S12.

[0079] Furthermore, if it is determined that the request is not to obtain various customer information (No in S17), the control unit 500 determines whether the registration key 572 has been operated (S21). If it is determined that the registration key 572 has been operated (Yes in S21), the transmission means 503 transmits the customer ID and age verification information stored in the customer ID section 531, and the facial feature data and various information stored in the customer information section 532 in association with each other to the server 3 (S22). Then, the control unit 500 returns to S12.

[0080] Moreover, if it is determined that the registration key 572 has not been operated (No in S21), the control unit 500 determines whether the end key 573 has been operated (S23). If it is determined that the end key 573 has not been operated (No in S23), the control unit 500 returns to S12, and if it is determined that the end key 573 has been operated (Yes in S23), the control unit 500 ends the process.

[0081] Next, the control of the POS terminal 1 will be described. FIG. 10 is a flowchart showing the flow of the control process of the POS terminal 1. As shown in FIG. 10, the control unit 100 of the POS terminal 1 judges whether the start key 171 has been operated (S31). The control unit 100 waits until the start key 171 has been operated (No in S31), and if it is judged that the start key 171 has been operated (Yes in S31), it judges whether the customer ID stored in the customer card has been acquired by the reader / writer 20 (S32). If it is judged that the customer ID has been acquired (Yes in S32), the person identification information acquisition means 105 stores the acquired customer ID in the customer ID section 131 (S33). Then, the control unit 100 returns to S32.

[0082] If it is determined that the customer ID is not to be acquired (No in S32), the control unit 100 determines whether the imaging unit 19 has acquired a facial image of the customer (S34). If it is determined that a facial image has been acquired (Yes in S34), the imaging information acquisition means 102 stores the acquired facial image in the captured image unit 133 (S35). The control unit 100 then calculates facial feature data of the customer based on the stored facial image (S36). The control unit 100 then stores the calculated facial feature data in the captured image unit 133 (S37). The control unit 100 then returns to S32.

[0083] Furthermore, if it is determined that a face image has not been acquired (No in S34), the control unit 100 determines whether a product image captured by the imaging unit 19 has been acquired (S41). If it is determined that a product image has been acquired (Yes in S41), the control unit 100 performs, for example, package recognition based on the acquired product image to identify the product (S42). Package recognition is a known technology that uses a general object recognition technology to identify a product from a captured product image.

[0084] Next, the control unit 100 (age verification product determination means) determines whether the identified product is an age verification product (S43). For example, in the product master 142, information (e.g., flag information) indicating that the product is an age verification product is attached to the age verification product, and whether or not the information is present can be determined. If it is determined that the product is not an age verification product (No in S43), the control unit 100 executes product registration processing for the product (S45). On the other hand, if it is determined that the product is an age verification product (Yes in S43), the control unit 100 executes identity verification processing and age verification processing (S44).

[0085] FIG. 11 is a flowchart showing the identity verification process and age verification process executed in S44. As shown in FIG. 11, the inquiry means 106 transmits the customer ID stored in the customer ID unit 131 to the server 3 and inquires about identity verification and age verification (S61). Then, the control unit 100 judges whether identity verification information corresponding to the transmitted customer ID has been received from the identity verification information stored in the identity verification storage unit 342 as a response to the inquiry (S62). The control unit 100 waits until it is received (No in S62), and if it is judged that identity verification information has been received (Yes in S62), the characteristic data acquisition means 101 stores the received identity verification information in the identity verification information unit 134 (S63). The identity verification information includes face feature data and age verification information as shown in FIG. 5.

[0086] Next, the control unit 100 judges whether the current date is equal to or longer than the first predetermined period stored in the predetermined period unit 143, based on the date information stored in the update date unit 1344 of the personal identification information stored in S63 (S64). If it is judged that the current date is equal to or longer than the first predetermined period (Yes in S64), an error message is displayed (S70) since too long a period has passed since the update date (or registration date), and the customer needs to register again. If the answer is Yes in S64, a message is displayed in S70 recommending that the customer perform the registration operation again at the registration POS 5. Then, the control unit 100 ends the process.

[0087] Also, if it is determined that the first predetermined period has not elapsed (No in S64), the identity verification means 103 determines whether the customer in the face image acquired in S34 is the same person based on the similarity calculated by comparing the facial feature data acquired in S34 and stored in S37 with the facial feature data (stored in the facial feature data unit 1342) included in the identity verification information received from the server 3 in S62 and stored in S63 (S65). If it is determined that the customer is not the same person (No in S65), the control unit 100 displays a message to the effect that the product determined to be an age-restricted product in S43 cannot be sold (S70). Then, the control unit 100 ends the process.

[0088] Moreover, if it is determined that the person is the principal (Yes in S65), the control unit 100 stores information indicating that the person is the principal (for example, flag "1") in the principal confirmation flag unit 1346 (S66).

[0089] Next, the control unit 100 judges whether the similarity level confirmed by the identity verification means 103 is equal to or higher than an upper limit (for example, 98% or higher (98% to 100%)) (S67). If it is equal to or higher than the upper limit, it indicates that the facial feature data calculated based on the face image of the customer captured by the imaging unit 19 and the facial feature data stored in the feature data unit 1342 are substantially identical, and it is not necessary to replace the facial feature data of the newly captured face image with the facial feature data stored in the feature data unit 1342. If it is judged that the similarity level is equal to or higher than the upper limit (Yes in S67), the control unit 100 stores information of the reply-unnecessary flag "1" in the reply-unnecessary flag unit 1347 (S68). If it is judged that the similarity level is not equal to or higher than the upper limit (i.e., is less than the upper limit) (No in S67), the control unit 100 does not store information of the reply-unnecessary flag "1" in the reply-unnecessary flag unit 1347 (skips the process of S68).

[0090] Next, the age verification means 107 judges whether the customer is over a predetermined age based on the age verification information of the customer stored in the age information section 1343 (S69). If it is judged that the customer is not over the predetermined age (No in S69), the control section 100 displays a message to the effect that the product judged to be an age-restricted product in S43 cannot be sold (S70). Then, the control section 100 ends the process.

[0091] If it is determined that the customer is over the predetermined age (Yes in S69), the control unit 100 (product registration means) executes product registration processing for the product determined to be an age verification product in S43 (S45), and then returns to S32.

[0092] Furthermore, in S41, if it is determined that the acquisition of a product image is not being performed (No in S41), the control unit 100 determines whether the payment key 172 has been operated (S51). If it is determined that the payment key 172 has not been operated (No in S51), the control unit 100 returns to S32, and if it is determined that the payment key 172 has been operated (Yes in S51), the control unit 100 executes a payment process for the product for which product registration processing has been performed and which is stored in the product information unit 132 (S52).

[0093] Next, the control unit 100 judges whether information confirming the identity of the person is stored in the identity confirmation flag unit 1346 (for example, whether a flag "1" is stored) (S53). If it is judged that information confirming the identity is not stored (No in S53), the process is terminated. If it is judged that information confirming the identity is stored (Yes in S53), the control unit 100 next judges whether the present (today's date) has passed the second predetermined period stored in the predetermined period unit 143 based on the date information stored in the update date unit 1344 of the identity confirmation information stored in S63 (S54). If it is judged that the second predetermined period has not passed (No in S54), the process is terminated.

[0094] Also, if it is determined that the second predetermined period or more has passed (Yes in S54), it is determined whether the reply-unnecessary flag "1" is stored in the reply-unnecessary flag unit 1347 (S55). If it is determined that the reply-unnecessary flag "1" is not stored (No in S55), the update transmission means 104 transmits the customer ID stored in S33, the facial feature data stored in S37, and the current date information (the day the facial image was acquired) to the server 3 (S56). Then, the control unit 100 ends the process. Also, if it is determined that the reply-unnecessary flag "1" is stored (Yes in S55), the control unit 100 ends the process without transmitting the customer ID stored in S33, the facial feature data stored in S37, and the current date information (the day the facial image was acquired) to the server 3.

[0095] When such a POS terminal 1 confirms the identity of the customer, if a second predetermined period has elapsed since the registration date (or update date), it transmits the latest facial feature data based on a captured facial image of the customer to the server 3.

[0096] Next, the control of the server 3 will be described. Fig. 12 is a flowchart showing the flow of the control process of the server 3. As shown in Fig. 12, the control unit 300 of the server 3 judges whether or not customer information has been received from the registered POS 5 (S71). If it is judged that customer information has been received (Yes in S71), the characteristic data storage means 301 creates personal identification information by associating each piece of the received customer information with the customer ID received at the same time, and stores the information in the personal identification storage unit 342 (S72). Then, the control unit 300 returns to S71.

[0097] Furthermore, if it is determined that the customer information has not been received from the registered POS 5 (No in S71), the control unit 300 determines whether an inquiry has been received from the POS terminal 1 in the process of S61 (S73). If it is determined that an inquiry has been received (Yes in S73), the control unit 300 extracts the personal identification information stored in the personal identification storage unit 342 in association with the customer ID received at the same time (S74). Then, the first response means 303 transmits the extracted personal identification information to the POS terminal 1 that made the inquiry (S75). Then, the control unit 300 returns to S71.

[0098] Also, if it is determined that the reception is not an inquiry (No in S73), the control unit 300 determines whether the customer ID, facial feature data, and date information have been received from the POS terminal 1 by the process of S55 (S76). If it is determined that the reception has been received (Yes in S76), the update means 302 overwrites the received facial feature data in the facial feature data section 3422 corresponding to the received customer ID, and overwrites the received date information in the update date section 3424, thereby updating the personal identification storage section 342 (S77). Then, the control unit 300 returns to S71. Note that, if it is determined that the reception is not a customer ID, facial feature data, and date information (No in S76), the control unit 300 returns to S71.

[0099] Such a server 3 overwrites and updates the facial feature data received from the POS terminal 1, and therefore can store the latest facial feature data.

[0100] In this way, according to the embodiment of the sales data processing system, the customer's facial feature data can be overwritten with data based on the latest facial image, making it possible to perform identity verification without reducing the accuracy when purchasing products that require age verification.

[0101] From here, a first modified example of the embodiment will be described. In the embodiment, in response to an inquiry, the facial feature data and age verification information of the customer are transmitted from the server 3 to the POS terminal 1. In the first modified example, in response to an inquiry, the facial feature data and age verification information of the customer are converted into code data and transmitted to a portable terminal carried by the customer, the portable terminal displays the received code data, and the POS terminal 1 acquires the facial feature data of the customer by reading the code data displayed on the portable terminal with the imaging unit 19.

[0102] 13 shows a sales data processing system 10 according to a first modified example. As shown in FIG. 13, a server 3 is capable of communicating with a mobile terminal 7 via a wireless communication line 8.

[0103] In the case of the first modified example, the control unit 300 of the server 3 functions as the second response means 304 instead of the first response means 303. The second response means 304 transmits the identity verification information including the facial feature data and age verification information corresponding to the customer ID received in the inquiry by the inquiry means 106 to the mobile terminal 7. Specifically, the second response means 304 transmits a code symbol obtained by symbolizing the identity verification information to the mobile terminal 7 specified by the address of the mobile terminal stored in the customer information unit 3425.

[0104] Fig. 14 is a diagram showing a state in which the mobile terminal 7 displays the code symbol received from the server 3. The other configuration is the same as that in Fig. 1. As shown in Fig. 14, the mobile terminal 7 displays the code symbol (e.g., a two-dimensional code) received from the server 3 on the display.

[0105] The POS terminal 1 captures an image of the displayed code symbol using the imaging unit 19. Then, the feature data acquisition means 101 of the POS terminal 1 decodes the captured code symbol to acquire facial feature data contained in the code symbol.

[0106] The server 3 symbolizes the personal identification information extracted in S74 in Fig. 12. Then, the second response means 304 transmits the symbolized code symbol to the portable terminal 7 (S75).

[0107] In FIG. 11, the control unit 100 of the POS terminal 1 determines whether the code symbol displayed on the portable terminal 7 has been read (S62), and if it is determined that the code symbol has been read (Yes in S62), the characteristic data acquisition means 101 decodes the read code symbol and stores the decoded personal identification information in the personal identification information unit 134 (S63).

[0108] In the first modified example, the configuration and control other than those described above are similar to those of the embodiment, and therefore description thereof will be omitted.

[0109] In this way, according to the sales data processing system of the first variant, the customer's facial feature data can be overwritten with data based on the latest facial image, making it possible to perform identity verification without reducing the accuracy when purchasing products that require age verification.

[0110] Next, a second modified example of the embodiment will be described. In the embodiment and the first modified example, the server 3 has an identity verification storage unit 342 (shown in Figs. 6 and 7), and the update means 302 of the server 3 overwrites the received facial feature data in the facial feature data unit 3422 corresponding to the received customer ID and overwrites the received date information in the update date unit 3424 to update the identity verification storage unit 342 in the process of S77, but in the second modified example, the memory unit 14 of the POS terminal 1 is provided with an identity verification storage unit 144 (feature data storage unit) having the same configuration as the identity verification storage unit 342. Specifically, the second modified example has the following configuration and performs the following control.

[0111] Fig. 15 is a block diagram showing a hardware configuration of the POS terminal 1 according to the second modified example. As shown in Fig. 15, the POS terminal 1 has an identity confirmation storage unit 144 in the memory unit 14. The identity confirmation storage unit 144 has the same configuration as the identity confirmation storage unit 342. Note that in the second modified example, the configuration other than the identity confirmation storage unit 144 is the same as that of the embodiment.

[0112] In the second modified example having such a configuration, the server 3 transmits the personal identification information stored in the personal identification storage unit 342 to each POS terminal 1 at a predetermined timing (for example, at the timing of opening of the store each day). Each POS terminal 1 stores the personal identification information received from the server 3 in the memory 14 as the personal identification storage unit 144.

[0113] Next, the control of the POS terminal 1 according to the second modified example will be described. Figures 16 and 17 are flowcharts showing the control process of the POS terminal 1 in the second modified example. Figure 16 is basically the same process as Figure 10, but S56 in Figure 10 is changed to S71. That is, when the POS terminal 1 in the second modified example determines that the reply unnecessary flag "1" is not stored (No in S55), the control unit 100 (update storage means) stores the customer ID stored in S33, the facial feature data stored in S37, and the current date information (the date the facial image was acquired) in the personal identification storage unit 144 (S71). Specifically, the control unit 100 (update storage means) overwrites and stores the facial feature data stored in S37 in the facial feature data section (corresponding to the facial feature data section 3422 of the personal identification storage unit 342) of the personal identification storage unit 144 (S71), and overwrites and stores the current date information (the date the facial image was acquired) in the update date section (corresponding to the update date section 3424 of the personal identification storage unit 342) of the personal identification storage unit 144 (S71). Then, the control unit 100 ends the process. The other processes in FIG. 16 of the second modified example are equivalent to those in FIG. 10.

[0114] 17 is basically the same as the process in FIG. 11, but the processes of S61 to S63 in FIG. 11 are changed to a process of S72. That is, the POS terminal 1 in the second modified example does not inquire the server 3 about the personal identification information related to the customer stored in S32, but acquires it from the personal identification storage unit 144 (S72). The control unit 100 executes the processes and judgments of S64 to S70 based on the personal identification information acquired in this manner.

[0115] The control unit 100 transmits the personal identification information stored in the personal identification storage unit 144 to the server 3 at a predetermined timing (for example, at the time of closing the store or settlement processing each day). The server 3 overwrites and stores the personal identification information received from the POS terminal 1 in the personal identification storage unit 342 to update it.

[0116] In this way, according to the sales data processing system of the second variant, the customer's facial feature data can be overwritten with data based on the latest facial image, making it possible to perform identity verification without reducing the accuracy when purchasing products that require age verification.

[0117] As described above, the embodiment and the first modified example are a sales data processing system 10 having a POS terminal 1 which performs product registration processing of products sold in a store by operation of a customer, and a server 3. The server 3 is provided with a feature data storage means 301 which associates and stores facial feature data indicating the facial features of a customer with age verification information of the customer. The POS terminal 1 is provided with an image information acquisition means 102 which acquires facial information of an image of a customer's face, a feature data acquisition means 101 which acquires the facial feature data and age verification information of the customer stored in the server 3, an age verification product determination means which determines whether the product to be purchased is an age verification product, and, when it is determined that the product is an age verification product, stores the facial feature data based on the facial image acquired by the image information acquisition means 102 and the feature data. The system comprises an identity verification means 103 which verifies the identity of the customer by comparing the facial feature data acquired by the data acquisition means 101, an age verification means 107 which, if the identity is verified, determines based on the age verification information whether the customer is over the age at which the customer can purchase an age verification product, a product registration means which performs product registration processing for the age verification product if it is determined that the customer is over the age at which the customer can purchase the age verification product, and an update transmission means 104 which, if the identity is verified, transmits facial feature data of the captured facial image to a server 3, and the server 3 comprises an update means 302 which overwrites and stores the facial feature data of the customer stored in the feature data storage means 301 based on the facial feature data transmitted by the update transmission means 104.

[0118] In the embodiment and the first modified example configured as above, if the product to be purchased is an age verification product, and the identity of the purchaser is confirmed, the facial feature data stored in the server 3 is updated to facial feature data based on the facial image acquired by the POS terminal 1. In this way, in the embodiment and the first modified example, the face can be collated based on the updated facial feature data, so that it is possible to prevent a decrease in the accuracy of identity verification when selling age verification products.

[0119] In addition, the POS terminal 1 in the embodiment and the first variant example is a POS terminal 1 in a sales data processing system 10 having a POS terminal 1 that performs product registration processing for products sold in a store by operation of a customer, and a server 3 that stores facial feature data of the customer, and is equipped with an image information acquisition means 102 that acquires facial information of an image of the customer's face, a feature data acquisition means 101 that acquires the facial feature data stored in the server 3 and age verification information of the customer, an age verification product determination means that determines whether the product to be purchased is an age verification product, an identity verification means 103 that, when it is determined that the product is an age verification product, compares the facial feature data based on the facial image acquired by the image information acquisition means 102 with the facial feature data acquired by the feature data acquisition means 101 to verify the identity of the customer, an age verification means 107 that, when it is confirmed that the customer is the identity of the customer, determines whether the customer is over the age to purchase an age verification product based on the age verification information, a product registration means that performs product registration processing for the age verification product when it is determined that the customer is over the age to purchase an age verification product, and an update transmission means that transmits the facial feature data of the imaged facial image to the server 3 when it is confirmed that the customer is the identity of the customer.

[0120] In the POS terminal 1 according to the embodiment and the first modified example configured as above, when the product to be purchased is an age verification product, if the identity of the purchaser is confirmed, the POS terminal 1 transmits facial feature data based on the facial image acquired by the POS terminal 1 to the server 3. In this way, in the embodiment and the first modified example, the face can be matched based on the updated facial feature data, so that it is possible to prevent a decrease in the accuracy of identity verification when selling an age verification product.

[0121] In addition, the POS terminal 1 of the second variant is a POS terminal 1 that performs product registration processing for products sold in a store by operation of a customer, and is equipped with an identity verification memory unit 144 that stores facial feature data indicating the facial features of the customer and age verification information, an image information acquisition means 102 that acquires facial information of an image of the customer's face, an age verification product determination means that determines whether the product to be purchased is an age verification product, an identity verification means 103 that, when it is determined that the product is an age verification product, compares the facial feature data based on the facial image acquired by the image information acquisition means 102 with the facial feature data stored in the identity verification memory unit 144 to verify the identity of the customer, an age verification means 107 that, when it is confirmed that the customer is the customer, determines based on the age verification information whether the customer is over the age at which the customer can purchase an age verification product, a product registration means that performs product registration processing for the age verification product when it is determined that the customer is over the age at which the customer can purchase an age verification product, and an update storage means that, when it is confirmed that the customer is the customer, overwrites and stores the facial feature data of the imaged facial image in the identity verification memory unit 144.

[0122] In the POS terminal 1 according to the second modified example configured as above, when the product to be purchased is an age verification product, if the identity of the purchaser is confirmed, facial feature data based on the facial image acquired by the POS terminal 1 is overwritten and stored in the identity verification storage unit 144. In this way, in the second modified example, since the face can be matched based on the updated facial feature data, it is possible to prevent a decrease in the accuracy of identity verification when selling an age verification product.

[0123] Furthermore, in the embodiment and the first variant, the feature data storage means 301 stores the updated update date information each time the facial feature data is updated, the feature data acquisition means 101 acquires the update date information along with the facial feature data, and the update transmission means 104 transmits the facial feature data and information on the date the previous image was captured if the date on which the imaging information acquisition means 102 acquired the facial image is more than a second predetermined period after the update date indicated by the update date information.

[0124] In the embodiment and the first variant of this configuration, facial feature data and information on the date the previous image was captured are transmitted if a predetermined period of time has passed since the update date (facial feature data and information on the date are not transmitted each time identity verification is performed), so there is no processing burden on the POS terminal 1 and the server 3.

[0125] Although the embodiment and the modified example of the present invention have been described above, the embodiment and the modified example are presented as examples and are not intended to limit the scope of the invention. The embodiment and the modified example can be implemented in various other forms, and various omissions, substitutions, changes, and combinations can be made without departing from the gist of the invention. The embodiment and the modified example are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims.

[0126] For example, in the embodiment, the POS terminal 1 has been described as an example of the sales data processing device. However, the sales data processing device is not limited to this and may be any device that is operated by a customer to verify the identity of the customer, and may be, for example, an identity verification device installed in a vending machine that sells tobacco or alcohol, or in a store that sells hazardous materials.

[0127] In the embodiment, the registration POS 5 is installed at a checkout counter as an example, but the present invention is not limited to this, and the location of the registration POS 5 does not matter as long as the registration operation can be performed.

[0128] Also, in the embodiment, the registration POS 5 has been described as a device separate from the POS terminal 1. However, this is not limiting, and the POS terminal 1 may also function as the registration POS 5. That is, a customer may use, for example, an unoccupied POS terminal 1 to perform customer registration processing (that is, to function as the registration POS 5).

[0129] In the embodiment, the server 3 is installed in the store T. However, the present invention is not limited to this, and the server 3 may be, for example, a server installed in a headquarters or a cloud server installed on a cloud.

[0130] In the embodiment, the face identification data is transmitted if the second predetermined period has passed since the registration date or update date of the face feature data (determination in S64). However, the determination as to whether the second predetermined period has passed is not essential and may be omitted. In this case, the face identification data will be transmitted every time the identity of the person is confirmed. Furthermore, the first predetermined period is not essential. [Explanation of symbols]

[0131] 1 POS terminal 3 Server 5. Registration POS 7 Mobile devices 10. Identity Verification System 19 Imaging section 20 Reader / Writer 59 Imaging section 60 Reader / Writer 100 Control section 101 Feature data acquisition means 102 Imaging information acquisition means 103 Identity Verification Methods 104 Update transmission means 105 Means of obtaining person specific information 106 Contact Methods 107 Age Verification Methods 131 Customer ID Department 132 Product Information Department 133 Imaging unit 134 Identification Information Division 143 Scheduled Period Division 300 Control section 301 Feature data storage means 302 Update method 303 First response means 304 Second response means 331 Sales Management Department 332 Product Information Department 342 Personal Identification Memory Unit 500 Control section 501 Customer information acquisition means 502 Imaging information acquisition means 503 Transmission Method 531 Customer ID Department 532 Customer Information Department 1341 Customer ID Department 1342 Facial Feature Data Section 1343 Age Information Department 1344 Update date section 1345 Customer Information Department 1346 Identity Verification Flag Section 3421 Customer ID Department 3422 Facial Feature Data Section 3423 Age Information Department 3424 Update date section 3425 Customer Information Department [Prior art documents] [Patent documents]

[0132] [Patent Document 1] JP 2016-181013 A

Claims

1. A sales data processing system having a sales data processing device that performs product registration processing of products sold in a store by customer operation, and a server, The server, A feature data storage means for storing face feature data indicating the facial features of a customer and age verification information of the customer in association with each other; Equipped with The sales data processing device includes: An imaging information acquisition means for acquiring face information of an image of a customer's face; a feature data acquisition means for acquiring the facial feature data and age verification information of the customer stored in the server; an age verification product determination means for determining whether the product to be purchased is an age verification product; an identity verification means for verifying the identity of the purchaser when it is determined that the product is an age verification product by comparing facial feature data based on the facial image acquired by the image capture information acquisition means with the facial feature data acquired by the feature data acquisition means; an age verification means for determining whether the customer is over the age required to purchase the age verification product based on the age verification information when the customer's identity is verified; a product registration means for performing the product registration process for the age verification product when it is determined that the customer is over the age at which the age verification product can be purchased; an update transmission means for transmitting facial feature data of the captured facial image to the server when the identity of the person is confirmed; Equipped with The server, an update means for overwriting and storing the facial feature data of the customer stored in the feature data storage means based on the facial feature data transmitted by the update transmission means; A sales data processing system comprising:

2. The server, storing the facial feature data and the age verification information of the customer in association with customer identification information that identifies the customer; The sales data processing device includes: A person identification information acquisition means for acquiring the customer identification information; and an inquiry means for inquiring of the server about the facial feature data and the age verification information based on the acquired customer identification information, the feature data acquisition means acquires the facial feature data and the age verification information of the customer based on the customer identification information acquired by the person identification information acquisition means; The update transmission means transmits the acquired customer identification information and the facial feature data based on the facial image, the updating means updates the facial feature data stored in association with the received customer identifying information to the received facial feature data; 2. The sales data processing system according to claim 1.

3. The inquiry means makes an inquiry about the facial feature data and the age verification information when it is determined that the product is an age verification product, the feature data acquisition means acquires the facial feature data and the age verification information of the customer in response to the inquiry; 3. The sales data processing system according to claim 2.

4. The server, a first response means for transmitting the facial feature data and the age verification information corresponding to the customer identification information received together with the inquiry by the inquiry means to the sales data processing device that has made the inquiry; the feature data acquisition means acquires the facial feature data and the age verification information transmitted by the first response means; 4. A sales data processing system according to claim 2 or 3.

5. The server, a second response means for transmitting the facial feature data and the age verification information corresponding to the customer identification information received together with the inquiry by the inquiry means to a portable terminal carried by the customer, the feature data acquisition means acquires the facial feature data and the age verification information transmitted to the portable terminal by the second response means by reading a code symbol including the facial feature data and the age verification information displayed on the portable terminal; 4. A sales data processing system according to claim 2 or 3.

6. the updating means stores update date information indicating the update date when the facial feature data is overwritten and stored each time the facial feature data is overwritten and stored, the feature data acquisition means acquires the update date information together with the facial feature data and the age verification information; the update transmission means transmits the facial feature data and information on the date on which the facial image was captured when a second predetermined period has elapsed since the update date indicated by the update date information on the date on which the facial image was captured by the imaging information acquisition means.

4. A sales data processing system according to claim 1.

7. the identity verification means verifies the identity of the person when a similarity calculated from facial feature data based on the face image acquired by the imaging information acquisition means and the facial feature data acquired by the feature data acquisition means is equal to or greater than a reference value; the update transmission means transmits the facial feature data of the captured facial image to the server when the identity verification means verifies the identity of the person and the similarity is less than an upper limit value indicating that the facial feature data based on the facial image acquired by the image capture information acquisition means and the facial feature data acquired by the feature data acquisition means match or nearly match, and does not transmit the facial feature data of the captured facial image to the server when the similarity is equal to or greater than the upper limit value.

4. A sales data processing system according to claim 1.

8. The feature data storage means stores the facial feature data and the storage date of the age verification information, the identity verification means does not verify the identity of the person when a first predetermined period longer than the second predetermined period has elapsed since the storage date or the update date indicated by the update date information previously stored by the update means; 7. The sales data processing system according to claim 6.

9. A sales data processing device for performing product registration processing of products sold in a store by customer operation, and a server for storing facial feature data of the customers, the sales data processing device being in a sales data processing system, An imaging information acquisition means for acquiring face information of an image of a customer's face; a feature data acquisition means for acquiring the facial feature data and the customer's age verification information stored in the server; an age verification product determination means for determining whether the product to be purchased is an age verification product; an identity verification means for verifying the identity of the purchaser when it is determined that the product is an age verification product by comparing facial feature data based on the facial image acquired by the image capture information acquisition means with the facial feature data acquired by the feature data acquisition means; an age verification means for determining whether the customer is over the age required to purchase the age verification product based on the age verification information when the customer's identity is verified; a product registration means for performing the product registration process for the age verification product when it is determined that the customer is over the age at which the age verification product can be purchased; an update transmission means for transmitting facial feature data of the captured facial image to the server when the identity of the person is confirmed; A sales data processing device comprising:

10. A sales data processing device that performs product registration processing of products sold in a store by customer operation, a feature data storage unit that stores facial feature data indicating the facial features of a customer and age verification information; An imaging information acquisition means for acquiring face information of an image of a customer's face; an age verification product determination means for determining whether the product to be purchased is an age verification product; an identity verification means for verifying the identity of a person by collating facial feature data based on a facial image acquired by the image capture information acquisition means with the facial feature data stored in the feature data storage unit when the person is determined to be an age verification product; an age verification means for determining whether the customer is over the age required to purchase the age verification product based on the age verification information when the customer's identity is verified; a product registration means for performing the product registration process for the age verification product when it is determined that the customer is over the age at which the age verification product can be purchased; an update storage means for overwriting and storing facial feature data of the captured facial image in the feature data storage unit when the identity of the person is confirmed; A sales data processing device comprising:

11. A sales data processing system having a sales data processing device that performs product registration processing of products sold in a store by customer operation and a server that stores facial feature data of the customers, comprising: An imaging information acquisition means for acquiring face information of an image of a customer's face; a feature data acquisition means for acquiring the facial feature data and the customer's age verification information stored in the server; an age verification product determination means for determining whether the product to be purchased is an age verification product; an identity verification means for verifying the identity of the purchaser when it is determined that the product is an age verification product by comparing facial feature data based on the facial image acquired by the image capture information acquisition means with the facial feature data acquired by the feature data acquisition means; an age verification means for determining whether the customer is over the age required to purchase the age verification product based on the age verification information when the customer's identity is verified; a product registration means for performing the product registration process for the age verification product when it is determined that the customer is over the age at which the age verification product can be purchased; an update transmission means for transmitting facial feature data of the captured facial image to the server when the identity of the person is confirmed; A program that can be used to

12. a computer as a sales data processing device, comprising: a feature data storage unit for storing face feature data indicating the features of a customer's face and age verification information; and a product registration process for products sold in a store according to an operation by the customer; An imaging information acquisition means for acquiring face information of an image of a customer's face; an age verification product determination means for determining whether the product to be purchased is an age verification product; an identity verification means for verifying the identity of a person by collating facial feature data based on a facial image acquired by the image capture information acquisition means with the facial feature data stored in the feature data storage unit when the person is determined to be an age verification product; an age verification means for determining whether the customer is over the age required to purchase the age verification product based on the age verification information when the customer's identity is verified; a product registration means for performing the product registration process for the age verification product when it is determined that the customer is over the age at which the age verification product can be purchased; an update storage means for overwriting and storing facial feature data of the captured facial image in the feature data storage unit when the identity of the person is confirmed; A program that can be used to

Images