Information Processing System
The information processing system addresses the inconvenience of carrying multiple membership cards by using facial recognition or biometric authentication to link customer identities with membership codes, enhancing convenience and reducing costs.
Patent Information
- Application Number
- JP2020029564
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-02-25
- Publication Date
- 2024-11-14
- Estimated Expiration
- 2040-02-25
AI Technical Summary
Customers often need to carry multiple membership cards for different stores, which is inconvenient.
An information processing system that uses facial recognition or biometric authentication to associate a customer's face or biometric information with identification information, which is then linked to a membership code, allowing the system to identify and manage customer memberships across different stores without the need for physical cards.
Reduces the inconvenience of carrying multiple membership cards by enabling seamless identification and management of customer memberships using facial recognition or biometric authentication, minimizing the need for physical cards and reducing costs associated with their issuance and replacement.
Smart Images

Figure 0007583528000001 
Figure 0007583528000002 
Figure 0007583528000003
Abstract
Description
[Technical field]
[0001] FIELD An embodiment of the present invention relates to an information processing system. [Background technology]
[0002] Traditionally, supermarkets and other stores have had a system where customers can receive benefits such as points by presenting their membership card to a store clerk or by having their membership card scanned by a self-service POS (Point of Sales) terminal when purchasing products. Summary of the Invention [Problem to be solved by the invention]
[0003] However, since a single customer generally visits multiple stores, in the conventional technology the customer would have to carry membership cards for multiple stores, which could be inconvenient. [Means for solving the problem]
[0004] An information processing system according to an embodiment includes an authentication device and an information processing device. The authentication device includes a first acquisition unit, a reading unit, a first transmission unit, and a reception unit. The first acquisition unit acquires a face image or biometric information of a customer. The reading unit reads identification information attached to an object that the customer can carry when shopping. The first transmission unit associates the face image or biometric information with the identification information and transmits them to the information processing device. The information processing device includes a second acquisition unit, an identification unit, a second transmission unit, and a registration unit. The second acquisition unit acquires the face image or biometric information and the identification information from the authentication device. The identification unit identifies the customer's membership code from the acquired face image or biometric information, and associates the membership code with the identification information. When the identification information is transmitted from a payment device that settles a transaction for the customer, the second transmission unit transmits the membership code associated with the identification information to the payment device. The reception unit of the authentication device further includes a reception unit that receives input of member information of the customer by an operation of the customer when the customer is not registered as a member. The first transmission unit transmits a face image of the customer when the reception unit receives the input of the member information of the customer. image Or biometric information 、 The registration unit of the information processing device transmits the member information to the information processing device in association with the member information. Customer's facial image or Biometric information and 、 When the member information is submitted, the newly issued member code will be , customer's facial image or Biometric information and, Member Information and Register it in correspondence with . [Brief description of the drawings]
[0005] [Figure 1] FIG. 1 is a diagram illustrating an example of an overall configuration of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of the authentication device according to the embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of functions of the authentication device according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of functions of the server according to the embodiment. [Diagram 5]FIG. 5 is a diagram illustrating an example of a face image database according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a member information database according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a membership code conversion table according to the embodiment. [Figure 8] FIG. 8 is a flowchart showing an example of a process flow for associating a customer with a barcode attached to a shopping basket according to the embodiment. [Figure 9] FIG. 9 is a flowchart showing an example of the flow of a membership code identification process during a transaction process according to this embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0006] Hereinafter, an information processing system according to an embodiment will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below.
[0007] FIG. 1 is a diagram showing an example of an overall configuration of an information processing system S according to an embodiment. As shown in FIG. 1, the information processing system S is used in a store 7 such as a supermarket. The information processing system S includes an authentication device 1 and a server 5. The authentication device 1 and the server 5 are connected to each other via a network such as a LAN (Local Area Network) so that they can communicate with each other. In addition, the server 5 is connected to POS (Point of Sales) terminals 31 to 33 installed in the store 7 so that they can communicate with each other via the network such as a LAN.
[0008] The authentication device 1 is installed, for example, near an entrance 71 of a store 7. An imaging device 2 is installed near the authentication device 1. The imaging device 2 transmits a captured image to the authentication device 1. Also, shopping baskets 61-64 are placed near the authentication device 1. An individual barcode is attached to each of the shopping baskets 61-64.
[0009] The shopping baskets 61 to 64 are examples of objects that the customer 4 can carry around when shopping in this embodiment. Hereinafter, when there is no need to particularly distinguish between the individual shopping baskets 61 to 64, they will simply be referred to as the shopping basket 6.
[0010] Furthermore, the barcode attached to the shopping basket 6 is an example of identification information. The barcode is also an example of a code symbol. The code symbol may be a two-dimensional barcode or the like. Furthermore, the object to which the barcode is attached is not limited to the shopping basket 6, but may be, for example, a shopping cart, a tag that can be attached to the shopping basket 6, or a reusable bag brought by the customer 4. For example, the authentication device 1 may issue a sticker on which a barcode is printed so that it can be attached to a reusable bag brought by the customer 4.
[0011] Furthermore, the medium that holds the identification information is not limited to code symbols such as barcodes. For example, a wireless tag such as an RFID (Radio Frequency Identification) tag that transmits identification information may be attached to the shopping basket 6. Although the medium that holds the identification information is not limited to these examples, it is preferable that the medium be a medium that can be read by a normal POS terminal 3.
[0012] A customer 4 visiting a store 7 operates the authentication device 1 to register his / her own face photograph 80 captured by the imaging device 2 in association with the barcode 81 attached to the shopping basket 61 selected by the customer 4. When one customer 4 has multiple shopping baskets 6, it is sufficient to register the barcode 81 attached to at least one shopping basket 6.
[0013] The authentication device 1 transmits the registered face photograph 80 and barcode 81 in association with each other to the server 5. The face photograph 80 is an example of a face image in this embodiment. Furthermore, if the customer 4 is not a member of the store 7, the authentication device 1 may accept a new member registration.
[0014] The imaging device 2 is a camera that is installed near the authentication device 1 and is capable of capturing a facial photograph 80 of a customer 4 standing in front of the authentication device 1. The imaging device 2 is electrically connected to the authentication device 1 and transmits the captured facial photograph 80 to the authentication device 1. Note that the imaging device 2 only needs to be capable of capturing an image of at least the face of the customer 4, and may be capable of capturing an image of the entire body of the customer 4.
[0015] The imaging device 2 may be not included in the information processing system S, or may be included in the information processing system S. In addition, in FIG. 1, the imaging device 2 is installed outside the authentication device 1, but the authentication device 1 may be equipped with the imaging device 2.
[0016] Furthermore, the authentication device 1 may authenticate the customer 4 using a method other than the facial photograph 80. For example, the authentication device 1 may perform biometric authentication of the customer 4 using a fingerprint, iris, or the like.
[0017] The server 5 is a store computer installed, for example, in the back yard of the store 7. The server 5 acquires product registration information on products purchased by the customers 4 and settlement information on payment from the POS terminals 31-33, and centrally manages them. The product registration information includes, for example, the product code, quantity, unit price, etc. of the products purchased by the customers 4. The settlement information includes, for example, the product code, quantity, unit price, etc. of the products purchased by the customers 4, the amount paid by the customers 4, and points generated by the transaction, etc.
[0018] The server 5 also stores the membership codes and facial photographs of pre-registered members in association with each other. The server 5 also stores information such as the member's point balance. The server 5 stores the membership code corresponding to the facial photograph 80 acquired from the authentication device 1 in association with the barcode 81. When the customer 4 performs the product registration process and payment process at the POS terminals 31-33, the server 5 transmits to the POS terminals 31-33 the membership code of the customer 4 associated with the barcode 81 of the shopping basket 6 read by the POS terminals 31-33.
[0019] The server 5 is an example of an information processing device in this embodiment. The server 5 may be provided outside the store 7. For example, when member information is shared among a plurality of stores, the server 5 may be provided in a headquarters that manages the plurality of stores. The server 5 may also be provided in a cloud environment.
[0020] The store 7 is also provided with POS terminals 31-33 capable of registering and paying for products purchased by the customer 4. The POS terminals 31-33 are an example of a payment device in this embodiment. In FIG. 1, the POS terminals 31-33 are self-service POS terminals that the customer 4 can operate, but they may be normal POS terminals operated by a store clerk, or self-service POS terminals in which the store clerk performs product registration and the customer 4 performs payment. Hereinafter, when there is no need to distinguish between the individual POS terminals 31-33, they will be referred to as POS terminal 3. Hereinafter, the product registration and payment processes will be collectively referred to as checkout processes.
[0021] In this embodiment, the POS terminal 3 reads the barcode 81 attached to the shopping basket 61 when the customer 4 performs a checkout process. For example, the customer 4 or a store clerk holds a hand scanner provided in the POS terminal 3 over the barcode 81 on the shopping basket 61 to read the barcode 81. If the POS terminal 3 is equipped with a vertical scanner, the vertical scanner may read the barcode 81 when the customer 4 places the shopping basket 61 in front of the vertical scanner. If a wireless tag is attached to the shopping basket 61, the POS terminal 3 receives identification information from the wireless tag.
[0022] As described above, the barcode 81 attached to the shopping basket 61 held by the customer 4 and the membership code of the customer 4 are associated by the authentication device 1, so the POS terminal 3 can identify the membership code of the customer 4 from the barcode 81. For example, the POS terminal 3 queries the server 5 about the read identification information and obtains from the server 5 the membership code associated with the barcode 81.
[0023] Furthermore, the POS terminal 3 treats the customer 4 as a member based on the acquired membership code. For example, the POS terminal 3 grants points that are generated when the customer 4 purchases a product to the acquired membership code. Note that, in this embodiment, the granting of points is exemplified as a benefit that a member can receive, but the benefit that a member can receive is not limited to this and may be a discount service or the like.
[0024] Next, a description will be given of the configuration of the authentication device 1. Fig. 2 is a diagram showing an example of a hardware configuration of the authentication device 1 according to this embodiment. As shown in Fig. 2, the authentication device 1 includes a control device such as a CPU (Central Processing Unit) 11, storage devices such as a RAM (Random Access Memory) 12 and a ROM (Read Only Memory) 13, an HDD (Hard Disk Drive) 14, a display 15, an operation unit such as a touch panel 16, a communication interface 17, a device interface 19, and a scanner 18.
[0025] The authentication device 1 may include other non-volatile storage devices such as flash memory instead of the HDD 14. The authentication device 1 may also include a dedicated scanner (not shown) capable of reading biometric information such as a fingerprint or iris of the customer 4. The authentication device 1 may also include an antenna (not shown) capable of reading a wireless tag.
[0026] The communication interface 17 is an interface that can be connected to a network such as a LAN, etc. The communication interface 17 transmits and receives information to and from the server 5 via the network.
[0027] The scanner 18 reads the barcode attached to the shopping basket 6. The scanner 18 may be a hand scanner that the customer 4 can hold in his / her hand and hold over the shopping basket 6, or may be a vertical scanner.
[0028] The device interface 19 is an interface for connecting to various devices. For example, the device interface 19 connects to the imaging device 2 and acquires a facial photograph 80 captured by the imaging device 2.
[0029] The imaging device 2 may be connected to the communication interface 17 via a network, instead of the device interface 19. Although the imaging device 2 is configured outside the authentication device 1 in FIG.
[0030] Fig. 3 is a diagram showing an example of functions of the authentication device 1 according to this embodiment. As shown in Fig. 3, the authentication device 1 includes a display control unit 101, a reception unit 102, a first acquisition unit 103, an authentication unit 104, a reading unit 105, and a first transmission unit 106. These functions are realized, for example, by the CPU 11 executing a program stored in the ROM 13.
[0031] The display control unit 101 displays an operation screen, etc., on the display 15. For example, the display control unit 101 displays an operation screen on which the customer 4 can input an operation to request registration of identification information. Furthermore, if the customer 4 is not registered as a member, the display control unit 101 displays on the display 15 a selection screen on which the customer 4 can select whether or not to register as a new member, and if the customer 4 selects to register as a new member, displays on the display 15 a member information input screen. Furthermore, the display control unit 101 may display on the display 15 a facial photograph 80 acquired by the first acquisition unit 103.
[0032] The reception unit 102 receives an operation requesting registration of identification information from the customer 4. For example, the reception unit 102 acquires the operation content of the customer 4 from the touch panel 16. When the reception unit 102 receives an operation requesting registration of identification information from the customer 4, the reception unit 102 transmits a notification that the operation has been received to the first acquisition unit 103 and the authentication unit 104.
[0033] Furthermore, the reception unit 102 receives input member information when the customer 4 registers as a new member. The reception unit 102 sends the received member information to the first transmission unit 106.
[0034] The first acquisition unit 103 acquires a facial photograph 80 of the customer 4 from the imaging device 2 via the device interface 19 or the communication interface 17. In addition, if the authentication device 1 is capable of performing biometric authentication, the first acquisition unit 103 may acquire biometric information such as a fingerprint or iris of the customer 4 from a dedicated scanner or the like.
[0035] For example, when the reception unit 102 receives an operation requesting registration of identification information from the customer 4, the first acquisition unit 103 acquires a facial photograph 80 of the customer 4 from the imaging device 2. The first acquisition unit 103 transmits the acquired facial photograph 80 to the authentication unit 104, the first transmission unit 106, and the display control unit 101.
[0036] The authentication unit 104 authenticates the customer 4 as a member when the customer 4 is registered as a member in the server 5. More specifically, when the facial photograph 80 of the customer 4 acquired by the first acquisition unit 103 is registered in the server 5 in association with a membership code, the authentication unit 104 authenticates the customer 4 as a member of the membership code.
[0037] The reading unit 105 reads identification information attached to an object that the customer 4 can carry around when shopping. More specifically, the reading unit 105 executes reading of the identification information when the reception unit 102 receives an operation requesting registration of the identification information from the customer 4. For example, the reading unit 105 reads the identification information indicated by the barcode 81 attached to the shopping basket 6 via the scanner 18. Furthermore, if a wireless tag is attached to the shopping basket 6, the reading unit 105 may obtain the identification information transmitted from the wireless tag attached to the shopping basket 6 from an antenna (not shown).
[0038] The first transmission unit 106 transmits the facial photograph 80 or biometric information and the identification information to the server 5 in association with each other. In this embodiment, the first transmission unit 106 transmits the facial photograph 80 acquired by the first acquisition unit 103 and the identification information indicated by the barcode 81 read by the reading unit 105 in association with each other to the server 5. Note that the first transmission unit 106 only needs to associate the facial photograph 80 with the identification information indicated by the barcode 81, and does not necessarily need to transmit them at the same time. For example, the first transmission unit 106 may transmit the membership code identified from the facial photograph 80 of the customer 4 and the identification information indicated by the barcode 81 in association with each other to the server 5.
[0039] Furthermore, when the customer 4 registers as a new member, the first transmission unit 106 transmits the member information of the customer 4 accepted by the acceptance unit 102 to the server 5 in association with the face photograph 80 of the customer 4.
[0040] Next, the server 5 of this embodiment will be described. The server 5 includes a control device such as a CPU, a storage device such as a ROM and a RAM, an external storage device such as a HDD and a CD drive, a display device such as a display device, and input devices such as a keyboard and a mouse, and has a hardware configuration that utilizes a normal computer.
[0041] Fig. 4 is a diagram showing an example of functions of the server 5 according to this embodiment. As shown in Fig. 4, the server 5 includes a second acquisition unit 501, a specification unit 502, a second transmission unit 503, a registration unit 504, and a storage unit 506. The second acquisition unit 501, the specification unit 502, and the second transmission unit 503 are realized, for example, by the CPU 11 executing a program stored in the ROM 13. The storage unit 506 is realized, for example, by a HDD or the like.
[0042] The second acquisition unit 501 acquires the facial photograph 80 or biometric information and the identification information indicated by the barcode 81 from the authentication device 1. More specifically, when the facial photograph 80 is transmitted from the authentication device 1 for authentication of the customer 4, the second acquisition unit 501 sends the facial photograph 80 to the identification unit 502. In addition, when the second acquisition unit 501 acquires the facial photograph 80 or biometric information and the identification information indicated by the barcode 81 after authentication of the customer 4, it sends the acquired information to the identification unit 502.
[0043] Furthermore, when the customer 4 registers as a new member, the second acquisition unit 501 acquires the face photograph 80 or biometric information of the customer 4 and the member information of the customer 4 from the authentication device 1. In this embodiment, the second acquisition unit 501 acquires the face photograph 80 of the customer 4 and the member information of the customer 4. The second acquisition unit 501 sends the acquired face photograph 80 and member information to the registration unit 504.
[0044] Furthermore, the second acquisition unit 501 acquires, from the POS terminal 3 that settles the transaction for customer 4, identification information indicated by the barcode 81 that the POS terminal 3 reads from the shopping basket 6. The second acquisition unit 501 sends the acquired identification information to the identification unit 502. Furthermore, the second acquisition unit 501 stores points based on payment information related to the accounting process for customer 4, acquired from the POS terminal 3 that settles the transaction for customer 4, in a membership information database described below in association with a membership code.
[0045] The identification unit 502 determines whether or not the customer 4 is registered as a member based on the facial photograph 80 or biometric information acquired by the second acquisition unit 501 and the pre-stored facial photograph 80 or biometric information of the member. For example, in this embodiment, the identification unit 502 identifies, by image processing, from among facial photographs of members registered in the facial image database stored in the storage unit 506, a photograph of the same person as the facial photograph 80 acquired by the second acquisition unit 501.
[0046] Fig. 5 is a diagram showing an example of the face image database 91 according to this embodiment. As shown in Fig. 5, the face image database 91 is a database in which membership codes are associated with face photographs of customers who have registered as members. The face image database 91 is stored in the storage unit 506. The identification unit 502 sends to the second transmission unit 503 whether or not the face photograph 80 acquired by the second acquisition unit 501 has been registered in the face image database 91.
[0047] Fig. 6 is a diagram showing an example of a member information database 92 according to this embodiment. Member information, which is information about customers who have already been registered as members of the store 7, is registered in the member information database 92. As shown in Fig. 6, the member information is information in which, for example, a member code, a member name, a gender, an age, an address, a point balance, and the like are associated with each other. Note that the member information is not limited to the example shown in Fig. 6, and may further include other information, or may not include personal information such as gender or address.
[0048] The membership code registered in face image database 91 described in Fig. 5 is the membership code registered in member information database 92 shown in Fig. 6. Note that, although an example in which face image database 91 and member information database 92 are separate has been described in this embodiment, a customer's face photo may also be included in the member information.
[0049] Furthermore, the identification unit 502 identifies the membership code of the customer 4 from the facial photograph 80 or biometric information acquired by the second acquisition unit 501, and stores the membership code in association with the identification information indicated by the barcode 81 in the memory unit 506. In this embodiment, the information associating the membership code with the identification information indicated by the barcode 81 is called a membership code conversion table, as it is used when the barcode 81 read from the shopping basket 6 by the POS terminal 3 is converted into a membership card.
[0050] Fig. 7 is a diagram showing an example of a membership code conversion table 93 according to this embodiment. For the sake of explanation, Fig. 7 shows an example in which a membership code is directly associated with a barcode image, but instead of a barcode image, identification information indicated by a barcode 81, such as a number, may also be associated with a membership code.
[0051] In addition, the identifying unit 502 searches the member code conversion table 93 for the identification information acquired from the POS terminal 3 by the second acquiring unit 501, and sends the member code associated with the identification information to the second transmitting unit 503.
[0052] Returning to Fig. 4, the second transmission unit 503 obtains from the identification unit 502 whether or not the facial photograph 80 obtained by the second acquisition unit 501 has been registered in the facial image database 91, and transmits the information to the authentication device 1. If the facial photograph 80 has been registered in the facial image database 91, the second transmission unit 503 may transmit the membership code associated with the facial photograph 80 and the membership information corresponding to the membership code to the authentication device 1. The information to be transmitted may be only a portion of the member information registered in the member information database 92, for example, only the member name.
[0053] Furthermore, when identification information is transmitted from the POS terminal 3 that settles the transaction of the customer 4, the second transmitting unit 503 transmits the membership code associated with the identification information to the POS terminal 3. More specifically, the second transmitting unit 503 transmits the membership code searched for from the membership code conversion table 93 by the identifying unit 502 to the POS terminal 3 that is the sender of the identification information indicated by the barcode 81.
[0054] Registration unit 504 and second acquisition unit 501 perform new member registration of customer 4. For example, registration unit 504 registers the member information of customer 4 acquired by second acquisition unit 501 from authentication device 1 in member information database 92. At this time, registration unit 504 generates a member code for customer 4, associates the generated member code with the member information, and registers it in member information database 92. The member code may be a consecutive number, or may be determined according to a predetermined rule.
[0055] Furthermore, the registration unit 504 registers the member code registered in the member information database 92 and the face photograph 80 of the customer 4 acquired from the authentication device 1 by the second acquisition unit 501 in the face image database 91 in association with each other.
[0056] When payment for customer 4's transaction is completed, release unit 505 releases the association between customer 4's membership code and barcode 81. More specifically, when second acquisition unit 501 acquires payment information related to customer 4's accounting process from POS terminal 3 which performs payment for customer 4's transaction, release unit 505 deletes customer 4's membership code and the identification information indicated by the barcode associated with that membership code from membership code conversion table 93.
[0057] Next, a flow of processing executed by the authentication device 1 configured as above for associating the customer 4 with the barcode 81 attached to the shopping basket 6 when the customer enters a store will be described.
[0058] 8 is a flowchart showing an example of the flow of a process for associating the customer 4 with the barcode 81 attached to the shopping basket 6 according to this embodiment. Before this process is executed, the display control unit 101 of the authentication device 1 displays on the display 15 an operation screen on which the customer 4 can input an operation for requesting registration of identification information (hereinafter, referred to as a registration start operation).
[0059] First, the reception unit 102 of the authentication device 1 determines whether or not a registration start operation has been received from the customer 4 (S1). When the reception unit 102 determines that a registration start operation has not been received (S1 "No"), the reception unit 102 repeats the process of S1.
[0060] Moreover, when it is determined that the acceptance unit 102 has accepted the registration start operation (S1 "Yes"), the first acquisition unit 103 acquires the face photograph 80 of the customer 4 from the imaging device 2 (S2).
[0061] Then, the first transmission unit 106 transmits the facial photograph 80 acquired by the first acquisition unit 103 to the server 5 (S3). If the facial photograph 80 is registered in the facial image database 91 of the server 5, a result that the facial photograph 80 has been registered in the facial image database 91 is transmitted from the server 5 to the authentication device 1.
[0062] The authentication unit 104 determines whether or not the customer 4 is a registered member, depending on whether or not the face photograph 80 of the customer 4 is registered in the face image database 91 (S4).
[0063] For example, when the authentication unit 104 receives a result from the server 5 indicating that the facial photograph 80 of the customer 4 is registered in the facial image database 91 of the server 5, it determines that the customer 4 is a registered member (S4 "Yes"). At this time, the server 5 may transmit the membership code and membership name of the customer 4 to the authentication device 1. When the membership name of the customer 4 is transmitted from the server 5 to the authentication device 1, the display control unit 101 of the authentication device 1 may display the membership name of the customer 4 on the display 15.
[0064] Next, the reading unit 105 reads the barcode 81 attached to the shopping basket 6 via the scanner 18 (S5).
[0065] Then, first transmission unit 106 transmits to server 5 a correspondence between the membership code identified from face photograph 80 of customer 4 and the identification information indicated by barcode 81 (S6). In server 5, the membership code of customer 4 and the identification information indicated by barcode 81 attached to shopping basket 6 are registered in member code conversion table 93 in a correspondence relationship. Note that first transmission unit 106 may transmit to server 5 a correspondence between face photograph 80 of customer 4 and the identification information indicated by barcode 81.
[0066] Furthermore, if the authentication unit 104 receives a result from the server 5 indicating that the facial photograph 80 of the customer 4 is not registered in the facial image database 91 of the server 5, it determines that the customer 4 is not a registered member (S4 “No”).
[0067] In this case, the reception unit 102 judges whether or not an operation to register as a new member by the customer 4 has been accepted (S7). For example, when the display control unit 101 displays on the display 15 a selection screen on which the customer 4 can select whether or not to register as a new member and the customer 4 selects to register as a new member on the selection screen, the reception unit 102 judges that an operation to register as a new member by the customer 4 has been accepted (S7 "Yes").
[0068] When the reception unit 102 receives an operation for the customer 4 to register as a new member, it receives input of member information of the customer 4. In this case, for example, the display control unit 101 displays an input screen for member information on the display 15. The reception unit 102 receives the member information of the customer 4 input on the input screen (S8).
[0069] Then, the first transmission unit 106 transmits the facial photograph 80 of the customer 4 and the membership information of the customer 4 accepted by the acceptance unit 102 to the server 5 in association with each other (S9). The server 5 registers the facial photograph 80 and the membership information of the customer 4 in the member information database 92 and the facial image database 91. After that, the customer 4 becomes a registered member, and the authentication device 1 executes the above-mentioned processes of S5 and S6 in the same way as for a normal member.
[0070] Furthermore, if the reception unit 102 determines that it has received an operation from the customer 4 not to register as a new member (S7 "No"), the facial photograph 80 of the customer 4 is not associated with the barcode 81 attached to the shopping basket 6, and the processing of this flowchart ends.
[0071] 8, authentication device 1 first identifies the membership code of customer 4, and then associates the identified membership code with the identification information indicated by barcode 81 and transmits them to server 5, but the process flow is not limited to this. For example, authentication device 1 may simultaneously transmit face photo 80 of customer 4 and the identification information indicated by barcode 81 to server 5, and then server 5 may associate the membership code identified from face photo 80 with the identification information indicated by barcode 81.
[0072] Next, the flow of processing when a customer 4 performs a transaction will be described. Figure 9 is a flowchart showing an example of the flow of the member code identification process during a transaction according to this embodiment. The processing of this flowchart is executed by the server 5.
[0073] The second acquisition unit 501 of the server 5 determines whether or not the barcode 81 of the shopping basket 6 has been received from the POS terminal 3 that settles the transaction of the customer 4 (S21). More specifically, the second acquisition unit 501 determines whether or not the server 5 has acquired, from the POS terminal 3, the identification information indicated by the barcode 81 that the POS terminal 3 read from the shopping basket 6.
[0074] When the second acquisition unit 501 determines that the identification information indicated by the barcode 81 has not been acquired (S21 "No"), it repeats the process of S21.
[0075] Moreover, when the second acquisition unit 501 determines that the identification information indicated by the barcode 81 has been acquired (S21 “Yes”), it sends the identification information indicated by the acquired barcode 81 to the specification unit 502.
[0076] The identification unit 502 identifies the membership code corresponding to the identification information indicated by the barcode 81 acquired by the second acquisition unit 501 from the membership code conversion table 93 (S22). Using the membership code, the POS terminal 3 identifies the customer 4 as a member and performs product registration processing and payment processing.
[0077] Then, the second transmitting unit 503 transmits the membership code identified by the identifying unit 502 from the membership code conversion table 93 to the POS terminal 3 that is the sender of the identification information indicated by the barcode 81 (S23).
[0078] In addition, the second acquisition unit 501 receives payment information related to the transaction process of the customer 4 from the POS terminal 3 (S24).
[0079] The second acquisition unit 501 stores the points included in the acquired payment information in member information database 92 in association with the membership code (S25). For example, the second acquisition unit 501 adds the points included in the acquired payment information to the points already registered in member information database 92, thereby storing the latest points in member information database 92. Furthermore, when customer 4 makes a payment using accumulated points, the second acquisition unit 501 subtracts the points used by customer 4 from the points registered in member information database 92. Note that the method of granting and using points is one example, and is not limited to this.
[0080] Then, the cancellation unit 505 cancels the association between the barcode 81 of the shopping basket 6 used by the customer 4 and the membership code of the customer 4 (S26). Here, the processing of this flowchart ends.
[0081] In this manner, in the information processing system S of the present embodiment, the authentication device 1 transmits to the server 5 the face photograph 80 or biometric information of the customer 4 in association with the identification information indicated by the barcode 81 attached to the shopping basket 6. The server 5 also identifies the membership code of the customer 4 from the face photograph 80 or biometric information of the customer 4 acquired from the authentication device 1, and transmits to the POS terminal 3 the membership code associated with the identification information when the identification information indicated by the barcode 81 attached to the shopping basket 6 is transmitted from the POS terminal 3 that settles the transaction of the customer 4. With this configuration, the information processing system S of the present embodiment provides the membership code of the customer 4 associated with the barcode 81 to the POS terminal 3 that reads the barcode 81 of the shopping basket 6. In the information processing system S of the present embodiment, the association between the membership code of the customer 4 and the barcode 81 of the shopping basket 6 held by the customer 4 is performed by face authentication or the like, so that the membership code of the customer 4 can be identified at the time of settlement even if the customer 4 does not have a medium indicating the membership code, such as a membership card.
[0082] Furthermore, in the information processing system S of this embodiment, the membership code of the customer 4 is associated with the barcode 81 of the shopping basket 6 by the authentication device 1 and server 5, not by the POS terminal 3, so that the membership code of the customer 4 can be identified at the time of payment even if the POS terminal 3 does not have a facial recognition or biometric authentication function. In the information processing system S of this embodiment, the membership code of the customer 4 can be identified by the barcode 81 attached to the shopping basket 6, so that it is not necessary to install an authentication device 1 for each POS terminal 3. Therefore, the number of authentication devices 1 with facial recognition or biometric authentication functions can be less than the number of POS terminals 3.
[0083] In addition, in the information processing system S of this embodiment, since a membership card is not required, it is possible to reduce the cost of issuing a membership card and the amount of resources consumed. In addition, it is possible to reduce the workload of reissuing a membership card when a customer 4 loses it.
[0084] Furthermore, in the information processing system S of this embodiment, when the authentication device 1 receives an operation from the customer 4 requesting registration of identification information, it reads the identification information of the barcode 81 attached to the shopping basket 6. In other words, in the information processing system S of this embodiment, association is performed only when the customer 4 requests association of his / her own membership code with the identification information of the barcode 81 attached to the shopping basket 6. Therefore, for example, when multiple customers 4 such as family or friends go shopping together, each with a shopping basket 6, it is necessary to associate only the shopping basket 6 held by the customer 4 performing the checkout process with the membership code of that customer 4.
[0085] Furthermore, in the information processing system S of this embodiment, when the payment by customer 4 is completed, the association between the membership code of customer 4 and the identification information is released. Therefore, when another customer uses the shopping basket 6 after customer 4 has made a payment, it is possible to reduce the possibility that the payment by the other customer will be mistakenly linked to the membership code of customer 4, who was the previous user.
[0086] Furthermore, in the information processing system S of this embodiment, the authentication device 1 reads the identification information from a code symbol or a wireless tag attached to the shopping basket 6. That is, in this embodiment, the identification information attached to the shopping basket 6 can be read from a code symbol such as a barcode 81 or a wireless tag. Therefore, according to the information processing system S of this embodiment, a medium that can be read by a normal POS terminal 3 can be used as a medium for holding the identification information for associating with a membership code.
[0087] The program executed by the authentication device 1 or the server 5 of this embodiment is provided by being pre-installed in the ROM 13 or the like. The program executed by the authentication device 1 or the server 5 of this embodiment may be provided by being recorded in a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a digital versatile disk (DVD) in the form of an installable or executable file.
[0088] Furthermore, the program executed by the authentication device 1 or server 5 of the present embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the program executed by the authentication device 1 or server 5 of the present embodiment may be provided or distributed via a network such as the Internet.
[0089] The program executed by the authentication device 1 of this embodiment has a modular configuration including the above-mentioned units (display control unit, reception unit, first acquisition unit, authentication unit, reading unit, and first transmission unit). The CPU (processor) reads out the program from the storage medium and loads the above-mentioned units onto the main storage device. As a result, the display control unit, reception unit, first acquisition unit, authentication unit, reading unit, and first transmission unit are generated on the main storage device.
[0090] The program executed by the server 5 of this embodiment has a modular configuration including the above-mentioned units (second acquisition unit, identification unit, second transmission unit, registration unit, and release unit). The CPU (processor) reads out the program from the storage medium and loads the above-mentioned units onto the main storage device. As a result, the second acquisition unit, identification unit, second transmission unit, registration unit, and release unit are generated on the main storage device.
[0091] In this embodiment, the display control unit 101, the reception unit 102, the first acquisition unit 103, the authentication unit 104, the reading unit 105, and the first transmission unit 106 of the authentication device 1 have been described as functions realized by the CPU 11, but these functions may be realized by hardware. Also, the touch panel 16 may be an example of a reception unit, the device interface 19 or the communication interface 17 may be an example of a first acquisition unit, the scanner 18 may be an example of a reading unit, and the communication interface 17 may be an example of a first transmission unit.
[0092] Furthermore, in the present embodiment, the HDD of the server 5 is taken as an example of the storage unit, but the storage unit may be a storage device or the like provided outside the server 5.
[0093] (Variation 1) In the above embodiment, the server 5 stores the face image database 91, but the authentication device 1 may store the face image database 91. Moreover, the authentication device 1 and the server 5 do not need to be separate devices. For example, the authentication device 1 may have the functions of the server 5.
[0094] In the above embodiment, the information processing system S includes the authentication device 1 and the server 5. However, the information processing system S may further include a POS terminal 3.
[0095] (Variation 2) In the above embodiment, the facial photograph 80 and the barcode 81 are acquired or read separately, but they may be acquired or read at the same time. For example, if the imaging device 2 can simultaneously capture an image of the shopping basket 6 and the face of the customer 4, the authentication device 1 may acquire a facial image of the customer 4 and read the barcode 81 from one captured image by image processing. When this configuration is adopted, the first acquisition unit 103 and the reading unit 105 may be integrated.
[0096] (Variation 3) In the above embodiment, the authentication device 1 reads the identification information of the barcode 81 attached to the shopping basket 6 when an operation requesting registration of identification information is received from the customer 4. However, a configuration may be adopted in which the barcode 81 attached to the shopping basket 6 is automatically associated with the membership code regardless of an operation requesting registration by the customer 4.
[0097] For example, when a state in which a customer 4 is holding a shopping basket 6 is depicted in an image captured by an imaging device 2 installed in a store 7, the authentication device 1 may obtain a facial image of the customer 4 from the image by image processing, as in the second modification, and may also read a barcode 81. When this configuration is adopted, the imaging device 2 may also serve as a surveillance camera installed in the store 7.
[0098] Furthermore, in the case where this configuration is adopted and multiple customers 4 are shopping together, each carrying a shopping basket 6, the POS terminal 3 may display a screen that allows the customer 4 making payment to select the identification information associated with which shopping basket 6. Furthermore, the POS terminal 3 may transmit to the server 5 only the barcode 81 attached to the first scanned shopping basket 6 out of the multiple shopping baskets 6.
[0099] (Variation 4) In the above embodiment, the server 5 stores the membership code of the customer 4 in association with the membership information, but the membership code may also be stored in association with information on a payment method such as a credit card or other cashless payment. Alternatively, the server 5 or the POS terminal 3 may obtain information on a payment method such as a credit card by transmitting the membership code of the customer 4 or a facial photograph 80 of the customer 4 to a computer of the credit company, and use the information to make payment for the product purchased by the customer 4. In this case, the customer 4 can purchase products at the store 7 without having to carry not only a membership card but also a credit card or the like for payment.
[0100] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]
[0101] 1 Authentication device 2. Imaging device 3,31~33 POS terminal 4 customers 5 Server 6,61~64 Shopping Basket 7 stores 15 Display 16 Touch Panel 18 Scanner 71 Entrance 80 Face photo 81 Barcode 91 Face Image Database 92 Membership information database 93 Membership code conversion table 101 Display control unit 102 Reception 103 First Acquisition Section 104 Authentication Section 105 Reading unit 106 First transmitter 501 Second Acquisition Division 502 Specific part 503 Second Transmission Unit 504 Registration Department 505 Release section 506 Storage section S Information Processing System [Prior art documents] [Patent documents]
[0102] [Patent Document 1] JP 2014-194732 A
Claims
1. An authentication device and an information processing device, The authentication device includes: a first acquisition unit that acquires a face image or biometric information of a customer; A reading unit that reads identification information attached to a portable object when a customer is shopping; a first transmission unit that transmits the face image or the biometric information and the identification information to the information processing device in association with each other; Equipped with The information processing device includes: a second acquisition unit that acquires the face image or the biometric information and the identification information from the authentication device; an identification unit that identifies a membership code of the customer from the acquired face image or biometric information and associates the membership code with the identification information; a second transmission unit that, when the identification information is transmitted from a payment device that performs payment for the transaction of the customer, transmits the member code associated with the identification information to the payment device; Equipped with The authentication device includes: a reception unit that receives input of member information of the customer through an operation by the customer when the customer is not a registered member, when the reception unit receives input of membership information of the customer, the first transmission unit transmits to the information processing device a face image or the biometric information of the customer in association with the membership information; the information processing device further includes a registration unit that, when the face image or the biometric information of the customer and the member information are transmitted from the authentication device, registers a newly issued member code of the customer in association with the face image or the biometric information of the customer and the member information; Information processing system.
2. The authentication device includes: a reception unit that receives an operation from the customer requesting registration of the identification information, the reading unit executes reading of the identification information when the reception unit receives the operation from the customer. The information processing system according to claim 1 .
3. The first transmission unit transmits the acquired face image or the acquired biometric information to the information processing device, the identification unit determines whether or not the customer is registered as a member based on the acquired face image or biometric information and pre-stored face images or biometric information of members; the authentication device further includes an authentication unit that authenticates the customer as a member when the customer is registered as a member in the information processing device; 3. The information processing system according to claim 1 or 2.
4. the information processing device further includes a cancellation unit that cancels the association between the membership code and the identification information of the customer when the payment of the customer is completed; The information processing system according to any one of claims 1 to 3.
5. The reading unit reads the identification information from a code symbol or a wireless tag attached to the object. The information processing system according to claim 1 .
Citation Information
Patent Citations
System for delivering merchandise
JP2002279038A
Electronic receipt management server, information processing device, and program
JP2014194732A
Checkout system, and imaging device
JP2015026130A
Information processing system and information processing program
JP2016126749A
