Selling system, selling device, selling method, and program for selling system

Abstract

To provide a vending system, a vendor, a vending method, and a program for the vending system which enable a purchaser being a member to quickly purchase a product in a hands-free manner and can be implemented with a simple configuration.SOLUTION: The vending system comprises: a vendor which acquires information about a product which a purchaser as a member who has completed registration of his or her face image will purchase, and captures an image of a face of the purchaser; a face authentication server which authenticates the purchaser on the basis of the image of the face of the purchaser captured at the time of purchase; and a management server which can communicate with the vendor and records purchased product information for each member.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a sales system, a sales device, a sales method, and a program for the sales system, which are used in a micro market such as an office area. [Background technology]

[0002] In recent years, systems for purchasing products without cash have been realized. Furthermore, in order to increase convenience for purchasers, systems that allow payment without carrying items for payment, such as IC cards and mobile phones, are being considered. As a method for making such empty-handed payments, it is possible to use biometric authentication. For example, it is known that a vending machine payment system uses face authentication to make payments quickly (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-87094 A Summary of the Invention [Problem to be solved by the invention]

[0004] When making payments using biometric authentication such as facial recognition, it is necessary to improve the accuracy of the authentication, the time it takes to make a payment, the accuracy of the payment, etc., in order to increase convenience for both the purchaser and the product provider. However, this is often difficult to achieve satisfactorily, and it cannot be said that empty-handed product purchases have become widespread.

[0005] An object of the present invention is to provide a sales system, a sales device, a sales method, and a program for the sales system that can be realized with a simple configuration and that allows a purchaser who is a member to quickly purchase an item empty-handed. [Means for solving the problem]

[0006] The sales system of the present invention is a sales system comprising a sales device used when a purchaser who has become a member by registering a facial image purchases an item, a face authentication server that authenticates the purchaser by identifying a facial image of the purchaser taken at the time of purchase, and a management server capable of communicating with the sales device, wherein the sales device comprises a camera that takes an image of the purchaser's face at the time of purchase, a purchased item information acquisition means that acquires purchased item information which is information relating to the item the purchaser is about to purchase, and a first communication means that transmits the facial image of the purchaser taken by the camera to the face authentication server, thereby receiving authentication result information including the result of authentication returned from the face authentication server, and when the authentication result information is authentication success information including information of authentication success, transmits the purchased item information and the authentication success information to the management server, and the face authentication server receives the purchased item information and the authentication success information from the management server, and the face authentication server receives the facial image of each member. The management server is equipped with an authentication information storage means for storing authentication information associating an identifier assigned to each member with the registered facial image of each member, a facial authentication means for authenticating the purchaser based on the authentication information and the facial image of the purchaser transmitted from the sales device, and a second communication means for transmitting authentication success information including the identifier to the sales device if the authentication is successful.The management server is equipped with a member information storage means for storing member information associating information about the member with the identifier for each member, a purchased product recording means for recording purchased product information for each member based on the member information and the purchased product information and authentication success information transmitted from the first communication means, and a third communication means for transmitting recording completion information to the sales device when recording is completed, and the sales device notifies the purchaser of the completion of product ejection and / or recording when the first communication means receives the recording completion information.

[0007] The sales device is preferably installed in a vending machine.

[0008] The vending device is preferably a retrofit to an existing vending machine.

[0009] The vending device is preferably connected to a payment unit of a vending machine.

[0010] The vending device is preferably contained in a tabletop terminal.

[0011] The purchased item information preferably includes information regarding the location of the item and / or the price of the item.

[0012] It is preferable that the vending device includes a passcode authentication means for performing passcode authentication, and that the first communication means transmits the purchased product information and authentication success information including the identifier to the management server after the passcode authentication is successful.

[0013] The camera preferably captures a vertically long photographic image including a facial image of the purchaser.

[0014] The purchased product information acquiring means preferably acquires product information from a barcode attached to the product.

[0015] It is preferable not to have a display means for displaying to the purchaser the face image of the purchaser captured by the camera.

[0016] The camera preferably includes a notification means for notifying the purchaser of the camera's photographing position.

[0017] The notification means is preferably a light emitting means and / or a sound generating means.

[0018] If authentication of the purchaser by the facial authentication means fails, it is preferable that the second communication means transmits authentication failure information not including the identifier to the vending device, and that upon receiving the authentication failure information, the vending device notifies the purchaser that authentication has failed.

[0019] The member information preferably includes information on vending devices available to each member.

[0020] It is preferable that the management server is connected to an administrator terminal owned by an administrator who manages members, and that the administrator terminal is capable of viewing and editing member information and purchased product information.

[0021] It is preferably used in the micro market.

[0022] The members are people who belong to a company or organization, and the service is preferably used for in-house sales or workplace sales.

[0023] The vending device of the present invention is a vending device used in the vending system described above, and can be installed in a vending machine.

[0024] Preferably, the camera can be mounted in the vending machine's shop window.

[0025] A sales method of the present invention is a sales method using a sales system including a sales device used when a purchaser who has become a member by registering a facial image purchases an item, a face authentication server that authenticates the purchaser by identifying a facial image of the purchaser taken at the time of purchase, and a management server capable of communicating with the sales device, in which in the sales device, a camera photographs the face of the purchaser at the time of purchase, a purchased item information acquisition means acquires purchased item information which is information regarding the item that the purchaser is attempting to purchase, a first communication means transmits the facial image of the purchaser obtained by photographing with the camera to the facial authentication server, thereby receiving authentication result information including a result of authentication returned from the facial authentication server, and when the authentication result information is authentication success information including information of authentication success, the purchased item information and the authentication success information are transmitted to the management server, and in the facial authentication server, an authentication information storage means stores authentication information associating an identifier assigned to each member with a registered facial image of each member; a facial authentication means authenticates the purchaser based on the authentication information and the facial image of the purchaser sent from the sales device; a second communication means transmits authentication success information including the identifier to the sales device if the authentication is successful; in the management server, a member information storage means stores member information for each member that associates information about the member with the identifier; a purchased product recording means records the purchased product information for each member based on the member information and the purchased product information and authentication success information sent from the first communication means; a third communication means transmits recording completion information to the sales device when recording is completed; and when the first communication means receives the recording completion information, the sales device notifies the purchaser of the completion of product ejection and / or recording.

[0026] A program for a sales system of the present invention is a program for realizing a sales method using a sales system including a sales device used when a purchaser who has become a member by registering a facial image purchases an item, a face authentication server that authenticates the purchaser by identifying a facial image of the purchaser taken at the time of the purchase, and a management server capable of communicating with the sales device, in which the sales device, face authentication server, and management server are each composed of a computer, and in the sales device, a camera photographs the face of the purchaser at the time of purchase, a purchased item information acquisition means acquires purchased item information which is information regarding the item that the purchaser is attempting to purchase, a first communication means transmits the facial image of the purchaser taken by the camera to the facial authentication server to receive authentication result information including a result of authentication returned from the facial authentication server, and when the authentication result information is authentication success information including information of authentication success, the purchased item information and the authentication success information are transmitted to the management server. the face authentication server, an authentication information storage means for storing authentication information associating an identifier assigned to each member with a registered facial image of each member, the facial authentication means authenticating the purchaser based on the authentication information and the facial image of the purchaser transmitted from the vending device, and the second communication means for transmitting authentication success information including the identifier to the vending device if the authentication is successful; the management server, a member information storage means for storing member information for each member associating information about the member with an identifier, a purchased product recording means for recording purchased product information for each member based on the member information and the purchased product information and authentication success information transmitted from the first communication means, and a third communication means for transmitting recording completion information to the vending device when recording is completed; and a function in the vending device, when the first communication means receives the recording completion information, notifying the purchaser of the completion of ejection of the product and / or recording. Effect of the Invention

[0027] According to the present invention, it is possible to provide a sales system, a sales device, a sales method, and a program for the sales system that enable a member purchaser to quickly purchase an item empty-handed and that can be realized with a simple configuration. [Brief description of the drawings]

[0028] [Figure 1] FIG. 1 is an explanatory diagram illustrating a configuration of a sales system. [Diagram 2] FIG. 2 is a block diagram showing the functions of the vending device. [Diagram 3] FIG. 1 is a schematic diagram showing the appearance of a vending machine. [Figure 4] FIG. 1 is an explanatory diagram illustrating the installation of a camera in a vending machine. [Diagram 5] FIG. 1 is an explanatory diagram illustrating the installation of a camera on a desktop terminal. [Figure 6] FIG. 2 is an image diagram showing an example of a captured image including a face image. [Figure 7] FIG. 2 is an explanatory diagram illustrating face authentication. [Figure 8] FIG. 11 is an explanatory diagram illustrating information sent from a vending device to a management server. [Figure 9] FIG. 2 is a block diagram showing functions of a face authentication server. [Figure 10] 2 is a block diagram showing the functions of a management server. FIG. [Figure 11] FIG. 11 is an explanatory diagram for explaining member information. [Figure 12] FIG. 2 is an explanatory diagram illustrating a purchase record including a purchase history. [Figure 13] 11 is an explanatory diagram illustrating information sent from a management server to a vending device and delivery of a commodity to a purchaser. FIG. [Figure 14] FIG. 13 is an explanatory diagram for explaining how to notify a purchaser of the completion of recording. [Figure 15] 1 is a block diagram showing the functions of a vending device equipped with a passcode authentication means; [Figure 16] FIG. 2 is an explanatory diagram illustrating an administrator terminal. [Figure 17] FIG. 13 is an explanatory diagram for explaining member information including items of available vending machines. [Figure 18] FIG. 18(A) is an explanatory diagram showing a camera having a guide LED on the front left, and FIG. 18(B) is an explanatory diagram showing a camera having a guide LED on the front right. [Figure 19]1 is a flowchart illustrating a flow of product purchase through the sales system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0029] The background to the invention of the embodiment will be described below. When payment is made by face authentication to realize empty-handed purchases in vending machines, etc., the target purchasers are an unspecified number of purchasers, and the greater the number of target purchasers, the longer the face authentication takes. In addition, when the purchasers are an unspecified number of purchasers, the face images registered in the authentication source at the time of face authentication may not be so uniform. In addition, when multiple payment methods are prepared to enhance customer convenience, complex interactions may be required to accurately perform each payment. In addition, depending on the installation location of the vending machine, etc., multiple faces of passersby, etc. may be photographed during face authentication. In such cases, face authentication may take time or become difficult. In this specification, "empty-handed" means that it is not necessary to carry an article such as a mobile phone or an IC card to make a payment or purchase a product.

[0030] Unlike vending machines that target a large number of purchasers, when a sales system is used for a micro market, it is possible to limit the number of purchasers expected for one vending machine to a small number of people. In addition, it is easy to make these purchasers members who have registered a unified face image in advance. A micro market is a small store that targets a small commercial area with a small number of target customers, such as a workplace such as a factory or office, or a facility such as a hospital, school, or apartment building. Examples of such small stores include stores where products are displayed, as well as vending machines.

[0031] For example, by using the face photo used on an employee ID or student ID for face authentication, or by taking a picture in the same environment within the company, face authentication can be performed based on a unified face image. In addition, vending machines in workplaces, office convenience stores, hospital kiosks or vending machines, etc. are installed in closed facilities such as inside a company or hospital, so there is little problem of taking pictures of passersby's faces during face authentication. In particular, in factories, etc., it may be prohibited to carry mobile phones, etc., so it is convenient for purchasers to purchase products empty-handed.

[0032] In addition, by designating the purchaser as a specific target such as an employee, it may be possible to provide the product free of charge as an employee benefit, or to deduct the cost of the product from the employee's salary, so that settlement with money owned by the purchaser at the time of purchase does not have to be made. The money referred to here includes money exchanged online, such as IC card payments.

[0033] In the present invention, by assuming a limited number of purchasers and configuring the sales system for a micro-market in a workplace, etc., it is possible to solve the various problems associated with payments by face authentication as described above. Note that the sales system may be configured more simply, for example by omitting the process of displaying a photographed face image to the purchaser for confirmation during face authentication at the time of purchase.

[0034] Therefore, the vending system etc. of the present invention can be easily installed in existing vending devices such as vending machines, etc. In this way, the present invention can be realized with a simple configuration.

[0035] As described above, in the present invention, by using the sales system etc. configured as described above for micro-markets in workplaces etc., a purchaser who is a member can purchase a product empty-handed. Furthermore, the sales system of the present invention does not necessarily require a means for settlement with money etc. owned by the purchaser at the time of purchase.

[0036] Furthermore, a member manager, such as a department in charge within a company, can manage purchases by members. For example, the locations within the company where members can purchase products may be limited by restricting the sales devices from which members can purchase products. In addition, convenience for purchasers regarding payments may be further improved by allowing each employee who is a member to purchase products free of charge within a certain range as part of employee benefits, or by deducting the amount of purchased products from the salary.

[0037] In this way, according to the sales system of the present invention, it is possible to realize a sales system, sales device, sales method, and program for the sales system that is suitable for both the member purchaser and the in-house membership manager who is the membership manager, with a simple configuration.

[0038] Hereinafter, a description will be given of embodiments of a sales system, a sales device, a sales method, and a program for the sales system that enable a member purchaser to quickly purchase an item empty-handed and that can be realized with a simple configuration.

[0039] 1, a sales system 10 includes a sales device 11, a face authentication server 12, and a management server 13. In this embodiment, the sales system 10 is a sales system 10 for a micro market, and is a sales system 10 that uses vending machines in a workplace. The sales device 11 is used when a purchaser who has become a member by registering a face image purchases a product.

[0040] In this specification, a face image refers to an image obtained by photographing a person's face with a camera or the like, and refers to an image in which a face is captured. Therefore, the entire captured image including the image of the face may be referred to as a face image. In this embodiment, a member is a person who belongs to a company or an organization. Therefore, the sales system 10 is used in in-house sales or workplace sales.

[0041] The face authentication server 12 authenticates the purchaser by identifying a face image of the purchaser photographed at the time of purchase. The management server 13 is capable of communicating with the vending device 11. The communication is via a network 14.

[0042] 2, vending device 11 includes camera 15, purchased product information acquisition means 16, and first communication means 17. Specifically, vending device 11 is a device that can be installed in various vending machines, tabletop terminals such as tablets placed in office convenience stores, self-checkout registers equipped with barcode scanners, etc. Note that when a tabletop terminal, etc. includes all of the means for performing the functions of vending device 11, vending device 11 may be included in the tabletop terminal, etc.

[0043] The camera 15 photographs the face of the purchaser at the time of purchase to obtain a facial image. The camera 15 may be any camera that can photograph the face of the purchaser so as to obtain a facial image that can be used for facial authentication.

[0044] It is preferable that the sales system 10 does not include a display means for displaying the purchaser's facial image acquired by the camera 15 to the purchaser. This is because by eliminating the process of the purchaser confirming the facial image acquired by the camera 15, the product can be provided to the purchaser in a shorter time, and the sales system 10 can be constructed with a simple configuration. Not limited to this, in some cases, the sales system 10 may include a display means for displaying the purchaser's facial image acquired by the camera 15 to the purchaser. In this case, after shooting, the facial image is displayed on the display means, and the purchaser confirms that the displayed facial image is not a failure image and performs an operation to confirm that this facial image will be used for facial authentication. After that, the acquired facial image is used for facial authentication.

[0045] Furthermore, if the face image captured by the camera 15 is a failure image that makes face authentication impossible, a method of informing the purchaser of the failure may be adopted, such as by using light, sound, etc., based on a reply from the face authentication server 12. Furthermore, when the camera 15 photographs the purchaser's face, the timing of photographing, etc., may be notified by using light, sound, etc. Such notifications will be described later.

[0046] 3, when vending device 11 is installed in vending machine 21, it is preferable that the camera can be installed inside show window 22. Vending machine 21 may be an existing vending machine to which vending device 11 including a camera has been retrofitted. The existing vending machine may be a vending machine that is already in operation, or may be a vending machine with an existing configuration that is currently being manufactured.

[0047] In order to capture the face of the purchaser in a facial image that allows appropriate facial authentication, it is preferable that the camera can be installed at either camera installation position 23 on the left wall or the right wall of the show window 22. Depending on the surrounding environment, etc., a camera installation position 23 appropriate for capturing an image of the purchaser's face can be selected from the multiple camera installation positions 23, and the setting direction of the camera, etc. can be adjusted.

[0048] As shown in Fig. 4, camera 15 is preferably installed at camera installation position 23. Camera 15 is attached to vending machine 21 or the like to properly capture facial images of purchasers, and is therefore preferably equipped with imaging direction adjustment means 15a such as a 360-degree rotating arm and / or swing mechanism. This ensures flexible installation positions and imaging angles, and allows the camera to be widely installed on vending machines 21 of various shapes.

[0049] Any method can be used to install the camera 15 as long as the camera 15 can be fixed to an appropriate camera installation position. Therefore, the camera 15 is installed using screws, a magnet, etc. If the sales device 11 is a self-checkout or the like, the camera 15 may be installed on the checkout device using a clip, a magnet, etc.

[0050] In addition, since the vending machine 21 is an existing vending machine, it is equipped with an IC card reader 24, a product selection button 25, etc. Therefore, in addition to purchases by face authentication, purchases by payment with an IC card, purchases by cash, etc., which are functions of a normal vending machine 21, etc., are possible.

[0051] As shown in FIG. 5, when the vending device 11 is installed in the tabletop terminal 31, in order to appropriately capture the face image of the purchaser for face authentication, it is preferable that the camera 15 is installed in a position where the face image of the purchaser who operates the tabletop terminal 31 can be acquired. The camera 15 may be installed away from the tabletop terminal 31, or may be installed in contact with the tabletop terminal 31 by a clip, a magnet, or the like. For example, the camera 15 is installed on the top of the tabletop terminal 31 by a clip 15b provided on the camera 15. The tabletop terminal 31 is a terminal device consisting of a computer equipped with a processor that can stand on a desk or the like, and is equipped with an existing payment unit. The camera 15 provided in the tabletop terminal 31 itself may be used as the camera 15. In this way, the vending device 11 may be included in a terminal device such as the tabletop terminal 31.

[0052] The tabletop terminal 31 includes a barcode scanner 32, a touch panel 33, and an IC card reader 34. The tabletop terminal 31 is placed, for example, in an office convenience store or the like. In the office convenience store, a purchaser selects a product he or she wants to purchase from products placed in a product area, and purchases the product by having the barcode scanner 32 of the tabletop terminal 31 read the barcode of the product. As described above, whether the vending device 11 is installed in a vending machine 21 or in a tabletop terminal 31, the vending device 11 can be installed without changing the shape, design, etc. of an existing device. Therefore, the sales system 10 can be easily introduced.

[0053] The camera 15 photographs the face of the purchaser when the purchaser purchases a product to obtain a facial image. The facial image may be one that can be facially authenticated by the facial authentication server 12. Although it depends on the type of the facial authentication server 12, the facial image obtained by the camera 15 may have, for example, a file format of JPEG, PNG, or the like, a number of colors of binary, grayscale, various full colors, or the like, and a file size of 10 MB or less, for example.

[0054] As shown in Fig. 6, it is preferable that the camera 15 captures a vertically long captured image 41a including a facial image 41 of a purchaser 42. Since vertical capture can cover the height difference of purchasers 42, it is possible to obtain an appropriate facial image 41 for any purchaser 42, from a short purchaser 42 to a tall purchaser 42. It is preferable that the captured image captured by the camera 15 includes an appropriate facial image 41 of the purchaser 42.

[0055] Vending device 11 may register face image 41 for becoming a member. For example, vending device 11 may be configured to register face image 41 by acquiring face image 41 according to an instructed sequence using a message display device and a selection device such as a touch panel provided in vending device 11.

[0056] The purchased product information acquiring means 16 acquires purchased product information, which is information related to the product that the purchaser is about to purchase. The purchased product information may be the product name, price, etc., the location of the selling device 11 where the product is placed, etc. The purchased product information acquiring means 16 may be any means capable of acquiring the above-mentioned information related to the product that the purchaser is about to purchase.

[0057] When the selling device 11 is installed in a vending machine 21, the purchased product information acquisition means 16 is a product selection button 25 (see FIG. 3) that a purchaser presses when selecting a product. When a purchaser 42 selects a product he or she wishes to purchase using the product selection button 25, the product name of the selected product and the location of the vending machine 21 are acquired as information about the product.

[0058] When the sales device 11 is installed in a tabletop terminal 31 arranged in an office convenience store or the like, the purchased product information acquisition means 16 is a barcode scanner 32 (see FIG. 4) or the like provided in the tabletop terminal 31. That is, the purchased product information acquisition means 16 may be a barcode scanner that acquires product information from a barcode attached to the product. When a purchaser 42 causes the barcode scanner 32 provided in the tabletop terminal 31 to read the barcode of a product that the purchaser 42 wishes to purchase, the product name of the selected product and the position of the tabletop terminal 31 are acquired as information related to the product.

[0059] The purchased product information acquisition means 16 is not limited to these, and may use known technology such as an IC tag, or AI (artificial intelligence) such as machine learning that identifies a product from an image of the product picked up by a customer. In addition, the purchased product information acquisition means 16 may use a location information system such as a GPS (Global Positioning System, Global Positioning Satellite) possessed by the vending device 11, etc., to acquire information regarding the location where the product is placed.

[0060] In this embodiment, since the selling device 11 is installed in a beverage vending machine 21, the purchased product information acquisition means 16 is a product selection button 25 used when the purchaser 42 selects a product. When the purchaser 42 presses the product selection button 25 of the vending machine 21, the location where the product that the purchaser 42 is trying to purchase is placed, that is, the location where the selling device 11 is installed, the product name, and the price are acquired as purchased product information.

[0061] First communication means 17 is included in vending device 11, and is means for communicating with face authentication server 12, management server 13, etc. via network 14 (see FIG. 1). As shown in FIG. 7, first communication means 17 transmits a face image 41 of the purchaser captured by camera 15 to face authentication server 12. Face authentication server 12 performs authentication on transmitted face image 41, and after authentication is completed, returns authentication result information 43 to vending device 11. Vending device 11 receives authentication result information 43 including the result of authentication returned from face authentication server 12 via first communication means 17. Note that in the drawings, in order to avoid cluttering the drawings, some of network 14, etc. may be omitted.

[0062] 8, when the received authentication result information 43 is authentication success information 43a including information on authentication success, the first communication means 17 transmits the purchased product information 44 and the authentication success information 43a including the identifier to the management server. Facial authentication by the facial authentication server 12 will be described later.

[0063] The first communication means 17 may be a transmission means using either wired or wireless communication, regardless of the format. The same applies to the second communication means (see FIG. 9) and the third communication means (see FIG. 10). It is preferable that the first communication means 17 is capable of transmitting a facial image 41 of the purchaser 42 taken by the camera 15 when the purchaser 42 purchases a product to the face authentication server 12 in a manner that enables face authentication, and is capable of receiving authentication result information returned from the face authentication server 12. It is preferable that the transmission and reception are performed without delay and at a speed that does not burden the purchaser 42.

[0064] The first communication means 17 may use a transmission means that is provided in advance in the vending machine 21 or the tabletop terminal 31. Specifically, the transmission means may use a line built into a payment unit that is provided in advance in the vending machine 21 or the like. The vending machine 21 or the like may be provided with a device for communicating through an LTE / 4G line for payment or the like. Therefore, it is preferable that the vending device 11 including the first communication means 17 is connected to the payment unit of the vending machine 21. If the payment unit of the vending machine 21 or the like does not have a communication means, the first communication means 17 is newly installed in the vending machine 21 or the like.

[0065] The first communication means 17 is not limited to a line built into the payment unit, but can be any means that can send a facial image 41 capable of facial recognition to the facial recognition server 12 and receive authentication result information from the facial recognition server 12, such as wired or wireless communication via an in-house LAN (Local Area Network).

[0066] In addition, in a specific case, the vending device 11 notifies the purchaser that the purchaser has discharged the product and / or that the management server has completed recording of the purchased product information. In another case, the vending device 11 notifies the purchaser that face authentication has failed. The discharge and / or notification of the product by the vending device 11 will be described later.

[0067] 9, the face authentication server 12 includes an authentication information storage means 51, a face authentication means 52, and a second communication means 53. The authentication information storage means 51 stores authentication information. The authentication information is data including a face image of an authentication source for authenticating the purchaser 42, that is, for confirming whether the purchaser 42 is a person registered as a member.

[0068] Specifically, the authentication information may be a table in which each face image 41 of a member is previously associated with an identifier or the like assigned to each member. The identifier is an ID (identifier) ​​and may be information consisting of codes, numbers, letters, or the like that uniquely identifies a member from among a plurality of members. The authentication information may be information in which information related to the face image 41, such as feature amounts obtained from the face image 41, is associated with the identifier.

[0069] Facial authentication means 52 authenticates purchaser 42 based on the authentication information and facial image 41 of purchaser 42 transmitted from vending device 11. Authenticating purchaser 42 means confirming whether purchaser 42 is a person registered as a member. When facial authentication means 52 determines that the face shown in facial image 41 of purchaser 42 transmitted from vending device 11 is the same as the face shown in any of the multiple facial images 41 contained in the authentication information, that is, when it determines that purchaser 42 transmitted from vending device 11 and the person shown in registered facial image 41 contained in the authentication information are the same person, it authenticates that purchaser 42 is one of the members who have registered facial image 41.

[0070] Here, the match of the facial images 41 does not mean that the images are exactly the same, but rather authenticates the identity of the person appearing in the facial images 41 by comparing the feature amounts of the facial images 41, etc. The facial recognition means 52 can determine whether the faces appearing in the facial images 41 are the same or different, based on the facial images 41 that are different as images. Note that various known technologies can be used as the facial recognition engine that authenticates the facial images 41. The facial recognition engine used may differ depending on the type of the facial recognition server 12, but any type of facial recognition server 12 that can perform facial recognition can be used.

[0071] It is deemed that authentication has been successful when face authentication means 52 confirms that the person appearing in face image 41 of purchaser 42 transmitted from vending device 11 is the same person appearing in face image 41 contained in the authentication information. Therefore, if authentication is successful, the identifier of the confirmed member is obtained based on the authentication information.

[0072] If the authentication is successful, second communication means 53 transmits authentication success information including the identifier to selling device 11. The authentication success information is generated when a person having face image 41 of purchaser 42 matches a person appearing in any of the multiple face images 41 contained in the authentication information, and therefore may include an identifier associated with face image 41 contained in the authentication information. As described above, selling device 11 receives the authentication success information transmitted from second communication means 53 and transmits it to management server 13 together with purchased item information.

[0073] It should be noted that face authentication means 52 determines that authentication has failed if the person appearing in face image 41 of purchaser 42 transmitted from vending device 11 does not match any of the people appearing in multiple face images 41 contained in the authentication information. If authentication of the purchaser by face authentication means 52 has failed, second communication means 53 preferably transmits authentication failure information not including an identifier to vending device 11.

[0074] 10, management server 13 includes member information storage means 55, purchased product recording means 56, and third communication means 57. Member information storage means 55 stores member information that associates information about the member with an identifier for each member.

[0075] 11, member information 61 recorded by member information storage means 55 can be a table that associates identifiers with information about members. The information about members is information that can identify a member, and can be an employee number, student ID number, name, department, etc. For example, in member information 61, an employee number and name are previously associated with an identifier, and it can be seen that the ID with identifier 0001 belongs to an employee named Yamada Taro whose employee number is T1001, and the ID with identifier 0002 belongs to an employee named Sato Jiro whose employee number is T1002.

[0076] As described above, vending device 11 receives authentication success information including the identifier when face authentication by face authentication server 12 is successful, and transmits this authentication success information together with purchased product information to management server 13. Using the member information and the authentication success information including the identifier transmitted from vending device 11, management server 13 can identify which member purchaser 42 who has been successfully authenticated is, using the identifier as a key.

[0077] The purchased product recording means 56 records the purchased product information for each member based on the member information 61 and the purchased product information and authentication success information transmitted from the first communication means. As shown in FIG. 12, a table in which the purchased product information is recorded for each member can be created as the purchase history 62. The purchase history 62 is composed of, for example, a member column 63 and a purchase history column 64. The purchased product recording means 56 records the purchased product information in the purchase history 62 each time the purchased product information is transmitted. For example, the purchase history 62 records the purchased product information of an employee named Yamada Taro with employee number T10001, and records that at 12:33 on October 3, 2022, a product named A Coffee was purchased at a vending machine numbered 111 for a purchase amount of 150 yen.

[0078] The third communication means transmits recording completion information to vending device 11 when the purchased product recording means 56 has completed recording the purchased product information in purchase history 62, etc. When the vending device 11 receives the recording completion information, it notifies the purchaser 42 of the completion of product ejection and / or recording. Product ejection is performed when the vending device 11 is a device that ejects products. Notification of recording completion is performed when the vending device 11 has display means.

[0079] 13, a third communication means possessed by management server 13 transmits recording completion information 65 to vending device 11. When vending device 11 receives recording completion information 65, if vending device 11 is vending machine 21, vending machine 21 dispenses product 66 to purchaser 42. If vending device 11 is tabletop terminal 31, a message such as "Recording into purchase history has been completed" is displayed on a display device such as a liquid crystal display serving as touch panel 33, thereby notifying purchaser 42 that recording is complete.

[0080] As described above, if authentication of the purchaser by face authentication means 52 fails and second communication means 53 transmits authentication failure information 43b not including an identifier to vending device 11, vending device 11 preferably notifies purchaser 42 that authentication has failed upon receiving authentication failure information 43b. This allows purchaser 42 to know that authentication has failed and that product 66 will not be dispensed or that the purchase has not been recorded.

[0081] 14, when the vending device 11 receives authentication failure information 43b from the face authentication server 12, if the vending device 11 is a vending machine 21, it can notify the purchaser 42 that authentication has failed by a display device, sound, light, etc., attached to the IC card reader. Similarly, if the vending device 11 is a tabletop terminal 31, it can notify the purchaser 42 that authentication has failed by displaying a message such as "authentication has failed" on the display device such as a liquid crystal display that is the touch panel 33.

[0082] If the authentication fails, the second communication means 53 may transmit authentication failure information to the management server 13. The management server 13 can use the authentication failure information for management of the sales system 10 by recording the authentication failure information as an error log.

[0083] By configuring sales system 10 as described above, purchaser 42 does not need to settle with money or the like at the time of purchase, and the simple configuration allows purchaser 42 who is a member to relatively quickly purchase products empty-handed within the office, etc. Therefore, sales system 10 is a sales system 10 that can be realized with a simple configuration, allowing purchaser 42 who is a member to quickly purchase products 66 empty-handed.

[0084] 15, vending device 11 may include passcode authentication means 71 for performing passcode authentication. When vending device 11 includes passcode authentication means 71, first communication means 17 transmits purchased product information and authentication success information including an identifier to management server 13 after passcode authentication is successful.

[0085] The passcode authentication means 71 may use a known passcode authentication means 71. For example, the vending device 11 assigns a passcode to each member at the time of member registration in which face image 41 is registered. It is preferable that the passcode is input after the vending device 11 receives authentication success information transmitted from the second communication means 53. A known passcode input means may be used as a method for inputting the passcode, and for example, the passcode is input using the touch panel 33.

[0086] Data on the source of passcode authentication may be included in member information 61. Information on whether passcode authentication was successful or unsuccessful may be included in recording completion information 65 transmitted from management server 13 to vending device 11. Based on the information on whether passcode authentication was successful or unsuccessful contained in recording completion information 65, vending device 11 may dispense merchandise, etc. These flows are the same as those described above.

[0087] By providing the passcode authentication means 71, security can be further improved, such as by preventing impersonation, compared to authentication using only face authentication. Furthermore, it is preferable because it does not complicate the configuration of the vending device 11, the communication load is small, and there is no time delay due to communication.

[0088] Furthermore, management server 13 may be connected to an administrator terminal owned by an administrator who manages members. The administrator terminal is a terminal for managing members, and is operated by the member's administrator or the person entrusted with managing the members. The administrator terminal may be used to view and edit member information 61 and purchased product information 44. This allows for more detailed service to be provided to members when purchasing products.

[0089] 16, the management server 13 is connected to an administrator terminal 72. The administrator terminal 72 is a terminal that manages the member information 61 and the purchased product information 44. The management of the member information 61 and the purchased product information 44 includes new creation, registration, updating, etc. of the member information 61, and the use of the purchased product information 44, etc.

[0090] By providing information on vending machines 11 available to each member in the member information 61, it is possible to limit the vending machines 11 that can be used by the purchaser 42. Using the member information and the authentication success information including the identifier transmitted from the vending machine 11 as a key, the management server 13 can identify which member the successfully authenticated purchaser 42 is, and can also determine whether the purchase was made using a vending machine 11 that can be used by this member. If the vending machine 11 is available, the subsequent processing is carried out. If the vending machine 11 is unavailable, the subsequent sales processing is not carried out, and the vending machine 11 notifies the purchaser 42 that the sale is not possible.

[0091] As shown in FIG. 17, the member information 61a is provided with a column of "available vending machines" which is information on vending machines 11 available to each member. The information on available vending machines 11 may be a positive list as shown in FIG. 17 or a negative list. In FIG. 17, an employee named Yamada Taro with employee number T1001 can purchase products using face authentication at vending machines 11 with numbers assigned to the vending machines 11 ranging from 100 to 199, but cannot purchase products using face authentication at other vending machines 11. In addition, services for members may be provided in more detail, such as vending machines that can be used free of charge, vending machines that can be used but are not free of charge, and the like. By providing information on available vending machines 11 for each member, it is possible to provide detailed services to members.

[0092] By using member information 61a having information on available vending machines 11, it is possible to obtain information as to which vending machines 11 the successfully authenticated purchaser 42 can use. Therefore, in the subsequent flow, when the purchased product recording means 56 has completed recording the purchased product information in the purchase history 62, etc., the third communication means transmits recording completion information to the vending machine 11. Upon receiving the recording completion information, the vending machine 11 notifies the purchaser 42 of the completion of ejecting the product and / or recording.

[0093] The purchased product information 44 contains the purchase history for each member, and can be used to manage the cost of purchased products. For example, the cost of purchased products can be deducted from salary, the cost of purchased products can be offset against a prepaid deposit, a subscription can be set up, or a certain amount of purchased products can be made free of charge as part of a benefit system.

[0094] As described above, the administrator terminal 72 can provide a full range of detailed services to the member purchasers 42. The member purchasers 42 can enjoy increased convenience in purchasing products, and the member administrator who provides or manages the products can easily make payments to the members and provide various services.

[0095] In addition, the administrator terminal 72 may be used when registering as a member. In other words, it may be a terminal for acquiring a face image 41 to be registered in the face authentication server 12, which is the source of face authentication of the member. As described above, the face image 41 to be registered in the face authentication server 12 may be photographed by the vending device 11.

[0096] In order to obtain an appropriate face image 41 during face authentication, the camera 15 in the vending device 11 may be provided with a notification means for notifying the purchaser of the camera shooting position and / or shooting timing. The notification means may be any means that can be recognized by human perception, such as a light emitting means and / or a sound generating means.

[0097] 18, the camera 15 may include a guide LED (light-emitting diode) 73. When acquiring a face image 41 of the purchaser 42 for face authentication at the time of purchase, the guide LED 73 notifies the purchaser 42 of the photographing position and the timing of photographing accurately.

[0098] Therefore, it is preferable to place the guide LED 73 near the lens 74 of the camera 15 and at a position that is easily visible to the purchaser 42. For example, as shown in Fig. 18(B), when the camera 15d is installed on the right side of the vending machine 21, it is preferable to place the camera 15d with the guide LED 73 located at the lower right of the lens 74 in the show window 22 of the vending machine 21. On the other hand, as shown in Fig. 18(A), when the camera 15c is installed on the left side of the vending machine 21, it is preferable to place the camera 15c with the guide LED 73 located at the lower left of the lens 74 in the show window 22 of the vending machine 21.

[0099] In the case of notifying the photographing position, the guide LED 72 lights up brightly to notify the purchaser 42 of the position of the camera when the face image 41 is acquired. In addition, in the case of notifying the timing of photographing, the time when the shutter is released can be notified to the purchaser 42 by a sequence of blinking of the guide LED 72. This sequence can be the same as the blinking sequence of the light during the self-timer in a general camera. The blinking sequence of the light during the self-timer can be, for example, a sequence in which the guide LED 72 blinks briefly every second for the first four seconds five seconds before photographing, and then blinks briefly every 0.3 seconds for the last second.

[0100] In addition, when the sales device 11 receives authentication result information 43 from the face authentication server 12 indicating that face authentication has failed, the camera 15 may re-acquire the face image 41, and at that time, the failure to acquire the face image may be notified to the purchaser 42 by light or sound.

[0101] As described above, by providing the guide LED 73 in an appropriate position on the camera 15, it becomes easy to acquire a facial image 41 of the purchaser 42 that is appropriate for facial authentication, and it is possible to prevent a failure of facial authentication due to the acquired facial image 41 being a failed image. Even if the image is a failed image, the facial image 41 of the purchaser 42 can be easily acquired again.

[0102] The flow of product purchase using the sales system 10 of the present invention will be described. As shown in FIG. 19, a purchaser 42 becomes a member by registering his / her own face image 41 (step ST010). To register as a member, it is necessary to create member information 61 (step ST020). The purchaser 42 who is a member uses the sales device 11 to select a product (step ST030).

[0103] When the purchaser 42 registers a product, the camera 15 captures the face of the purchaser 42 to obtain a facial image 41 (step ST040). After the facial image 41 is obtained, the facial authentication server 12 performs facial authentication (step ST050). If the facial authentication is successful (Y in step ST060), purchased product information and the like are transmitted to the management server 13 (step ST070). If the facial authentication is unsuccessful (N in step ST060), the process is repeated from capturing the facial image 41 (step ST040).

[0104] Management server 13 creates a purchase history by recording purchased product information 44 for each member using purchased product information 44. When recording is completed, management server 13 transmits recording completion information 65 to vending device 11 (step ST080). When vending device 11 receives recording completion information 65, it notifies purchaser 42 of the completion of ejecting the product and / or recording (step ST090).

[0105] In the above embodiment, the vending device 11, face authentication server 12, management server 13, administrator terminal 72, etc. can be realized using a computer. These computers have a processor and a control unit that controls the processor. Therefore, the hardware structure of each of the above-mentioned means is various processors. The various processors include a CPU (Central Processing Unit), a GPU (Graphical Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various means, and a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing various processes. Each means may be realized by using a combination of processors.

[0106] Therefore, the program for the sales system of the present invention is a program for realizing a sales method using a sales system including a sales device used when a purchaser who has become a member by registering a facial image purchases a product, a face authentication server that authenticates the purchaser by identifying a facial image 41 of the purchaser taken at the time of the purchase, and a management server capable of communicating with the sales device, and in the sales device, the sales device, face authentication server, and management server are each composed of a computer, a camera photographs the face of the purchaser at the time of purchase, a purchased product information acquisition means acquires purchased product information which is information on the product that the purchaser is attempting to purchase, a first communication means transmits the facial image of the purchaser taken by the camera to the facial authentication server to receive authentication result information including the result of authentication returned from the facial authentication server, and when the authentication result information is authentication success information including information on authentication success, the sales device manages the purchased product information and the authentication success information. the face authentication server, an authentication information storage means for storing authentication information associating an identifier assigned to each member with a registered facial image of each member, the facial authentication means authenticating the purchaser based on the authentication information and the facial image of the purchaser transmitted from the vending device, and the second communication means for transmitting authentication success information including the identifier to the vending device if the authentication is successful; the management server, a member information storage means for storing member information for each member associating information about the member with an identifier, a purchased product recording means for recording purchased product information for each member based on the member information and the purchased product information and authentication success information transmitted from the first communication means, and a third communication means for transmitting recording completion information to the vending device when recording is completed; and a function in the vending device, when the first communication means receives the recording completion information, notifying the purchaser of the completion of ejection of the product and / or recording. [Explanation of symbols]

[0107] 10 Sales System 11 Sales Equipment 12 Face Recognition Server 13 Management Server 14 Network 15, 15c, 15d Camera 15a Shooting direction adjustment means 15b Clip 16. Means of acquiring purchased product information 17 First means of communication 21 Vending Machines 22. Show Window 23 Camera installation position 24, 34 IC card reader 25 Product selection button 31 Desktop terminal 32 Barcode Scanner 33 Touch Panel 41 Face Image 41a Photographed image 42 Buyers 43 Authentication result information 43a Authentication success information 43b Authentication failure information 44 Purchase Product Information 51 Authentication information storage means 52 Face Recognition Methods 53 Second means of communication 55 Member information storage means 56 Purchase record means 57 Third means of communication 61, 61a Membership Information 62 Purchase History 63 Membership column 64 Purchase history section 65 Recording Completion Information 66 items 71 Passcode authentication method 72 Administrator terminal 73 Guide LED 74 Lens ST010-ST090 Step

Claims

1. A sales system comprising: a sales device used when a purchaser who has become a member by registering a facial image purchases a product; a face authentication server that authenticates the purchaser by identifying a facial image of the purchaser photographed at the time of the purchase; and a management server capable of communicating with the sales device, the sales device comprises a camera that photographs the face of the purchaser at the time of the purchase; a purchased product information acquisition means that acquires purchased product information that is information regarding the product that the purchaser is about to purchase; and a first communication means that receives authentication result information including a result of authentication returned from the face authentication server by transmitting the facial image of the purchaser photographed by the camera to the face authentication server, and when the authentication result information is authentication success information including information of authentication success, transmits the purchased product information and the authentication success information to the management server; the face authentication server comprises: an authentication information storage means for storing authentication information that associates an identifier assigned to each of the members with the registered face image of each of the members; a face authentication means for authenticating the purchaser based on the authentication information and the face image of the purchaser transmitted from the sales device; and a second communication means for transmitting the authentication success information including the identifier to the sales device if the authentication is successful; the management server comprises: a member information storage means for storing member information for each of the members, which associates information about the member with the identifier; a purchased product recording means for recording the purchased product information for each of the members based on the member information and the purchased product information and the authentication success information transmitted from the first communication means; and a third communication means for transmitting recording completion information to the sales device when the recording is completed; The vending device notifies the purchaser of the completion of ejection of the product and / or the completion of the recording when the first communication means receives the recording completion information.

2. The sales system according to claim 1 , wherein the sales device is installed in a vending machine.

3. The vending system according to claim 1 , wherein the vending device is installed as an add-on to an existing vending machine.

4. The vending system according to claim 1 , wherein the vending device is connected to a payment unit of a vending machine.

5. 2. The sales system according to claim 1, wherein the sales device is included in a tabletop terminal.

6. The sales system according to claim 1 , wherein the purchased product information includes information regarding a location where the product is located and / or a price of the product.

7. The vending device includes a passcode authentication means for performing passcode authentication, The sales system according to claim 1 , wherein the first communication means transmits the purchased product information and the authentication success information including the identifier to the management server after the passcode authentication is successful.

8. 2. The sales system according to claim 1, wherein the purchased product information acquisition means acquires information about the product from a barcode attached to the product.

9. The sales system according to claim 1 , wherein the camera captures a vertically long photographed image including a facial image of the purchaser.

10. The sales system according to claim 1 , further comprising no display means for displaying the face image of the purchaser captured by the camera to the purchaser.

11. 2. The sales system according to claim 1, wherein said camera includes a notification means for notifying said purchaser of the position where said camera is photographed.

12. 12. The sales system according to claim 11, wherein the notification means is a light emitting means and / or a sound generating means.

13. When the authentication of the purchaser by the face authentication means fails, The second communication means transmits authentication failure information not including the identifier to the vending device; 2. The sales system according to claim 1, wherein the sales device notifies the purchaser that the authentication has failed when the sales device receives the authentication failure information.

14. The sales system according to claim 1 , wherein the member information includes information on the sales devices available to each of the members.

15. The management server is connected to an administrator terminal owned by an administrator who manages the members, 2. The sales system according to claim 1, wherein the administrator terminal is capable of viewing and editing the member information and the purchased product information.

16. The sales system according to claim 1, which is used in a micro market.

17. 2. The sales system according to claim 1, wherein said members are people belonging to a company or an organization, and the sales system is used for in-house sales or workplace sales.

18. A vending device for use in the vending system according to claim 1, which can be installed in a vending machine.

19. 20. The vending apparatus of claim 18, wherein a camera is mountable within a display window of the vending machine.

20. A sales method using a sales system including a sales device used when a purchaser who has become a member by registering a facial image purchases a product, a face authentication server that authenticates the purchaser by identifying a facial image of the purchaser taken at the time of the purchase, and a management server that can communicate with the sales device, In the sales device, a camera photographs the face of the purchaser at the time of the purchase, a purchased item information acquisition means acquires purchased item information which is information relating to the item that the purchaser wishes to purchase, a first communication means transmits the facial image of the purchaser photographed by the camera to a face authentication server, thereby receiving authentication result information including a result of authentication returned from the face authentication server, and when the authentication result information is authentication success information including information on authentication success, the purchased item information and the authentication success information are transmitted to the management server, In the face authentication server, an authentication information storage means stores authentication information that associates an identifier assigned to each of the members with the registered face image of each of the members, a face authentication means authenticates the purchaser based on the authentication information and the face image of the purchaser transmitted from the sales device, and a second communication means transmits the authentication success information including the identifier to the sales device if the authentication is successful, in said management server, a member information storage means stores member information for each said member that associates information about said member with said identifier, a purchased product recording means records said purchased product information for each said member based on said member information and said purchased product information and said authentication success information transmitted from said first communication means, and a third communication means transmits recording completion information to said sales device when said recording is completed, The selling method, wherein the vending device notifies the purchaser of the completion of ejection of the product and / or the completion of the recording when the first communication means receives the recording completion information.

21. A program for implementing a sales method using a sales system including a sales device used when a purchaser who has become a member by registering a facial image purchases a product, a face authentication server that authenticates the purchaser by identifying a facial image of the purchaser taken at the time of the purchase, and a management server that can communicate with the sales device, The vending device, the face authentication server, and the management server are each a computer, a function in the sales device of having a camera photograph the face of the purchaser at the time of the purchase, a purchased product information acquisition means acquiring purchased product information which is information relating to the product that the purchaser wishes to purchase, a first communication means transmitting the facial image of the purchaser photographed by the camera to a facial authentication server, thereby receiving authentication result information including a result of authentication returned from the facial authentication server, and when the authentication result information is authentication success information including information on authentication success, transmitting the purchased product information and the authentication success information to the management server; a function in the face authentication server in which an authentication information storage means stores authentication information that associates an identifier assigned to each of the members with the registered face image of each of the members, a face authentication means authenticates the purchaser based on the authentication information and the face image of the purchaser transmitted from the sales device, and a second communication means transmits the authentication success information including the identifier to the sales device when the authentication is successful; a member information storage means for storing member information for each of the members that associates information about the member with the identifier, a purchased product recording means for recording the purchased product information for each of the members based on the member information and the purchased product information and the authentication success information transmitted from the first communication means, and a third communication means for transmitting recording completion information to the sales device when the recording is completed; a program for a sales system that, in the sales device, realizes a function of notifying the purchaser of the completion of ejecting the product and / or the recording when the first communication means receives the recording completion information.

Images