Store management system, store management method, computer program, and recording medium

Abstract

To appropriately manage entry of a customer to a store or the like.SOLUTION: A store management system comprises: acquisition means for acquiring a face image from an imaging device which captures a face image of a customer at a timing when at least one of a customer entering the store, settling the payment, and leaving the store is to take place; notification means for notifying the customer that a face image from which the customer is recognizable is to be acquired by the acquisition means; and permission means for permitting the customer at least one of entering the store, settling the payment, and leaving the store under a condition that a face image from which the customer is recognizable has been acquired by the acquisition means and the customer has been notified by the notification means.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to the technical field of a store management system, a store management method, a computer program, and a recording medium for managing customer entry into a store. [Background technology]

[0002] One known system of this type is one that authenticates the face of a customer to allow them to enter an unmanned store, etc. For example, Patent Document 1 discloses a technology that photographs the face of a person entering or leaving a store, and permits the customer to enter or leave if the photographed face data can be compared with pre-stored data.

[0003] Additionally, Patent Document 2 discloses a technology that, if the user's facial image does not match the facial image for authentication, registers the user as a suspicious person and prevents the entrance / exit gate from being unlocked. Patent Document 3 discloses a technology that, if the facial image of a customer matches pre-stored data on customers who require attention, outputs information indicating that a customer who requires attention has visited the store. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-009231 [Patent Document 2] Japanese Patent Application Publication No. 2017-215737 [Patent Document 3] Japanese Patent Application Laid-Open No. 2010-136898 Summary of the Invention [Problem to be solved by the invention]

[0005] In the technology described in Patent Document 1, for example, facial recognition (i.e., matching a captured facial image with a registered facial image) is performed to enhance security in unmanned stores. However, in order to perform facial recognition, facial data for matching must be prepared in advance, which requires the user to go through a membership registration procedure that involves capturing a facial image. Such a procedure is extremely time-consuming for many users.

[0006] The present invention has been made in consideration of the above-mentioned problems, and its object is to provide a store management system, a store management method, a computer program, and a recording medium that can appropriately manage customer entry into a store, etc. [Means for solving the problem]

[0007] One aspect of the store management system of the present invention comprises an acquisition means for acquiring a facial image of a customer from an imaging device that captures the facial image of the customer when the customer is about to enter the store, make a payment, or leave the store; a notification means for notifying the customer that a facial image in which the customer can be recognized will be acquired by the acquisition means; and a permission means for permitting the customer to enter the store, make a payment, or leave the store, on the condition that the acquisition means has acquired a facial image in which the customer can be recognized and the notification means has notified the customer.

[0008] One aspect of the store management method of the present invention is a store management method executed by at least one computer, which acquires a facial image of a customer from an imaging device that captures the customer's face when the customer is about to enter, pay, or leave the store, notifies the customer that a facial image that can be used to recognize the customer will be acquired, and allows the customer to enter, pay, or leave the store, on the condition that a facial image that can be used to recognize the customer has been acquired and the customer has been notified.

[0009] One aspect of the computer program of the present invention causes a computer to execute a store management method that acquires a facial image of a customer from an imaging device when the customer is about to enter a store, make a payment, or leave the store, notifies the customer that a facial image in which the customer can be recognized will be acquired, and allows the customer to enter the store, make a payment, or leave the store, on the condition that a facial image in which the customer can be recognized has been acquired and the customer has been notified.

[0010] One aspect of the recording medium of the present invention is a recording medium on which one aspect of the computer program described above is recorded. [Effects of the Invention]

[0011] According to one aspect of each of the above-described store management system, store management method, computer program, and recording medium, it is possible to suitably manage customer entry into a store, etc. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a block diagram showing the hardware configuration of a store management system according to a first embodiment. [Figure 2] 1 is a plan view showing an example of a store layout to which a store management system according to a first embodiment is applied. [Figure 3] 1 is a block diagram showing functional blocks included in a store management device according to a first embodiment. [Figure 4] 4 is a flowchart showing the flow of operations of the store management system according to the first embodiment. [Figure 5] FIG. 10 is a block diagram showing functional blocks included in a store management device according to a second embodiment. [Figure 6] 10 is a flowchart showing the flow of operations of a store management system according to a second embodiment. [Figure 7] FIG. 10 is a block diagram showing functional blocks included in a store management device according to a third embodiment. [Figure 8]10 is a flowchart showing the flow of operations of a store management system according to a third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of a store management system, a store management method, a computer program, and a recording medium will be described with reference to the drawings.

[0014] First Embodiment First, a store management system according to the first embodiment will be described with reference to Figures 1 to 4. The type of store managed by the store management system is not particularly limited, but the technical effects of this embodiment are particularly evident in, for example, unmanned (nighttime) convenience stores.

[0015] (Hardware configuration) First, the hardware configuration of a store management system according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of a store management system according to a first embodiment.

[0016] 1, the store management system 1 according to this embodiment includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, a storage device 14, an input device 15, and an output device 16. The CPU 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected via a data bus 17.

[0017] The CPU 11 loads a computer program. For example, the CPU 11 may load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. For example, the CPU 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The CPU 11 may acquire (i.e., load) a computer program from a device (not shown) located outside the store management system 1 via a network interface. The CPU 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In this embodiment, when the CPU 11 executes the loaded computer program, functional blocks for store management are implemented within the CPU 11. In other words, the CPU 11 can function as a controller for executing store management.

[0018] The RAM 12 temporarily stores computer programs executed by the CPU 11. The RAM 12 temporarily stores data that is temporarily used by the CPU 11 while the CPU 11 is executing the computer programs. The RAM 12 may be, for example, a D-RAM (Dynamic RAM).

[0019] The ROM 13 stores computer programs executed by the CPU 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a P-ROM (Programmable ROM).

[0020] The storage device 14 stores data that the store management system 1 saves over the long term. The storage device 14 may also function as a temporary storage device for the CPU 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0021] The input device 15 is a device that receives input instructions from a user of the store management system 1. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel.

[0022] The output device 16 is a device that outputs information related to the store management system 1 to the outside. For example, the output device 16 may be a display device that can display information related to the store management system 1.

[0023] (System Configuration) Next, the configuration of the store management system 1 according to the first embodiment will be described with reference to Figures 2 and 3. Figure 2 is a plan view showing an example of a store layout to which the store management system according to the first embodiment is applied. Figure 3 is a block diagram showing functional blocks included in the store management system according to the first embodiment.

[0024] As shown in Figure 2, the store management system 1 according to the first embodiment is applied to a store such as a convenience store. The store management system 1 includes a store management device 10 configured as a store management server that controls the entire system, a camera 20a and a tablet 30a installed at the store entrance, a camera 20b and a cashier terminal 40 installed near the cashier counter, and a camera 20c and a tablet 30b installed at the store exit.

[0025] 3, the store management device 10 includes a face image acquisition unit 100, an image capture notification unit 200, and an operation permission unit 300. These functional blocks are realized, for example, by the CPU 11 (see FIG. 1).

[0026] The facial image acquisition unit 100 is connected to at least one camera 20 (i.e., cameras 20a, 20b, and 20c in FIG. 2 ) arranged in a store, for example. The camera 20 is configured to be able to capture a facial image of a user, and the facial image acquisition unit 100 is configured to be able to acquire an image captured by each camera 20 (i.e., a facial image of the user). More specifically, when a user attempts to enter a store, the facial image acquisition unit 100 can acquire a facial image of the user attempting to enter from camera 20a installed near the store entrance. When a user attempts to pay in the store, the facial image acquisition unit 100 can acquire a facial image of the user attempting to pay from camera 20b installed near the cash register terminal 40. When a user attempts to leave the store, the facial image acquisition unit 100 can acquire a facial image of the user attempting to leave from camera 20c installed near the store exit. The facial image of the user acquired by the facial image acquisition unit 100 is stored in, for example, a storage device 14 included in the store management system 1. The face image acquisition unit 100 is a specific example of "acquisition means" in the appendix described below.

[0027] The image capture notification unit 200 is connected to, for example, a tablet 30 (i.e., tablets 30a and 30b in FIG. 2 ) or cash register terminal 40 arranged in a store, or any other HMI (Human Machine Interface), and is configured to be able to notify a user that a facial image of the user will be captured or has been captured by the camera 20 (i.e., that a facial image of the user will be captured or has been captured by the facial image acquisition unit 100). More specifically, the image capture notification unit 200 can notify a user about to enter the store that a facial image will be captured or has been captured by the camera 20a via the tablet 30a installed near the store entrance. The image capture notification unit 200 can notify a user about to pay at the store that a facial image will be captured or has been captured by the camera 20b via the cash register terminal 40. The image capture notification unit 200 can notify a user about to leave the store that a facial image will be captured or has been captured by the camera 20c via the tablet 30b installed near the store exit. For example, the imaging notification unit 200 notifies the user that a facial image will be captured or that it has been captured by displaying a predetermined image (for example, an image showing a message indicating that a facial image will be captured or that it has been captured) on the screen of a display provided in the tablet 30 or the cashier terminal 40. Alternatively, the imaging notification unit 200 notifies the user that a facial image will be captured or that it has been captured by playing a predetermined sound (for example, a sound indicating that a facial image will be captured or that it has been captured) from a speaker. Note that the notification by the imaging notification unit 200 may be a notification that allows the user to recognize that a facial image will be captured, and may not only directly notify the user that a facial image will be captured, but also implicitly indicate that a facial image will be captured. The imaging notification unit 200 is a specific example of a "notification means" in the appendix described below.

[0028] The operation permission unit 300 is configured to permit the user to enter the store, make a transaction, or leave the store (specifically, the action that was being performed when the facial image was captured), on the condition that the facial image of the user has been captured by the facial image capture unit 100 and the user has been notified of the image capture by the image capture notification unit 200. The operation permission unit 300 permits the user to enter or leave the store, for example, by controlling the opening and closing of the automatic door 50 at the store entrance. The operation permission unit 300 also permits the user to make a transaction, for example, by controlling the operation of the store's cash register terminal 40. The operation permission unit 300 is a specific example of "permission means" in the appendix described below.

[0029] (Operation description) Next, the operational flow of the store management system 1 according to the first embodiment will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the operational flow of the store management system according to the first embodiment.

[0030] As shown in FIG. 4, the store management system 1 according to the first embodiment first detects the presence of a user who is about to enter, pay, or leave the store (step S101). The presence of such a user can be detected, for example, using a sensor installed near the store entrance or near the cash register. Alternatively, the presence of the user may be detected based on the user's operation of a terminal. If the presence of a user is not detected (step S101: NO), the subsequent processing is not executed. In this case, the processing of step S101 may be restarted after a predetermined period of time.

[0031] When the presence of a user is detected (step S101: YES), the imaging notification unit 200 notifies the user that a face image will be captured (step S102). That is, the flowchart shown in Fig. 4 shows the operation of the imaging notification unit 200 notifying the user that a face image will be captured before the face image is actually captured. The notification to the user may include an instruction to adjust the user's position (for example, to move the user into the imaging range of the camera 20) or an instruction to face the camera 20 so that the face image can be captured normally.

[0032] Next, the camera 20 captures an image of the user, and the facial image acquisition unit 100 acquires the user's facial image (step S103). The timing of capturing the facial image may be determined by the user (for example, capturing the image may be performed when the user operates a button). The captured facial image may also be displayed on the tablet 30, the cashier terminal 40, or the like so that the user can confirm it. Note that if the imaging notification unit 200 does not notify the user that a facial image will be captured, but rather notifies the user that a facial image has already been captured, step S103 may be executed first, and then step S102 may be executed.

[0033] Thereafter, the face image acquisition unit 100 checks whether the face image has been acquired normally (step S104). For example, the face image acquisition unit 100 determines whether the captured face image can be normally recognized as a human face. If it is determined that the face image has not been acquired normally (step S104: NO), the camera captures an image of the user again, and the face image acquisition unit 100 attempts to acquire the face image again (step S103). Note that if a face image cannot be acquired normally even after capturing an image a predetermined number of times, an instruction to expose the face to the camera (for example, prompting the user to remove sunglasses or a mask) may be output.

[0034] If it is determined that the facial image has been successfully acquired (step S104: NO), the operation permission unit 300 permits the user whose facial image has been captured to enter the store, make a transaction, or leave the store (step S105). Note that the operation permission unit 300 may notify the user that entry, payment, or leaving the store has been permitted.

[0035] (Technical Effects) Next, the technical effects obtained by the store management system 1 according to the first embodiment will be described.

[0036] As described with reference to FIGS. 1 to 4, the store management system 1 according to the first embodiment allows users whose face images have been captured to enter, pay, and leave the store (in other words, they are permitted to use the store). On the other hand, users whose face images have not been captured are not permitted to enter, pay, or leave the store (in other words, they are not permitted to use the store). In this way, if a user's face image is acquired in advance before they are permitted to use the store, security in the store (particularly in unmanned stores at night, etc.) can be increased. Specifically, security can be made stronger compared to when anyone is allowed to use the store freely.

[0037] Furthermore, in this embodiment, particularly, before being permitted to enter, pay, and leave the store, the user is notified that a facial image has been captured in advance or that a facial image has already been captured, so the user is reliably aware that the store is aware of their presence. For example, the user recognizes that the store should be able to identify them using their facial image. This effectively prevents the user from engaging in inappropriate behavior in the store.

[0038] In this embodiment, a facial image is only captured, and no matching with a pre-registered facial image (so-called facial authentication) is performed. Therefore, it is possible to allow the user to use the store in an appropriate manner without forcing the user to go through membership registration procedures (specifically, the process of linking a facial image with a user account) before visiting the store.

[0039] Second Embodiment Next, a store management system 1 according to a second embodiment will be described with reference to Figures 5 and 6. The second embodiment differs from the first embodiment only in some of its configuration and operation, and is otherwise generally similar. Therefore, the following will describe in detail the differences from the first embodiment, and will omit a description of the overlapping parts as appropriate.

[0040] (System Configuration) First, the configuration of functional blocks included in a store management device 10 according to the second embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing functional blocks included in a store management device according to the second embodiment.

[0041] As shown in FIG. 5, the store management device 10 according to the second embodiment further includes a consent confirmation unit 400 in addition to the functional blocks of the first embodiment shown in FIG.

[0042] The consent confirmation unit 400 is configured to confirm whether the user has consented to the notification from the imaging notification unit 200 (i.e., a notification informing the user that a face image will be captured or that an image has been captured). The consent confirmation unit 400 determines that the user's consent has been obtained, for example, by the user operating a terminal such as the tablet 30 or the cash register terminal 40. Alternatively, the consent confirmation unit 400 may determine that the user's consent has been obtained when the user makes a motion (typically a gesture) indicating consent to being captured. Alternatively, the consent confirmation unit 400 may determine that the user's consent has been obtained when the user does not make a motion indicating refusal to be captured in response to the notification from the imaging notification unit 200. When determining that the user's consent has been obtained based on such a user motion, the consent confirmation unit 400 may determine the type of user motion via the camera 20 (or any sensor capable of detecting the user's motion). Furthermore, the consent confirmation unit 400 may display to the user a message pursuant to the Personal Information Protection Act (for example, a message indicating that the captured face image will only be used for processes permitting entry, payment, and exit from the store). The consent confirmation unit 400 is a specific example of a "determination means" in the appendix described below.

[0043] (Operation description) Next, the operational flow of the store management system 1 according to the second embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the operational flow of the store management system according to the second embodiment.

[0044] As shown in FIG. 6, during operation of the store management system 1 according to the second embodiment, after notification is executed by the imaging notification unit 200 (step S102), the consent confirmation unit 400 determines whether or not the user has consented to the notification (step S201).

[0045] If it is determined that the user has given consent (step S201: YES), the processes from step S103 onwards are executed as in the first embodiment (i.e., the user is permitted to use the store as appropriate). On the other hand, if it is determined that the user has not given consent (step S201: NO), the processes from step S103 onwards are not executed (i.e., the user is not permitted to use the store).

[0046] (Technical Effects) Next, the technical effects obtained by the store management system 1 according to the second embodiment will be described.

[0047] As described in Figures 5 and 6, the store management system 1 according to the second embodiment allows only users who consent to having their face images captured to use the store (i.e., enter, pay, and leave) as appropriate. This prevents users who refuse to have their face images captured from being able to use the store. It also ensures that face images are not used by the store without the user's consent.

[0048] Third Embodiment Next, a store management system 1 according to a third embodiment will be described with reference to Figures 7 and 8. The third embodiment differs from the first and second embodiments only in some of its configuration and operation, and is otherwise generally similar. Therefore, the following will describe in detail the differences from the first and second embodiments, and will omit a description of the overlapping parts as appropriate.

[0049] (System Configuration) First, the configuration of functional blocks included in a store management device 10 according to the third embodiment will be described with reference to Fig. 7. Fig. 7 is a block diagram showing functional blocks included in a store management device according to the third embodiment.

[0050] As shown in FIG. 7, the store management device 10 according to the third embodiment is configured to further include a facial image erasing unit 500 in addition to the functional blocks of the first embodiment shown in FIG.

[0051] The facial image erasing unit 500 is configured to erase the facial image acquired by the facial image acquisition unit 100 (in other words, delete the facial image data of the user that had been stored) when a deletion trigger is detected for a user who has been permitted to enter, pay, and leave the store. The "deletion trigger" is a pre-set condition for determining whether or not to erase the stored facial image. The condition may be set to determine when the facial image becomes unnecessary (specifically, when the opportunity to use the facial image for permitting entry, payment, and leaving the store will no longer exist). Examples of deletion triggers include "user leaving the store" and "a certain amount of time has passed since entering the store." When the user leaving the store is used as the deletion trigger, the facial image erasing unit 500 may erase the facial image immediately after the user leaves the store or after a certain amount of time has passed since leaving the store. The facial image erasing unit 500 may determine that the user has left the store when the operation permission unit 300 permits the user to leave the store. Furthermore, even if it is not possible to directly detect that the user has left the store, in a situation where it can be determined that the user has definitely left the store (for example, when an extremely long time has passed since the user entered the store), it may be determined that the user has already left the store and the facial image may be erased. The facial image erasing unit 500 is a specific example of "erasing means" in the appendix described below.

[0052] (Operation description) Next, the operational flow of the store management system 1 according to the third embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the operational flow of the store management system according to the third embodiment.

[0053] 8, during operation of the store management system 1 according to the third embodiment, after the operation permission unit 300 gives permission to enter, pay, and leave the store (step S105), the facial image erasure unit 500 determines whether a deletion trigger has been detected (step S301). If it is determined that a deletion trigger has not been detected (step S301: NO), the series of processes ends without deleting the facial image. In this case, the process of step S301 can be executed again after a predetermined period of time.

[0054] If it is determined that a deletion trigger has been detected (step S301: YES), the facial image erasing unit 500 erases the facial image of the user for whom the deletion trigger was detected (step S302). Therefore, after the deletion trigger is detected, the store management system 1 according to the third embodiment will no longer store facial images of users. In other words, the store management system 1 according to the third embodiment is configured to store only facial images of users for whom a deletion trigger has not been detected.

[0055] (Technical Effects) Next, the technical effects obtained by the store management system 1 according to the third embodiment will be described.

[0056] As explained in Figures 7 and 8, the store management system 1 according to the third embodiment erases the facial image of a user for which a deletion trigger has been detected. Therefore, even if the same user visits the store again, a new facial image is acquired each time. This eliminates the need for the store management system 1 to store a huge amount of facial image data. Furthermore, facial images can be managed appropriately as personal information.

[0057] <Modification> Next, a modification of the store management system 1 according to the first to third embodiments will be described.

[0058] As already explained, the store management system 1 according to the first to third embodiments permits a user to use a store on the condition that a user's facial image is captured and notified. It does not require matching of the facial image (so-called "face authentication"). However, aside from these operations, a user's facial authentication may be performed using a facial image acquired once. For example, when paying, a determination may be made as to whether a facial image of the user captured upon entering the store matches a facial image of the user about to pay. Similarly, when leaving the store, a determination may be made as to whether a facial image of the user captured upon entering or paying matches a facial image of the user about to leave. When performing facial authentication, adopting a configuration that erases facial images (i.e., captures new images each time) as in the third embodiment described above can more effectively perform facial authentication. For example, this can avoid a situation where a facial image captured during the day cannot be used for nighttime facial authentication due to differences in brightness when the facial images were captured, or conversely, a facial image captured at night cannot be used for daytime facial authentication. Furthermore, the latest facial images can always be used, and unnecessary facial images can be deleted (in other words, the facial images to be matched can be limited), thereby improving the accuracy of facial authentication.

[0059] Alternatively, the facial image may be compared only with pre-stored facial images of users who should not be allowed to enter the store (for example, a list of facial images of suspicious people), and if the facial image matches, the user may not be allowed to enter, pay, or leave the store. In this case, a backroom or an operation center may be notified of the pre-stored user's visit. Alternatively, a store staff member may respond via an intercom or the like and manually allow the user to use the store.

[0060] In addition, images taken when entering the store, paying, and leaving the store can be linked to customer information such as when the customer entered the store, what they bought, and when they left, making the images easily viewable.

[0061] Furthermore, if no transaction or exit is detected within a predetermined time (for example, about 10 minutes) after entering the store, a notification may be sent to the back room or the operations center to prompt the customer to check the inside of the store.

[0062] Furthermore, the system may be able to switch between a mode in which a face image is captured and entry, payment, and exit are permitted (i.e., a mode in which the operations described in the first to third embodiments are performed) and a mode in which anyone is allowed to freely enter, pay, and exit the store. In this case, the mode may be switched by an operation by a store clerk, or the mode may be switched automatically depending on the time (for example, the time when unmanned business begins).

[0063] <Additional Notes> The following additional notes are provided regarding the above-described embodiment.

[0064] (Appendix 1) The store management system described in Appendix 1 is a store management system characterized by comprising: an acquisition means for acquiring a facial image of a customer from an imaging device that captures the facial image of the customer when the customer is about to enter the store, make a payment, or leave the store; a notification means for notifying the customer that the facial image will be acquired by the acquisition means or that the facial image has been acquired; and an authorization means for permitting the customer to enter the store, make a payment, or leave the store, on the condition that the acquisition means has acquired the facial image and the notification means has notified the customer.

[0065] (Appendix 2) The store management system described in Appendix 2 is the store management system described in Appendix 1, characterized in that the permission means permits the customer to at least one of entering the store, paying, and leaving the store without determining whether the facial image acquired by the acquisition means matches that of the customer acquired in advance.

[0066] (Appendix 3) The store management system described in Appendix 3 is the store management system described in Appendix 1 or 2, characterized in that the notification means notifies the customer that the facial image will be acquired or has been acquired by displaying a specified image to the customer or uttering a specified sound to the customer.

[0067] (Appendix 4) The store management system described in Appendix 4 is a store management system described in any one of Appendixes 1 to 3, further comprising a judgment means for determining whether the customer has agreed to the notification by the notification means, and the permission means is characterized in that, in addition to the acquisition of the facial image by the acquisition means and the notification to the customer by the notification means, it is determined by the judgment means that the customer has agreed, and the permission means permits the customer to at least one of entering the store, making the payment, and leaving the store.

[0068] (Appendix 5) The store management system described in Appendix 5 is the store management system described in Appendix 4, characterized in that the determination means determines that the customer has agreed to the notification by the notification means if the customer takes a specified action after the notification by the notification means.

[0069] (Appendix 6) The store management system described in Appendix 6 is characterized in that it further comprises an erasing means for erasing the facial image of the customer acquired by the acquisition means when a deletion trigger related to the customer is detected.

[0070] (Appendix 7) The store management method described in Appendix 7 is a store management method characterized by including an acquisition step of acquiring a facial image of a customer from an imaging device that captures the facial image of the customer when the customer is about to enter the store, make a payment, or leave the store; a notification step of notifying the customer that the facial image will be acquired in the acquisition step or that the facial image has been acquired; and an authorization step of permitting the customer to enter the store, make a payment, or leave the store, on the condition that the facial image has been acquired in the acquisition step and the customer has been notified in the notification step.

[0071] (Appendix 8) The computer program described in Appendix 8 is a computer program that causes a computer to execute the following steps: an acquisition step of acquiring a facial image of a customer from an imaging device that captures the facial image of the customer when the customer is about to enter a store, make a payment, or leave the store; a notification step of notifying the customer that the facial image will be acquired in the acquisition step or that the facial image has been acquired; and an authorization step of authorizing the customer to enter the store, make a payment, or leave the store, on the condition that the facial image has been acquired in the acquisition step and the customer has been notified in the notification step.

[0072] (Appendix 9) The recording medium described in Supplementary Note 9 is a recording medium having the computer program described in Supplementary Note 8 recorded thereon.

[0073] The present invention can be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and the store management system, store management method, computer program, and recording medium that involve such modifications are also included in the technical idea of ​​the present invention.

[0074] To the extent permitted by law, this application claims priority to Japanese Patent Application No. 2019-113479, filed June 19, 2019, the disclosure of which is incorporated herein in its entirety. Furthermore, to the extent permitted by law, all publications and papers mentioned in this specification are incorporated herein by reference. [Explanation of symbols]

[0075] 1. Store management system 10. Store management device 11 CPU 15 Input Devices 16 Output Devices 20 Camera 30 tablets 40 cashier terminal 50 Automatic Doors 100 Facial image acquisition unit 200 Imaging notification unit 300 Operation permission unit 400 Consent Confirmation Department 500 Face image erasure unit

Claims

1. an acquisition means for acquiring a facial image of a customer from an imaging device that captures the facial image of the customer when the customer is about to enter the store, make a payment, or leave the store; a notification means for notifying the customer that a face image capable of recognizing the customer will be acquired by the acquisition means before the face image is acquired; a permission means for permitting the customer to enter the store, make a transaction, or leave the store without performing any processing using the acquired face image, on the condition that the acquisition means has acquired a face image capable of recognizing the customer and the notification means has notified the customer; A store management system comprising:

2. The store management system according to claim 1, characterized in that the permission means permits the customer to enter the store, make the transaction, or leave the store without determining whether the facial image capable of recognizing the customer acquired by the acquisition means matches that of the customer acquired in advance.

3. The store management system according to claim 1 or 2, characterized in that the notification means notifies the customer that a facial image capable of recognizing the customer has been obtained by displaying a predetermined image to the customer or by making a predetermined sound to the customer.

4. further comprising a determination means for determining whether the customer has agreed to the notification by the notification means; The permission means permits the customer to at least one of entering the store, making the transaction, and leaving the store on the condition that the acquisition means has acquired a facial image capable of recognizing the customer, the notification means has notified the customer, and the determination means has determined that the customer has agreed. The store management system according to any one of claims 1 to 3.

5. 5. The store management system according to claim 4, wherein the determining means determines that the customer has consented to the notification by the notifying means if the customer takes a predetermined action after receiving the notification by the notifying means.

6. 6. The store management system according to claim 1, further comprising an erasing unit that erases the facial image that can be used to recognize the customer, acquired by the acquisition unit, when a deletion trigger related to the customer is detected.

7. 1. A store management method executed by at least one computer, comprising: acquiring a face image of a customer from an imaging device that captures a face image of the customer at a timing when the customer is about to enter the store, make a payment, or leave the store; notifying the customer that a facial image capable of recognizing the customer will be acquired before the facial image is acquired; On the condition that a facial image capable of recognizing the customer has been acquired and the customer has been notified, the customer is permitted to enter the store, make a transaction, or leave the store without performing any processing using the acquired facial image. A store management method characterized by:

8. acquiring a face image of a customer from an imaging device that captures a face image of the customer at a timing when the customer is about to enter the store, make a payment, or leave the store; notifying the customer that a facial image capable of recognizing the customer will be acquired before the facial image is acquired; On the condition that a facial image capable of recognizing the customer has been acquired and the customer has been notified, the customer is permitted to enter the store, make a transaction, or leave the store without performing any processing using the acquired facial image. A computer program that causes a computer to execute a store management method.

9. A recording medium on which the computer program according to claim 8 is recorded.

Images