Shop system, processing method, and program

Abstract

To provide a shop system, a processing method, and a program which reduce decrease in the number of shop users caused by face image capture as a condition for shop entry.SOLUTION: A shop system 10 includes: an acquisition unit that acquires an entrance image produced by a camera installed at a shop entrance; a detection unit that detects the face of a person in the entrance image; a processing unit that produces a processed image in which the entrance image, where the face of a person has been detected, has been processed; a display control unit that causes display means to display the processed image; and a determination unit 15 that determines whether the entrance image prior to processing of the processed image, displayed by the display means, satisfies prescribed conditions.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a store system, a processing method, and a program. [Background technology]

[0002] Non-Patent Document 1 discloses a system used in unmanned stores, in which a customer can enter the store by photographing their face at the entrance.

[0003] Patent Document 1 discloses a technology that analyzes a captured image to include the user operating a kiosk terminal and the person behind him, and when a suspicious person is detected, generates an image with added information to distinguish between the user and the suspicious person, and displays the image on an operator terminal for operators stationed at a call center, etc.

[0004] Patent Document 2 discloses a technology for controlling admission using face recognition.

[0005] Patent Document 3 discloses a technique for displaying a preview of a processed image obtained by processing a captured image, rather than displaying the captured image as is. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2019-149625 A [Patent Document 2] JP 2018-128970 A [Patent Document 3] JP 2011-97519 A [Non-patent literature]

[0007] [Non-Patent Document 1] "Take a photo of your face to enter the store...Lawson conducts a demonstration experiment of late-night unmanned operation to combat labor shortages", [online], August 23, 2019, FNN PRIME, [Retrieved March 12, 2020], Internet<URL: https: / / www.fnn.jp / posts / 00047868HDK / 201908232030_livenewsalpha_HDK> Summary of the Invention [Problem to be solved by the invention]

[0008] In unmanned stores or stores with fewer staff, technology is needed to identify people who enter the store in order to ensure safe transactions. One example is a technology that requires facial photography as a condition for store entry, such as the technology disclosed in Non-Patent Document 1. In this case, the person who entered the store can be identified by the facial photo of the person. However, some people are reluctant to have their face photographed when entering the store. For this reason, if facial photography is required as a condition for store entry, there is a risk that the number of store users will decrease. None of Patent Documents 1 to 3 and Non-Patent Document 1 discloses this problem.

[0009] An object of the present invention is to prevent a decrease in the number of store customers caused by requiring facial photography as a condition for entering a store. [Means for solving the problem]

[0010] According to the present invention, An acquisition means for acquiring an entrance image generated by a camera installed at a store entrance; a detection means for detecting a human face in the entrance image; a processing means for processing the entrance image in which a human face has been detected to generate a processed image; A display control means for displaying the processed image on a display means; A determination means for determining whether the entrance image before processing of the processed image displayed by the display means at a predetermined photographing timing satisfies a predetermined condition; a processing means for registering the entrance image determined to satisfy the predetermined condition in the store visitor information stored in a storage means when the predetermined condition is satisfied, and for causing a store entrance control device installed at the store entrance to be in a state allowing the store entrance; A store system having the above configuration is provided.

[0011] Further, according to the present invention, The computer Acquire an entrance image generated by a camera installed at the store entrance, Detecting a person's face in the entrance image; generating a processed image by processing the entrance image in which a human face has been detected; Displaying the processed image on a display means; determining whether the entrance image before processing of the processed image displayed on the display means at a predetermined photographing timing satisfies a predetermined condition; When the specified conditions are met, a processing method is provided in which the entrance image judged to meet the specified conditions is registered in the store visitor information stored in a storage means, and an entrance control device installed at the store entrance is set to a state allowing entry into the store.

[0012] Further, according to the present invention, Computer, An acquisition means for acquiring an entrance image generated by a camera installed at the entrance of the store; a detection means for detecting a human face in the entrance image; a processing means for processing the entrance image in which a human face has been detected to generate a processed image; a display control means for displaying the processed image on a display means; a determination means for determining whether the entrance image before processing of the processed image displayed by the display means at a predetermined photographing timing satisfies a predetermined condition; a processing means for registering the entrance image determined to satisfy the predetermined condition in the store visitor information stored in a storage means when the predetermined condition is satisfied, and for causing a store entrance control device installed at the store entrance to be in a state allowing the store entrance; A program is provided to function as a Effect of the Invention

[0013] According to the present invention, a decrease in the number of store customers caused by requiring face photography as a condition for store entry is suppressed. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 is a diagram for explaining an overview of a store system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a store system according to the present embodiment. [Diagram 3] FIG. 2 is an example of a functional block diagram of a store system according to the present embodiment. [Figure 4] 10A and 10B are diagrams illustrating an example of image processing executed by the store system of the present embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of information processed by the store system according to the present embodiment. [Figure 6] 10 is a flowchart showing an example of a processing flow of the store system of the present embodiment. [Figure 7] 10 is a flowchart showing an example of a processing flow of the store system of the present embodiment. [Figure 8] 10 is a flowchart showing an example of a processing flow of the store system of the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] <First embodiment> "overview" First, an overview of the store system of this embodiment will be described with reference to Fig. 1. Fig. 1 shows a store entry control device 20, a controller 30, a camera 40, and a display device 50. The store system has at least the controller 30. The store system may further have at least one of the store entry control device 20, the camera 40, and the display device 50. The controller 30 is connected to each of the store entry control device 20, the camera 40, and the display device 50 via wires and / or wirelessly, and is capable of communicating with each other.

[0016] The store entry control device 20, camera 40, and display device 50 are installed at the entrance of the store. The store entry control device 20 is a device that controls entry into the store, and examples of this include a gate and an automatic door. The camera 40 is installed to capture the faces of customers. The display device 50 displays the images generated by the camera 40 so that the customers can view them. Note that "entering the store" means passing through the store entry control device 20 and entering the store. "Visiting the store" means coming to the store, and does not specifically indicate whether or not the customer has entered the store.

[0017] Before entering the store, the customer performs the task of having the camera 40 photograph his / her face. Specifically, the customer first positions his / her face in front of the camera 40, then views the image displayed by the display device 50, and adjusts the position and expression of his / her face. At this time, the controller 30 does not display the image generated by the camera 40 as is on the display device 50, but displays the processed image after processing the image on the display device 50. In this way, while the customer is performing the photographing task for entering the store, not the actual image of the customer's face that was photographed, but the processed image that was processed by processing the image is displayed so that the customer can enjoy the processed image while performing the photographing task for entering the store.

[0018] When the photographing operation for entering the store is normally completed, the controller 30 sets the store entry control device 20 to a state in which the customer can enter the store. This control causes the gate (store entry control device 20) to be in an open state, or the automatic door (store entry control device 20) to be in an open state.

[0019] With this store system, customers can enjoy the photo shoot required to enter the store. This reduces customers' resistance to the photo shoot. As a result, the decrease in the number of store users caused by having their faces photographed as a condition for entering the store is suppressed.

[0020] "Hardware Configuration" Next, an example of the hardware configuration of the store system will be described. The functional units of the store system of this embodiment are realized by any combination of hardware and software, centering on the CPU (Central Processing Unit) of any computer, memory, programs loaded into the memory, a storage unit such as a hard disk that stores the programs (programs that are stored before the device is shipped, as well as programs downloaded from storage media such as CDs (Compact Discs) or servers on the Internet, can be stored), and a network connection interface. Those skilled in the art will understand that there are various variations in the methods and devices for realizing the system.

[0021] FIG. 2 is a block diagram illustrating an example of the hardware configuration of a store system of this embodiment. As shown in FIG. 2, the store system has a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The peripheral circuit 4A does not necessarily have to be included. The store system may be configured as one device that is physically and / or logically integrated, or may be configured as multiple devices that are physically and / or logically separated. When the store system is configured as multiple devices that are physically and / or logically separated, each of the multiple devices can have the above hardware configuration.

[0022] The bus 5A is a data transmission path for the processor 1A, the memory 2A, the peripheral circuit 4A, and the input / output interface 3A to mutually transmit and receive data. The processor 1A is, for example, a processor such as a CPU or a GPU (Graphics Processing Unit). The memory 2A is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). The input / output interface 3A includes an interface for acquiring information from an input device, an external device, an external server, an external sensor, the entrance control device 20, a camera 40, a display device 50, etc., and an interface for outputting information to an output device, an external device, an external server, the entrance control device 20, a camera 40, a display device 50, etc. Examples of the input device include a keyboard, a mouse, a microphone, a touch panel, a physical button, a camera, etc. Examples of the output device include a display, a speaker, a printer, a mailer, etc. The processor 1A can issue commands to each module and perform calculations based on the results of those calculations.

[0023] "Function Configuration" Next, a functional configuration of the store system 10 will be described. An example of a functional block diagram of the store system 10 is shown in Fig. 3. As shown in the figure, the store system 10 has an acquisition unit 11, a detection unit 12, a processing unit 13, a display control unit 14, a determination unit 15, a processing unit 16, and a storage unit 17.

[0024] The acquisition unit 11 acquires an image (hereinafter, referred to as an "entrance image") generated by a camera 40 installed at a store entrance. The acquisition unit 11 acquires the entrance image from the camera 40 by real-time processing.

[0025] The detection unit 12 detects a human face in the entrance image. The "technology for detecting a human face in an image" is widely known, so a description thereof will be omitted here.

[0026] The processing unit 13 processes the entrance image in which a person's face is detected to generate a processed image. The processing unit 13 may or may not execute processing on the entrance image in which a person's face is not detected. However, there is a high possibility that the entrance image in which a person's face is not detected will not be viewed by anyone. By omitting the processing on such an entrance image, the processing load on the processing unit 13 can be reduced.

[0027] The processing can be carried out in various ways. For example, as shown in Fig. 4, processing may be carried out on the face of a person in an image. Specifically, processing may be carried out so that the feature amount extracted from the face of the person included in the entrance image does not match the feature amount extracted from the face of the person included in the processed image. In the example shown in the figure, the size of the person's eyes is changed by processing.

[0028] In addition, processing may be performed on other parts of the image (background parts, body parts of a person, etc.). For example, processing may be performed to superimpose a frame or decoration on the background part, processing may be performed to superimpose a specific outfit (a tuxedo, a dress, etc.) on the body part of a person, or other processing may be performed.

[0029] The display control unit 14 causes the processed image generated by the processing unit 13 to be displayed on the display device 50 (display means). The display device 50 displays the processed image so that it can be viewed by a customer (a customer photographed by the camera 40) who is photographing in front of the camera 40 in order to enter the store. For example, the display device 50 may be a display installed in a position and orientation that allows it to be viewed by a customer who is photographing in front of the camera 40 in order to enter the store. Alternatively, the display device 50 may be a projection device that projects information in a position that allows it to be viewed by a customer who is photographing in front of the camera 40 in order to enter the store.

[0030] The determination unit 15 determines whether or not the entrance image before processing of the processed image displayed on the display device 50 at a predetermined photographing timing satisfies a predetermined condition.

[0031] The predetermined photographing timing may be the timing when a customer inputs a photographing instruction. In this case, the customer inputs the photographing instruction via any input device such as a touch panel, a physical button, a microphone, a mouse, or a keyboard. Alternatively, the predetermined photographing timing may be the timing when a predetermined time has elapsed from a predetermined reference point in time. The predetermined reference point in time may be, for example, the timing when a human sensor or a camera detects that a customer has approached the camera 40, or the timing when the display device 50 starts displaying a processed image obtained by processing an entrance image including the customer's face, or may be something else.

[0032] When the determination unit 15 detects the arrival of a predetermined photographing timing, it identifies the processed image displayed on the display device 50 at that time, and then acquires an entrance image before processing of the identified processed image. For example, the entrance image acquired by the acquisition unit 11 and the processed image generated by the processing unit 13 may be temporarily stored in the storage unit 17 while being linked to each other. Then, the determination unit 15 may acquire an entrance image linked to the identified processed image from among the entrance images stored in the storage unit 17. In addition, the determination unit 15 may acquire an entrance image before processing of the identified processed image by performing processing to return the processed image to the entrance image.

[0033] After acquiring an entrance image before processing of the specified processed image, the judgment unit 15 judges whether the acquired entrance image satisfies a predetermined condition. The predetermined condition is that "the content of the entrance image is such that an individual can be identified", for example, "predetermined features of a person's face can be extracted", "predetermined parts of a person's face (eyes, nose, mouth, etc.) can be extracted", etc.

[0034] When the judgment unit 15 judges that the predetermined conditions are met, the processing unit 16 registers the entrance image judged to meet the predetermined conditions in the store visitor information stored in the memory unit 17, and sets the store entry control device 20 to a state allowing entry into the store.

[0035] An example of customer information is shown in FIG. 5. In the example shown, customer identification information for distinguishing customers from each other and information for identifying entrance images determined to satisfy a predetermined condition (such as a file name) are registered in association with each other. The customer information makes it possible to identify the customer.

[0036] In the case of technology that processes images and displays them so that they can be viewed, with the main purpose of providing entertainment, the processed image displayed at the time of shooting is saved, and the image before processing is not saved. In contrast, store system 10, which generates and displays processed images to reduce resistance to being photographed and has the main purpose of obtaining information (facial image) to identify store visitors, saves the unprocessed image of the processed image displayed at the time of shooting. In this respect, store system 10 differs from technology that processes images and displays them so that they can be viewed, with the main purpose of providing entertainment.

[0037] The store entry control device 20 is a device that controls entry into a store, and is, for example, a gate or an automatic door. The store entry control device 120 can be in a first state (a state in which the gate or door is open) that permits passage (entry into the store) and a second state (a state in which the gate or door is closed) that denies passage (entry into the store). The store entry control device 20 executes an operation to transition between the first state and the second state based on a control signal (electrical signal) sent by the processing unit 16.

[0038] When the determining unit 15 determines that the predetermined condition is satisfied, the processing unit 16 transmits a control signal for changing to the first state to the entrance control device 20. The entrance control device 20 changes to the first state based on the control signal.

[0039] Next, an example of the flow of processing by the store system 10 will be described with reference to the flowchart of FIG.

[0040] First, the acquisition unit 11 acquires an image (entrance image) generated by the camera 40 installed at the store entrance (S10). The acquisition unit 11 acquires the entrance image from the camera 40 by real-time processing. The camera 40 may generate images at all times. Alternatively, the camera 40 may generate images while a human presence sensor or the like detects the presence of a person at a predetermined position in front of the camera 40.

[0041] Thereafter, the detection unit 12 detects a human face in the entrance image (S11). If a human face is not detected in the entrance image (No in S11), the process returns to S10 and the same process is repeated.

[0042] On the other hand, if a human face is detected in the entrance image (Yes in S11), the processing unit 13 processes the entrance image to generate a processed image (S12). Then, the display control unit 14 causes the display device 50 to display the generated processed image (S13).

[0043] Before displaying the processed image, the display control unit 14 may cause the display device 50 to display a live image (an image not including a person's face) acquired by the acquisition unit 11 from the camera 40, or may cause other information (advertisements, weather, news, etc.) to be displayed, or may not cause anything to be displayed.

[0044] Thereafter, if it is not the predetermined photographing timing (No in S14), the process returns to S10 and repeats the same process. As described above, the predetermined photographing timing may be the timing when a customer inputs a photographing instruction, the timing when a predetermined time has elapsed from a predetermined reference point in time, or any other timing.

[0045] When the specified shooting timing arrives (Yes in S14), the judgment unit 15 identifies the processed image being displayed on the display device 50 at that time, and then acquires an entrance image before processing of the identified processed image (S15). The judgment unit 15 then judges whether the acquired entrance image satisfies a specified condition. As described above, the specified condition is that "the content of the entrance image is such that an individual can be identified", and examples of such conditions include "predetermined features of a person's face can be extracted", "predetermined features of a person's face (eyes, nose, mouth, etc.) can be extracted", etc.

[0046] If the acquired entrance image does not satisfy the predetermined condition (No in S16), the process returns to S10 and the same process is repeated. At this time, the store system 10 may display an error message on the display device 50, such as "Facial image could not be captured correctly. Please take another photograph."

[0047] On the other hand, if the acquired entrance image satisfies the predetermined condition (Yes in S16), the processing unit 16 newly registers the acquired entrance image in the store visitor information stored in the storage unit 17 (S17). Next, the processing unit 16 controls the store entry control device 20 to be in a state where the store is available for entry (a state where the gate and door are open) (S18).

[0048] "Action and effect" As described above, the store system 10 of this embodiment displays, while a customer is taking a picture of his / her face before entering the store, an edited image of the face of the customer, rather than the actual image of the face, so that the customer can view the edited image. With this store system 10, customers can enjoy the edited image while taking pictures of themselves before entering the store. This reduces customers' resistance to the picture taking process. As a result, a decrease in the number of store users caused by making face photography a condition for entering the store is suppressed.

[0049] In addition, the store system 10 can process the image so that the feature amount extracted from the face of the person included in the entrance image does not match the feature amount extracted from the face of the person included in the processed image. By processing the face of the person in this way, the processed image becomes more enjoyable to view. As a result, it is possible to further reduce the resistance of customers to having their picture taken before entering the store.

[0050] <Second embodiment> The store system 10 of this embodiment differs from the first embodiment in that it has a function of saving the processed image that was displayed at the time of photographing and providing it to the customer.

[0051] The processing unit 16 executes a process of storing the processed image displayed by the display device 50 at a predetermined photographing timing in the storage unit 17 and providing it to a customer. That is, the processing unit 16 in this embodiment stores in the storage unit 17 both the "processed image displayed by the display device 50 at a predetermined photographing timing" and the "entrance image before processing of the processed image."

[0052] Here, an example of a process for providing the saved processed image to a customer will be described. Note that the example given here is merely an example, and the implementation method is not limited to this.

[0053] "Example 1" The processing unit 16 provides the customer with storage location information (such as a URL) of the processed image. The processing unit 16 may create a code (such as a two-dimensional code) indicating the storage location information and display it on the display device 50. In this case, the customer can obtain the storage location information by operating his / her own user terminal to read the code. In addition, the processing unit 16 may transmit the storage location information to a user terminal (such as a smartphone, smart watch, tablet terminal, or mobile phone) by short-range wireless communication in response to the customer's operation of holding the user terminal over a predetermined position. After obtaining the storage location information, the customer operates his / her own user terminal to access the storage location indicated by the storage location information and obtain the processed image.

[0054] "Example 2" The processing unit 16 accepts the input of customer identification information and provides the processed image to the customer identified by the customer identification information. For example, the customer identification information may be associated with an email address and registered in the center server in advance. Then, the processing unit 16 may transmit the processed image or the above-mentioned storage location information to the email address associated with the input customer identification information.

[0055] Additionally, the processing unit 16 may provide the processed image and the above-mentioned storage location information on a personal page (a page after logging in using customer identification information) of an app or a homepage.

[0056] The processing unit 16 may receive input from the customer as to whether or not they wish to obtain an edited image at any timing while they are taking pictures to enter the store. If an input indicating a wish is received, the processing unit 16 may store the edited image and provide it to the customer, but if an input indicating a wish is not received, these processes may not be executed.

[0057] The processing unit 16 deletes the entrance image and the processed image stored in the storage unit 17 from the storage unit 17 at a predetermined timing. This realizes privacy protection, etc. Note that the timing of deleting each differs due to the difference in the purpose of storing the processed image and the entrance image. Specifically, the timing of deleting the processed image is earlier than the timing of deleting the entrance image.

[0058] Next, an example of the flow of processing by the store system 10 will be described with reference to the flowchart of FIG.

[0059] First, the acquisition unit 11 acquires an image (entrance image) generated by the camera 40 installed at the store entrance (S20). The acquisition unit 11 acquires the entrance image from the camera 40 by real-time processing. The camera 40 may generate images at all times. Alternatively, the camera 40 may generate images while a human presence sensor or the like detects the presence of a person at a predetermined position in front of the camera 40.

[0060] Thereafter, the detection unit 12 detects a human face in the entrance image (S21). If a human face is not detected in the entrance image (No in S21), the process returns to S20 and the same process is repeated.

[0061] On the other hand, if a human face is detected in the entrance image (Yes in S21), the processing unit 13 processes the entrance image to generate a processed image (S22). Then, the display control unit 14 causes the display device 50 to display the generated processed image (S23).

[0062] Before displaying the processed image, the display control unit 14 may cause the display device 50 to display a live image (an image not including a person's face) acquired by the acquisition unit 11 from the camera 40, or may cause other information (advertisements, weather, news, etc.) to be displayed, or may not cause anything to be displayed.

[0063] Thereafter, if it is not the predetermined photographing timing (No in S24), the process returns to S20 and the same process is repeated. As described above, the predetermined photographing timing may be the timing when the customer inputs a photographing instruction, the timing when a predetermined time has elapsed from a predetermined reference point in time, or any other timing.

[0064] When the specified shooting timing arrives (Yes in S24), the judgment unit 15 identifies the processed image being displayed on the display device 50 at that time, and then acquires an entrance image before processing of the identified processed image (S25). The judgment unit 15 then judges whether the acquired entrance image satisfies a specified condition. As described above, the specified condition is that "the content of the entrance image is such that an individual can be identified", and examples of such conditions include "predetermined features of a person's face can be extracted", "predetermined features of a person's face (eyes, nose, mouth, etc.) can be extracted", etc.

[0065] If the acquired entrance image does not satisfy the predetermined condition (No in S26), the process returns to S20 and the same process is repeated. At this time, the store system 10 may display an error message on the display device 50, such as "Facial image could not be captured correctly. Please take another photograph."

[0066] On the other hand, if the acquired entrance image satisfies the predetermined condition (Yes in S26), the processing unit 16 newly registers the acquired entrance image in the store visitor information stored in the storage unit 17 (S27). The processing unit 16 also executes a process of saving the processed image displayed on the display device 50 at the predetermined shooting timing and providing it to the customer (S28). An example of the process of providing the processed image to the customer is as described above.

[0067] The processing unit 16 may receive an input of the customer's intention as to whether or not they wish to obtain an edited image at any timing while the customer is taking photographs to enter the store. If an input indicating a wish is received, the processing unit 16 may execute the process of S28, and if an input indicating a no wish is received, the processing unit 16 may not execute the process of S28.

[0068] Thereafter, the processing unit 16 controls the store entry control device 20 to set the store entry possible state (gate and door open state) (S29).

[0069] Other configurations of the store system 10 are similar to those in the first embodiment.

[0070] According to the store system 10 of this embodiment, the same action and effect as the first embodiment is realized. Furthermore, according to the store system 10 of this embodiment, the processed image can be saved and provided to the customer. This makes the customer look forward to taking pictures before entering the store. As a result, the resistance to taking pictures before entering the store can be further reduced.

[0071] <Third embodiment> The store system 10 of this embodiment differs from the first and second embodiments in that it estimates personal attributes based on a face image included in an entrance image, and processes the entrance image using a method according to the estimation result.

[0072] The processing unit 13 estimates person attributes based on the face of the person detected in the entrance image. For example, the processing unit 13 estimates any attribute among attributes that can be estimated from a face image, such as gender, age, and nationality.

[0073] Then, the processing unit 13 processes the entrance image with a method according to the estimation result (person attribute). For example, a processing method is determined in advance for each person attribute. Examples of combinations of person attributes and processing methods include, but are not limited to, "cut the hair into a crew cut" when the person attributes are "female" and "teens", "braid the hair" when the person attributes are "male" and "teens", and "make the eyes larger" when the person attributes are "female" and "in their 20s or 30s".

[0074] Next, an example of the flow of processing by the store system 10 will be described with reference to the flowchart of FIG.

[0075] First, the acquisition unit 11 acquires an image (entrance image) generated by the camera 40 installed at the store entrance (S40). The acquisition unit 11 acquires the entrance image from the camera 40 by real-time processing. The camera 40 may generate images at all times. Alternatively, the camera 40 may generate images while a human presence sensor or the like detects the presence of a person at a predetermined position in front of the camera 40.

[0076] Thereafter, the detection unit 12 detects a human face in the entrance image (S41). If a human face is not detected in the entrance image (No in S41), the process returns to S40 and the same process is repeated.

[0077] On the other hand, if a person's face is detected in the entrance image (Yes in S41), the processing unit 13 estimates the person's attributes based on the person's face included in the entrance image (S42). Next, the processing unit 13 processes the entrance image using a method according to the estimation result of S42 to generate a processed image (S43). Then, the display control unit 14 causes the display device 50 to display the generated processed image (S44).

[0078] Before displaying the processed image, the display control unit 14 may cause the display device 50 to display a live image (an image not including a person's face) acquired by the acquisition unit 11 from the camera 40, or may cause other information (advertisements, weather, news, etc.) to be displayed, or may not cause anything to be displayed.

[0079] Thereafter, if it is not the predetermined photographing timing (No in S45), the process returns to S40 and the same process is repeated. As described above, the predetermined photographing timing may be the timing when a customer inputs a photographing instruction, the timing when a predetermined time has elapsed from a predetermined reference point in time, or any other timing.

[0080] When the specified shooting timing arrives (Yes in S45), the judgment unit 15 identifies the processed image being displayed on the display device 50 at that time, and then acquires an entrance image before processing of the identified processed image (S46). The judgment unit 15 then judges whether the acquired entrance image satisfies a specified condition. As described above, the specified condition is that "the content of the entrance image is such that an individual can be identified", and examples of such conditions include "predetermined features of a person's face can be extracted", "predetermined features of a person's face (eyes, nose, mouth, etc.) can be extracted", etc.

[0081] If the acquired entrance image does not satisfy the predetermined condition (No in S47), the process returns to S40 and the same process is repeated. At this time, the store system 10 may display an error message on the display device 50, such as "Facial image could not be captured correctly. Please take another photograph."

[0082] On the other hand, if the acquired entrance image satisfies the predetermined condition (Yes in S47), the processing unit 16 newly registers the acquired entrance image in the store visitor information stored in the storage unit 17 (S48). Next, the processing unit 16 controls the store entry control device 20 to be in a state where the store is available for entry (a state where the gate and door are open) (S49).

[0083] After S48, the "processing for saving the processed image displayed on the display device 50 at the time of shooting and providing it to the customer (S28 in FIG. 7)" described in the second embodiment may be executed.

[0084] A modification of this embodiment will now be described.

[0085] The display device 50 may display the processing method in a selectable manner. Then, the processing unit 13 may process the entrance image by the selected method.

[0086] Furthermore, the processing method executed may be registered in association with each visitor in the visitor information stored in the memory unit 17. The processing unit 13 may process the entrance image using a method different from the past method when the visitor next visits the store. Based on the feature amount of the face image of the visitor, information on each visitor's past visits can be extracted from the information registered in the visitor information.

[0087] The other configuration of the store system 10 is similar to that of the first and second embodiments.

[0088] According to the store system 10 of this embodiment, the same effects as those of the first and second embodiments are achieved. Furthermore, according to the store system 10 of this embodiment, images are not processed in the same manner for all customers, but rather, they can be processed in a manner appropriate to the personal attributes of each customer. Since images can be processed in a manner appropriate for each customer, satisfaction with the processed images increases. This makes customers look forward to the photo shoot before entering the store. As a result, resistance to the photo shoot before entering the store can be further reduced.

[0089] <Modification> Here, a modified example applicable to all the embodiments will be described. As described in the above embodiment, when a photograph of a customer's face is taken before entering the store, instead of the actual photographed image, a processed image of the photographed image is displayed so that the customer can view it. It is considered that a group of customers (family, friends, etc.) who come to the store would like to view and enjoy each other's processed images. Nevertheless, it is inconvenient to have to photograph and enter the store one by one.

[0090] Therefore, the store system 10 may have a means for receiving an input from a customer specifying the number of customers. Then, the processing unit 16 may set the entrance control device 20 to a state in which the customer can enter the store in response to registering entrance images for the specified number of customers in the customer information.

[0091] If the store entry control device 20 is set to a store entry enable state each time an entrance image of each customer is registered in the store entry information while a group of customers are taking pictures, each customer will think that they must enter the store when the store entry control device 20 becomes available for entry in response to the completion of their own photography work. In addition, if the store entry control device 20 is set to an entry enable state at an unnecessary time, inconveniences such as an unrelated person entering the store at that opportunity and an increase in the processing load due to unnecessary operation of the store entry control device 20 may occur. In the case of a configuration in which the store entry control device 20 is set to an entry enable state in response to the registration of entrance images for a specified number of people in the store entry information as in this modified example, such inconveniences can be reduced.

[0092] In this specification, "acquisition" may include "a device going to retrieve data stored in another device or storage medium (active acquisition)" based on user input or program instructions, such as receiving data by making a request or inquiry to another device, or accessing and reading out another device or storage medium. Also, "acquisition" may include "inputting data output from another device to the device (passive acquisition)" based on user input or program instructions, such as receiving data that is distributed (or transmitted, push notification, etc.). Also, "acquisition" may include selecting and acquiring data or information received, and "editing data (converting data to text, rearranging data, extracting part of data, changing file format, etc.) to generate new data and acquiring the new data."

[0093] A part or all of the above-described embodiments can be described as follows, but is not limited to the following. 1. An acquisition means for acquiring an entrance image generated by a camera installed at a store entrance; a detection means for detecting a human face in the entrance image; a processing means for processing the entrance image in which a human face has been detected to generate a processed image; A display control means for displaying the processed image on a display means; A determination means for determining whether the entrance image before processing of the processed image displayed by the display means at a predetermined photographing timing satisfies a predetermined condition; a processing means for registering the entrance image determined to satisfy the predetermined condition in the store visitor information stored in a storage means when the predetermined condition is satisfied, and for causing a store entrance control device installed at the store entrance to be in a state allowing the store entrance; A store system with the above. 2. The store system according to 1, wherein the display means displays the processed image so that a person photographed by a camera installed at the store entrance can view the processed image. 3. A store system according to 1 or 2, wherein the predetermined condition is that predetermined features of a person's face can be extracted. 4. A store system according to any one of 1 to 3, wherein the features extracted from the face of the person included in the entrance image do not match the features extracted from the face of the person included in the processed image. 5. A store system according to any one of 1 to 4, wherein the processing means executes a process of storing the processed image displayed by the display means at the specified shooting timing in the storage means and providing the image to customers. 6. The processing means deletes the entrance image and the processed image stored in the storage means from the storage means at a predetermined timing, 6. The store system according to 5, wherein the processed image is deleted earlier than the entrance image. 7. A store system according to any one of 1 to 6, wherein the processing means estimates personal attributes based on the face of a person detected in the entrance image, and processes the entrance image using a method according to the estimation result. 8. The computer: Acquire an entrance image generated by a camera installed at the store entrance, Detecting a person's face in the entrance image; generating a processed image by processing the entrance image in which a human face has been detected; Displaying the processed image on a display means; determining whether the entrance image before processing of the processed image displayed on the display means at a predetermined photographing timing satisfies a predetermined condition; When the specified conditions are met, the entrance image judged to meet the specified conditions is registered in the store visitor information stored in a storage means, and an entrance control device installed at the store entrance is set to a state allowing entry. 9. Computer An acquisition means for acquiring an entrance image generated by a camera installed at the entrance of the store; a detection means for detecting a human face in the entrance image; a processing means for processing the entrance image in which a human face has been detected to generate a processed image; a display control means for displaying the processed image on a display means; a determination means for determining whether the entrance image before processing of the processed image displayed by the display means at a predetermined photographing timing satisfies a predetermined condition; a processing means for registering the entrance image determined to satisfy the predetermined condition in the store visitor information stored in a storage means when the predetermined condition is satisfied, and for causing a store entrance control device installed at the store entrance to be in a state allowing the store entrance; A program that functions as a

[0094] Although the present invention has been described above with reference to the embodiments (and examples), the present invention is not limited to the above-mentioned embodiments (and examples). Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

[0095] This application claims priority based on Japanese Patent Application No. 2020-070797, filed on April 10, 2020, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0096] 1A Processor 2A Memory 3A input / output I / F 4A Peripheral circuit 5A Bus 10 Store System 11 Acquisition Department 12 Detection section 13 Processing Department 14 Display control section 15 Judgment Department 16 Processing section 17 Memory section 20. Store entry control device 30 Controller 40 Camera 50 Display device

Claims

1. An acquisition means for acquiring an entrance image generated by a camera installed at a store entrance; a detection means for detecting a human face in the entrance image; a processing means for processing the entrance image in which a human face has been detected to generate a processed image; A display control means for displaying the processed image on a display means; a determination means for determining whether the entry image before processing of the processed image displayed by the display means satisfies a predetermined condition; A store system with the above.

2. 2. The store system according to claim 1, further comprising a processing means for putting an entrance control device installed at the store entrance into a state allowing entrance to the store when the predetermined condition is satisfied.

3. The store system according to claim 1 or 2, wherein the processing means generates the processed image by processing at least one of a facial portion of a person in the entrance image, a body portion of a person in the entrance image, and a background portion in the entrance image.

4. 4. The store system according to claim 1, wherein the display means displays the processed image so that a person photographed by a camera installed at an entrance of the store can view the processed image.

5. The store system according to claim 1 , wherein the predetermined condition is that a predetermined feature amount of a person's face is extracted.

6. The store system according to claim 1 , wherein a feature extracted from a face of a person included in the entrance image does not match a feature extracted from a face of a person included in the processed image.

7. 3. The store system according to claim 2, wherein the processing means executes a process of storing the processed image displayed by the display means in a storage means and providing the processed image to customers.

8. The processing means deletes the entrance image and the processed image stored in the storage means from the storage means at a predetermined timing, The store system according to claim 7 , wherein the processed image is deleted earlier than the entrance image.

9. The store system according to claim 1 , wherein the processing means estimates personal attributes based on a face of a person detected in the entrance image, and processes the entrance image using a method according to a result of the estimation.

10. The computer Acquire an entrance image generated by a camera installed at the store entrance, Detecting a person's face in the entrance image; generating a processed image by processing the entrance image in which a human face has been detected; Displaying the processed image on a display means; A processing method for determining whether the entrance image before processing of the processed image displayed by the display means satisfies a predetermined condition.

11. Computer, An acquisition means for acquiring an entrance image generated by a camera installed at the entrance of the store; a detection means for detecting a human face in the entrance image; a processing means for processing the entrance image in which a human face has been detected to generate a processed image; a display control means for displaying the processed image on a display means; a determination means for determining whether the entry image before processing of the processed image displayed by the display means satisfies a predetermined condition; A program that functions as a

Images