Store system, processing method and program

Abstract

To provide a shop system, a processing method, and a program which reduce decrease in the number of shop users caused by face image capture as a condition for shop entry.SOLUTION: A shop system 10 includes: an acquisition unit that acquires an entrance image produced by a camera installed at a shop entrance; a detection unit that detects the face of a person in the entrance image; a processing unit that produces a processed image in which the entrance image, where the face of a person has been detected, has been processed; a display control unit that causes display means to display the processed image; and a determination unit 15 that determines whether the entrance image prior to processing of the processed image, displayed by the display means, satisfies prescribed conditions.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a store system, a processing method, and a program. [Background technology]

[0002] Non-Patent Document 1 discloses a system used in unmanned stores, in which a user can enter the store by taking a picture of their face at the entrance.

[0003] Patent Document 1 discloses a technology that analyzes an image captured to include the user operating the kiosk terminal and the person behind them, and when a suspicious person is detected, generates an image with information added to identify the user and the suspicious person, and displays the image on an operator terminal for operators stationed at a call center, etc.

[0004] Patent Document 2 discloses a technology for controlling admission using face authentication.

[0005] Patent Document 3 discloses a technique for displaying a preview image in which a photographed image is processed, rather than displaying the photographed image as is. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Publication No. 2019-149625 [Patent Document 2] Japanese Patent Application Laid-Open No. 2018-128970 [Patent Document 3] Japanese Patent Application Laid-Open No. 2011-97519 [Non-patent literature]

[0007] [Non-Patent Document 1] "Take a photo of yourself to enter the store...Lawson conducts a trial of late-night unmanned operations to combat labor shortages," [online], August 23, 2019, FNN PRIME, [Retrieved March 12, 2020], Internet<URL: https: / / www.fnn.jp / posts / 00047868HDK / 201908232030_livenewsalpha_HDK> Summary of the Invention [Problem to be solved by the invention]

[0008] In unmanned stores or stores with reduced manpower, technology is needed to identify people who enter the store in order to ensure safe transactions. One example is a technology that requires facial photography as a condition for entry, such as the technology disclosed in Non-Patent Document 1. In this case, people who enter the store can be identified by their facial photograph. However, some people are reluctant to have their faces photographed when entering the store. For this reason, if facial photography is required as a condition for entry, there is a risk that the number of store users will decrease. Neither Patent Documents 1 to 3 nor Non-Patent Document 1 discloses this problem.

[0009] An object of the present invention is to prevent a decrease in the number of store customers caused by requiring facial photography as a condition for entering a store. [Means for solving the problem]

[0010] According to the present invention, an acquisition means for acquiring an entrance image generated by a camera installed at the entrance of the store; a detection means for detecting a person's face in the entrance image; a processing means for processing the entrance image from which a person's face has been detected to generate a processed image; a display control means for displaying the processed image on a display means; a determining means for determining whether the entrance image before processing of the processed image displayed by the display means at a predetermined photographing timing satisfies a predetermined condition; a processing means for registering the entrance image determined to satisfy the predetermined condition in the store visitor information stored in a storage means when the predetermined condition is satisfied, and for enabling a store entry control device installed at the store entrance to enter the store; A store system having the above configuration is provided.

[0011] Further, according to the present invention, The computer Acquires an entrance image generated by a camera installed at the store entrance, Detecting a person's face in the entrance image; generating a processed image by processing the entrance image in which a person's face has been detected; displaying the processed image on a display means; determining whether the entrance image before processing of the processed image displayed by the display means satisfies a predetermined condition at a predetermined photographing timing; If the specified conditions are met, a processing method is provided in which the entrance image judged to meet the specified conditions is registered in the store visitor information stored in a storage means, and an entry control device installed at the store entrance is set to a state allowing entry into the store.

[0012] Further, according to the present invention, Computer, an acquisition means for acquiring an entrance image generated by a camera installed at the store entrance; a detection means for detecting a human face in the entrance image; a processing means for processing the entrance image in which a person's face has been detected to generate a processed image; a display control means for displaying the processed image on a display means; a determination means for determining whether the entrance image before processing of the processed image displayed by the display means at a predetermined photographing timing satisfies a predetermined condition; a processing means for registering the entrance image determined to satisfy the predetermined condition in the store visitor information stored in a storage means when the predetermined condition is satisfied, and for enabling a store entry control device installed at the store entrance to enter the store; A program is provided to function as a [Effects of the Invention]

[0013] According to the present invention, a decrease in the number of customers at a store caused by requiring facial photography as a condition for entering the store can be suppressed. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 1 is a diagram for explaining an overview of a store system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a diagram illustrating an example of a hardware configuration of a store system according to an embodiment of the present invention. [Figure 3] FIG. 2 is an example of a functional block diagram of a store system according to the present embodiment. [Figure 4] 10A and 10B are diagrams illustrating an example of image processing executed by the store system of the present embodiment. [Figure 5] FIG. 2 is a diagram illustrating an example of information processed by the store system according to the present embodiment. [Figure 6] 10 is a flowchart illustrating an example of a processing flow of the store system according to the present embodiment. [Figure 7] 10 is a flowchart illustrating an example of a processing flow of the store system according to the present embodiment. [Figure 8] 10 is a flowchart illustrating an example of a processing flow of the store system according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0015] First Embodiment "overview" First, an overview of the store system of this embodiment will be described using Figure 1. Figure 1 shows a store entry control device 20, a controller 30, a camera 40, and a display device 50. The store system has at least the controller 30. The store system may further have at least one of the store entry control device 20, the camera 40, and the display device 50. The controller 30 is connected to each of the store entry control device 20, the camera 40, and the display device 50 via wired and / or wireless connections, and is capable of communicating with them.

[0016] The store entry control device 20, camera 40, and display device 50 are installed at the entrance of the store. The store entry control device 20 is a device that controls entry into the store, and is exemplified by, for example, a gate or an automatic door. The camera 40 is installed to capture the faces of customers. The display device 50 displays images generated by the camera 40 so that the customers can view them. Note that "entering the store" means passing through the store entry control device 20 and entering the store. "Visiting the store" means coming to the store, and does not specifically indicate whether or not the customer has entered the store.

[0017] Before entering the store, a customer performs the task of having the camera 40 capture a picture of their face. Specifically, the customer first positions their face in front of the camera 40, then views the image displayed on the display device 50 and adjusts the position and expression of their face. At this time, the controller 30 does not display the image generated by the camera 40 as is on the display device 50, but rather displays an edited image after processing the image on the display device 50. In this way, while the customer is performing the photo shoot to enter the store, not the actual image of the customer's face, but the edited image obtained by processing the image is displayed for viewing, so the customer can enjoy the edited image while performing the photo shoot to enter the store.

[0018] When the photographing operation for entering the store is completed normally, the controller 30 sets the store entry control device 20 to a state in which the store can be entered. This control causes the gate (store entry control device 20) to be in an open state, or the automatic door (store entry control device 20) to be in an open state.

[0019] This store system allows customers to enjoy the process of having their photo taken before entering the store. This reduces customers' resistance to the process. As a result, it prevents a decrease in the number of store users due to requiring facial photography as a condition for entering the store.

[0020] "Hardware Configuration" Next, an example of the hardware configuration of a store system will be described. The functional units of the store system of this embodiment are realized by any combination of hardware and software, centered around a CPU (Central Processing Unit) of any computer, memory, programs loaded into memory, a storage unit such as a hard disk that stores the programs (this can store programs that are pre-loaded when the device is shipped, as well as programs downloaded from storage media such as CDs (Compact Discs) or servers on the Internet), and a network connection interface. Those skilled in the art will understand that there are many variations in the implementation methods and devices.

[0021] FIG. 2 is a block diagram illustrating an example of the hardware configuration of a store system according to this embodiment. As shown in FIG. 2, the store system includes a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. Note that the peripheral circuit 4A is not necessarily required. Note that the store system may be configured as a single device that is physically and / or logically integrated, or may be configured as multiple devices that are physically and / or logically separated. When the store system is configured as multiple devices that are physically and / or logically separated, each of the multiple devices may have the above hardware configuration.

[0022] The bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuit 4A, and input / output interface 3A to mutually transmit and receive data. The processor 1A is, for example, a processing unit such as a CPU or a graphics processing unit (GPU). The memory 2A is, for example, a random access memory (RAM) or a read-only memory (ROM). The input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external servers, external sensors, the entry control device 20, the camera 40, the display device 50, etc., and interfaces for outputting information to output devices, external devices, external servers, the entry control device 20, the camera 40, the display device 50, etc. Examples of input devices include a keyboard, mouse, microphone, touch panel, physical buttons, camera, etc. Examples of output devices include a display, speaker, printer, mailer, etc. The processor 1A can issue commands to each module and perform calculations based on the results of those calculations.

[0023] "Function Configuration" Next, the functional configuration of the store system 10 will be described. An example of a functional block diagram of the store system 10 is shown in Figure 3. As shown in the figure, the store system 10 has an acquisition unit 11, a detection unit 12, a processing unit 13, a display control unit 14, a determination unit 15, a processing unit 16, and a storage unit 17.

[0024] The acquisition unit 11 acquires an image (hereinafter referred to as an "entrance image") generated by a camera 40 installed at the entrance of a store. The acquisition unit 11 acquires the entrance image from the camera 40 by real-time processing.

[0025] The detection unit 12 detects a person's face in the entrance image. "Techniques for detecting a person's face in an image" are widely known, so a description thereof will be omitted here.

[0026] The processing unit 13 processes an entrance image in which a person's face is detected to generate a processed image. The processing unit 13 may or may not perform processing on an entrance image in which a person's face is not detected. However, an entrance image in which a person's face is not detected is likely not to be viewed by anyone. By omitting processing on such an entrance image, the processing load on the processing unit 13 can be reduced.

[0027] The processing can be performed in a variety of ways. For example, as shown in Figure 4, processing may be performed on the face of a person in the image. Specifically, processing may be performed so that the feature amount extracted from the face of the person included in the entrance image and the feature amount extracted from the face of the person included in the processed image do not match. In the example shown, the size of the person's eyes has been changed by processing.

[0028] In addition, processing may be performed on other parts of the image (background, body parts of a person, etc.). For example, processing may be performed to superimpose a frame or decoration on the background, or to superimpose a predetermined outfit (tuxedo, dress, etc.) on the body parts of a person, or other processing may be performed.

[0029] The display control unit 14 causes the processed image generated by the processing unit 13 to be displayed on the display device 50 (display means). The display device 50 displays the processed image so that it can be viewed by a customer (a customer photographed by the camera 40) who is photographing in front of the camera 40 in preparation for entering the store. For example, the display device 50 may be a display installed in a position and orientation that can be viewed by a customer who is photographing in front of the camera 40 in preparation for entering the store. Alternatively, the display device 50 may be a projection device that projects information in a position that can be viewed by a customer who is photographing in front of the camera 40 in preparation for entering the store.

[0030] The determination unit 15 determines whether the entrance image before processing of the processed image displayed on the display device 50 at a predetermined photographing timing satisfies a predetermined condition.

[0031] The predetermined timing for taking a photograph may be the timing when a customer inputs a photographing instruction. In this case, the customer inputs the photographing instruction via any input device such as a touch panel, physical buttons, a microphone, a mouse, or a keyboard. Alternatively, the predetermined timing for taking a photograph may be the timing when a predetermined time has elapsed from a predetermined reference point in time. The predetermined reference point in time may be, for example, the timing when a human presence sensor or a camera detects that a customer has approached the camera 40, or the timing when the display device 50 starts displaying a processed image obtained by processing an entrance image including the customer's face, or any other timing.

[0032] When the determination unit 15 detects the arrival of a predetermined photographing timing, it identifies the processed image displayed on the display device 50 at that time, and then acquires an entrance image before processing of the identified processed image. For example, the entrance image acquired by the acquisition unit 11 and the processed image generated by the processing unit 13 may be linked to each other and temporarily stored in the storage unit 17. Then, the determination unit 15 may acquire an entrance image linked to the identified processed image from the entrance images stored in the storage unit 17. Alternatively, the determination unit 15 may acquire an entrance image before processing of the identified processed image by processing the processed image back to the entrance image.

[0033] After acquiring an entry image before processing the identified processed image, the determination unit 15 determines whether the acquired entry image satisfies a predetermined condition. The predetermined condition is that "the content of the entry image is such that an individual can be identified," and examples of the condition include "predetermined features of a person's face can be extracted," "predetermined features of a person's face (eyes, nose, mouth, etc.) can be extracted," etc.

[0034] When the judgment unit 15 judges that the predetermined conditions are met, the processing unit 16 registers the entrance image judged to meet the predetermined conditions in the store visitor information stored in the memory unit 17, and sets the store entry control device 20 to a state where the store can be entered.

[0035] An example of customer information is shown in Figure 5. In the example shown, customer identification information for distinguishing between customers and information (such as a file name) for identifying an entrance image that has been determined to satisfy a predetermined condition are linked together and registered. The customer information makes it possible to identify the customer.

[0036] In the case of technology that processes images and displays them in a viewable manner with the primary purpose of providing entertainment, the processed image displayed at the time of capture is saved, and the unprocessed image is not saved. In contrast, the store system 10, which generates and displays processed images to reduce resistance to being photographed and whose primary purpose is to obtain information (facial images) to identify store visitors, saves the unprocessed image of the processed image displayed at the time of capture. In this respect, the store system 10 differs from technology that processes images and displays them in a viewable manner with the primary purpose of providing entertainment.

[0037] The store entry control device 20 is a device that controls entry into a store, and is, for example, a gate or an automatic door. The store entry control device 120 can be in a first state (a state in which the gate or door is open) that allows passage (entry into the store), and a second state (a state in which the gate or door is closed) that denies passage (entry into the store). The store entry control device 20 then executes an operation to transition between the first state and the second state based on a control signal (electrical signal) sent by the processing unit 16.

[0038] When the determining unit 15 determines that the predetermined condition is satisfied, the processing unit 16 transmits a control signal for switching to the first state to the store entry control device 20. The store entry control device 20 switches to the first state based on the control signal.

[0039] Next, an example of the processing flow of the store system 10 will be described using the flowchart of FIG.

[0040] First, the acquisition unit 11 acquires an image (entrance image) generated by the camera 40 installed at the store entrance (S10). The acquisition unit 11 acquires the entrance image from the camera 40 by real-time processing. The camera 40 may generate images at all times. Alternatively, the camera 40 may generate images while a human sensor or the like detects the presence of a person at a predetermined position in front of the camera 40.

[0041] Thereafter, the detection unit 12 detects a human face in the entrance image (S11). If a human face is not detected in the entrance image (No in S11), the process returns to S10 and the same process is repeated.

[0042] On the other hand, if a human face is detected in the entrance image (Yes in S11), the processing unit 13 processes the entrance image to generate a processed image (S12), and the display control unit 14 causes the display device 50 to display the generated processed image (S13).

[0043] Before displaying the processed image, the display control unit 14 may display on the display device 50 a live image (an image that does not include a person's face) acquired by the acquisition unit 11 from the camera 40, or may display other information (advertisements, weather, news, etc.), or may not display anything.

[0044] Thereafter, if the predetermined timing for taking a photograph has not yet arrived (No in S14), the process returns to S10 and repeats the same process. As described above, the predetermined timing for taking a photograph may be the timing when a customer inputs a photographing instruction, the timing when a predetermined time has elapsed from a predetermined reference point in time, or any other timing.

[0045] When the predetermined photographing timing arrives (Yes in S14), the judgment unit 15 identifies the processed image currently being displayed on the display device 50, and then acquires an entry image before processing of the identified processed image (S15). The judgment unit 15 then judges whether the acquired entry image satisfies a predetermined condition. As described above, the predetermined condition is that "the content of the entry image is such that an individual can be identified," and examples of the predetermined condition include "predetermined features of a person's face can be extracted," "predetermined features of a person's face (eyes, nose, mouth, etc.) can be extracted," etc.

[0046] If the acquired entrance image does not satisfy the predetermined conditions (No in S16), the process returns to S10 and the same process is repeated. At this time, the store system 10 may display an error message on the display device 50, such as "The facial image could not be captured correctly. Please take another photo."

[0047] On the other hand, if the acquired entrance image satisfies the predetermined condition (Yes in S16), the processing unit 16 newly registers the acquired entrance image in the store visitor information stored in the storage unit 17 (S17). Next, the processing unit 16 controls the store entry control device 20 to set the store entry possible state (gate and door open state) (S18).

[0048] "Action and effect" As described above, the store system 10 of this embodiment displays an edited image of the customer's face, rather than the actual image, so that the customer can view it while the customer is taking a photo of their face before entering the store. This store system 10 allows customers to enjoy the edited image while taking a photo of themselves before entering the store. This reduces customers' resistance to the photo shoot. As a result, a decrease in the number of store users due to requiring a photo of their face to be taken as a condition for entering the store is prevented.

[0049] Furthermore, the store system 10 can process the image so that the feature values ​​extracted from the face of the person included in the entrance image do not match the feature values ​​extracted from the face of the person included in the processed image. By processing the face of the person in this way, the processed image becomes more enjoyable to view. As a result, it is possible to further reduce customers' resistance to having their picture taken before entering the store.

[0050] <Second embodiment> The store system 10 of this embodiment differs from the first embodiment in that it has a function of saving the processed image that was displayed at the time of shooting and providing it to the customer.

[0051] The processing unit 16 stores the processed image displayed by the display device 50 at a predetermined photographing timing in the storage unit 17 and provides it to customers. That is, the processing unit 16 of this embodiment stores both the "processed image displayed by the display device 50 at a predetermined photographing timing" and the "entrance image before processing of the processed image" in the storage unit 17.

[0052] Here, an example of a process for providing a customer with a saved processed image will be described. Note that the example given here is merely an example, and the implementation method is not limited to this.

[0053] "Example 1" The processing unit 16 provides the customer with storage location information (such as a URL) of the processed image. The processing unit 16 may create a code (such as a two-dimensional code) indicating the storage location information and display it on the display device 50. In this case, the customer can obtain the storage location information by operating their own user terminal to read the code. Alternatively, the processing unit 16 may transmit the storage location information to a user terminal (such as a smartphone, smartwatch, tablet terminal, or mobile phone) via short-range wireless communication in response to the customer holding the user terminal over a predetermined position. After obtaining the storage location information, the customer operates their own user terminal to access the storage location indicated by the storage location information and obtain the processed image.

[0054] "Example 2" The processing unit 16 accepts input of customer identification information and provides the processed image to the customer identified by the customer identification information. For example, the customer identification information may be linked to an email address and registered in advance in the center server. The processing unit 16 may then transmit the processed image or the storage location information to the email address linked to the input customer identification information.

[0055] Additionally, the processing unit 16 may provide the processed image and the above-mentioned storage location information on the app or on a personal page of the homepage (a page after logging in using customer identification information).

[0056] The processing unit 16 may receive input from the customer as to whether or not they wish to obtain an edited image at any timing while they are taking photographs to enter the store. If an input indicating a desire is received, the processing unit 16 may store the edited image and provide it to the customer, but if an input indicating a desire is received, these processes may not be performed.

[0057] The processing unit 16 deletes the entrance image and the processed image stored in the storage unit 17 from the storage unit 17 at a predetermined timing. This realizes privacy protection, etc. Note that the timing for deleting each differs depending on the purpose of storing the processed image and the entrance image. Specifically, the timing for deleting the processed image is earlier than the timing for deleting the entrance image.

[0058] Next, an example of the processing flow of the store system 10 will be described using the flowchart of FIG.

[0059] First, the acquisition unit 11 acquires an image (entrance image) generated by the camera 40 installed at the store entrance (S20). The acquisition unit 11 acquires the entrance image from the camera 40 by real-time processing. The camera 40 may generate an image at all times. Alternatively, the camera 40 may generate an image while a human sensor or the like detects that a person is present at a predetermined position in front of the camera 40.

[0060] Thereafter, the detection unit 12 detects a human face in the entrance image (S21). If a human face is not detected in the entrance image (No in S21), the process returns to S20 and the same process is repeated.

[0061] On the other hand, if a human face is detected in the entrance image (Yes in S21), the processing unit 13 processes the entrance image to generate a processed image (S22), and the display control unit 14 causes the display device 50 to display the generated processed image (S23).

[0062] Before displaying the processed image, the display control unit 14 may display on the display device 50 a live image (an image that does not include a person's face) acquired by the acquisition unit 11 from the camera 40, or may display other information (advertisements, weather, news, etc.), or may not display anything.

[0063] Thereafter, if the predetermined photographing timing has not yet arrived (No in S24), the process returns to S20 and repeats the same process. As described above, the predetermined photographing timing may be the timing when a customer inputs a photographing instruction, the timing when a predetermined time has elapsed from a predetermined reference point in time, or any other timing.

[0064] When the predetermined photographing timing arrives (Yes in S24), the judgment unit 15 identifies the processed image currently being displayed on the display device 50, and then acquires an entry image before processing of the identified processed image (S25). The judgment unit 15 then judges whether the acquired entry image satisfies a predetermined condition. As described above, the predetermined condition is that "the content of the entry image is such that an individual can be identified," and examples of the predetermined condition include "predetermined features of a person's face can be extracted," "predetermined features of a person's face (eyes, nose, mouth, etc.) can be extracted," etc.

[0065] If the acquired entrance image does not satisfy the predetermined conditions (No in S26), the process returns to S20 and the same process is repeated. At this time, the store system 10 may display an error message on the display device 50, such as "The facial image could not be captured correctly. Please take the image again."

[0066] On the other hand, if the acquired entrance image satisfies the predetermined condition (Yes in S26), the processing unit 16 newly registers the acquired entrance image in the store customer information stored in the storage unit 17 (S27). In addition, the processing unit 16 executes a process of saving the processed image displayed on the display device 50 at the predetermined shooting timing and providing it to the customer (S28). An example of the process of providing the processed image to the customer is as described above.

[0067] The processing unit 16 may receive an input from the customer as to whether or not they wish to obtain an edited image at any timing while they are taking photographs to enter the store. If an input indicating a desire is received, the processing unit 16 may execute the process of S28, and if an input indicating a disdesired desire is received, the processing unit 16 may not execute the process of S28.

[0068] Thereafter, the processing unit 16 controls the store entry control device 20 to set the store entry possible (gate and door open) (S29).

[0069] Other configurations of the store system 10 are the same as those in the first embodiment.

[0070] The store system 10 of this embodiment achieves the same effects as the first embodiment. Furthermore, the store system 10 of this embodiment can save processed images and provide them to customers. This makes customers look forward to taking photos before entering the store. As a result, it is possible to further reduce resistance to taking photos before entering the store.

[0071] <Third embodiment> The store system 10 of this embodiment differs from the first and second embodiments in that it estimates personal attributes based on a face image included in an entrance image and processes the entrance image using a method according to the estimation result.

[0072] The processing unit 13 estimates person attributes based on the face of the person detected in the entrance image. For example, the processing unit 13 estimates any attribute that can be estimated from a face image, such as gender, age, nationality, etc.

[0073] Then, the processing unit 13 processes the entrance image using a method according to the estimation result (person attribute). For example, a processing method is determined in advance for each person attribute. Examples of combinations of person attributes and processing methods include, but are not limited to, "cutting the hair into a crew cut" when the person attributes are "female" and "teens," "braiding the hair" when the person attributes are "male" and "teens," and "making the eyes larger" when the person attributes are "female" and "in their 20s or 30s."

[0074] Next, an example of the processing flow of the store system 10 will be described using the flowchart of FIG.

[0075] First, the acquisition unit 11 acquires an image (entrance image) generated by the camera 40 installed at the store entrance (S40). The acquisition unit 11 acquires the entrance image from the camera 40 by real-time processing. The camera 40 may generate an image at all times. Alternatively, the camera 40 may generate an image while a human sensor or the like detects that a person is present at a predetermined position in front of the camera 40.

[0076] Thereafter, the detection unit 12 detects a human face in the entrance image (S41). If a human face is not detected in the entrance image (No in S41), the process returns to S40 and the same process is repeated.

[0077] On the other hand, if a person's face is detected in the entrance image (Yes in S41), the processing unit 13 estimates the person's attributes based on the person's face included in the entrance image (S42). Next, the processing unit 13 processes the entrance image using a method according to the estimation result of S42 to generate a processed image (S43). Then, the display control unit 14 displays the generated processed image on the display device 50 (S44).

[0078] Before displaying the processed image, the display control unit 14 may display on the display device 50 a live image (an image that does not include a person's face) acquired by the acquisition unit 11 from the camera 40, or may display other information (advertisements, weather, news, etc.), or may not display anything.

[0079] Thereafter, if the predetermined photographing timing has not yet arrived (No in S45), the process returns to S40 and repeats the same process. As described above, the predetermined photographing timing may be the timing when a customer inputs a photographing instruction, the timing when a predetermined time has elapsed from a predetermined reference point in time, or any other timing.

[0080] When the predetermined photographing timing arrives (Yes in S45), the judgment unit 15 identifies the processed image currently being displayed on the display device 50, and then acquires an entry image before processing of the identified processed image (S46). The judgment unit 15 then judges whether the acquired entry image satisfies a predetermined condition. As described above, the predetermined condition is that "the content of the entry image is such that an individual can be identified," and examples of the predetermined condition include "predetermined features of a person's face can be extracted," "predetermined features of a person's face (eyes, nose, mouth, etc.) can be extracted," etc.

[0081] If the acquired entrance image does not satisfy the predetermined conditions (No in S47), the process returns to S40 and the same process is repeated. At this time, the store system 10 may display an error message on the display device 50, such as "The facial image could not be captured correctly. Please take another photo."

[0082] On the other hand, if the acquired entrance image satisfies the predetermined condition (Yes in S47), the processing unit 16 newly registers the acquired entrance image in the store visitor information stored in the storage unit 17 (S48). Next, the processing unit 16 controls the store entry control device 20 to set the store entry possible state (gate and door open state) (S49).

[0083] After S48, the "processing for saving the processed image displayed on the display device 50 at the time of shooting and providing it to the customer (S28 in Figure 7)" described in the second embodiment may be executed.

[0084] A modification of this embodiment will now be described.

[0085] The display device 50 may display the processing method in a selectable manner, and the processing unit 13 may process the entrance image using the selected method.

[0086] Furthermore, the processing method performed may be registered in association with each customer in the store visitor information stored in the memory unit 17. The processing unit 13 may then process the entrance image using a method different from the previous method when the customer next visits the store. Based on the feature amount of the customer's facial image, information about each customer's past visits can be extracted from the information registered in the store visitor information.

[0087] Other configurations of the store system 10 are the same as those in the first and second embodiments.

[0088] The store system 10 of this embodiment achieves the same effects as the first and second embodiments. Furthermore, the store system 10 of this embodiment can process images in a manner appropriate to the personal attributes of each customer, rather than processing the images in the same manner for all customers. Since images can be processed in a manner suited to each customer, customer satisfaction with the processed images increases. This makes customers look forward to taking photos before entering the store. As a result, resistance to taking photos before entering the store can be further reduced.

[0089] <Modification> Here, a modified example applicable to all the embodiments will be described. As described in the above embodiment, if, during the photographing process to enter the store, an edited image of the customer's face is displayed for viewing instead of the actual photographed image, it is considered that multiple customers who come to the store as a group (family, friends, etc.) will want to enjoy viewing each other's edited images. Nevertheless, it is inconvenient if the photographing and entry to the store are performed one by one.

[0090] Therefore, the store system 10 may have a means for receiving an input from a customer specifying the number of customers. Then, the processing unit 16 may set the store entry control device 20 to a state in which customers can enter the store in response to registering entrance images for the specified number of customers in the store visitor information.

[0091] If the store entry control device 20 is set to an entry-enabled state each time an entrance image of a group of customers is registered in the store entry information while the customer is taking photographs, each customer will think that they must enter the store when the store entry control device 20 is set to an entry-enabled state upon completion of their own photographing work. Furthermore, setting the store entry control device 20 to an entry-enabled state at an unnecessary time can cause inconveniences such as unrelated people entering the store at the same time, or an increased processing load due to unnecessary operation of the store entry control device 20. This inconvenience can be alleviated by a configuration such as this modified example, in which the store entry control device 20 is set to an entry-enabled state upon registration of entrance images for a specified number of customers in the store entry information.

[0092] In this specification, "acquisition" may include "a device going to retrieve data stored in another device or storage medium (active acquisition)" based on user input or program instructions, such as receiving data by making a request or inquiry to another device, or accessing and reading out another device or storage medium. Furthermore, "acquisition" may also include "inputting data output from another device to a device (passive acquisition)" based on user input or program instructions, such as receiving data that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may also include selecting and acquiring data or information from received data or information, and "generating new data by editing data (converting it to text, rearranging data, extracting some data, changing the file format, etc.), and acquiring the new data."

[0093] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. 1. An acquisition means for acquiring an entrance image generated by a camera installed at the store entrance; a detection means for detecting a person's face in the entrance image; a processing means for processing the entrance image from which a person's face has been detected to generate a processed image; a display control means for displaying the processed image on a display means; a determining means for determining whether the entrance image before processing of the processed image displayed by the display means at a predetermined photographing timing satisfies a predetermined condition; a processing means for registering the entrance image determined to satisfy the predetermined condition in the store visitor information stored in a storage means when the predetermined condition is satisfied, and for enabling a store entry control device installed at the store entrance to enter the store; A store system with: 2. The store system according to 1, wherein the display means displays the processed image so that it can be viewed by a person photographed by a camera installed at the store entrance. 3. The store system according to 1 or 2, wherein the predetermined condition is that predetermined features of a person's face can be extracted. 4. A store system according to any one of 1 to 3, wherein the feature extracted from the face of the person included in the entrance image does not match the feature extracted from the face of the person included in the processed image. 5. A store system according to any one of 1 to 4, wherein the processing means stores the processed image displayed by the display means at the specified photographing timing in the storage means and performs a process of providing the image to customers. 6. The processing means deletes the entrance image and the processed image stored in the storage means from the storage means at a predetermined timing, 6. The store system according to 5, wherein the timing for deleting the processed image is earlier than the timing for deleting the entrance image. 7. A store system described in any one of 1 to 6, wherein the processing means estimates person attributes based on the face of a person detected in the entrance image, and processes the entrance image using a method according to the estimation result. 8. The computer Acquires an entrance image generated by a camera installed at the store entrance, Detecting a person's face in the entrance image; generating a processed image by processing the entrance image in which a person's face has been detected; displaying the processed image on a display means; determining whether the entrance image before processing of the processed image displayed by the display means satisfies a predetermined condition at a predetermined photographing timing; If the specified conditions are met, the entrance image judged to meet the specified conditions is registered in the store visitor information stored in a storage means, and the store entry control device installed at the store entrance is set to a state allowing entry. 9. Computer an acquisition means for acquiring an entrance image generated by a camera installed at the store entrance; a detection means for detecting a human face in the entrance image; a processing means for processing the entrance image in which a person's face has been detected to generate a processed image; a display control means for displaying the processed image on a display means; a determination means for determining whether the entrance image before processing of the processed image displayed by the display means at a predetermined photographing timing satisfies a predetermined condition; a processing means for registering the entrance image determined to satisfy the predetermined condition in the store visitor information stored in a storage means when the predetermined condition is satisfied, and for enabling a store entry control device installed at the store entrance to enter the store; A program that functions as a

[0094] Although the present invention has been described above with reference to the embodiments (and examples), the present invention is not limited to the above-described embodiments (and examples). Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

[0095] This application claims priority based on Japanese Patent Application No. 2020-070797, filed on April 10, 2020, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0096] 1A processor 2A Memory 3A input / output I / F 4A peripheral circuit 5A Bus 10 Store System 11 Acquisition Department 12 Detector 13 Processing Department 14 Display control unit 15 Judgment Department 16 Processing section 17 Memory section 20. Store entry control device 30 Controllers 40 Camera 50 Display device

Claims

1. an acquisition means for acquiring an entrance image generated by a camera installed at the entrance of the store; a detection means for detecting a person's face in the entrance image; a processing means for processing the entrance image from which a person's face has been detected to generate a processed image; a display control means for displaying the processed image on a display means; a determining means for determining whether the entrance image before processing of the processed image displayed by the display means satisfies a predetermined condition; A store system with:

2. 2. The store system according to claim 1, further comprising processing means for causing an entry control device installed at the store entrance to be in a state allowing entry to the store when the predetermined condition is met.

3. The store system according to claim 1 or 2, wherein the processing means generates the processed image by processing at least one of the facial portion of a person in the entrance image, the body portion of a person in the entrance image, and the background portion in the entrance image.

4. 4. The store system according to claim 1, wherein the display unit displays the processed image so that it can be viewed by a person photographed by a camera installed at the store entrance.

5. The store system according to claim 1 , wherein the predetermined condition is that predetermined features of a person's face can be extracted.

6. The store system according to claim 1 , wherein the feature extracted from the face of the person included in the entrance image does not match the feature extracted from the face of the person included in the processed image.

7. 3. The store system according to claim 2, wherein the processing means executes a process of storing the processed image displayed by the display means in a storage means and providing the processed image to customers.

8. The processing means deletes the entrance image and the processed image stored in the storage means from the storage means at a predetermined timing, The store system according to claim 7 , wherein the timing for deleting the processed image is earlier than the timing for deleting the entrance image.

9. The store system according to claim 1 , wherein the processing means estimates person attributes based on the face of a person detected in the entrance image, and processes the entrance image using a method according to the estimation result.

10. The computer Acquires an entrance image generated by a camera installed at the store entrance, Detecting a person's face in the entrance image; generating a processed image by processing the entrance image in which a person's face has been detected; displaying the processed image on a display means; A processing method for determining whether the entrance image before processing of the processed image displayed by the display means satisfies a predetermined condition.

11. Computer, an acquisition means for acquiring an entrance image generated by a camera installed at the store entrance; a detection means for detecting a human face in the entrance image; a processing means for processing the entrance image in which a person's face has been detected to generate a processed image; a display control means for displaying the processed image on a display means; a determination means for determining whether the entrance image before processing of the processed image displayed by the display means satisfies a predetermined condition; A program that functions as a

Images