Store entry management device, store entry management method, and program

Abstract

A store-entry management device (100) is provided with: an output control unit (102) which, once a human body sensor installed at an entrance of a store has detected a person, causes an output unit (80) provided at said entrance to output voice guidance about how to enter the store; an acquisition unit (104) which acquires, from a terminal provided at the entrance, authentication information for authenticating said person; and an opening / closing control unit (106) which releases the lock of an entrance door, once the acquired authentication information has met criteria. The output control unit (102) uses detection results, which are from the human body sensor and are prior to the acquisition of the authentication information, to determine whether the voice guidance is needed, and the output control unit thereby controls the output of the voice guidance.

Description

[Technical field]

[0001] The present invention relates to a store entry management device, a store entry management method, and a program. [Background technology]

[0002] Terminals that are operated by customers themselves, such as self-checkouts in supermarkets and ATMs (Automatic Teller Machines) in financial institutions, are becoming widespread. Patent Document 1 describes that whether a customer is having difficulty operating a customer device can be analyzed based on the customer's operation history, the customer's degree of confusion regarding the operation of the customer device can be calculated, and the calculated degree of confusion can be notified to a user terminal of a salesperson together with a command to follow up on a customer who is determined to require urgent follow-up. The customer's operation history includes the time spent on an operation menu, the number of times the same type of operation menu is displayed, the number of operation errors, the time taken to perform the operation, etc.

[0003] Patent Document 2 describes detecting the degree of hesitation of a user in an operation terminal device and providing an effective operation support guide. For example, rather than measuring a state where a customer is hesitant in an operation based on the time it takes to operate, the system detects the customer's line of sight on an operation screen and detects the time the line of sight remains on the screen, thereby judging the state where the line of sight is wandering based on a standard, thereby detecting the customer's hesitation in an operation. The system then describes outputting an operation support guide corresponding to the point where the line of sight remains on the screen. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-40956 A [Patent Document 2] JP 2014-109916 A Summary of the Invention [Problem to be solved by the invention]

[0005] In recent years, as a measure to deal with labor shortages, convenience stores and other businesses have begun to try out unmanned stores at night. In unmanned stores, the entrance is generally locked, and customers can enter the store by performing a certain authentication procedure when they arrive, which unlocks the automatic doors.

[0006] However, many customers do not know how to authenticate themselves to enter a store, so they give up on entering and leave. It is desirable to reduce the number of customers who give up on entering and leave like this.

[0007] The present invention has been made in consideration of the above circumstances, and an object of the present invention is to encourage customers who come to a store to enter the store. [Means for solving the problem]

[0008] In order to solve the above-mentioned problems, each aspect of the present invention employs the following configuration.

[0009] The first aspect relates to a store entry management device. A store entry management device according to a first aspect of the present invention comprises: an output control means for causing an output means provided at the store entrance to output audio guidance on how to enter the store when a human presence sensor installed at the store entrance detects a human; an acquisition means for acquiring authentication information for authenticating a person from a terminal provided at the entrance; and an opening / closing control means for unlocking the entrance door when the acquired authentication information satisfies a standard, The output control means determines whether or not the voice guidance is required using a detection result of the human presence sensor before acquiring the authentication information, and controls output of the voice guidance.

[0010] The second aspect relates to a store entry management method of a store entry management device executed by at least one computer. A store entry management method according to a second aspect of the present invention comprises: The entrance management device When a human presence sensor installed at the entrance of the store detects a person, an output device installed at the entrance outputs audio guidance on how to enter the store, Acquiring authentication information for authenticating a person from a terminal provided at the entrance; unlocking the entrance door when the acquired authentication information satisfies a criterion; The method includes determining whether or not the voice guidance is required using a detection result of the human presence sensor before the authentication information is acquired, and controlling output of the voice guidance.

[0011] Another aspect of the present invention may be a program for causing at least one computer to execute the method of the second aspect, or a computer-readable recording medium having such a program recorded thereon. This recording medium includes a non-transitory tangible medium. The computer program includes computer program code which, when executed by a computer, causes the computer to carry out the store entry management method on the store entry management device.

[0012] Any combination of the above components, and any transformation of the present invention into a method, device, system, recording medium, computer program, etc., are also effective as aspects of the present invention.

[0013] Furthermore, the various components of the present invention do not necessarily have to be independent entities, but may be formed as a single member by multiple components, one component may be formed from multiple components, one component may be a part of another component, or part of one component may overlap with part of another component, etc.

[0014] In addition, although the method and computer program of the present invention describe a number of steps in a sequential order, the order does not limit the order in which the steps are executed. Therefore, when implementing the method and computer program of the present invention, the order of the steps can be changed as long as it does not affect the content.

[0015] Furthermore, the steps of the method and computer program of the present invention are not limited to being executed at different timings, and therefore a step may occur while another step is being executed, or the execution timing of a step may overlap partially or entirely with the execution timing of another step, etc. Effect of the Invention

[0016] According to each of the above aspects, guidance on how to enter an unmanned store is efficiently output, guiding customers to enter the store and preventing a decrease in utilization rate. [Brief description of the drawings]

[0017] [Figure 1] 1 is a diagram showing an example of the configuration of a store entry management system according to an embodiment of the present invention; [Diagram 2] 2 is a block diagram illustrating a hardware configuration of a computer of an operation terminal that realizes the store entry management device of the embodiment. FIG. [Diagram 3] This is a front view of the store entrance as seen from outside the store. [Figure 4] FIG. 2 is an external view of a housing in which an operation terminal is provided. [Diagram 5] 1 is a functional block diagram logically showing a configuration of a store entry management device according to an embodiment of the present invention; [Figure 6] 1 is a flowchart showing an example of the operation of the store entry management device according to the embodiment. [Figure 7] 1 is a functional block diagram logically illustrating a configuration example of a store entry management device according to an embodiment; [Figure 8] 1 is a flowchart showing an example of the operation of the store entry management device according to the embodiment. [Figure 9] 4 is a flowchart showing an example of the operation of the store entry management device according to the embodiment. [Figure 10] 1 is a flowchart showing an example of the operation of the store entry management device according to the embodiment. [Figure 11] 1 is a flowchart showing an example of the operation of the store entry management device according to the embodiment. [Figure 12] 1 is a functional block diagram logically illustrating a configuration example of a store entry management device according to an embodiment; [Figure 13] 1 is a flowchart showing an example of the operation of the store entry management device according to the embodiment. [Figure 14] 1 is a functional block diagram logically illustrating a configuration example of a store entry management device according to an embodiment; [Figure 15] 1 is a flowchart showing an example of the operation of the store entry management device according to the embodiment. [Figure 16] FIG. 13 is a diagram showing an arrangement of a human presence sensor in a modified embodiment. [Figure 17] 13 is a flowchart showing an example of the operation of the store entry management device according to a modified embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are given the same reference numerals, and the description will be omitted as appropriate. In each drawing, the configuration of the parts that are not related to the essence of the present invention is omitted and is not shown.

[0019] In the embodiment, "acquisition" includes at least one of the following: a device goes to retrieve data or information stored in another device or storage medium (active acquisition), and inputs data or information output from another device to the device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a reply, and accessing and reading information from another device or storage medium. Examples of passive acquisition include receiving information that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.

[0020] (First embodiment) <System Overview> FIG. 1 is a diagram showing an example of the configuration of a store entry management system 1 according to an embodiment of the present invention. The store entry management system 1 includes an operation terminal 40 and a server 10. The operation terminal 40 is included in a housing 50 provided to the side of an automatic door 20 of a store, and accepts operations from customers U who visit the store. The operation terminal 40 includes a computer 1000 that realizes a store entry management device 100, which will be described later. The server 10 and the operation terminal 40 are connected via a communication network 3. The server 10 manages the operation terminal 40. The store entry management system 1 further includes a storage device 12.

[0021] The storage device 12 stores and accumulates various information used by the server 10 (for example, authentication information and store visit records described below). The storage device 12 may be provided inside the server 10 or may be provided externally. In other words, the storage device 12 may be hardware integrated with the server 10 or hardware separate from the server 10. The storage device 12 may be connected to the server 10 via the communication network 3.

[0022] <Hardware configuration example> Fig. 2 is a block diagram illustrating a hardware configuration of a computer 1000 of an operation terminal 40 that realizes a store entry management device 100 described later. The server 10 in Fig. 1 is also realized by the computer 1000. Moreover, the functions of the store entry management device 100 may be shared between the operation terminal 40 and the server 10.

[0023] The computer 1000 has a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0024] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to a bus connection.

[0025] The processor 1020 is implemented by a central processing unit (CPU) or a graphics processing unit (GPU).

[0026] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0027] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like. The storage device 1040 stores program modules that realize each function of the store entry management device 100 (for example, an output control unit 102, an acquisition unit 104, an opening / closing control unit 106, a determination unit 108, a notification unit 110, and the like, which will be described later). The processor 1020 loads each of these program modules onto the memory 1030 and executes them, thereby realizing each function corresponding to the program module. The storage device 1040 may also store each data of the storage device 12 of the server 10.

[0028] The program module may be recorded in a recording medium. The recording medium for recording the program module may include a non-transitory tangible medium usable by the computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.

[0029] The input / output interface 1050 is an interface for connecting the computer 1000 to various input / output devices. The input / output interface 1050 also functions as a communication interface for performing short-range wireless communication such as Bluetooth (registered trademark) and NFC (Near Field Communication).

[0030] The network interface 1060 is an interface for connecting the computer 1000 to a communication network. This communication network is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The method for connecting the network interface 1060 to the communication network may be a wireless connection or a wired connection.

[0031] The computer 1000 then connects to necessary devices (for example, a connection between the operation terminal 40 and the server 10, or to the display 54, code reader 56, operation buttons such as the shooting button 60, camera 62, speaker 66, microphone 68, and the keyboard, mouse, speaker, microphone, printer, etc. of the server 10 (not shown)) via the input / output interface 1050 or the network interface 1060.

[0032] FIG. 3 is a front view of the store entrance as seen from outside the store. As described above, the automatic door 20 and the housing 50 including the operation terminal 40 are provided at the side of the automatic door 20 at the entrance of the store. The store entry management system 1 further includes a camera 5 and a sensor 30.

[0033] Camera 5 is installed near automatic door 20 and captures images of people approaching automatic door 20. Camera 5 includes a lens and an imaging element such as a CCD (Charge Coupled Device) image sensor. The images captured by camera 5 are at least one of a video, a still image, and frame images captured at a predetermined interval. Camera 5 may be a security camera installed at the entrance of a store for crime prevention.

[0034] The sensor 30 is provided on the top of the automatic door 20 and detects a person standing in front of the automatic door 20. The sensor 30 is, for example, an infrared sensor.

[0035] There are no particular limitations on the means of communication between the camera 5 and / or the sensor 30 and the store entry management device 100 (the operation terminal 40 and / or the store entry management device 100), and either a wired or wireless communication method may be used.

[0036] Fig. 4 is an external view of a housing 50 in which the operation terminal 40 is provided. The computer 1000 in Fig. 2 which realizes the operation terminal 40 is contained inside the housing 50. On the front surface 52 of the housing 50, a display 54 of the operation terminal 40, a code reader 56, a shooting button 60, a camera 62, a speaker 66, and a microphone 68 are provided.

[0037] The display 54 is a liquid crystal display or an organic EL (Electro Luminescence) display, and may be a touch panel that accepts user operations. The code reader 56 reads a QR code (registered trademark), a barcode, or the like that is held over a reading surface. The camera 62 captures an image of the face of the customer U standing in front of the operation terminal 40. The image capture button 60 is an operation button for causing the camera 62 to capture an image of the face of the customer U. However, the image capture button 60 may be a GUI (Graphical User Interface) such as an operation button displayed on the touch panel (display 54). The speaker 66 outputs audio guidance to the customer U and outputs notification sounds. The microphone 68 collects the speech of the customer U and environmental sounds around the store.

[0038] In this embodiment, the operation terminal 40 is operated by a customer U when the store is unmanned and the customer U enters the store. The customer U may be a member who has registered in advance to use the member service provided by the store, or may not be a member. In the case of a member, for example, the customer U may have member A member identification information such as a number may be assigned to the member, and a member card bearing, for example, a barcode or QR code (registered trademark) indicating the member number may be distributed.

[0039] Alternatively, an application for providing the membership service may be started on the customer U's smartphone or the like, and a barcode or QR code indicating the membership number may be displayed on the display of the mobile device by logging in using user information such as the user ID and password registered at the time of user registration. A predetermined web page for providing the membership service may be accessed using a browser instead of an application, and a barcode or QR code indicating the membership number may be displayed on the display of the mobile device by logging in to the member page using user information.

[0040] Hereinafter, the QR code used by the customer U to enter the store is also referred to as the store entry QR code. The store entry QR code includes information that can identify the member (e.g., a member number). Furthermore, the store entry QR code may have an expiration date and may also include information about the expiration date.

[0041] Furthermore, the code reader 56 may be an IC card reader. Information indicating the membership number may be recorded in the IC memory of the mobile terminal of the customer U, and the mobile terminal may be held up to the IC card reader to cause the IC card reader to read the information indicating the membership number.

[0042] Furthermore, customer U can read the store's QR code for entering the store with his / her smartphone and operate according to the operation screen of a specific web page indicated by the QR code, thereby causing customer U's membership number to be transmitted to operation terminal 40.

[0043] In detail, the operation terminal 40 further has a short-range communication means (not shown) such as Bluetooth (registered trademark). Also, a QR code for entering the store is posted on the wall surface of the store entrance, on the door, on the front surface of the operation terminal 40, or on the display 54 of the operation terminal 40.

[0044] Then, the customer U reads the QR code for entering the store with his / her smartphone. Then, the customer U accesses and opens a specific web page indicated by the QR code, and operates according to the operation screen of the web page. When the operation is accepted, the membership number is transmitted to the operation terminal 40 using a short-range communication means (e.g., Bluetooth (registered trademark)) of the smartphone. The operation terminal 40 can receive the membership number from the customer U's smartphone using the short-range communication means. This membership number may be a temporary membership number for visitors, or may be the membership number of the customer U identified by logging in to the member page on the specific web page indicated by the QR code. The membership number may be stored in the memory of the customer U's smartphone, or the membership number may be acquired and transmitted to the operation terminal 40 by accessing and logging in to a web page for members using the QR code.

[0045] Furthermore, if the customer U is not registered as a member of the store, the customer U can enter the store by capturing an image of the customer U's face using the camera 62 provided in the operation terminal 40. In this embodiment, the customer U is made to press the capture button 60 in order to obtain the customer U's consent to having his or her face photographed.

[0046] <Example of functional configuration> 5 is a functional block diagram logically showing the configuration of the store entry management device 100 according to the embodiment of the present invention. The store entry management device 100 includes an output control unit 102, an acquisition unit 104, and an opening / closing control unit 106.

[0047] When a human presence sensor 70 installed at a store entrance detects a person, the output control unit 102 causes an output unit 80 (such as speaker 66 in FIG. 4) installed at the entrance to output audio guidance on how to enter the store. An acquisition unit 104 acquires authentication information for authenticating the person from an operation terminal 40 installed at the entrance. An opening / closing control unit 106 unlocks the automatic door 20 at the entrance when the acquired authentication information meets a standard. The output control unit 102 uses the detection result of the human presence sensor 70 before acquiring the authentication information to determine whether audio guidance is necessary and controls the output of the audio guidance.

[0048] The authentication information is, for example, a face image or features of a face image used for face authentication, or information that can identify a member, such as a membership number. However, other biometric authentication information other than face authentication may also be used. The other biometric authentication information includes, for example, at least one feature of the iris, vein, auricle, fingerprint, gait, and physique (height, shoulder width, body length, bone structure, etc.).

[0049] The human presence sensor 70 is at least one of an infrared sensor (sensor 30) installed near the automatic door 20 in Fig. 3 and an image sensor that analyzes images from the camera 5, but is not limited to this. The output unit 80 is at least one of the speaker 66 and the display 54 of the operation terminal 40 in Fig. 4. Alternatively, it may be another lighting unit such as an LED (Light Emitting Diode) provided in the operation terminal 40. When the output unit 80 is an LED, the output control unit 102 controls the turning on, blinking, turning off, etc. of the LED.

[0050] As described above, customer U may or may not be a member of the store. Or, even if the customer U is a member, he or she may not carry a membership card or other proof of membership code.

[0051] The operation for customer U to enter the store differs depending on whether he or she is a member or not (or if he or she has forgotten his or her membership card). If the customer is a member, a store entry QR code or the like is displayed on the member card or customer U's mobile terminal (not shown), and the customer can enter the store by holding it over code reader 56 to read the membership information. On the other hand, if the customer is not a member, an image of customer U's face is temporarily stored.

[0052] Unlocking the automatic door 20 refers to unlocking the automatic door 20, which is locked during unmanned business hours, and automatically opening it. Furthermore, when the sensor 30 detects the entry of a customer U into the store, it is preferable that the automatic door 20 is automatically locked again to prevent anyone other than the customer U from entering the store from outside. However, from inside the store, the automatic door 20 is unlocked by a predetermined operation (for example, human detection or authentication by the human sensor 70 (face authentication or presentation of a membership card or store entry QR code)), allowing the customer U to go outside.

[0053] In addition, unmanned operations include a business mode in which a store clerk is not present in the store, or a store clerk is present in the store but cannot serve customers, such as a so-called one-person operation state.

[0054] <Example of operation> FIG. 6 is a flowchart showing an example of the operation of the store entry management device 100 of this embodiment. First, when the motion sensor 70 (detection by analysis of captured image by the sensor 30 or the camera 5) installed at the entrance of the store detects a person (YES in step S101), the output control unit 102 uses the detection result of the motion sensor 70 before acquiring the authentication information to determine whether or not voice guidance is required (step S103). The output control unit 102 waits until the motion sensor 70 detects a person (NO in step S101).

[0055] If it is necessary to output voice guidance (required in step S103), the output control unit 102 causes the speaker 66 provided at the entrance to output voice guidance on how to enter the store (step S105). For example, when the sensor 30 above the automatic door 20 detects the presence of the customer U in front of the automatic door 20, the sensor 30 causes the speaker 66 of the operation terminal 40 to output voice guidance such as "Please proceed to the operation panel on the left side of the automatic door" to inform the customer U of the presence of the operation terminal 40.

[0056] On the other hand, if the output of the voice guidance is not required (No in step S103), step S105 is bypassed and the output control unit 102 proceeds to step S107 without outputting the voice guidance. This is the case, for example, when the analysis result of the image from the camera 5 indicates that the customer U is in front of the operation terminal 40.

[0057] Then, the acquisition unit 104 acquires authentication information for authenticating a person from the operation terminal 40 provided at the entrance (step S107). Specifically, for example, the customer U holds the store entry QR code displayed on the customer U's mobile terminal over the code reader 56 of the operation terminal 40, whereby the customer U's membership information is read and acquired by the acquisition unit 104 as authentication information. Alternatively, if the customer U is not a member, the customer U presses the photographing button 60 of the operation terminal 40 to have the camera 62 photograph the customer U's face. The acquisition unit 104 acquires the facial image of the customer U photographed by the camera 62 as authentication information.

[0058] If the acquired authentication information satisfies the criteria (YES in step S109), the opening / closing control unit 106 unlocks the automatic entrance door 20 (step S111). On the other hand, if the authentication information does not satisfy the criteria (NO in step S109), the opening / closing control unit 106 bypasses step S111, does not unlock the automatic door 20, and ends this process.

[0059] For example, the authentication information (membership information) read from the store entry QR code is compared with the store's membership information registered in the storage device 12 of the server 10, and if it is determined that the person is a member of the store, the criteria are met. If there is no match in the store's membership information, the criteria are not met.

[0060] According to this embodiment, in an unmanned store, the need for voice guidance is determined and voice guidance is output when necessary, so voice guidance is not broadcast unnecessarily outside the store. In addition, the presence of the operation terminal 40, which is located next to the automatic door 20 of the store and is necessary for entering the store, can be notified to the customer U by voice guidance as necessary. This makes it possible to efficiently output guidance on how to enter an unmanned store and guide the customer U into the store. In turn, this makes it possible to prevent a decrease in the utilization rate of the store.

[0061] Second embodiment FIG. 7 is a functional block diagram logically illustrating a configuration example of the store entry management device 100 of this embodiment. The store entry management device 100 of this embodiment is the same as the above embodiment except that the authentication information is an image of a person's face. The store entry management device 100 of this embodiment further includes an image processing unit 120 in addition to the configuration of the store entry management device 100 of the above embodiment in FIG. 5. The image processing unit 120 may be included inside the operation terminal 40 or may be outside the operation terminal 40. In other words, the image processing unit 120 may be hardware separate from the operation terminal 40. For example, the image processing unit 120 may be connected to the operation terminal 40 via the communication network 3. Alternatively, the image processing unit 120 may be included in the server 10.

[0062] <Example of functional configuration> In this embodiment, the authentication information is an image of a person's face, and the opening / closing control unit 106 unlocks the entrance door when the analysis result of the face included in the image satisfies a criterion.

[0063] As shown in Fig. 4, a photographing button 60, a camera 62, and a photographing subject explanation section 64 are provided on the front surface 52 of the housing 50 of the operation terminal 40. The photographing subject explanation section 64 describes an explanation that people who do not have a store entry QR code are the photographing subject. The photographing icon display section 65 describes an arrow indicating the position of the button to be pressed when photographing a face, and a camera icon.

[0064] 4, a code reader 56, a reading instruction section 58, and a reading icon display section 59 are provided on the front surface 52 of the housing 50 of the operation terminal 40. The reading instruction section 58 describes how a person who has a store entry QR code should read the code using the code reader 56. The reading icon display section 59 describes an icon that diagrammatically shows the QR code and an arrow indicating the position of the code reader 56.

[0065] In this embodiment, if the customer U does not have an entry QR code, the output control unit 102 outputs voice guidance (e.g., "Your face will be photographed with the camera on the operation panel, so please press the capture button.") from the output unit 80 (speaker 66 of the operation terminal 40 in Figure 4) to encourage the customer U to press the capture button 60 to take a facial image.

[0066] Furthermore, if the customer U has a store entry QR code, the output control unit 102 causes the output unit 80 (the speaker 66 of the operation terminal 40 in FIG. 4) to output audio guidance urging the customer U to hold the store entry QR code over the code reader 56.

[0067] When the acquiring unit 104 accepts that the customer U has pressed the photographing button 60, the acquiring unit 104 captures a face of the customer U using the camera 62 and acquires the face image as authentication information. The image processing unit 120 analyzes the face image acquired by the acquisition unit 104, and judges whether an image of sufficient image quality has been acquired to extract a predetermined feature amount required for performing authentication processing, for example. Alternatively, the image processing unit 120 judges whether the feature amount extracted from the face image is distinguishable from that of another person, that is, whether the feature amount is equal to or exceeds a reference value. The image processing unit 120 may store at least one of the face image and the feature amount extracted from the face image as a store visit record in the storage device 12 in association with date and time information.

[0068] If the facial image does not meet the criteria, the output control unit 102 may further output audio guidance to encourage the user to take the photograph again, including advice on how to obtain a more accurate image, such as "The face could not be recognized. Please face the camera directly and press the capture button again to capture the face."

[0069] <Example of operation> The operation of the entrance management device 100 of this embodiment is the same as that of the above embodiment in Fig. 6, but in step S107, the authentication information acquired by the acquisition unit 104 is a face image of the customer U captured by the camera 62 of the operation terminal 40, and in step S109, if the feature amount extracted from the face image is equal to or greater than a reference value, the opening / closing control unit 106 determines that the authentication information satisfies the reference (YES in step S109). Other than these processes, it is the same as Fig. 6.

[0070] According to this embodiment, the face of the customer U in front of the operation terminal 40 is photographed when the photographing button 60 of the operation terminal 40 is pressed, and the photographed facial image of the customer U is used as authentication information. As shown in Fig. 4, a photographing subject explanation section 64 and a photographing icon display section 65 are provided on the front surface 52 of the housing 50, so that the customer U can view these explanations and photograph the facial image.

[0071] Furthermore, when a facial image is used as authentication information, advice may be output to the customer U by voice guidance so that the facial image meets the criteria. In that case, an image with good image quality can be obtained as authentication information.

[0072] Third embodiment The store entry management device 100 of this embodiment is similar to any of the above embodiments, except that it has a configuration in which it outputs a first guidance when the human presence sensor 70 detects a person before starting the process of acquiring authentication information. The store entry management device 100 of this embodiment will be described as having the same configuration as the store entry management device 100 of the second embodiment in Fig. 7, but it may also have the same configuration as the store entry management device 100 of the first embodiment in Fig. 5.

[0073] 3, the operation terminal 40 is installed next to the automatic door 20. Then, the output control unit 102 causes the output unit 80 to output a first guidance when the human presence sensor 70 detects a human before the operation terminal 40 starts the process of acquiring authentication information.

[0074] Here, the first guidance is for guiding the customer U to the operation terminal 40, and includes, for example, audio guidance such as "Please proceed to the operation panel on the left side of the automatic door." Furthermore, the first guidance may notify the customer U of the presence of the operation terminal 40 by outputting an alarm sound from the speaker 66, displaying an image on the display 54 of the operation terminal 40, or outputting audio together with a message image such as "The operation panel is this way."

[0075] Furthermore, the first guidance may be output using at least one of audio, image, and video, giving a simple explanation of the operations required to enter the store, such as, "Our store is currently unmanned. You can enter by performing the necessary operations on the operation panel to the left of the automatic door," or, "You can enter by holding up the entry QR code on the operation panel to the left of the automatic door or having your face photographed."

[0076] Fig. 8 is a flowchart showing an example of the operation of the store entry management device 100 of this embodiment. The flowchart of this embodiment is executed instead of steps S103 and S105 of Fig. 6 after the human presence sensor 70 at the store entrance detects a person in the determination of step S101 of Fig. 6 (YES in step S101).

[0077] After the human presence sensor 70 at the entrance of the store detects a person (YES in step S101), it is determined whether or not the acquisition unit 104 has not yet performed an acquisition process for authentication information (step S121). acquisition If the process has not yet started (YES in step S121), the output control unit 102 causes the output unit 80 to output the first guidance (step S123).

[0078] For example, in a manned store, the human sensor 70 of the automatic door 20 detects a person standing in front of the automatic door 20 and automatically opens the automatic door 20. However, in an unmanned store, the automatic door 20 is locked, so even if a person stands in front of the automatic door 20, the automatic door 20 does not open. The automatic door 20 is unlocked and the person can enter the store by performing an authentication operation for entering the store on the operation terminal 40 installed next to the automatic door 20. However, people who are not accustomed to unmanned stores, or who do not know or are unaware that the store is unmanned, go directly to the automatic door 20 when they try to enter the store. Therefore, many people think that the door is broken or the store is closed when they stand in front of the automatic door 20 and the door does not open, and just leave.

[0079] According to this embodiment, in such a situation, for example, an operation terminal 40 installed next to an automatic door 20 can output a first guidance message to a customer U who comes to the store, thereby informing the customer U of the presence of the operation terminal 40.

[0080] In other words, by outputting first guidance such as "Please proceed to the operation panel on the left side of the automatic door," "The operation panel is this way," "Our store is currently unmanned. You can enter the store by performing the necessary operations on the operation panel to the left of the automatic door," and "You can enter the store by holding up the entry QR code on the operation panel to the left of the automatic door or by having your face photographed," it is possible to make customers aware of the presence of the operation terminal 40.

[0081] In addition, since the operation terminal 40 is equipped with a display 54, the location of the operation terminal 40 can be notified to the customer U by lighting up the display 54 or displaying a message such as "The operation panel is this way."

[0082] In this way, even in unmanned stores, customers can be guided to enter the store rather than giving up and going home, which in turn prevents a decline in the store's customer utilization rate.

[0083] (Fourth embodiment) The store entry management device 100 of this embodiment is the same as that of the third embodiment, except that it has a configuration for outputting a second guidance when it is detected that a customer who has come to the store is unable to enter the store even after the first guidance is output. The store entry management device 100 of this embodiment will be described as having the same configuration as the store entry management device 100 of the second and third embodiments in Fig. 7, but it may also have the same configuration as the store entry management device 100 of the first embodiment in Fig. 5.

[0084] If the human sensor 70 continues to detect a human even after the output of the first guidance, the output control unit 102 outputs a second guidance different from the first guidance. The volume of the second guidance is smaller than the volume of the first guidance.

[0085] When the human presence sensor 70 continues to detect a person, it means that the person is unable to enter the store and continues to stand in front of the store entrance, and it is assumed that the person is in a difficult situation because he or she does not know how to enter the store. Therefore, the second guidance may include, for example, a lecture to the customer on how to enter the store using the operation terminal 40.

[0086] The second guidance may, for example, use video, images, and text on the display 54 of the operation terminal 40 to explain the store entry method when the user has a store entry QR code and when the user does not have one. In this case, the second guidance assumes that a person is standing in front of the operation terminal 40, so the volume of the second guidance may be lower than that of the first guidance for calling a person to the operation terminal 40 from in front of the automatic door 20. Alternatively, the output control unit 102 may display an explanation of the store entry method on the display 54 using images and text, without outputting audio.

[0087] Whether or not the human presence sensor 70 is continuing to detect a person can be determined by detecting whether a signal indicating the detection state is continually being input from the sensor 30, or by analyzing the image captured by the camera 5 to detect that the same person is continuing to be present in the vicinity of the store's automatic door 20 or the operating terminal 40.

[0088] <Example of operation> Fig. 9 is a flowchart showing an operation example of the store entry management device 100 of this embodiment. The flowchart of this embodiment is executed after step S123 of Fig. 8. After the output control unit 102 outputs the first guidance (step S123), if the human presence sensor 70 continues to detect a person (YES in step S131), the output control unit 102 causes the output unit 80 to output a second guidance different from the first guidance (step S133).

[0089] According to this embodiment, when a person who has come to an unmanned store is in a difficult situation in front of the store because he does not know how to enter the store, the second guidance can be output to give a lecture on how to enter the store. This can prevent a situation in which a customer gives up and leaves because he does not know how to enter the store, and can improve the customer's store utilization rate. In addition, by making the volume of the second guidance lower than that of the first guidance for calling a person to the operation terminal 40 from in front of the automatic door 20 at the store entrance, or by making it silent, it is possible to reduce noise in the vicinity of the store.

[0090] (Modification of the fourth embodiment) As a modified version of the fourth embodiment, at least two motion sensors 70, 72 may be used to detect the presence of the same person in at least two stages. Fig. 16 is a diagram showing the arrangement of motion sensors in this modified version. For example, the two motion sensors 70, 72 have different detection ranges, and the first motion sensor 70 has a wider detection range 74 than the second motion sensor 72. The second motion sensor 72 has a detection range 76 that is near the operation terminal 40 or the automatic door 20, and the first motion sensor 70 includes a range away from the automatic door 20 in its detection range.

[0091] When a person P approaches the store, the first human presence sensor 70 first detects a person within the first detection range 74 and outputs the first guidance, and then, when the second human presence sensor 72 detects the presence of a person within the second detection range 76, the output control unit 102 may output a second guidance different from the first guidance. The volume of the second guidance may be lower than the volume of the first guidance.

[0092] Furthermore, if no human is detected by the second human sensor 72 even after a predetermined time has elapsed since the first human sensor 70 detected the human, the first guidance may be output again.

[0093] <Example of operation> 17 is a flowchart showing an example of the operation of the modified store entry management device 100. After the first human presence sensor 70 detects a person P (YES in step S201) and outputs the first guidance (step S203), the output control unit 102 determines whether the second human presence sensor 72 has detected the person P (step S205).

[0094] If the person P is not detected by the second human presence sensor 72 (NO in step S205), the process returns to step S203, and the output control unit 102 causes the output unit 80 to output the first guidance again (step S203).

[0095] This example shows that person P is staying a little distance away from the store (within detection range 74) and is not within detection range 76 of second human presence sensor 72. The fact that person P is staying within detection range 74 means that person P is not approaching operation terminal 40. In other words, it is highly likely that person P is having trouble finding the location of operation terminal 40 or is checking from a distance to see if the store is open. Therefore, output control unit 102 causes output unit 80 to output the first guidance again.

[0096] As mentioned above, the first guidance is, "Please proceed to the control panel on the left side of the automatic doors.", "The control panel is over here.", "Our store is currently unmanned. You can enter the store by performing the necessary operations on the control panel to the left of the automatic doors.", and "You can enter the store by holding up the entry QR code on the control panel to the left of the automatic doors or having your face photographed."

[0097] On the other hand, when the second human presence sensor 72 detects the person P (YES in step S205), the output control unit 102 outputs the second guidance (step S207). The second guidance may include, for example, a lecture to the customer on how to enter the store using the operation terminal 40. The volume of the second guidance may be lower than the volume of the first guidance.

[0098] After outputting the first guidance in step S203, in step S205, the second human sensor 72 preferably continues monitoring whether or not a person is detected for several to 10 seconds. In other words, it is preferable to continue monitoring for the time it takes for the person P to enter the detection range 76 from the detection range 74.

[0099] In this modified embodiment, two human sensors 70 、72 However, as long as the detection range can be divided into multiple stages and the presence of a person can be detected, any number of sensors can be used. Also, the detection range can be divided into three or more stages to detect the presence of a person, and three or more types of guidance can be selected and output according to the detection range.

[0100] Alternatively, the output control unit 102 may output different guidance depending on the detection result of a person in a plurality of different detection ranges. In other words, the output control unit 102 may output different guidance depending on the position of the person. For example, the output control unit 102 may output different guidance at different volumes when a person is detected at a position away from the store, when a person is detected in front of the automatic door 20, and when a person is detected in front of the operation terminal 40.

[0101] For example, the volume may be set to three levels, and if a person is detected away from the store, the above-mentioned first guidance may be output at the first level of volume, and if a person is subsequently detected in front of the automatic door 20, the first guidance may be output at a second level of volume that is lower than the first level. Furthermore, if a person is subsequently detected in front of the operation terminal 40, the above-mentioned second guidance may be output at a third level of volume that is lower than the second level.

[0102] The position where person P is present may be detected by analyzing an image captured using a camera 5 instead of a human presence sensor, and the output control unit 102 may output different guidance depending on the position where person P is detected.

[0103] According to this configuration, it is possible to inform person P who is standing a little distance away from the store of the method for entering the store and the location of the operation terminal 40, and to call the person to the operation terminal 40, and if the person approaches the operation terminal 40, it is possible to output a further guidance to support the person so that the person can enter the store promptly. In addition, the second guidance is made at a lower volume than the first guidance, which serves as a noise reduction measure for the neighborhood of the store.

[0104] Fifth embodiment The store entry management device 100 of this embodiment is the same as any of the above-described embodiments, except that it has a configuration for controlling the volume of the voice guidance based on the detection result of a volume detection unit installed in the store.

[0105] The output control unit 102 controls the volume of the voice guidance based on the detection result of a volume detection unit (not shown) installed in the store. The volume detection unit may be, for example, the microphone 68 of the operation terminal 40, or a separate microphone installed outside the store. The microphone 68 collects environmental sounds around the store and measures the volume.

[0106] For example, the volume of the voice guidance is set to three levels, first, second, and third volumes, in descending order of volume. When the environmental sound is equal to or greater than a first reference value, such as when there is a lot of traffic in front of the store or when construction is underway, the output control unit 102 sets the volume of the voice guidance to the first volume. When the traffic volume is not high during the day at the store and the environmental sound is less than the first reference value but equal to or greater than the second reference value, the output control unit 102 sets the volume of the voice guidance to the second volume. When the traffic volume in front of the store is low at night and the environmental sound is less than the second reference value, the output control unit 102 sets the volume of the voice guidance to the third volume.

[0107] According to this embodiment, the same effects as those of the above embodiment are achieved, and furthermore, since the volume of the voice guidance is controlled according to the level of the environmental sound around the store, it is possible to take measures against noise in the neighborhood. Also, when there is a lot of traffic around the store and the surrounding environmental sound is loud, the volume can be controlled to make it easier to hear.

[0108] Sixth embodiment The store entry management device 100 of this embodiment is the same as any of the above embodiments, except that it has a configuration that outputs audio guidance when the authentication information acquisition process does not start after a certain period of time has passed. Here, it is described as having the same configuration as the store entry management device 100 of the first embodiment in Fig. 5, but the configuration of this embodiment may be combined with other embodiments.

[0109] When the operation terminal 40 does not execute the process of acquiring authentication information even after a first reference time has elapsed after the human presence sensor 70 detects a human, the output control unit 102 causes the output unit 80 to output a voice guidance.

[0110] The first reference time is, for example, several tens of seconds. If the process of acquiring authentication information does not start even after the first reference time has elapsed, it is highly likely that a person who has come to the store is trying to enter the store but is confused because he or she does not know how to enter. Therefore, the output control unit 102 causes the output unit 80 to output guidance that lectures the customer on how to have the customer present the authentication information required for entering the store.

[0111] For example, the voice guidance output at this time may include content explaining that there are multiple ways to enter the store, such as "If you have an entry QR code, please hold the QR code over the counter," and "If you do not have an entry QR code, your face will be photographed, so please press the capture button," or an explanation of the operations required to obtain consent to have your face photographed, such as "To enter the store, you must present your QR code or have your face photographed," and "If you're OK with having your face photographed, please press the capture button."

[0112] Moreover, the process of acquiring authentication information is determined when the acquiring unit 104 detects that the code reader 56 has read the store entry QR code or the photographing button 60 has been pressed.

[0113] <Example of operation> Fig. 10 is a flowchart showing an example of the operation of the store entry management device 100 of this embodiment. The flowchart of this embodiment is executed instead of step S103 in Fig. 6 after the human presence sensor 70 at the store entrance detects a person in the determination of step S101 in Fig. 6 (YES in step S101).

[0114] After the motion sensor 70 at the store entrance detects a person (YES in step S101), the output control unit 102 monitors whether a first reference time has elapsed (step S141). If the first reference time has elapsed (YES in step S141), it determines whether the authentication information acquisition process has been executed, for example, whether the photograph button 60 has been pressed or whether the store entry QR code has been read by the code reader 56 (step S143). Until the first reference time has elapsed (NO in step S141), the output control unit 102 continues to monitor the passage of time.

[0115] If it is determined that the authentication information acquisition process has been executed (YES in step S143), step S105 in Fig. 6 is bypassed, and the process proceeds to step S107 in Fig. 6. In step S107 in Fig. 6, the acquisition unit 104 executes the authentication information acquisition process. On the other hand, if it is determined that the authentication information acquisition process has not been executed (NO in step S143), the process proceeds to step S105 in Fig. 6. That is, the output control unit 102 causes the output unit 80 to output voice guidance.

[0116] In this manner, if the process of obtaining authentication information is not started even after the first reference time has elapsed since the detection of a person, a voice guidance can be output.

[0117] As mentioned above, after a person is detected, AfterHowever, if the authentication information required for entering the store is not acquired, the customer may be confused and not know how to operate the device. According to this embodiment, the output control unit 102 causes the output unit 80 to output audio guidance instructing the customer on how to enter the store, so that it is possible to help a customer who was thinking of giving up on entering the store and going home, and to prevent a decrease in the utilization rate of the store.

[0118] Seventh embodiment The store entry management device 100 of this embodiment has the same configuration as the store entry management device 100 of the second embodiment in Fig. 7, except that it has a configuration for outputting audio guidance when a face image that satisfies a criterion is not acquired even after a certain time has elapsed since a person was detected. However, it may be combined with the configuration of other embodiments described later and the configuration having the image processing unit 120 of this embodiment.

[0119] The output control unit 102 outputs audio guidance when a face image satisfying the criteria is not obtained even after a second reference time has elapsed after the human presence sensor 70 detects a person. A face image satisfying the criteria is an image with image quality from which a predetermined feature amount required for face recognition processing can be extracted. Alternatively, a face image satisfying the criteria is an image in which the feature amount extracted from the face image has a feature amount that can be distinguished from another person.

[0120] The second reference time is, for example, several seconds to several tens of seconds. When a face image that satisfies the criteria cannot be obtained even after the second reference time has elapsed, it may be that the customer is attempting to photograph his / her face, but does not face the camera 62, has moved his / her face, or is too far away from or too close to the camera 62.

[0121] Therefore, the audio guidance includes at least one of the following: "Please face the camera," "You will be photographed, so please face the camera without moving your head," "Please move away from the camera," and "Please move closer to the camera."

[0122] In addition to the audio guidance, a video, image or text giving a lecture on the shooting method may be displayed as guidance on the display 54 of the operation terminal 40.

[0123] <Example of operation> Figure 11 teeth, 6 is a flowchart showing an example of the operation of the store entry management device 100 according to the present embodiment. The flowchart according to the present embodiment is executed instead of step S103 in FIG. 6 after the human presence sensor 70 at the store entrance detects a person in step S101 in FIG. 6 (YES in step S101).

[0124] After the motion sensor 70 at the store entrance detects a person (YES in step S101), the output control unit 102 monitors whether a second reference time has elapsed (step S151). If the second reference time has elapsed (YES in step S151), it is determined whether a face image satisfying the criterion has been obtained (step S153). Here, the output control unit 102 queries the image processing unit 120 as to whether a face image satisfying the criterion has been obtained. Meanwhile, the output control unit 102 continues to monitor the passage of time until the second reference time has elapsed (NO in step S151).

[0125] If it is determined that a face image satisfying the criteria has been obtained (YES in step S153), step S105 in Fig. 6 is bypassed, and the process proceeds to step S107 in Fig. 6. In step S107 in Fig. 6, the acquisition unit 104 performs an acquisition process of authentication information. On the other hand, if it is determined that a face image satisfying the criteria has not been obtained (NO in step S153), the process proceeds to step S105 in Fig. 6. That is, the output control unit 102 causes the output unit 80 to output a voice guidance.

[0126] In this way, if a face image that satisfies the criteria is not obtained even after the second reference time has elapsed since a person was detected, audio guidance can be output.

[0127] As mentioned above, after a person is detected, the AfterHowever, if authentication information that satisfies the criteria is not acquired, it is possible that the customer is moving or is not facing the camera 62 properly. Therefore, by outputting voice guidance to the customer showing where to stand and an explanation of how to take a photo, it is possible to successfully capture a face image that satisfies the criteria. Even if it takes time because the authentication information does not satisfy the criteria, if the customer does not understand the reason, he or she may think that the equipment is broken or that the store is closed, and give up and go home. In this embodiment, the time required to capture a face for authentication can be shortened, so it is possible to prevent customers from giving up and going home because it takes too long.

[0128] Eighth embodiment Fig. 12 is a functional block diagram logically showing an example of the configuration of the store entry management device 100 of this embodiment. The store entry management device 100 of this embodiment is similar to any of the other embodiments described above, except that it has a configuration in which the guidance content and notification method are determined according to the situation of the customer. The store entry management device 100 of this embodiment will be described in combination with the second embodiment of Fig. 7, but it may also be combined with other embodiments.

[0129] The store entry management device 100 of this embodiment has the same configuration as the store entry management device 100 of Fig. 7, and further includes a determination unit 108. The determination unit 108 repeatedly acquires the detection results of the human presence sensor 70, and determines at least one of the contents of the guidance and the notification method using the analysis results of the images included in the multiple detection results. The output control unit 102 causes the output unit 80 to output guidance according to the determined contents.

[0130] In this embodiment, the human presence sensor 70 is, for example, a camera 5 that is provided above the automatic door 20 and captures people in the area in front of the automatic door 20 and the area in front of the operation terminal 40. People near the store entrance are detected by performing image analysis processing using the video from the camera 5 or multiple frame images. The analysis results are associated with at least one of the content of guidance and the notification method corresponding to at least one of the person's position, movement, and behavior.

[0131] The position, movement, and behavior of a person at the store entrance may be assumed in advance, and the state may be associated with at least one of the content of guidance and the notification method suitable for those states. Furthermore, the analysis result of the image by the camera 5 may be associated with the assumed state of the person's position, movement, and behavior. That is, the analysis result may be associated with at least one of the content of guidance and the notification method and stored in, for example, a table. In this way, the determination unit 108 can refer to the table and determine the content of guidance and the notification method corresponding to the analysis result.

[0132] For example, the contents of the guidance and the notification method are exemplified below, but are not limited to these. (1) A voice guidance indicating that the store is unmanned is output from the speaker 66 of the operation terminal 40. (2) A voice guidance is output from the speaker 66 of the operation terminal 40 informing the customer that an operation on the operation terminal 40 is required to enter the store. (3) Audio guidance or an alarm sound that notifies the user of the location of the operation terminal 40 is output from the speaker 66. Or, a video or image is displayed on the display 54 of the operation terminal 40. An LED of the operation terminal 40 is turned on or blinks. (4) Display 54 of operation terminal 40 displays an image explaining how to enter the store. (5) When the customer has the store entry QR code, guidance is output using at least one of audio, image, and video to specifically explain how to operate the store. (6) Guidance notifying the user of the presence of the code reader 56 of the operation terminal 40 is output in the form of at least one of audio, image, and video. (7) Guidance is output in the form of at least one of audio, image, and video, instructing the customer to hold the QR code over the code reader 56 to enter the store. (8) Output guidance in the form of audio, images, and / or video that specifically explains how to operate the store if the customer does not have the store entry QR code. (9) Guidance is output in the form of at least one of audio, image, and video to inform the user that a photograph of the face is required, and to obtain consent to photographing the face or to operate the photographing button 60 in order to photograph the face. (10) Guidance on the positions of the shooting button 60 and the camera 62 is output in the form of at least one of audio, image, and video. (11) A guidance on how to take a photograph so that the facial image satisfies a standard is outputted by at least one of audio, image, and video. (12) An operator at a remote center is notified that a customer is having difficulty entering the store, and the operator asks the customer questions. The operator and the customer can talk to each other using the speaker 66 and microphone 68. The operator's face may also be displayed on the display 54. (13) A guidance indicating that an operator at a remote center can be contacted and the contact method is output by at least one of voice, image, and video.

[0133] For example, when it is detected that a person is standing in front of the automatic door 20, the determination unit 108 determines at least one of the above guidance contents and notification methods (1) to (3). When it is detected that a person is standing in front of the operation terminal 40 for several seconds, the determination unit 108 determines at least one of the above guidance contents and notification methods (1) to (5). When it is detected that a person is standing in front of the operation terminal 40 for several tens of seconds or walking back and forth between the operation terminal 40 and the automatic door 20, the determination unit 108 determines at least one of the above guidance contents and notification methods (5) to (13).

[0134] <Example of operation> Fig. 13 is a flowchart showing an example of the operation of the store entry management device 100 of this embodiment. The flowchart of this embodiment is executed in parallel with the process of Fig. 6 after the human presence sensor 70 at the store entrance detects a person in the judgment of step S101 of Fig. 6 (YES in step S101). In other words, while the process of Fig. 13 is being executed, the process of acquiring authentication information by the acquisition unit 104 in the flow of Fig. 6 and the process of unlocking the automatic door 20 by the opening / closing control unit 106 are executed.

[0135] After the motion sensor 70 at the store entrance detects a person (YES in step S101), it is determined whether the motion sensor 70 has detected a person continuously for a third reference time (step S161). If the motion sensor 70 has detected a person continuously for the third reference time (YES in step S161), the output control unit 102 causes the output unit 80 to output a third guidance (step S163).

[0136] The third guidance is, for example, the above-mentioned (1) to (3). Until the human sensor 70 detects a person continuously for a third reference time (NO in step S161), the output control unit 102 waits and continues monitoring.

[0137] Furthermore, after step S163, the output control unit 102 judges whether or not the automatic door 20 has been unlocked (step S165). If it is judged that the automatic door 20 has been unlocked (YES in step S165), this process ends.

[0138] On the other hand, if it is determined that the automatic door 20 is not unlocked (NO in step S165), the output control unit 102 determines whether or not the fourth reference time has elapsed (step S167). If the fourth reference time has elapsed (YES in step S167), the output control unit 102 causes the output unit 80 to output the fourth guidance (step S169). Then, the process returns to step S165. On the other hand, the process returns to step S165 until the fourth reference time has elapsed (NO in step S167).

[0139] The fourth guidance is, for example, at least one of the above-mentioned (4) to (11).

[0140] Furthermore, as shown in Fig. 14, the store entry management device 100 of this embodiment may further include a notification unit 110 in addition to the configuration of Fig. 12. After the fourth guidance is given, the notification unit 110 notifies a remote operation center when a fifth reference time has elapsed.

[0141] <Example of operation> FIG. 15 is a flowchart showing an example of the operation of the store entry management device 100 of this embodiment. After the fourth guidance is output in step S169 in Fig. 13, the determination unit 108 further determines whether or not the fifth reference time has elapsed (step S171). Then, until the fifth reference time has elapsed (NO in step S171), the process returns to step S165 in Fig. 13.

[0142] On the other hand, if the fifth reference time has elapsed (YES in step S171), the decision unit 108 causes the notification unit 110 to notify an operator at a remote center (step S173). Then, upon receiving the notification, the operator uses the speaker 66 and microphone 68 of the operation terminal 40 to explain to the customer how to enter the store.

[0143] Instead of an operator at a remote center, the notification unit 110 may connect to, for example, an AI (Artificial Intelligence) and have the AI ​​handle the customer's request.

[0144] According to this embodiment, at least one of the contents of the guidance and the notification method is determined using the results obtained by analyzing the image captured by the camera 5 installed next to the automatic door 20. Therefore, appropriate guidance can be provided in accordance with the behavior of the person through an appropriate notification method. in This allows customers to enter the store efficiently.

[0145] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than those described above can also be adopted. For example, the steps shown in the flowcharts of the above embodiments, for example, the steps in the flowcharts of Figures 8, 9, 10, 11, 13, 15, and 17 may be combined as long as there is no contradiction. For example, after the flowchart of Figure 17, the process may proceed to the flowchart of Figure 9 or 10.

[0146] Although the present invention has been described above with reference to the embodiments and examples, the present invention is not limited to the above-mentioned embodiments and examples. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In the present invention, when information about a user is acquired and used, this shall be done lawfully.

[0147] A part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes. 1. An output control means for causing an output means provided at the store entrance to output audio guidance on how to enter the store when a human presence sensor installed at the store entrance detects a human; an acquisition means for acquiring authentication information for authenticating a person from a terminal provided at the entrance; and an opening / closing control means for unlocking the entrance door when the acquired authentication information satisfies a standard, The output control means determines whether or not the voice guidance is required using a detection result of the human presence sensor before acquiring the authentication information, and controls the output of the voice guidance. 2. In the store entry management device according to 1., the authentication information is an image of the face of the person, The opening / closing control means is a store entry management device that unlocks the entrance door when an analysis result of the face included in the image satisfies a criterion. 3. In the store entry management device according to 1. or 2., The terminal is installed next to the door, The output control means outputs a first guidance when the human presence sensor detects a human before the terminal starts the process of acquiring the authentication information. 4. In the store entry management device according to 3., when the human presence sensor continues to detect a human even after the output of the first guidance, the output control means outputs a second guidance different from the first guidance; A store entry management device, wherein a volume of the second guidance is lower than a volume of the first guidance. 5. In the store entry management device according to 3. or 4., A second human presence sensor having a second detection range narrower than the first detection range of the human presence sensor and detecting a person near the door, the output control means, when the second human presence sensor detects the presence of the person within the second detection range after the human presence sensor detects the presence of the person within the first detection range and outputs the first guidance, outputs a second guidance different from the first guidance; A store entry management device, wherein a volume of the second guidance is lower than a volume of the first guidance. 6. In the store entry management device according to any one of 1. to 5., The output control means controls the volume of the voice guidance based on a detection result of a volume detection means installed in the store. 7. In the store entry management device according to any one of 1. to 6., The output control means of the store entry management device outputs the voice guidance if the authentication information acquisition process is not executed in the terminal even after a first reference time has elapsed after the human presence sensor detects the person. 8. In the store entry management device according to any one of 2. and 3. to 7. which cites 2., The output control means of the store entry management device outputs the voice guidance if, after the human presence sensor detects the person, a second reference time has elapsed and no image of the face that meets the reference has been obtained. 9. In the entrance management device according to any one of 1. to 8., A determination unit is further provided for repeatedly acquiring detection results of the human presence sensor and determining at least one of the content of the guidance and the notification method using an analysis result of an image included in the plurality of detection results, The output control means outputs the guidance according to the determined content. 10. In the entrance management device according to 9., The output control means When the human presence sensor detects a human continuously for a third reference time, a third guidance is output; Thereafter, if a fourth reference time has elapsed without the door being unlocked, the store entry management device outputs a fourth guidance. 11. In the store entry management device according to 10., The store entry management device further comprises a notification means for notifying an operations center when a fifth reference time has elapsed after the fourth guidance has been given.

[0148] 12. The store entry management device is When a human presence sensor installed at the entrance of the store detects a person, an output device installed at the entrance outputs audio guidance on how to enter the store, Acquiring authentication information for authenticating a person from a terminal provided at the entrance; unlocking the entrance door when the acquired authentication information satisfies a criterion; A store entry management method, comprising: determining whether or not the voice guidance is required using a detection result of the human presence sensor before the authentication information is acquired; and controlling output of the voice guidance. 13. In the store entry management method described in 12., the authentication information is an image of the face of the person, The store entry management device, The store entry management method unlocks the entrance door when an analysis result of the face included in the image satisfies a criterion. 14. In the store entry management method according to 12. or 13., The terminal is installed next to the door, The store entry management device, The store entry management method includes outputting a first guidance when the human presence sensor detects a human before the terminal starts a process of acquiring the authentication information. 15. In the store entry management method described in 14., The store entry management device, If the human presence sensor continues to detect a human even after the first guidance is output, a second guidance different from the first guidance is output; A store entry management method, wherein the volume of the second guidance is lower than the volume of the first guidance. 16. In the store entry management method described in 14. or 15., The store entry management device, using a second human presence sensor having a second detection range narrower than the first detection range of the human presence sensor and detecting a person near the door, when the human presence sensor detects the presence of a person within the first detection range and outputs the first guidance, and then when the second human presence sensor detects the presence of the person within the second detection range, a second guidance different from the first guidance is output; A store entry management method, wherein the volume of the second guidance is lower than the volume of the first guidance. 17. In the store entry management method according to any one of 12. to 16., The store entry management device, The store entry management method further comprises controlling the volume of the voice guidance based on a detection result of a volume detection means installed in the store. 18. In the store entry management method according to any one of 12. to 17., The store entry management device, The store entry management method outputs the voice guidance if the authentication information acquisition process is not executed in the terminal even after a first reference time has elapsed after the human presence sensor detects the person. 19. In the store entry management method according to any one of 14. to 18. which quotes 13. and 13., The store entry management device, The store entry management method outputs the voice guidance if the image of the face that satisfies the criteria is not obtained even after a second reference time has elapsed after the human presence sensor detects the person. 20. In the store entry management method according to any one of 12. to 19., The store entry management device further comprises: repeatedly acquiring detection results of the human presence sensor, and determining at least one of the content of the guidance and a notification method using an analysis result of an image included in the plurality of detection results; The store entry management method outputs the guidance according to the determined content. 21. In the store entry management method described in 20., The store entry management device, When the human presence sensor detects a human continuously for a third reference time, a third guidance is output; Thereafter, if a fourth reference time has elapsed without the door being unlocked, a fourth guidance is outputted. 22. In the store entry management method described in 21., The store entry management device further comprises: The store entry management method further notifies an operations center when a fifth reference time has elapsed after the fourth guidance has been given.

[0149] 23. To the computer: a step of outputting audio guidance on how to enter the store from an output device provided at the entrance when a human presence sensor installed at the entrance detects a human; acquiring authentication information for authenticating a person from a terminal provided at the entrance; executing a procedure of unlocking the entrance door if the acquired authentication information satisfies a criterion; A program for executing, in the output procedure, a procedure for determining whether or not the voice guidance is needed using the detection result of the human presence sensor before the authentication information is acquired, and controlling the output of the voice guidance. 24. In the program according to 23., the authentication information is an image of the face of the person, On the computer, a program for executing a procedure for unlocking the entrance door when an analysis result of the face contained in the image satisfies a criterion; 25. In the program according to 23. or 24., The terminal is installed next to the door, On the computer, a program for executing a procedure for outputting a first guidance when the human presence sensor detects a human before the terminal starts a process of acquiring the authentication information; 26. In the program according to 25., On the computer, If the human presence sensor continues to detect a human even after the first guidance is output, a second guidance is output, the second guidance being lower in volume than the first guidance and different from the first guidance. R A program that executes a procedure. 27. In the program according to 25. or 26., On the computer, A program for executing a procedure using a second human presence sensor having a second detection range narrower than the first detection range of the human presence sensor to detect a person near the door, whereafter the human presence sensor detects the presence of a person within the first detection range and outputs the first guidance, and then, when the second human presence sensor detects the presence of the person within the second detection range, outputs a second guidance that is lower in volume than the first guidance and different from the first guidance. 28. In the program according to any one of 23. to 27., On the computer, A program for executing a procedure for controlling the volume of the voice guidance based on a detection result of a volume detection means installed in the store. 29. In the program according to any one of 23. to 28., On the computer, A program for executing a procedure for outputting the voice guidance if the authentication information acquisition process is not executed in the terminal after a first reference time has elapsed after the human presence sensor detects the person. 30. In the program according to any one of 24. and 25. to 29. which cites 24., On the computer, A program for executing a procedure for outputting the voice guidance when an image of the face that satisfies a second reference time has elapsed after the human presence sensor detects the person and the image does not satisfy the reference. 31. In the program according to any one of 23. to 30., On the computer, a step of repeatedly acquiring detection results of the human presence sensor, and determining at least one of the content of the guidance and a notification method using an analysis result of an image included in the plurality of detection results; and a program for executing a procedure for outputting the guidance in accordance with the determined content. 32. In the program according to 31., On the computer, outputting a third guidance when the human presence sensor continuously detects a human for a third reference time; Thereafter, if a fourth reference time has elapsed without the door being unlocked, a fourth guidance is output. 33. In the program according to 32., On the computer, and a program for executing a procedure for notifying an operations center when a fifth reference time has elapsed after the fourth guidance has been performed.

[0150] This application claims priority based on Japanese Patent Application No. 2020-080075, filed on April 30, 2020, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0151] 1. Store entry management system 3. Communication Network 5. Camera 10 Server 12 Storage device 20 Automatic Doors 30 Sensors 40 Operation terminal 50 Case 52 Front 54 Display 56 Code Reader 60 Shooting button 62 Camera 64. Photographing Subject Explanation Section 65 Shooting icon display area 66 Speaker 68 Microphones 70 Human Sensor 80 Output section 100 Store entry management device 102 Output control section 104 Acquisition Department 106 Opening and closing control section 108 Decision Section 110 Notification Department 120 Image Processing Unit 1000 Computers 1010 Bus 1020 Processor 1030 Memory 1040 Storage Device 1050 Input / Output Interface 1060 Network Interface

Claims

1. an output control means for causing an output means provided at the store entrance to output audio guidance on how to enter the store when a human presence sensor installed at the store entrance detects a human; an acquisition means for acquiring authentication information for authenticating a person from a terminal provided at the entrance; and an opening / closing control means for unlocking the entrance door when the acquired authentication information satisfies a standard, the output control means determines whether the voice guidance is necessary based on a location of a person detected in a detection result of the human presence sensor before acquiring the authentication information, and controls output of the voice guidance; The terminal is installed next to the door, the output control means causes the terminal to output a first guidance when the human presence sensor detects a human before the terminal starts a process of acquiring the authentication information; when the human presence sensor continues to detect a human even after the output of the first guidance, the output control means outputs a second guidance different from the first guidance; The store entry management device, wherein the volume of the second guidance is lower than the volume of the first guidance.

2. The store entry management device according to claim 1, A second human presence sensor having a second detection range narrower than the first detection range of the human presence sensor and configured to detect a person near the door, the output control means, when the second human presence sensor detects the presence of the person within the second detection range after the human presence sensor detects the presence of the person within the first detection range and outputs the first guidance, outputs a second guidance different from the first guidance; The store entry management device, wherein the volume of the second guidance is lower than the volume of the first guidance.

3. In the store entry management device according to claim 1 or 2, The output control means of the store entry management device outputs the voice guidance if the authentication information acquisition process is not executed in the terminal even after a first reference time has elapsed after the human presence sensor detects the person.

4. In the store entry management device according to any one of claims 1 to 3, A determination unit is further provided for repeatedly acquiring detection results of the human presence sensor and determining at least one of the content of the guidance and the notification method using an analysis result of an image included in the plurality of detection results, The output control means outputs the guidance according to the determined content.

5. The store entry management device according to claim 4, The output control means When the human presence sensor detects a human continuously for a third reference time, a third guidance is outputted; Thereafter, if a fourth reference time has elapsed without the door being unlocked, the store entry management device outputs a fourth guidance.

6. The store entry management device according to claim 5, The store entry management device further comprises a notification means for notifying an operations center when a fifth reference time has elapsed after the fourth guidance has been given.

7. The entrance management device When a human presence sensor installed at the entrance of the store detects a person, an output device installed at the entrance outputs audio guidance on how to enter the store, Acquiring authentication information for authenticating a person from a terminal provided at the entrance; unlocking the entrance door when the acquired authentication information satisfies a criterion; determining whether the voice guidance is required based on a location where a person is detected that is included in a detection result of the human presence sensor before acquiring the authentication information, and controlling an output of the voice guidance; The terminal is installed next to the door, The store entry management device, outputting a first guidance when the human presence sensor detects a human before the terminal starts a process of acquiring the authentication information; If the human presence sensor continues to detect a human even after the first guidance is output, a second guidance different from the first guidance is output; A store entry management method, wherein the volume of the second guidance is lower than the volume of the first guidance.

8. On the computer, a step of outputting audio guidance on how to enter the store from an output device provided at the entrance when a human presence sensor installed at the entrance detects a human; acquiring authentication information for authenticating a person from a terminal provided at the entrance; executing a procedure of unlocking the entrance door if the acquired authentication information satisfies a criterion; in the step of outputting the authentication information, a step of determining whether the voice guidance is necessary or not based on a location of a person detected by the human presence sensor before the authentication information is acquired, and controlling output of the voice guidance; The terminal is installed next to the door, The computer includes: a step of outputting a first guidance when the human presence sensor detects a human before the terminal starts a process of acquiring the authentication information; if the human presence sensor continues to detect a human even after the first guidance is output, a second guidance different from the first guidance is output; A program, wherein a volume of the second guidance is lower than a volume of the first guidance.

Images