Unattended store operation support device and unattended store operation support method

Abstract

To efficiently configure and operate an unmanned store without gates and to allow a user to appropriately experience purchase in the unmanned store.SOLUTION: An unmanned store operation support device 100 includes: a communication device 105 which communicates with an authentication unit, a distance sensor, and a weight sensor on a commodity shelf which are arranged in an unmanned store; and an arithmetic unit 104 which performs processing of acquiring authentication data relating to a store user from the authentication unit, processing of user authentication based on the authentication data, processing of specifying the commodity shelf at which the store user exists, on the basis of a position monitoring result of the store user by the distance sensor, and processing of specifying store takeout operation of a prescribed commodity by the store user at the commodity shelf on the basis of measurements of the distance sensor and the weight sensor, wherein when a situation that the store user is leaving a prescribed area in the unmanned store is specified on the basis of the monitoring result of the distance sensor, payment procedures for the prescribed commodity which store the takeout operation is specified for the store user is executed.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an unmanned store operation support device and an unmanned store operation support method.

Background Art

[0002] In order to provide a new shopping experience for store users and to make the store operation smarter and more efficient, so-called unmanned stores have been proposed. In an unmanned store, a series of purchase actions are monitored and controlled, starting from the authentication control of users at the gate of the store entrance / exit, through the selection of products by the users, bringing them to the payment device and the payment process, to the exit control of the users at the above-mentioned gate. As related prior art for such unmanned stores, an unmanned store system, its control method and its computer program, as well as an unmanned cash register device (see Patent Document 1) have been proposed.

[0003] This technology relates to an unmanned store system including an authentication device that acquires personal information from a part of the user's body, transmits the personal information to a first server, and receives authentication of the personal information from the first server, and a gate control device that opens the gate so that the user can enter or exit the store if the authentication device receives authentication, and an unmanned cash register device that acquires personal information from a part of the user's body, transmits the personal information to a second server, and settles the product amount if it receives authentication of the personal information from the second server.

[0004] Also, technologies (see Patent Document 2) have been proposed to avoid substitution of users who have purchased products and to appropriately grasp users who have left the store without purchasing products in face authentication in the store.

[0005] This technology relates to an unmanned store system that manages the usage status of an unmanned store by face authentication by pre-registered users. It includes a first face authentication machine that acquires a face image of a user when entering the store using a first camera and performs processing related to face authentication to permit the user to enter the store based on the face image at the time of entry, a second face authentication machine that acquires a face image of the user at the time of settlement using a second camera and performs processing related to face authentication to permit the user to settle based on the face image at the time of settlement, and a third face authentication machine that acquires a face image of the user when leaving the store using a third camera and performs processing related to face authentication to confirm the user's departure from the store based on the face image at the time of departure.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0007] However, in order to operate an unmanned store as described above, it was necessary to prepare an appropriate space within the facility for installing gates. There were also problems such as the high cost of introducing the gates themselves, leading to an increase in the installation cost of the unmanned store. On the other hand, even if one attempts to easily install and operate a gate-less unmanned store, it is highly likely that users visiting such an unmanned store will find it difficult to intuitively understand how to enter the store and perform the purchase operation, and also how to leave the store. As a result, the user will wander around the store with a complex flow line, leading to problems such as a decrease in user satisfaction and store sales efficiency. will also occur.

[0008] Therefore, an object of the present invention is to provide a technology that efficiently configures and operates a cashierless unmanned store and provides an appropriate purchasing experience for users in the unmanned store.

Means for Solving the Problems

[0009] The unmanned store operation support device of the present invention for solving the above problems includes a communication device that communicates with an authentication unit, a distance sensor, and a weight sensor of a commodity shelf arranged in the unmanned store, a process of acquiring authentication data regarding a store user from the authentication unit, a process of user authentication based on the authentication data, a process of specifying the commodity shelf where the store user is located based on the position monitoring result by the distance sensor regarding the store user, a process of specifying, regarding a predetermined commodity taken out by the store user on the commodity shelf, based on observed values of the distance sensor and the weight sensor, and when a situation where the store user leaves a predetermined area in the unmanned store is specified based on the monitoring result of the distance sensor, a process of executing a settlement procedure for the predetermined commodity for which the taking-out operation has been specified regarding the store user, and an arithmetic unit that executes It has, for each pattern combining the status of the purchasing behavior of a store user, the condition of the outstanding or success / failure of the user authentication, and the condition of the taking-out operation of the store user, holds information on predetermined voice output content, collates the status of the purchasing behavior of a predetermined store user, the outstanding or success / failure of the user authentication regarding the store user, and each information on the taking-out operation of the store user with the pattern, and executes voice output by a predetermined output device based on the information on the voice output content corresponding to the matched pattern. characterized in that Further, the unmanned store operation support method of the present invention is such that an information processing device includes a communication device that communicates with an authentication unit, a distance sensor, and a weight sensor of a commodity shelf arranged in the unmanned store, a process of acquiring authentication data regarding a store user from the authentication unit, a process of user authentication based on the authentication data, a process of specifying the commodity shelf where the store user is located based on the position monitoring result by the distance sensor regarding the store user, a process of specifying, regarding a predetermined commodity taken out by the store user on the commodity shelf, based on observed values of the distance sensor and the weight sensor, and when a situation where the store user leaves a predetermined area in the unmanned store is specified based on the monitoring result of the distance sensor, a process of executing a settlement procedure for the predetermined commodity for which the taking-out operation has been specified regarding the store user And, for each pattern combining the status of the purchasing behavior of a store user, the condition of the outstanding or success / failure of the user authentication, and the condition of the taking-out operation of the store user, which is held in advance, collates the status of the purchasing behavior of a predetermined store user, the outstanding or success / failure of the user authentication regarding the store user, and each information on the taking-out operation of the store user with the information on the predetermined voice output content, and performs a process of voice output by a predetermined output device based on the information on the voice output content corresponding to the matched pattern. characterized by executing.

Advantages of the Invention

[0010] According to the present invention, it is possible to efficiently configure and operate a cashierless unmanned store and to provide an appropriate purchase experience for users in the unmanned store.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Modes for Carrying Out the Invention

[0012] <Network Configuration> Embodiments of the present invention will be described in detail below with reference to the drawings. FIG. 1 is a network configuration diagram including the unmanned store operation support device 100. The unmanned store operation support device 100 shown in FIG. 1 is a computer that efficiently configures and operates a gate-less unmanned store and provides an appropriate purchase experience for users in the unmanned store.

[0013] As shown in FIG. 1, the unmanned store operation support device 100 of the present embodiment is communicably connected to at least an authentication display 150, an optical radar 160, a weight sensor 175, and a monitor 180 via a network 1. Therefore, these may be collectively referred to as an unmanned store operation system 10. Also, as shown in the figure, the unmanned store operation support device 100 is communicably connected to a user terminal 200, an authentication infrastructure 300, and a settlement infrastructure 400 via the network 1.

[0014] The unmanned store operation support device 100 of the present embodiment can be said to be a service providing device of the unmanned store operating company itself or an operator commissioned by the operating company to operate the unmanned store.

[0015] On the other hand, the authentication display 150 is a device installed in an entrance area where an area is defined in advance among the spaces constituting the unmanned store. In addition to a communication device corresponding to the network 1, it includes a camera 155 and a touch panel 156.

[0016] Among these, the camera 155 is a digital camera that captures a living body part of a store user who visits the entrance area, for example, the face, and acquires and generates face image data or feature amount data of the store user.

[0017] Also, the touch panel 156 receives the input of the ID from the store user whose face is to be photographed by the above-mentioned camera 155.

[0018] Each store user of the unmanned store is assumed to have previously executed a user registration process with the authentication infrastructure 300 via the unmanned store operation support device 100 (or the user terminal 200).

[0019] In this case, the unmanned store operation support device 100 captures the face image of the store user with the camera 155 and inputs the ID held in advance using the touch panel 156. The unmanned store operation support device 100 sets the face image data (or its feature quantity data) and the ID thus obtained and performs the user registration process on the authentication infrastructure 300. For the user registration process itself that sets the biometric information and the ID, an existing method may be appropriately adopted.

[0020] Therefore, the store user for whom the above user registration has been completed stands in front of the authentication display 150 and performs face capture by the camera 155 and ID input by the touch panel 156, thereby proceeding with the user authentication procedure on the authentication infrastructure 300 via the unmanned store operation support device 100.

[0021] Note that the information defining the above entry area includes the coordinate values of each vertex constituting the shape of the area. Also, the origin coordinates of the coordinate system including the coordinate values indicate a point at any location (previously defined) in the space constituting the unmanned store.

[0022] Subsequently, the optical radar 160 is specifically a 3D LiDAR, which irradiates infrared laser light in a three-dimensional manner and can measure the shape of the irradiated target area and the objects existing therein and the distance thereto.

[0023] The optical radar 160 in the present embodiment is responsible for grasping the space constituting the unmanned store, the entry area and the purchase area in the space, the location of the store user, and the specific process of the reach target position (i.e., the product located at that position) on the product shelf. The observation values by the optical radar 160 are distributed to the unmanned store operation support device 100 via the network 1. ​

[0024] Further, the weight sensor 175 is installed at each product storage position of the product shelf 170, and distributes its measurement results to the unmanned store operation support device 100 via the network 1. The unmanned store operation support device 100 shall hold and manage information on the weight of each product stored, i.e., displayed, in each section of such a product shelf 170 in the product management DB 126.

[0025] Also, the monitor 180 is a display device installed around the above-described product shelf 170, i.e., in the purchase area, and is also equipped with an appropriate speaker. The monitor 180 outputs the information distributed from the unmanned store operation support device 100 to the screen or outputs it as audio.

[0026] The information output to the screen may include, in addition to advertisements for store users, the status of the purchase behavior of the store user (any one of in the store, purchasing, and settling).

[0027] Also, the information output as audio includes a message for guiding actions that optimizes the actions of the store user according to the status of the purchase behavior classified for the store user, the outstanding or success / failure of user authentication for the store user, and the product removal operation of the store user.

[0028] Also, the user terminal 200 is a terminal used by a store user of an unmanned store when using the service. Specifically, a smartphone, a tablet terminal, a personal computer, etc. can be assumed.

[0029] In addition, although the authentication infrastructure 300 is not particularly limited, in this embodiment, it is assumed by way of example that the applicant has developed and is already providing PBI (Public Biometric Infrastructure). This PBI is an authentication infrastructure technology that achieves both privacy protection and high security by converting biometric information of the person to be authenticated into an irrecoverable form and using this as a public key. The authentication infrastructure 300 receives a user authentication request from the unmanned store operation support device 100 through an API (Application Programming Interface) and responds with the authentication result.

[0030] In addition, the payment infrastructure 400 is, for example, a credit card payment platform, and also receives a payment request from the unmanned store operation support device 100 (regarding the products taken out by the store user from the product shelf 170 and carried out from the purchase area) through an API (Application Programming Interface) and responds with the payment result. <Hardware Configuration> In addition, the hardware configuration of the unmanned store operation support device 100 of this embodiment is as follows in FIG. 2.

[0031] That is, the unmanned store operation support device 100 includes a storage device 101, a memory 103, an arithmetic device 104, and a communication device 105.

[0032] Among these, the storage device 101 is composed of an appropriate non-volatile memory element such as an SSD (Solid State Drive) or a hard disk drive.

[0033] In addition, the memory 103 is composed of a volatile memory element such as a RAM (Random Access Memory).

[0034] The arithmetic unit 104 is a CPU (Central Processing Unit) that reads and executes the program 102 stored in the storage device 101 into the memory 103 to perform overall control of the device itself and perform various determinations, calculations, and control processes.

[0035] Further, the communication device 105 is connected to the network 1 and is assumed to be a network interface card or the like that is responsible for communication processing between the authentication display 150, the optical radar 160, the weight sensor 175, the monitor 180, the user terminal 200, the authentication infrastructure 300, and the settlement infrastructure 400.

[0036] In addition to the program 102 for implementing the functions required for the unmanned store operation support device of the present embodiment, a user management DB 125, a product management DB 126, a basket management DB 127, and a voice guidance determination table 128 are at least stored in the storage device 101. However, the details of these databases and tables will be described later.

[0037] In addition to the above-described configuration, the unmanned store operation support device 100 may further include at least any one of the authentication display 150, the camera 155, the touch panel 156, the optical radar 160, the product shelf 170, the weight sensor 175, and the monitor 180. <Example of data structure> Subsequently, various types of information used by the unmanned store operation support device 100 of the present embodiment will be described. FIG. 3 shows an example of the user management DB 125 in the present embodiment.

[0038] The user management DB 125 of the present embodiment is a database that stores information of store users. This user management DB 125 is, for example, a collection of records that associate data such as the result of user authentication, the location, the status of the purchase behavior in the unmanned store and the observation time, and the target product for each store user with the ID of each store user as a key.

[0039] Next, FIG. 4 shows an example of the product management DB 126 in the present embodiment. The product management DB 126 in the present embodiment is a database that stores information on products displayed and sold on the product shelves 170 of the unmanned store.

[0040] This product management DB 126 is, for example, a collection of records that associate data such as the name, price, weight, product shelf 170 in which the product is stored, storage section on the product shelf 170, and storage status of the product, etc., with a product ID that uniquely identifies the product as a key.

[0041] Next, FIG. 5 shows an example of the basket management DB 127 in the present embodiment. The basket management DB 127 in the present embodiment is a database that stores, for each purchase opportunity, records generated in response to an event of a store user taking out a product from the product shelf 170, that is, information on the product that has become the purchase target by the store user.

[0042] This basket management DB 127 is, for example, a collection of records that associate data such as the ID of the target product, product name, price, quantity, date and time of removal from the product shelf 170, etc., with the ID of the store user as a key.

[0043] Next, FIG. 6 shows a configuration example of the voice guidance decision table 128 in the present embodiment. The voice guidance decision table 128 in the present embodiment defines a message for guiding actions that optimizes the actions of the store user according to the combination pattern of the status of the purchase action classified for the store user, the outstanding or success / failure of user authentication for the store user, and the product retrieval operation of the store user.

[0044] Specifically, it is a collection of records that associate information such as case classification, situation, and voice content with the status of the purchase action as a key.

[0045] Among these, the case classification is, for example, "normal" when user authentication is successful, "abnormal" in any of the cases of unregistered user, failure, and outstanding, and "abnormal" when the user enters the purchase area or takes out a product without completing user authentication. Also, the situation is the content that classifies the specific situations in each of those case classifications. <Flow Example: Product Purchase and Settlement> Hereinafter, the actual procedure of the unmanned store operation support method in the present embodiment will be described with reference to the drawings. Various operations corresponding to the unmanned store operation support method described below are realized by a program that the unmanned store operation support device 100 reads out and executes in a memory or the like. And this program is composed of codes for performing various operations described below.

[0046] FIG. 7 and FIG. 8 are diagrams showing flow examples of the unmanned store operation support method in the present embodiment. Here, it is assumed that a store user who has already registered for use in advance visits the operation facility of an unmanned store (e.g., a commercial building, an office building, inside a station of a public transportation facility, etc.) and tries to view and purchase products in the unmanned store. And it is assumed that the store user is attracted by a guidance sign or the like arranged around the unmanned store and tries to perform an operation in front of the authentication display 150.

[0047] In this case, the authentication display 150, in response to the approach detection or a predetermined operation of the above-described store user, executes photographing of the face image of the store user by the camera 155 and acceptance of ID input by the touch panel 156 (s10).

[0048] Also, the authentication display 150 notifies the unmanned store operation support device 100 of a user authentication request including the face image data (or its feature amount data) and the ID obtained in s10 through the network 1 (s11).

[0049] On the other hand, the unmanned store operation support device 100 transmits the user authentication request received from the authentication display 150 to the authentication base 300, obtains the authentication processing result there, and responds to the authentication display 150 (s12).

[0050] The authentication display 150 obtains a response from the unmanned store operation support device 100 at s12 and displays it on the touch panel 156 as a result of user authentication (see FIG. 9) (s13).

[0051] During such processing, it is assumed that the optical radar 160 is performing sensing on the above-mentioned store users and is sensing the location of the store users within the unmanned store. In addition, the location information sensed by the optical radar 160 is notified to the unmanned store operation support device 100 via the network 1 at any time or at regular intervals (s1).

[0052] Therefore, the unmanned store operation support device 100 collates the location information of the store users notified from the optical radar 160 with the range information of each area (refer to the concept in FIG. 10) of the store user entry area, purchase area, and other areas (a closed space defined by the coordinate values of each location indicating the area boundary of the space as a coordinate system) that make up the unmanned store, and determines in which area the store user is located (s2).

[0053] In addition, the unmanned store operation support device 100 classifies the status of the purchase behavior of the store user into one of "entering the store", "purchasing", and "settling" according to the area specified in the determination of s2 (s3). The result is stored in the user management DB 125 together with the location and the observation date and time.

[0054] When the location is the entry area, the status of the purchase behavior of the store user is "entering the store". When the location is the purchase area, the status of the purchase behavior of the store user is "purchasing". When the location is neither the entry area nor the purchase area, the status of the purchase behavior of the store user is "settling".

[0055] However, when making such a classification, not only the location but also whether the store user takes out the product (described later) shall be taken into consideration. That is, when classified as "in settlement", it is determined as "in settlement" when the store user leaves the purchase area while having taken out and held the product from the product shelf 170 of the unmanned store.

[0056] In addition, the unmanned store operation support device 100 associates the classification result in s3 with the ID of the store user or a predetermined icon, etc., and displays it on the monitor 180 (see FIG. 11) (s4).

[0057] Although it is also conceivable to distribute information to the user terminal 200 of the store user whose contact information, etc. has been registered in advance instead of displaying it on the monitor 180, in order to be able to handle the situation where the store user does not have a user terminal 200 such as a smartphone, the operation of displaying on the monitor 180 is suitable for handling.

[0058] As for the store user, even if not carrying a special terminal, etc., it is possible to objectively overlook the status of their own purchase behavior and their location in the unmanned store at any time, and it becomes less likely that mistakes, etc. will occur regarding their actions in the store.

[0059] On the other hand, the store user who has recognized the result notification of successful user authentication (s13) on the authentication display 150 moves to the product shelf 170 arranged in the unmanned store, picks up each product displayed there and views it for confirmation, and makes a purchase decision.

[0060] At this time, the optical radar 160 observes the stretching motion of the store user towards the above-mentioned product, and notifies the unmanned store operation support device 100 of the information on the storage section in the product shelf 170 that is the target of the stretching motion (s14).

[0061] Also, at this time, the weight sensors 175 installed in each storage section of the merchandise shelf 170 also observe the weight change caused by the merchandise being picked up by the store user, and notify the unattended store operation support device 100 of the information on the weight change, that is, the information indicating that the weight of the contents being measured has become zero (s15). Of course, if the merchandise once picked up is returned to the original storage section, the weight sensor 175 observes the event that the weight of the contents has returned from zero to the merchandise weight, and notifies the unattended store operation support device 100 of the information to that effect.

[0062] The unattended store operation support device 100 synthesizes each notification received in s14 and s15, and senses that an reaching-out action has been taken in a certain storage section of the merchandise shelf 170 and that the weight of the merchandise stored in that storage section has become zero, that is, has been taken out (s16).

[0063] At this time, the unattended store operation support device 100 specifies the merchandise to be taken out using the information on the merchandise shelf 170 and the storage section as keys in the merchandise management DB 126, and sets the information on the merchandise in the "target merchandise" column of the record of the store user in the user management DB 125 (s1 7).

[0064] Thereafter, the unattended store operation support device 100 repeats each of the above processes s14 to s17 according to the trend of the store user, and updates the status of the purchase behavior of the store user.

[0065] At that time, if the unattended store operation support device 100 senses the timing when the status of the purchase behavior of the store user in the user management DB 125 has changed from "purchasing" to "settling" (s18: Y), for the merchandise managed by the basket management DB 127 for the store user, that is, the merchandise taken out from the merchandise shelf 170 and in a state of having left the purchase area, it aggregates the settlement amount based on the price and quantity values of the merchandise (s19).

[0066] Note that the unmanned store operation support device 100 determines, based on the information on the entrance area and the purchase area among the spaces constituting the unmanned store, that the store user who has taken out a product has left the purchase area, that is, the status of the purchase action has changed from during purchase to during settlement, based on the monitoring result by the optical radar 160.

[0067] In addition, when the status of the purchase action of such a store user changes, the unmanned store operation support device 100 associates the status of the purchase action after the change with the identification information of the store user and displays it on the monitor 180 in the same form as in FIG. 11.

[0068] Returning to the original explanation here. The unmanned store operation support device 100 that performed the aggregation in S19 transmits a settlement request including the settlement amount information aggregated in S19 to the settlement platform 400 (S20).

[0069] In this case, based on the settlement request, the settlement platform 400 refers to the registration information of the above-mentioned store user who is the main settlement party, that is, the information on the settlement means such as a credit card, executes a predetermined settlement process, and responds with the result to the unmanned store operation support device 100.

[0070] The unmanned store operation support device 100 receives the response from the settlement platform 400, outputs this as the result of the settlement process (see FIG. 12) (S21), and ends the process.

[0071] The output in this case can be assumed to be, for example, the case of sending a message to a pre-registered email address or mobile phone number of the store user. The store user can view the message on an appropriate terminal such as the user terminal 200 and recognize the information on the purchase of products in the unmanned store. <Flow Example: Voice Output> Subsequently, the processing of voice output to the store user in the unmanned store operation support method of the present embodiment will be described. FIG. 13 is a diagram showing a flow example of the unmanned store operation support method in the present embodiment.

[0072] Here, based on the status of the purchase behavior of the above-mentioned store user, the outstanding or success / failure of user authentication, and the product retrieval status, a process of outputting an appropriate voice message for the store user from the authentication display 150, the monitor 180, or the user terminal 200 will be described.

[0073] As already described, when operating a so-called gate-less unmanned store, since there is no structure that can be immediately recognized as an icon, there is a risk that the store user may be confused about their actions inside the unmanned store.

[0074] On the other hand, the unmanned store operation support device 100 of the present embodiment can prompt the store user on the spot to modify incorrect actions or execute insufficient actions, etc., by outputting an appropriate guiding voice message according to the situation where the store user is placed at each time.

[0075] In this case, the unmanned store operation support device 100 refers to the "authentication result" column, "purchase behavior status" column, and "target product" column in the user management DB 125 respectively, and specifies the outstanding or success / failure status of user authentication, the status of purchase behavior, and the status of product retrieval operation (s30).

[0076] Subsequently, the unmanned store operation support device 100 collates the values specified in s30 with the voice guidance decision table 128 (Fig. 6), and specifies a record in which the "status" of the purchase behavior matches and the "situation" matches the outstanding or success / failure of user authentication and the product retrieval status (s31).

[0077] For example, if the status of a certain store user's purchase behavior is "purchasing", that is, the user is located in the purchase area, but user authentication has not been performed, in the example of Fig. 6, a record corresponding to "entered the purchase area without authentication" of No. 7 will be specified.

[0078] Subsequently, the unmanned store operation support device 100 acquires the text data in the "voice content" column of the record specified in s31, outputs the voice instruction to the authentication display 150, the monitor 180, or the user terminal 200 (s32), and ends the process. In the example of the No. 7 record in FIG. 6 described above, the voice "Not authenticated." will be output.

[0079] As described above, the best mode for carrying out the present invention has been specifically described. However, the present invention is not limited to this, and various modifications can be made without departing from the gist thereof.

[0080] According to this embodiment, it is possible to efficiently configure and operate a gate-less unmanned store and to make the purchase experience of users in the unmanned store appropriate.

[0081] From the description of this specification, at least the following is clarified. That is, in the unmanned store operation support device of the present embodiment, the arithmetic device previously holds information on at least a purchase area including the arrangement position of the product shelves among the spaces constituting the unmanned store, and when executing the settlement procedure for the store user, it may be specified based on the monitoring result by the distance sensor that the store user has left the purchase area of the unmanned store.

[0082] According to this, it is possible to accurately grasp the situation where the store user has moved out of the unmanned store while holding the product taken out from the product shelf as the intention of the store user to purchase and settle, and to complete the settlement process without any special procedures or operations. As a result, it is possible to efficiently configure and operate a gate-less unmanned store and to make the purchase experience of users in the unmanned store more appropriate.

[0083] Further, in the unmanned store operation support device according to the present embodiment, the arithmetic unit further holds information on the entry area including the arrangement position of the authentication unit among the spaces constituting the unmanned store, and based on the monitoring result of the distance sensor regarding the location of the store user, classifies the status of the purchase behavior of the store user in the unmanned store into any one of in the process of entering the store corresponding to the entry area, in the process of purchasing corresponding to the purchase area, and in the process of settlement when leaving the purchase area, associates the result of the classification with the identification information of the store user, and further executes a process of displaying it on a predetermined monitor in the unmanned store.

[0084] According to this, the store user can easily check their own status on the monitor installed in the unmanned store without checking the status using a specific information processing terminal or the like. As a result, the configuration and operation of the unmanned store without a gate can be efficiently carried out, and the purchase experience of the users in the unmanned store can be made more appropriate.

[0085] Further, in the unmanned store operation support device according to the present embodiment, the arithmetic unit holds information on the voice output content determined in advance for each pattern combining the status of the purchase behavior of the store user, the condition of the outstanding or success / failure of the user authentication, and the condition of the taking-out operation of the store user, collates the classified status of the purchase behavior regarding the store user, the outstanding or success / failure of the user authentication regarding the store user, and each information of the taking-out operation of the store user with the pattern, and based on the information on the voice output content corresponding to the pattern that matches, executes voice output using a predetermined output device.

[0086] According to this, for example, by appropriately performing voice announcements from the system side according to the appropriateness of the actions of the store user, the actions of the store user can be guided to appropriate purchase actions. As a result, the configuration and operation of the unmanned store without a gate can be efficiently carried out, and the purchase experience of the users in the unmanned store can be made more appropriate.

[0087] Further, in the unmanned store operation support method according to the present embodiment, the information processing device may previously hold information on a purchase area including at least the arrangement position of the product shelves among the spaces constituting the unmanned store, and when executing the settlement procedure for the store user, the store user leaving the purchase area of the unmanned store may be specified based on the monitoring result by the distance sensor.

[0088] Further, in the unmanned store operation support method according to the present embodiment, the information processing device may further hold information on an entrance area including the arrangement position of the authentication unit among the spaces constituting the unmanned store, and based on the monitoring result of the distance sensor regarding the location of the store user, classify the status of the purchase behavior of the store user in the unmanned store into any one of in-store corresponding to the entrance area, during purchase corresponding to the purchase area, and during settlement when leaving the purchase area, and further execute a process of associating the result of the classification with the identification information of the store user and displaying it on a predetermined monitor in the unmanned store.

[0089] Further, in the unmanned store operation support method according to the present embodiment, the information processing device holds information on voice output content predetermined for each pattern combining the status of the purchase behavior of the store user, the condition of the outstanding or success / failure of user authentication, and the condition of the taking-out operation of the store user, collates the classified status of the purchase behavior regarding the store user, the outstanding or success / failure of user authentication regarding the store user, and each information on the taking-out operation of the store user with the pattern, and based on the information on the voice output content corresponding to the pattern that matches, executes voice output with a predetermined output device.

Explanation of Signs

[0090] 1 Network 10 Unmanned Store Operation System 100 Unmanned Store Operation Support Device 101 Storage Device 102 Program 103 Memory 104 Computing device 105 Communication device 125 User management DB 126 Product management DB 127 Basket management DB 128 Voice guidance decision table 150 Authentication unit 155 Camera 156 Touch panel 160 Optical radar 170 Product shelf 175 Weight sensor 180 Monitor 200 User terminal 300 Authentication infrastructure 400 Payment infrastructure

Claims

1. A communication device that communicates with an authentication unit, a distance sensor, and a weight sensor of a product shelf arranged in a unmanned store, a process of acquiring authentication data regarding a store user from the authentication unit, a process of authenticating the user based on the authentication data, a process of identifying the product shelf where the store user is located based on the position monitoring result by the distance sensor regarding the store user, a process of identifying, regarding the product taking-out operation of a predetermined product by the store user on the product shelf, based on the observed values of the distance sensor and the weight sensor, and when a situation where the store user leaves a predetermined area in the unmanned store is identified based on the monitoring result of the distance sensor, a process of executing a settlement procedure for the predetermined product for which the taking-out operation has been identified regarding the store user, and an arithmetic unit that executes the processes, holds information on voice output contents determined in advance for each pattern combining the status of the purchase behavior of the store user, the condition of the outstanding or success / failure of the user authentication, and the condition of the taking-out operation of the store user, collates each information on the status of the purchase behavior of a predetermined store user, the outstanding or success / failure of the user authentication regarding the store user, and the taking-out operation of the store user with the pattern, and based on the information on the voice output contents corresponding to the matching pattern, executes voice output by a predetermined output device, A unmanned store operation support device characterized by the above.

2. The arithmetic unit, holds in advance information on a purchase area including at least the arrangement position of the product shelf among the spaces constituting the unmanned store, when executing the settlement procedure regarding the store user, identifies that the store user has left the purchase area of the unmanned store based on the monitoring result by the distance sensor, The unmanned store operation support device according to Claim 1, characterized by the above.

3. The arithmetic unit, further holds information on an entrance area including the arrangement position of the authentication unit among the spaces constituting the unmanned store, Based on the monitoring result of the distance sensor regarding the location of the store user, the status of the purchasing behavior of the store user in the unmanned store is classified into one of the following: during entry corresponding to the entry area, during purchase corresponding to the purchase area, and during settlement when leaving the purchase area. The result of this classification is associated with the identification information of the store user and further processed to be displayed on a predetermined monitor in the unmanned store. The unmanned store operation support device according to claim 2, characterized in that.

4. The information processing device is provided with a communication device that communicates with an authentication unit, a distance sensor, and a weight sensor of a commodity shelf arranged in the unmanned store, performs processing to obtain authentication data regarding a store user from the authentication unit, performs user authentication processing based on the authentication data, performs processing to identify the commodity shelf where the store user is located based on the position monitoring result by the distance sensor regarding the store user, performs processing to identify the taking-out operation of a predetermined commodity by the store user on the commodity shelf based on the observed values of the distance sensor and the weight sensor, when identifying a situation where the store user leaves a predetermined area in the unmanned store based on the monitoring result of the distance sensor, performs processing to execute a settlement procedure for the predetermined commodity for which the taking-out operation has been identified regarding the store user, and for each pattern combining the status of the purchasing behavior of the store user, the condition of the outstanding or success / failure of the user authentication, and the condition of the taking-out operation of the store user, which are held in advance, collates the information on the status of the purchasing behavior of a predetermined store user, the outstanding or success / failure of the user authentication regarding the store user, and each piece of information on the taking-out operation of the store user with the information on the voice output content determined in advance, and based on the information on the voice output content corresponding to the matching pattern, performs voice output processing using a predetermined output device. A method for supporting the operation of an unmanned store, characterized by executing the above.

5. The information processing device previously holds information on at least the purchase area including the arrangement position of the commodity shelf among the spaces constituting the unmanned store, when executing the settlement procedure regarding the store user, identifies that the store user has left the purchase area of the unmanned store based on the monitoring result by the distance sensor. The method for supporting the operation of an unmanned store according to claim 4, characterized in that.

6. The information processing device Among the spaces constituting the unmanned store, further hold information on the entrance area including the arrangement position of the authentication unit. Based on the monitoring result of the distance sensor regarding the location of the store user, classify the status of the purchase behavior of the store user in the unmanned store into any one of being in the process of entering the store corresponding to the entrance area, being in the process of purchasing corresponding to the purchase area, and being in the process of settlement when leaving the purchase area, associate the result of the classification with the identification information of the store user, and further execute a process of displaying on a predetermined monitor in the unmanned store. The unmanned store operation support method according to claim 5, characterized in that.

Images