Cash register support device, method, and program

Abstract

This allows employees to notice when a customer has come to the register, even if the customer doesn't take any action. [Solution] The register status determination unit (11) determines whether or not there is an employee at the register installed in the store. The register waiting line determination unit (12) determines whether or not there are customers waiting in line at the register in the store. If the register status determination unit (11) determines that there is no employee at the register and the register waiting line determination unit (12) determines that there are customers waiting in line, the notification unit (13) notifies the employee that there are customers waiting in line.

Description

[[Technical Field]]

[0001] The present disclosure relates to a checkout operation support apparatus, a method, and a computer-readable medium. [[Background Art]]

[0002] As a related art, Patent Document 1 discloses an accounting operation support apparatus that supports accounting operations in a store. In Patent Document 1, the accounting operation support apparatus detects the state of customers waiting for checkout based on video of an area where customers waiting for checkout stay. Further, the accounting operation support apparatus detects the state of a person staying in the store based on video obtained by capturing the inside of the store. The accounting operation support apparatus determines, according to the state of customers waiting for checkout and the congestion state in the store, whether to permit notification that instructs a store clerk or a store manager to take an action to reduce customers' waiting time for checkout.

[0003] Specifically, in Patent Document 1, when a checkout counter is in operation, there are many customers waiting for checkout, and the inside of the store is congested, the accounting operation support apparatus issues notification instructing support for checkout work at the checkout counter to a portable terminal possessed by a store clerk or a store manager. Even when there are many customers waiting for checkout, if the inside of the store is not congested, the accounting operation support apparatus does not carry out notification instructing support for checkout work at the checkout counter. When the checkout counter is not in operation and the inside of the store is congested, the accounting operation support apparatus transmits a checkout operation start instruction to the portable terminal. [[Prior Art Documents]] [[Patent Documents]]

[0004] [[Patent Document 1]] Japanese Unexamined Patent Application Publication No. 2015-148918 [[Summary of the Invention]] [[Problem to be Solved by the Invention]]

[0005] Some stores may have self-checkout machines. However, if customers approaching the checkout counter are unable to properly determine whether or not they are eligible to use a self-checkout machine, they may not be able to use the self-checkout machines efficiently.

[0006] In light of these circumstances, one of the objectives of this disclosure is to provide a cashier support device, method, and computer-readable medium that can determine whether or not a customer waiting in line at the register is eligible to use a self-checkout register. [Means for solving the problem]

[0007] To achieve the above objective, this disclosure provides, in a first aspect, a cashier support device. The cashier support device includes a cashier status determination unit that determines whether or not there is an employee at a cashier installed in a store, a cashier queue determination unit that determines whether or not there are customers waiting in line at the cashier in the store, and a notification unit that notifies the employee that there are customers waiting in line at the cashier when it is determined that there is no employee at the cashier and that there are customers waiting in line.

[0008] This disclosure provides, in a second aspect, a method for supporting cashier operations. The cashier operation support method includes determining whether or not there is an employee at a cashier installed in a store, determining whether or not there are customers waiting in line at the cashier in the store, and if it is determined that there is no employee at the cashier and that there are customers waiting in line, notifying the employee that there are customers waiting in line.

[0009] This disclosure provides, in a third aspect, a computer-readable medium. The computer-readable medium stores a program that causes a computer to perform a process including determining whether or not there is an employee at a cash register installed in a store, determining whether or not there are customers waiting in line at the cash register in the store, and, if it is determined that there is no employee at the cash register and there are customers waiting in line, notifying the employee that there are customers waiting in line. [Effects of the Invention]

[0010] The cashier support device, method, and computer-readable media relating to this disclosure enable employees to notice when a customer has come to the cashier, even if the customer does not take any action. [Brief explanation of the drawing]

[0011] [Figure 1] A block diagram showing a schematic configuration example of the cashier support device related to this disclosure. [Figure 2] A block diagram showing an example configuration of a cashier support system including a cashier support device according to the first embodiment of this disclosure. [Figure 3] A schematic diagram showing an example of a store layout and the placement of cameras within the store. [Figure 4] A flowchart illustrating the operating procedure of a cash register support device. [Figure 5] A block diagram showing a cashier support device according to a second embodiment of this disclosure. [Figure 6] A block diagram showing a cashier support device according to the third embodiment of this disclosure. [Figure 7] A block diagram showing an example of a computer device configuration. [Modes for carrying out the invention]

[0012] Prior to describing embodiments of this disclosure, an overview of this disclosure will be provided. Figure 1 shows a schematic example of the configuration of a cashier support device according to this disclosure. The cashier support device 10 includes a cashier status determination unit 11, a cashier waiting determination unit 12, and a notification unit 13.

[0013] The register status determination unit 11 determines whether or not there is an employee at the register installed in the store. The register queue determination unit 12 determines whether or not there are customers waiting in line at the register in the store. If the notification unit 13 determines that there is no employee at the register and that there are customers waiting in line at the register, it notifies the store employees that there are customers waiting in line at the register.

[0014] In this disclosure, if the notification unit 13 determines that there is no employee at the register and that there is a customer waiting in line at the register, it notifies the employee that there is a customer waiting in line. Upon receiving the notification, the employee will become aware that there is a customer waiting in line and can move to the register. In this disclosure, when the register is unattended and a customer approaches the register, the employee is notified of the presence of a customer waiting in line. Therefore, in this disclosure, the employee can become aware that a customer has come to the register even if the customer does not take any action.

[0015] The embodiments of this disclosure will be described in detail below with reference to the drawings. Note that the following description and drawings have been omitted and simplified as appropriate for clarity of explanation. Furthermore, in the following drawings, the same elements and similar elements are denoted by the same reference numerals, and redundant explanations are omitted where necessary.

[0016] Figure 2 shows an example configuration of a cashier support system including a cashier support device according to the first embodiment of this disclosure. The cashier support system 100 includes a cashier support device 110, cameras 200-1 to 200-n, and a store clerk terminal device 210, where n is an integer of 1 or more.

[0017] The cashier support device 110 is used to assist employees with cashier duties in stores where customers purchase goods. In this embodiment, the store in which the cashier support device 110 is used is a store where employees perform tasks other than cashier duties in the sales area or back room, at least temporarily, away from the cashier counter. Employees will move to the cashier as needed to perform cashier duties. The cashier support device 110 may be located in the store or in a separate location. The cashier support device 110 corresponds to the cashier support device 10 shown in Figure 1.

[0018] The clerk terminal device 210 is a terminal device used by an employee of a store. The clerk terminal device 210 may be, for example, a terminal device owned by an employee such as a smartphone or a tablet terminal. Alternatively, the clerk terminal device 210 may be a wearable terminal such as a smart watch. The clerk terminal device 210 is configured to enable wireless communication with the checkout operation support device 110.

[0019] Cameras 200-1 to 200-n are cameras arranged in a store and acquire images of a predetermined area in the store. The cameras 200-1 to 200-n include a camera that acquires an image or a video of an area of a checkout counter where a cash register is installed. Further, the cameras 200-1 to 200-n include a camera that acquires an image of an area on the sales floor side relative to the checkout counter. The camera that acquires an image of the area of the checkout counter and the camera that acquires an image of the area on the sales floor side relative to the checkout counter may be the same camera. In other words, one camera may be used to acquire both the image of the area of the checkout counter and the image of the area on the sales floor side relative to the checkout counter. Note that in the following description, unless there is a particular need for distinction, the cameras 200-1 to 200-n may also be referred to as the camera 200.

[0020] Figure 3 shows an example of the layout of a store and the installation status of the camera 200. In the store, a checkout counter is provided with a cash register at which an employee performs registration and payment of purchased products. The cash register is also called a POS (Point of Sales) terminal. The cash register arranged at the checkout counter may be a semi-self-checkout register in which an employee registers the purchased products and a customer performs payment at a payment machine. In addition to manned checkout registers that require employee involvement, the store may also be provided with an unmanned checkout register or a self-checkout register where the customer performs the process from registration of purchased products to payment.

[0021] In the example shown in Figure 3, cameras 200-1 to 200-5 are installed in the store. Camera 200-1 is a camera that acquires images of the cash register counter and the area in front of the cash register counter. Camera 200-2 is a camera that acquires images of the store entrance area. Cameras 200-3 to 200-5 are cameras 200 that acquire images of the area between the product display shelves, i.e., the aisle area. Each camera 200 may be a camera that acquires images or videos within a predetermined field of view, or it may be a 360-degree camera that can acquire 360-degree images in all directions (up, down, left, and right).

[0022] Returning to Figure 2, the cashier support device 110 includes an image acquisition unit 111, a cashier waiting determination unit 112, a cashier status determination unit 113, and a store clerk notification unit 114. Physically, the cashier support device 110 may be configured as a device having one or more processors and one or more memories. For example, at least some of the functions of each part within the cashier support device 110 may be realized by the processor executing processing according to instructions read from memory.

[0023] The video acquisition unit 111 acquires images or videos acquired by one or more cameras 200. The checkout line determination unit 112 determines whether or not there are customers waiting in line at the checkout. The checkout line determination unit 112 determines whether or not there are customers waiting in line at the checkout based on images acquired by cameras that acquire images of the area in front of the checkout, that is, images of the area on the sales floor side of the checkout counter. The checkout line determination unit 112 determines whether or not there are customers waiting in line at the checkout based on images acquired by camera 200-1 shown in Figure 3.

[0024] More specifically, the checkout line determination unit 112 performs image analysis on the image acquired by camera 200-1 to determine whether or not there is a person in front of the checkout counter. The checkout line determination unit 112 also determines whether or not a person has been standing in front of the checkout counter for a predetermined amount of time or longer. For example, if the checkout line determination unit 112 determines that there is a customer waiting in line, it determines that there is a customer waiting in line, if it determines that there is a person in front of the checkout counter and that the person has been standing in front of the checkout counter for 2 seconds or more. For example, if there is no person in front of the checkout counter, or if a person who was standing in front of the checkout counter moves away in less than 2 seconds, the checkout line determination unit 112 determines that there is no customer waiting in line. The checkout line determination unit 112 corresponds to the checkout line determination unit 12 shown in Figure 1.

[0025] The checkout line determination unit 112 may, in the event of image analysis, detect at least one of the gaze direction and face orientation of the person standing in front of the checkout counter. In addition to determining whether a person has been standing in front of the checkout counter for two seconds or more, or alternatively, the checkout line determination unit 112 may determine whether there are customers waiting in line based on the gaze direction or face orientation of the person standing in front of the checkout counter.

[0026] For example, the checkout line determination unit 112 may determine that there is a customer waiting in line if the person in front of the checkout counter is frequently facing the checkout counter. Alternatively, the checkout line determination unit 112 may determine that there is a customer waiting in line if the person in front of the checkout counter is looking at products such as cigarettes placed behind the checkout counter. The checkout line determination unit 112 may also determine that there is no customer waiting in line if the person in front of the checkout counter is not looking at the checkout counter, even if the person has been standing in front of the checkout counter for more than two seconds. It is believed that determining whether there is a customer waiting in line can be done more accurately by determining whether there is a customer waiting in line based on the direction of the gaze or the direction of the face. In other words, it is believed that it can be more accurately determined whether a person is simply standing in front of the checkout counter or whether a person is standing in front of the checkout counter to purchase products.

[0027] The register status determination unit 113 determines whether or not there is an employee at the register. The register status determination unit 113 determines whether or not there is an employee at the register based on an image acquired by a camera that acquires an image of the area inside the register counter. The register status determination unit 113 determines whether or not there is an employee at the register counter who is available to handle the register, based on an image acquired by camera 200-1 shown in Figure 3.

[0028] More specifically, the register status determination unit 113 performs image analysis on the image acquired by camera 200-1 to determine whether or not there is a person inside the register counter. If there is a person inside the register counter, the register status determination unit 113 determines that there is an employee at the register. If there is no person inside the register counter, the register status determination unit 113 determines that there is no employee at the register. The register status determination unit 113 corresponds to the register status determination unit 11 shown in Figure 1.

[0029] The register status determination unit 113 may, in image analysis, detect the direction of the employee's gaze or the orientation of their face if there is a person inside the register counter, i.e., an employee inside the register counter. In addition to determining whether or not there is an employee at the register, the register status determination unit 113 may also determine, based on the employee's gaze direction or the orientation of their face, whether or not the employee is in a state where they can notice customers waiting in line at the register. For example, the register status determination unit 113 determines that if the employee inside the register counter has their back to the sales floor, the employee is in a state where they cannot notice customers waiting in line at the register. The register status determination unit 113 determines that if the employee inside the register counter is facing in front of the register counter, the employee is in a state where they can notice customers waiting in line at the register.

[0030] The employee notification unit 114 notifies an employee that there is a customer waiting in line at the register if the register waiting line determination unit 112 determines that there is a customer waiting in line at the register and the register status determination unit 113 determines that there is no employee at the register. The employee notification unit 114 transmits a notification to the employee terminal device 210 informing the employee that there is a customer waiting in line at the register. Upon receiving the notification, the employee terminal device 210 displays a message on its display informing the employee that there is a customer waiting in line at the register. The employee terminal device 210 may also use sound or vibration to inform the employee that there is a customer waiting in line at the register. The employee notification unit 114 corresponds to the notification unit 13 shown in Figure 1.

[0031] Even if there is an employee at the register, if the register status determination unit 113 determines that the employee is unable to notice the customer waiting in line, the employee notification unit 114 may send a notification to the employee terminal device 210 informing them that there is a customer waiting in line. In that case, the employee at the register counter can notice the customer waiting in line before the customer speaks to the employee, and can quickly serve the customer waiting in line.

[0032] Next, the operating procedure will be explained. Figure 4 shows the operating procedure of the cash register support device 110. The operating procedure of the cash register support device 110 corresponds to the cash register support method. The cash register status determination unit 113 determines whether or not there is an employee at the cash register (step S1). In step S1, the cash register status determination unit 113 determines whether or not there is an employee at the cash register counter based on an image acquired by the video acquisition unit 111 from the camera 200, which acquires an image of the area inside the cash register counter. Step S1 is repeated until it is determined that there is no employee at the cash register.

[0033] If it is determined in step S1 that there are no employees at the register, the register queue determination unit 112 determines whether or not there are customers waiting in line at the register counter (step S2). In step S2, the register queue determination unit 112 determines whether or not there are customers waiting to pay at the register counter, for example, based on images acquired from the camera 200, which is acquired by the video acquisition unit 111, which acquires images of the area in front of the register counter.

[0034] In the above example, when it is determined in step S1 that there are no employees at the register, the register queue determination unit 112 determines in step S2 whether or not there are customers waiting at the register. However, this embodiment is not limited to this. The register queue determination unit 112 may determine whether or not there are customers waiting at the register without depending on the determination result of the register status determination unit 113. In that case, step S1 and step S2 may be performed in either order or in parallel.

[0035] If the employee notification unit 114 determines in step S1 that there is no employee at the register and in step S2 that there is a customer waiting in line at the register, it notifies the employee in charge of the register that there is a customer waiting in line (step S3). In step S3, the employee notification unit 114 sends a notification to the employee terminal device 210 held by the employee indicating that there is a customer waiting in line at the register. The employee can become aware of the customer waiting in line by, for example, seeing the message displayed on the employee terminal device 210. The employee interrupts whatever work they are doing outside the register counter, goes to the register counter, and attends to the customer.

[0036] In this embodiment, the register status determination unit 113 determines whether or not there is an employee at the register. The register waiting determination unit 112 determines whether or not there are customers waiting in front of the register. The employee notification unit 114 notifies the employee that there are customers waiting in line if there is no employee at the register and there are customers waiting in front of the register. In this embodiment, employees can immediately notice customers waiting in line and move to the register counter even if the customer does not take action to call an employee. Therefore, this embodiment can shorten the time customers spend waiting in line at the register. Also, in this embodiment, customers do not need to call an employee themselves, so this embodiment can suppress a decline in the customer user experience. Furthermore, in this embodiment, workers can concentrate on tasks other than register work without having to worry about whether or not there are customers waiting in line at the register. Therefore, this embodiment can improve the work efficiency of employees.

[0037] Next, a second embodiment of the present disclosure will be described. Figure 5 shows a cashier support device according to the second embodiment of the present disclosure. The cashier support device 110a according to this embodiment has, in addition to the configuration of the cashier support device 110 described in the first embodiment shown in Figure 2, a target estimation unit 115.

[0038] The purpose estimation unit 115 estimates the customer's purpose for coming to the register. For example, the purpose estimation unit 115 estimates the customer's purpose based on images acquired by a camera 200 that acquires images of the area in front of the register counter. For example, the purpose estimation unit 115 performs image analysis on images acquired by camera 200-1 shown in Figure 3 to determine whether the customer has come to the register counter with the items they intend to purchase. For example, in the image analysis, the purpose estimation unit 115 determines whether the customer is holding the items in their hands or whether the items are in the basket the customer is holding. The purpose estimation unit 115 estimates the customer's purpose based on whether or not they are holding the items they intend to purchase.

[0039] For example, if a customer is at a checkout counter with an item in their hand, it is highly likely that the customer is there to purchase that item. On the other hand, if a customer is at a checkout counter without an item in their hand, it is highly likely that the customer is there to purchase items that are not on display in the store, such as cigarettes or stamps, or to pay various fees. The purpose estimation unit 115 estimates that if a customer is at a checkout counter with an item in their hand, the customer is there to purchase that item. The purpose estimation unit 115 estimates that if a customer is standing in front of a checkout counter without an item in their hand, the customer is there to purchase items that are in stock at the register, or to pay various fees, i.e., to receive revenue on behalf of others.

[0040] In the above description, an example was given in which the camera used by the register queue determination unit 112 to determine whether or not there are customers waiting in line at the register and the camera used by the purpose estimation unit 115 to estimate the purpose for which the customer came to the register are the same camera. However, this embodiment is not limited to this. The camera used by the register queue determination unit 112 to determine whether or not there are customers waiting in line at the register and the camera used by the purpose estimation unit 115 to estimate the purpose for which the customer came to the register do not necessarily have to be the same camera.

[0041] In this embodiment, the employee notification unit 114 notifies employees that there are customers waiting in line at the register, and also notifies employees of the purpose estimated by the purpose estimation unit 115 as additional information. The employee notification unit 114 transmits the purpose estimated by the purpose estimation unit 115 as additional information to the employee terminal device 210. The employee terminal device 210 displays the purpose for which the customer came to the register on its display. By referring to the additional information, employees can predict what tasks will occur at the register when they move to the register counter. Also, for example, if a customer has come to the register counter for the purpose of receiving payment on their behalf, one of the employees who is familiar with receiving payment on behalf of a customer can go to the register.

[0042] The employee notification unit 114 may set a priority for notifications informing employees that there are customers waiting in line at the register, according to the purpose estimated by the purpose estimation unit 115. Here, the priority indicates the degree of necessity for the employee to go to the register counter. The employee terminal device 210 may notify employees of the set priority in addition to, or instead of, notifying them of the purpose estimated by the purpose estimation unit 115.

[0043] For example, if a store has self-checkout machines, customers who come to the checkout counter with their items may complete their payment using the self-checkout machine. In this case, employees do not need to go to the checkout counter. Therefore, the need for employees to go to the checkout counter is considered relatively low. On the other hand, if a customer comes to the checkout counter to purchase items or to receive payment on behalf of another customer, the customer cannot pay using the self-checkout machine, so employee assistance is required. Therefore, the need for employees to go to the checkout counter is considered high.

[0044] The employee notification unit 114 sets the priority to "high" if the estimated purpose is to purchase items in the register or to collect income on behalf of others. The employee notification unit 114 sets the priority to "low" if the estimated purpose is to purchase items. If the estimated purpose is to purchase items, the employee notification unit 114 may set the priority according to the operating status of the self-checkout registers. For example, the employee notification unit 114 may set the priority to "low" if the customer can use the self-checkout register. The employee notification unit 114 may set the priority to "medium" if another customer is already using the self-checkout register and the customer waiting in line cannot use it. In addition, even if the estimated purpose is to purchase items, the employee notification unit 114 may set the priority to "high" if the customer's gaze, as detected by the register waiting determination unit 112, is directed towards items in the register, such as cigarettes. When an employee is notified of the priority, the employee can determine whether they must move to the register counter or whether they can move to the register counter while observing the situation.

[0045] In this embodiment, the purpose estimation unit 115 estimates the customer's purpose for coming to the register. The employee notification unit 114 notifies the employee of the estimated purpose. In this embodiment, the purpose for which a customer waiting in line to come to the register is estimated, and the estimation result is notified to the employee. By notifying the employee of the customer's purpose for coming to the register, the employee can predict the tasks at the register before moving to the register counter. Therefore, it is believed that the employee can perform register operations smoothly.

[0046] Next, a third embodiment of the present disclosure will be described. Figure 6 shows a cashier support device according to the third embodiment of the present disclosure. The cashier support device 110b according to this embodiment has a timing prediction unit 116 in addition to the configuration of the cashier support device 110 described in the first embodiment shown in Figure 2. The cashier support device 110b may also have a timing prediction unit 116 in addition to the configuration of the cashier support device 110a described in the second embodiment shown in Figure 5.

[0047] The timing prediction unit 116 predicts when a customer who has entered the store will arrive at the cash register counter. The timing prediction unit 116 predicts when a customer will arrive at the cash register counter based on at least one of the customer's movement trajectory within the store and the customer's past behavior history information. For example, the timing prediction unit 116 tracks the movement of a customer who has entered the store based on images acquired by multiple cameras 200 placed in the store, as shown in Figure 3. Based on the tracking results, i.e., the movement trajectory, the timing prediction unit 116 determines whether the customer is moving through the store along a predetermined route that has been anticipated in advance. The predetermined route is not limited to one, and several routes may be anticipated in the store.

[0048] The timing prediction unit 116 compares the customer's movement trajectory with a predetermined route and determines whether the customer is moving along the predetermined route based on whether the customer's movement trajectory deviates from the predetermined route. The timing prediction unit 116 predicts when the customer will arrive at the register based on whether the customer is moving along the route. For example, if the customer goes directly from the entrance to the register counter, the timing prediction unit 116 determines that the customer is not moving along the route within the store. If the timing prediction unit 116 determines that the customer is not moving along the route within the store, it predicts that the customer will arrive at the register a first predetermined time after entering the store. If the timing prediction unit 116 determines that the customer is moving along the route within the store, it predicts that the customer will arrive at the register a second predetermined time after entering the store (second predetermined time > first predetermined time).

[0049] When the timing prediction unit 116 predicts when a customer will come to the register using the customer's past behavior history information, it retrieves the behavior history information of the customer who has entered the store from a storage device that stores the behavior history information. For example, the behavior history information is stored for each customer. The timing prediction unit 116 identifies the customer, for example, using facial recognition, and retrieves the past behavior history information of the identified customer. Alternatively, the behavior history information may be stored for each customer attribute, such as age and gender. In that case, the timing prediction unit 116 may identify attributes from the customer's facial image, etc., and retrieve the behavior history information corresponding to the identified attributes. By using the behavior history information, it is possible to determine whether a customer is someone who goes straight to the register after entering the store, or someone who shops carefully after entering the store before going to the register. Therefore, it is considered that when behavior history information is used, the timing when a customer will come to the register can be predicted with high accuracy.

[0050] In this embodiment, in addition to the operations described in the first or second embodiment, the employee notification unit 114 notifies employees of the prediction results of the timing prediction unit 116, that is, the predicted timing of when the customer will come to the register. After the customer enters the store, the employee notification unit 114 transmits the predicted timing of when the customer will come to the register to the employee terminal device 210. The employee terminal device 210 displays the predicted timing of when the customer will come to the register, for example, how much later the customer will come to the register, on its display.

[0051] In this embodiment, the employee notification unit 114 notifies the employee of the prediction result of the timing prediction unit 116. By looking at the prediction result, the employee can predict when a customer will come to the register and decide whether to interrupt the work being done outside the register and go to the register counter, or to continue working. For example, if it is predicted that a customer will come to the register soon, the employee can interrupt their work and go to the register counter immediately. On the other hand, if it is predicted that a customer will not come to the register soon, the employee can continue working. Therefore, this embodiment can improve the work efficiency of employees.

[0052] In this disclosure, the cashier support device 110 may be configured using a computer device or a server device. Figure 7 shows an example of the configuration of a computer device that may be used in the cashier support device 110. The computer device 500 has a control unit (CPU: Central Processing Unit) 510, a storage unit 520, a ROM (Read Only Memory) 530, a RAM (Random Access Memory) 540, a communication interface (IF: Interface) 550, and a user interface 560.

[0053] The communication interface 550 is an interface for connecting the computer device 500 to a communication network via wired communication means or wireless communication means. The user interface 560 includes a display unit, such as a display. The user interface 560 also includes input units such as a keyboard, mouse, and touch panel.

[0054] The memory unit 520 is an auxiliary storage device capable of holding various types of data. The memory unit 520 does not necessarily have to be part of the computer device 500; it may be an external storage device or cloud storage connected to the computer device 500 via a network.

[0055] ROM 530 is a non-volatile memory device. For example, a semiconductor memory device such as a relatively small-capacity flash memory is used for ROM 530. The program executed by the CPU 510 can be stored in the storage unit 520 or ROM 530. The storage unit 520 or ROM 530 stores various programs, for example, for realizing the functions of each part within the cash register support device 110.

[0056] The program, when loaded into a computer, includes a set of instructions (or software code) for causing the computer to perform one or more of the functions described in the embodiments. The program may be stored on a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, Compact Disc (CD), digital versatile disc (DVD), Blu-ray® disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrically, optically, acoustically, or otherwise propagating signals.

[0057] RAM 540 is a volatile memory device. Various semiconductor memory devices such as DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory) can be used for RAM 540. RAM 540 can be used as an internal buffer for temporarily storing data. CPU 510 loads the program stored in memory unit 520 or ROM 530 into RAM 540 and executes it. By executing the program, the functions of each part of the cash register support device 110 can be realized. CPU 510 may have an internal buffer that can temporarily store data.

[0058] In each of the above embodiments, the cashier support device 110 does not necessarily have to be configured as a single device. The cashier support device 110 may be configured using multiple physically separated devices.

[0059] Although embodiments of this disclosure have been described in detail above, this disclosure is not limited to the embodiments described above, and modifications and changes to the embodiments described above, without departing from the spirit of this disclosure, are also included in this disclosure.

[0060] For example, some or all of the above embodiments may also be described as follows, but are not limited to the following.

[0061] [Note 1] A register status determination unit that determines whether or not there is an employee at the register installed in the store, The aforementioned store includes a checkout line determination unit that determines whether or not there are customers waiting in line at the checkout counter, A cash register support device comprising: a notification unit that notifies the employee that there are customers waiting in line at the cash register when it is determined that there are no employees at the cash register and that there are customers waiting in line at the cash register.

[0062] [Note 2] The cashier queue determination unit determines whether or not there are customers waiting in line at the cashier, based on images acquired by a camera that acquires images of the area on the sales floor side of the cashier counter where the cashier is installed, as described in Appendix 1 of the cashier support device.

[0063] [Note 3] The cashier queue determination unit detects a person from an image acquired by a camera that acquires the area on the sales floor side from the cashier counter, and determines that there is a customer waiting in line at the cashier if the detected person is standing still for a predetermined time or longer, as described in Appendix 2 of the cashier support device.

[0064] [Note 4] The cashier waiting determination unit detects at least one of the detected person's gaze direction and face orientation, and determines whether or not there is a customer waiting in line at the cashier based on at least one of the detected gaze direction and face orientation, as described in Appendix 3 of the cashier support device.

[0065] [Note 5] The cash register status determination unit determines whether or not an employee is at the cash register based on an image acquired by a camera that acquires an image of the area within the cash register counter where the cash register is installed, as described in any one of Appendix 1 to 4 of the cash register operation support device.

[0066] [Note 6] The system further includes a purpose estimation unit that estimates the customer's purpose for coming to the register based on images acquired by a camera that acquires images of the area on the sales floor side from the register counter where the register is installed. The notification unit is a cashier support device according to any one of the appendices 1 to 5, which notifies the employee of the presumed purpose.

[0067] [Note 7] The aforementioned purpose estimation unit estimates the purpose depending on whether the customer has the product or not, as described in Appendix 6 of the cashier support device.

[0068] [Note 8] The cashier support device according to Appendix 6 or 7, wherein the notification unit sets a priority for notifications indicating that there are customers waiting in line at the register, according to the estimated purpose, and notifies the employee of the set priority.

[0069] [Note 9] The system further includes a timing prediction unit that predicts when a customer who has entered the store will come to the cash register. The notification unit is a cashier support device according to any one of the appendices 1 to 8, which notifies the employee of the predicted timing.

[0070] [Note 10] The cashier support device according to Appendix 9, wherein the timing prediction unit predicts the timing at which the customer will come to the cashier based on at least one of the customer's movement trajectory in the store and the customer's past behavior history information.

[0071] [Note 11] The system determines whether or not there is an employee at the cash register installed in the store. In the aforementioned store, determine whether or not there are customers waiting in line at the cash register. A cashier support method that, when it is determined that there is no employee at the cashier and that there are customers waiting in line at the cashier, notifies the employee that there are customers waiting in line at the cashier.

[0072] [Note 12] The system determines whether or not there is an employee at the cash register installed in the store. In the aforementioned store, determine whether or not there are customers waiting in line at the cash register. A non-temporary computer-readable medium that stores a program for causing a computer to perform a process that includes notifying an employee that there is a customer waiting in line at the register, if it is determined that there is no employee at the register and that there is a customer waiting in line at the register. [Explanation of Symbols]

[0073] 10: Cash register support device 11: Register status determination unit 12: Checkout queue determination unit 13: Notification Department 100: Cash register support system 110: Cash register support device 111: Video Acquisition Unit 112: Checkout queue determination unit 113: Register status determination unit 114: Clerk Notification Department 115: Purpose estimation part 116: Timing prediction unit 200: Camera 210: Staff terminal device

Claims

1. A cashier queue determination unit determines whether or not there are customers waiting in line at the cashier based on an image of the area in front of the cashier in the store, If it is determined that there are customers waiting in line at the register, the availability determination unit determines whether the customers waiting in line can use the self-checkout registers installed in the store, based on the operating status of the self-checkout registers. The aforementioned availability determination unit is: If the self-checkout machine is not being used by another customer, it is determined that the customer waiting in line can use the self-checkout machine. If the self-checkout machine is being used by another customer, it is determined that the customer waiting in line cannot use the self-checkout machine. A cash register support device.

2. The cash register support device according to claim 1, wherein the image of the area in front of the cash register is an image acquired by a camera that captures the area on the sales floor side from the cash register counter installed in the store.

3. The cashier queue determination unit detects a person from an image acquired by the camera, and determines that there is a customer waiting in line at the cashier if the detected person is standing in front of the cashier for a predetermined time or longer, as described in claim 2 of the cashier support device.

4. The cashier queue determination unit detects at least one of the direction of the person's gaze and the direction of their face, and determines whether or not there is a customer waiting in line at the cashier based on at least one of the detected direction of gaze and the direction of their face, as described in claim 3.

5. A purpose estimation unit estimates the purpose for which the customer came to the cash register based on images acquired by a camera that acquires images of the area on the sales floor side from the cash register counter where the cash register is installed. A cashier support device according to any one of claims 1 to 4, comprising a notification unit for notifying an employee that there are customers waiting in line at the register and the presumed purpose.

6. The cashier support device according to claim 5, wherein the notification unit sets a priority for notifications indicating that there are customers waiting in line at the cashier, according to the estimated purpose, and notifies the employee of the set priority.

7. The system further includes a timing prediction unit that predicts when a customer who has entered the store will come to the cash register. The cash register support device according to claim 5, wherein the notification unit notifies the employee of the predicted timing.

8. The cashier support device according to claim 7, wherein the timing prediction unit predicts the timing at which the customer will come to the cashier based on at least one of the customer's movement trajectory in the store and the customer's past behavior history information.

9. Based on an image of the area in front of the cash register in the store, it is determined whether or not there are customers waiting in line at the cash register. If it is determined that there are customers waiting in line at the register, it is determined whether the customers waiting in line can use the self-checkout machines installed in the store, based on the operating status of the self-checkout machines. If the self-checkout machine is not being used by another customer, it is determined that the customer waiting in line can use the self-checkout machine. If the self-checkout machine is being used by another customer, it is determined that the customer waiting in line cannot use the self-checkout machine. Methods for supporting cashier operations.

10. Based on an image of the area in front of the cash register in the store, it is determined whether or not there are customers waiting in line at the cash register. If it is determined that there are customers waiting in line at the register, it is determined whether the customers waiting in line can use the self-checkout machines installed in the store, based on the operating status of the self-checkout machines. If the self-checkout machine is not being used by another customer, it is determined that the customer waiting in line can use the self-checkout machine. A program that causes a computer to perform a process to determine that a customer waiting in line cannot use the self-checkout register if the self-checkout register is being used by another customer.

Images