Notification system, notification method and program

Abstract

The present invention provides a notification system (10) having: a customer status information generation unit (11) that, on the basis of a captured image of the inside of a store, generates customer status information which indicates the number of customers waiting to check out and / or the number of customers in the store; a checkout work region information generation unit (12) that, on the basis of the captured image of the inside of the store, generates checkout work region information which indicates the status of a checkout work region in which a sales clerk who carries out a checkout work is to be located; a determination unit (13) that, on the basis of the customer status information and the checkout work region information, determines whether or not a notification of an assistance request for the checkout work is to be made; and a notification unit (14) that, when it is determined that the notification of the assistance request is to be made, makes the notification of the assistance request via an output device.

Description

Technical Field

[0001] The present invention relates to a notification system, a notification method, and a program.

Background Art

[0002] A technique related to the present invention is disclosed in Patent Document 1. Patent Document 1 discloses an apparatus that detects the state of store employees present in a store based on an image captured inside the store, and gives a notification instructing the operation of a cash register device based on the detection result. More specifically, Patent Document 1 discloses that when it is possible to detect, based on an image captured outside an accounting work area in a store, a store employee who is staying outside the accounting work area and performing a task different from the accounting work, the above notification is given.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There are customers who feel stressed waiting in line for accounting. By reducing the waiting time for accounting, customer satisfaction can be improved, and an increase in store sales and the like can be expected. For example, if a technique that detects the need to increase the number of store employees performing accounting work by image analysis or the like and notifies the store employees to that effect is used, it is possible to promptly increase the number of store employees performing accounting work at the necessary timing and reduce the waiting time of customers.

[0005] However, in such a notification technology, it is necessary to send notifications at the truly necessary timing and reduce unnecessary notifications. If there are many unnecessary notifications, there is a problem that the recipients of the notifications (store clerks) will find the notifications annoying or ignore them. Patent Document 1 discloses a technique for analyzing a video captured of the area "outside the accounting work area" within a store and determining whether a notification is necessary or not based on the result, in order to reduce unnecessary notifications. In the technique of this Patent Document 1, there are the following problems.

[0006] The area outside the above-mentioned accounting work area is an area including the area where products are displayed, the backyard, etc., and its area is relatively large. When the area to be monitored is wide in this way, problems such as "the number of facilities (cameras, etc.) to be installed increases and the cost burden becomes large", "the cost burden and labor burden required for maintenance of the installed facilities become large", "the generated image data becomes enormous and the processing burden on the computer becomes large" may occur.

[0007] An object of the present invention is to detect the need for additional store clerks performing accounting work and reduce unnecessary notifications.

Means for Solving the Problem

[0008] According to the present invention, customer situation information generation means for generating customer situation information indicating at least one of the number of customers waiting to pay and the number of customers in the store, based on an image captured of the store interior; accounting work area information generation means for generating accounting work area information indicating the situation of the accounting work area where the store clerks performing accounting work are located, based on an image captured of the store interior; determination means for determining whether to notify an auxiliary request for accounting work based on the customer situation information and the accounting work area information; notification means for notifying the auxiliary request via an output device when it is determined to notify the auxiliary request; and having and the determination means determines to notify the assistance request when at least one of "the number of customers in the store is equal to or greater than a second reference value" and "the number of customers waiting for checkout is equal to or greater than a third reference value and the number of customers in the store is equal to or greater than a fourth reference value" is satisfied, and the situation of the checkout work area indicated by the checkout work area information satisfies a predetermined condition a notification system is provided.

[0009] Further, according to the present invention, The computer generating customer status information indicating at least one of the number of customers waiting to pay and the number of customers present in the store based on images taken inside the store; generating accounting work area information indicating the status of the accounting work area where the store clerk will be located based on the image captured inside the store; determining whether to notify a request for assistance with accounting work based on the customer status information and the accounting work area information; If it is determined that the assistance request should be notified, the assistance request is notified via an output device. and determines to notify the assistance request when at least one of "the number of customers in the store is equal to or greater than a second reference value" and "the number of customers waiting for checkout is equal to or greater than a third reference value and the number of customers in the store is equal to or greater than a fourth reference value" is satisfied, and the situation of the checkout work area indicated by the checkout work area information satisfies a predetermined condition A notification method is provided.

[0010] Further, according to the present invention, Computer, a customer status information generating means for generating customer status information indicating at least one of the number of customers waiting to pay and the number of customers present in the store based on an image taken inside the store; accounting work area information generation means for generating accounting work area information indicating the status of the accounting work area in which a store clerk performing accounting work will be located based on images taken inside the store; a determination means for determining whether to issue a request for assistance with accounting work based on the customer status information and the accounting work area information; a notification means for notifying the request for assistance via an output device when it is determined that the request for assistance should be notified; Function as 、 the determination means determines to notify the assistance request when at least one of "the number of customers in the store is equal to or greater than a second reference value" and "the number of customers waiting for checkout is equal to or greater than a third reference value and the number of customers in the store is equal to or greater than a fourth reference value" is satisfied, and the situation of the checkout work area indicated by the checkout work area information satisfies a predetermined condition Programs are offered. [Effects of the Invention]

[0011] According to the present invention, it is possible to detect the need to increase the number of store clerks performing checkout operations and reduce unnecessary notifications. [Brief explanation of the drawings]

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

[0013] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, like components are designated by like reference numerals, and the description thereof will be omitted as appropriate.

[0014] First Embodiment "overview" The notification system of this embodiment is characterized in that it determines whether or not to notify a request for assistance with accounting work based on "customer status information" and "accounting work area information," and notifies in accordance with the determination.

[0015] The customer status information indicates at least one of the number of customers waiting to pay and the number of customers inside the store. For example, the area where customers waiting to pay are located or the entrance and exit of the store can be set as a monitoring area, and customer status information can be generated based on images of that area. In this way, the area in the store that is monitored to generate customer status information can be a relatively small area.

[0016] The accounting work area information indicates the situation of the accounting work area (e.g., inside the cash register counter, etc.) where the store clerks who perform accounting work are located. Although details will be described later, for example, the accounting work area information indicates the number of store clerks in the accounting work area, the content of their actions, etc. The accounting work area can be set as a monitoring area, and the accounting work area information can be generated based on the image captured of that area. In this way, the area within the store to be monitored for generating the accounting work area information can be a relatively narrow area.

[0017] By determining whether to notify the auxiliary requirement for accounting work based on such characteristic customer situation information and accounting work area information, unnecessary notifications can be reduced accurately, and the area within the store to be monitored can be made smaller than in the prior art. Details will be described below.

[0018] "Hardware Configuration" Next, an example of the hardware configuration of the notification system will be described. FIG. 1 is a diagram showing an example of the hardware configuration of the notification system. Each functional unit included in the notification system 10 is realized by an arbitrary combination of hardware and software centered around the CPU (Central Processing Unit), memory, program loaded into the memory, storage unit such as a hard disk for storing the program (in addition to the program stored in advance at the stage of shipping the device, programs downloaded from storage media such as CDs (Compact Discs) and servers on the Internet can also be stored), and network connection interface. And it is understood by those skilled in the art that there are various modification examples for the realization method and device.

[0019] As shown in FIG. 1, the notification system has a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The notification system may not have the peripheral circuit 4A.

[0020] Note that the notification system may be composed of a plurality of physically and / or logically separated devices, or may be composed of one physically and logically integrated device. In the former case, each device can have the above hardware configuration.

[0021] Bus 5A is a data transmission path for the processor 1A, the memory 2A, the peripheral circuit 4A, and the input / output interface 3A to transmit and receive data to and from each other. The processor 1A is an arithmetic processing device such as a CPU or a GPU (Graphics Processing Unit). The memory 2A is a memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The input / output interface 3A includes an interface for acquiring information from an input device, an external device, an external server, an external sensor, etc., and an interface for outputting information to an output device, an external device, an external server, etc. The input device is, for example, a keyboard, a mouse, a microphone, etc. The output device is, for example, a display, a speaker, a printer, a mailer, etc. The processor 1A can issue commands to each module and perform operations based on their operation results.

[0022] "Functional Configuration" Next, an example of the functional configuration of the notification system 10 will be described. As shown in the functional block diagram of FIG. 2, the notification system 10 includes a customer situation information generation unit 11, an accounting work area information generation unit 12, a determination unit 13, and a notification unit 14.

[0023] Before explaining these functional units, the "accounting work area" and the "accounting waiting area" will be explained. The accounting work area is a partial area within the store and is an area monitored by a camera to generate accounting work area information. The accounting waiting area is a partial area within the store and is an example of an area monitored by a camera to generate customer situation information. The user of the notification system 10 or the service provider who provides the service using the notification system 10 can set these areas in consideration of the layout and practices of each store.

[0024] The accounting work area is the area where the staff performing accounting work is located. The staff performing accounting work is located near the accounting device (for example, a POS (point of sales) register) and operates the accounting device. The accounting work area is set to include the area near the accounting device.

[0025] Note that depending on the business format of the store, the staff performing accounting work may perform work other than operating the accounting device. For example, operating equipment (microwave oven, coffee maker, ticket issuing machine, etc.) installed near the accounting device, or taking out products (cigarettes, prepared foods, stamps, postcards, etc.) from the product display area installed near the accounting device. The accounting work area may be set to include the area where such work other than operating the accounting device is performed.

[0026] As described above, the accounting work area is the area monitored by the camera. Considering the cost burden of equipment introduction and maintenance, and the processing burden of the computer required for image processing, etc., it is preferable to make the accounting work area small. However, in order to allow the staff performing accounting work to move freely to a certain extent, it is preferable to set the accounting work area with a certain margin.

[0027] The accounting waiting area is the area where the customers waiting for accounting are located. Generally, the accounting waiting area is located near the accounting work area. For example, each store considers in which direction it is preferable to extend the line of customers waiting for accounting based on the layout inside the store, etc. Then, for example, inside the store (for example, on the floor inside the store), a guide indicating where to wait when waiting for accounting is displayed. The customers waiting for accounting generate a line extending in a predetermined direction based on this guide. For example, based on such practices for each store, the accounting waiting area can be set.

[0028] As described above, the accounting waiting area is an example of an area to be monitored by a camera. Considering the cost burden of equipment introduction and maintenance, as well as the processing burden of the computer required for image processing, etc., it is preferable to make the accounting waiting area small. However, in order to allow customers waiting for accounting to move freely to a certain extent, it is preferable to set the accounting waiting area with a certain margin.

[0029] Fig. 3 shows an example of an accounting work area and an accounting waiting area. Fig. 3 shows the layout inside the store. In the example of Fig. 3, a plurality of accounting devices are installed on one counter. And the inside of the counter is set as the accounting work area. The store clerk operates the accounting device in the accounting work area. Note that depending on the business type of the store, the store clerk may perform operations other than operating the accounting device in the accounting work area. For example, operating a predetermined device (microwave oven, coffee maker, ticket issuing machine, etc.), or taking out products (cigarettes, prepared foods, stamps, postcards, etc.) from a predetermined product display area.

[0030] And in the example of Fig. 3, the accounting waiting area is set to include the area in front of the counter and extend through the space between the shelves from there.

[0031] Fig. 4 shows another example of an accounting work area and an accounting waiting area. Fig. 4 shows the layout inside the store. In the example of Fig. 4, a plurality of counters are provided, and accounting devices are installed on each counter. And at least one store clerk is located inside each counter, and customers pass by in turn on the opposite side of the counter. In the illustrated example, the accounting work area is set to include a plurality of counters. And an accounting waiting area is set adjacent to this accounting work area.

[0032] In the present embodiment, at least one camera is installed at a position and orientation for photographing the accounting work area set as shown in Fig. 3 or Fig. 4, for example. Note that in the present embodiment, at least one camera may be further installed at a position and orientation for photographing the accounting work area set as shown in Fig. 3 or Fig. 4, for example.

[0033] Returning to Figure 2, the customer situation information generation unit 11 generates customer situation information indicating at least one of the number of customers waiting to pay and the number of customers inside the store based on images taken inside the store. The customer situation information generation unit 11 acquires and processes images taken by cameras installed inside the store in real time to generate customer situation information.

[0034] The number of customers waiting to pay can be determined by performing image analysis such as person detection on an image captured of the waiting area. For example, the number of people detected in the waiting area may be calculated as the number of customers waiting to pay. Alternatively, a line of people may be detected within the waiting area. The number of people waiting in line may then be calculated as the number of customers waiting to pay.

[0035] The number of customers in a store can be determined by performing image analysis such as person detection and movement trajectory detection on images taken of, for example, the store entrance or a predetermined location (such as a passageway) connected to the store entrance. For example, the number of customers in the store can be detected by counting up the number of customers in the store when a person heading into the store is detected, and counting down the number of customers in the store when a person heading out of the store is detected.

[0036] The checkout work area information generation unit 12 generates checkout work area information that indicates the status of the checkout work area where a store clerk will be located, based on images of the checkout work area within the store. The checkout work area information generation unit 12 acquires and processes images taken by cameras installed within the store in real time to generate checkout work area information.

[0037] The accounting work area information generation unit 12 can generate accounting work area information that indicates at least one of the number of store clerks present in the accounting work area, the actions of the store clerk, the position of the store clerk within the accounting work area, the direction of the store clerk's face, and the store clerk's line of sight.

[0038] The actions include, but are not limited to, "operating an accounting device", "operating a microwave oven", "operating a coffee maker", "operating a ticket vending machine", "operating device A (any other device)", "taking out cigarettes from the cigarette display area", "taking out prepared foods from the prepared food display area", "taking out stamps and postcards from the stamp and postcard display area", "performing courier work (measuring weight and size, creating forms, etc.)". The accounting work area information generation unit 12 can estimate the actions of the store clerk as described above based on a predetermined algorithm based on the positional relationship and contact state between the store clerk and other objects (devices, display areas, instruments used for courier work, etc.), the relationship between the direction of the store clerk's face and the position of other objects, and the relationship between the direction of the store clerk's line of sight and the position of other objects.

[0039] In addition, the accounting work area information generation unit 12 can generate accounting work area information indicating the operating status of devices installed in the accounting work area based on an image taken inside the store. The devices targeted by this process include at least one of an accounting device and devices other than the accounting device (such as a microwave oven, a coffee maker, a ticket vending machine, etc.).

[0040] The operating status indicates whether the device is operating or not. If the appearance of the device is different when it is operating and when it is not operating, the accounting work area information generation unit 12 may determine whether each device is operating by detecting the difference in appearance through image analysis. Alternatively, the accounting work area information generation unit 12 may detect the surrounding situation of the device through image analysis and determine whether each device is operating based on the detection result. For example, if a store clerk touching the device is detected, the device may be determined to be operating. Also, if a store clerk staying in front of the device for a predetermined time or more is detected, the device may be determined to be operating. Further, if a store clerk whose face direction has been facing the device continuously for a predetermined time or more is detected, the device may be determined to be operating. Also, if a store clerk whose line of sight has been facing the device continuously for a predetermined time or more is detected, the device may be determined to be operating. Note that the examples here are merely examples and are not limited thereto.

[0041] In addition, the accounting work area information generation unit 12 may generate accounting work area information indicating the operating status of the devices installed in the accounting work area based on the information acquired from the external device. For example, the device itself may output information indicating whether it is in operation. Then, the accounting work area information generation unit 12 may acquire the information in real-time processing directly from the device or via another device such as a store server.

[0042] The determination unit 13 determines whether to notify an auxiliary request for the accounting work based on the customer status information and the accounting work area information.

[0043] The determination unit 13 determines to notify an auxiliary request when at least one of "the number of customers waiting for accounting is equal to or greater than the first reference value", "the number of customers in the store is equal to or greater than the second reference value", and "the number of customers waiting for accounting is equal to or greater than the third reference value and the number of customers in the store is equal to or greater than the fourth reference value" is satisfied, and the status of the accounting work area indicated by the accounting work area information satisfies a predetermined condition.

[0044] By judging the condition regarding the number of customers waiting for accounting, the congestion of accounting at the current time can be detected. Also, by judging the condition regarding the number of customers in the store, the possibility of accounting congestion in the relatively near future can be detected. And as will be shown below, by judging the condition regarding the status of the accounting work area, it is possible to determine whether to notify an auxiliary request based on necessity, effectiveness, etc.

[0045] Note that the first reference value and the third reference value may be the same value or different values. Also, the second reference value and the fourth reference value may be the same value or different values.

[0046] Here, a predetermined condition (hereinafter referred to as "accounting work area condition") regarding the status of the accounting work area and its significance will be explained.

[0047] The accounting work area condition is, for example, "The number of store employees present within the accounting work area is less than or equal to the fifth reference value", "The number of store employees present within the accounting work area and performing a predetermined action is less than or equal to the sixth reference value", "There are store employees present within the accounting work area and performing accounting work area The number of store employees at a predetermined position within the accounting work area is less than or equal to the seventh reference value", "The number of store employees present within the accounting work area and having a predetermined face orientation is less than or equal to the eighth reference value", "The number of store employees present within the accounting work area and having a predetermined line-of-sight state is less than or equal to the ninth reference value", "There are store employees present within the accounting work area and performing a predetermined action other than accounting work", "There are store employees present within the accounting work area and located at a position different from the position where they will stay during accounting work", "There are store employees present within the accounting work area and having a face orientation different from the state during accounting work", "There are store employees present within the accounting work area and having a line-of-sight state different from the state during accounting work", "The number of operating accounting devices is less than or equal to the tenth reference value", "A predetermined device other than the accounting device is operating", and, "The number of store employees present within the accounting work area is less than the number of store employees on duty at that time" is one of, or a combination of multiple ones connected by logical operators. Each will be described below.

[0048] - The number of store employees present within the accounting work area is less than or equal to the fifth reference value - When the accounting is congested or may become congested in the relatively near future, and the number of clerks in the accounting work area is small, an assistance request should be notified and additional staff need to be hired. By hiring additional staff, the efficiency of the accounting work can be improved and the waiting time of customers can be reduced. On the other hand, if there are already a sufficient number of clerks in the accounting work area, no improvement in the efficiency of the accounting work can be expected even if more staff are hired. Rather, drawbacks such as too many clerks in the accounting work area and poor work efficiency may occur. According to this condition, by appropriately setting the fifth reference value, it is possible to decide to notify the assistance request at a necessary and effective time.

[0049] - The number of clerks present in the accounting work area and performing a predetermined action is equal to or less than the sixth reference value - The predetermined action is the operation of the accounting device. When the accounting is congested or may become congested in the relatively near future, and the number of clerks operating the accounting device is small, an assistance request should be notified and additional staff need to be hired. By hiring additional staff, the efficiency of the accounting work can be improved and the waiting time of customers can be reduced. On the other hand, if there are already a sufficient number of clerks operating the accounting device, no improvement in the efficiency of the accounting work can be expected even if more staff are hired. Rather, drawbacks such as too many clerks in the accounting work area and poor work efficiency may occur. According to this condition, by appropriately setting the sixth reference value, it is possible to decide to notify the assistance request at a necessary and effective time.

[0050] - The number of clerks present in the accounting work area and at a predetermined position within the accounting work area is equal to or less than the seventh reference value - The predetermined position is a position where one stays when operating the accounting device, such as in front of the accounting device. When accounting is congested or may become congested in the relatively near future, if the number of store clerks staying at the above-mentioned predetermined position is small, that is, if the number of store clerks operating the accounting device is small, a supplementary request should be notified and additional staff need to be added. By adding staff, the efficiency of the accounting work can be improved and the waiting time of customers can be reduced. On the other hand, if a sufficient number of store clerks are already operating the accounting device, no improvement in the efficiency of the accounting work can be expected even if more staff are added. Rather, drawbacks such as too many store clerks in the accounting work area and poor work efficiency may occur. According to this condition, by appropriately setting the seventh reference value, it is possible to decide to notify a supplementary request when it is necessary and effective.

[0051] - The number of store clerks present in the accounting work area and having a predetermined face orientation is less than or equal to the eighth reference value - The predetermined face orientation is a state that can occur when operating the accounting device. For example, states such as facing the accounting device, facing the customer in front of the accounting device, or facing the area of the counter where the goods to be accounted for are placed are exemplified. When accounting is congested or may become congested in the relatively near future, if the number of store clerks having the above-mentioned predetermined face orientation is small, that is, if the number of store clerks operating the accounting device is small, a supplementary request should be notified and additional staff need to be added. By adding staff, the efficiency of the accounting work can be improved and the waiting time of customers can be reduced. On the other hand, if a sufficient number of store clerks are already operating the accounting device, no improvement in the efficiency of the accounting work can be expected even if more staff are added. Rather, drawbacks such as too many store clerks in the accounting work area and poor work efficiency may occur. According to this condition, by appropriately setting the eighth reference value, it is possible to decide to notify a supplementary request when it is necessary and effective.

[0052] - The number of store clerks present in the accounting work area and having a predetermined line-of-sight state is less than or equal to the ninth reference value - The specified line-of-sight state is a state that can occur when operating the accounting device. For example, states such as facing the accounting device, facing the customer in front of the accounting device, facing the area of the counter where the goods to be accounted for are placed, etc. are exemplified. In a situation where accounting is congested or in a situation where accounting may become congested in the relatively near future, when the number of store clerks in the above line-of-sight state is small, that is, when the number of store clerks operating the accounting device is small, it is necessary to notify an assistance request and increase the number of staff. By increasing the number of staff, the efficiency of the accounting work can be improved and the waiting time of customers can be reduced. On the other hand, when a sufficient number of store clerks are already operating the accounting device, no improvement in the efficiency of the accounting work can be expected even if the number of staff is increased further. Rather, drawbacks such as the number of store clerks in the accounting work area becoming too large and the work efficiency deteriorating may occur. According to this condition, by appropriately setting the ninth reference value, it is possible to determine to notify an assistance request when it is necessary and effective.

[0053] -There is a store clerk in the accounting work area who is performing a predetermined action other than the accounting work- The predetermined action is, for example, "operating a microwave oven", "operating a coffee maker", "operating a ticket vending machine", "operating device A (any other device)", "taking out cigarettes from the cigarette display area", "taking out prepared foods from the prepared food display area", "taking out stamps and postcards from the stamp and postcard display area", "performing courier work (measuring weight and size, creating forms, etc.)", etc. Note that the predetermined action may be one of the actions that a store clerk can perform in such an accounting work area and that can be relatively strongly time-constrained for the work. For example, "operating a coffee maker", "operating a ticket vending machine", "taking out stamps and postcards from the stamp and postcard display area", "performing courier work (measuring weight and size, creating forms, etc.)", etc. are exemplified, but are not limited thereto.

[0054] If there is a store clerk performing such predetermined actions in a situation where accounting is congested or in a situation where accounting may become congested in the relatively near future, that is, if there is a store clerk who cannot immediately operate the accounting device, notify an assistance request and additional staff are needed. According to this condition, it is possible to determine to notify an assistance request when it is necessary and effective.

[0055] -There is a store clerk who is in the accounting work area and is in a position different from the position where he / she will stay during the accounting work- If there is a store clerk who is in a situation where accounting is congested or in a situation where accounting may become congested in the relatively near future, is in a position different from the position where he / she will stay during the accounting work, and is performing work other than operating the accounting device, notify an assistance request and additional staff are needed. According to this condition, it is possible to determine to notify an assistance request when it is necessary and effective.

[0056] -There is a store clerk who is in the accounting work area and whose face orientation is in a state different from the state during the accounting work- If there is a store clerk whose face orientation is in a state different from the state during the accounting work, that is, a store clerk who is performing work other than operating the accounting device, in a situation where accounting is congested or in a situation where accounting may become congested in the relatively near future, notify an assistance request and additional staff are needed. According to this condition, it is possible to determine to notify an assistance request when it is necessary and effective.

[0057] -There is a store clerk who is in the accounting work area and whose line-of-sight state is in a state different from the state during the accounting work- If there is a store clerk whose line-of-sight state is in a state different from the state during the accounting work, that is, a store clerk who is performing work other than operating the accounting device, in a situation where accounting is congested or in a situation where accounting may become congested in the relatively near future, notify an assistance request and additional staff are needed. According to this condition, it is possible to determine to notify an assistance request when it is necessary and effective.

[0058] -The number of operating accounting devices is less than or equal to the 10th reference value- In a situation where accounting is congested or may become congested in the relatively near future, if the number of operating accounting devices is equal to or less than the tenth reference value (the tenth reference value is less than the number of existing accounting devices) and there are still accounting devices that are not in operation, it is necessary to notify a request for assistance and increase the number of operating accounting devices. According to this condition, it can be determined that a request for assistance will be notified when necessary and effective.

[0059] -Specified equipment other than accounting equipment is in operation- The predetermined device is an object that is installed in the checkout work area and operated by a store clerk, and examples thereof include a microwave oven, a coffee maker, a ticket vending machine, etc. Note that the predetermined device may be any of these devices that may require a relatively large amount of time for operation. Examples of the predetermined device include, but are not limited to, a coffee maker and a ticket vending machine.

[0060] When the checkout area is busy or is likely to be busy in the relatively near future, if there is a store clerk operating a specific device, i.e., a store clerk performing a task other than operating the checkout device, a request for assistance must be notified and additional staff must be provided. According to this condition, it can be determined that a request for assistance must be notified when necessary and effective.

[0061] -The number of clerks in the accounting work area is less than the number of clerks currently on duty- If the number of clerks present in the accounting work area is less than the number of clerks currently on duty, it means that there are clerks who are not present in the accounting work area. In this case, notifying a request for assistance will result in an increase in the number of clerks in the accounting work area. On the other hand, if the number of clerks present in the accounting work area is equal to the number of clerks currently on duty, it means that all of the clerks currently on duty are present in the accounting work area. In this case, notifying a request for assistance will not result in an increase in the number of clerks in the accounting work area. According to this condition, it can be determined that a request for assistance will be notified when necessary and effective.

[0062] The determination unit 13 detects the number of employees on duty and compares that number with the number of employees present in the checkout work area to determine whether the condition is met. The number of employees on duty may be detected based on a pre-created work shift schedule, based on information managed by a time attendance management device that manages the attendance of employees, or by other means.

[0063] When the decision unit 13 decides to notify the request for assistance with the checkout work, the notification unit 14 notifies the request for assistance via an output device. The output device may be a display, a speaker, a mobile terminal, etc., but is not limited to these.

[0064] For example, the request for assistance may be notified to all store clerks via one or more speakers installed to deliver sound throughout the entire store. Alternatively, the request for assistance may be notified to store clerks in a predetermined area of the store via speakers or displays installed in a predetermined area, such as the back of the store. Alternatively, the request for assistance may be notified to a predetermined store clerk via a mobile device carried by the predetermined store clerk. Notification via the mobile device may be via email, push notification on an app, or the like. The predetermined store clerk may be a manager such as a store manager or leader. Alternatively, the predetermined store clerk may be a store clerk who is not in the checkout work area.

[0065] Identifying clerks not present in the checkout work area may be achieved, for example, by the following process. First, clerks present in the checkout work area are identified through facial recognition processing based on images generated by a camera capturing the checkout work area. Next, clerks currently on duty are identified based on a pre-created work shift schedule and information managed by a time attendance management device that manages clerk attendance. After subtracting clerks present in the checkout work area from the clerks currently on duty, the remaining clerks are identified as clerks not present in the checkout work area.

[0066] The notification unit 14 may also notify content other than a request for assistance. For example, if it detects that a device other than a checkout device (such as a microwave, coffee maker, or ticket vending machine) is operating, or if it detects that a store clerk is performing a task other than a checkout in the checkout work area, it may issue a notification requesting assistance with operating the device or the task. In this case, the notification may include information identifying the device or the task.

[0067] Furthermore, if the notification unit 14 detects an event in which a request for assistance is not sent because the number of clerks present in the checkout work area is equal to the number of clerks currently on duty, or if the notification unit 14 detects such an event a predetermined number of times or more within a predetermined period, the notification unit 14 may send a notification requesting a shift improvement. The notification is sent to a predetermined person (such as the store manager). There are no particular limitations on the means for realizing this.

[0068] Next, an example of the processing flow of the notification system 10 will be described with reference to the flowchart of FIG.

[0069] First, the customer situation information generation unit 11 starts generating customer situation information, and the accounting work area information generation unit 12 starts generating accounting work area information (S10). The customer situation information generation unit 11 and the accounting work area information generation unit 12 repeatedly generate this information until processing is completed.

[0070] The determination unit 13 determines whether the customer's situation satisfies the conditions for notification of an assistance request based on the customer situation information (S11). If so (Yes in S11), the determination unit 13 determines whether the accounting work area situation satisfies the conditions for notification of an assistance request based on the accounting work area information (S12). If so (Yes in S12), the notification unit 14 notifies the assistance request (S13).

[0071] If the customer's situation does not meet the conditions for notification of an assistance request (No in S11), or if the situation in the accounting work area does not meet the conditions for notification of an assistance request (No in S12), the notification unit 14 will not notify the assistance request.

[0072] "Action and effect" The notification system 10 of this embodiment determines whether to notify a request for accounting assistance based on "customer status information" and "accounting work area information." By using the customer status information, it is possible to detect current accounting congestion and the possibility of accounting congestion in the relatively near future. Furthermore, by using the accounting work area information, it is possible to appropriately determine the necessity and validity of an assistance request based on the status of the accounting work area. The notification system 10, which determines whether to notify a request for accounting assistance based on such customer status information and accounting work area information, can effectively reduce unnecessary notifications.

[0073] Furthermore, customer status information can be generated by monitoring the checkout waiting area or store entrances and exits, etc. And checkout work area information can be generated by monitoring the checkout work area, etc. Because it is only necessary to monitor such a relatively small area, it is possible to reduce the costs of installing and maintaining equipment, as well as the computer processing load required for image processing.

[0074] Furthermore, since the necessity and validity of the assistance request are determined based on the characteristic accounting work area conditions described above, the necessity and validity of the assistance request can be determined with high accuracy.

[0075] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations can also be adopted.

[0076] In this specification, "acquisition" includes at least one of the following: "the device retrieves data stored in another device or storage medium (active acquisition)" based on user input or program instructions, such as receiving data by making a request or inquiry to another device, or accessing and reading out another device or storage medium; "the device inputs data output from another device (passive acquisition)" based on user input or program instructions, such as receiving data that is distributed (or transmitted, push notification, etc.), and selecting and acquiring data from received data or information; and "the device generates new data by editing data (converting it to text, rearranging data, extracting some data, changing the file format, etc.), and then acquires the new data."

[0077] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes. 1. A customer status information generating means for generating customer status information indicating at least one of the number of customers waiting to pay and the number of customers present in the store based on images taken inside the store; accounting work area information generation means for generating accounting work area information indicating the status of the accounting work area where a store clerk performing accounting work will be located based on images taken inside the store; a decision means for deciding whether to notify a request for assistance with the accounting work based on the customer status information and the accounting work area information; a notification means for notifying the request for assistance via an output device when it is determined that the request for assistance should be notified; A notification system having: 2. The determining means "The number of customers waiting to pay is equal to or greater than the first threshold." "The number of customers in the store is equal to or greater than the second threshold" and, "The number of customers waiting to pay is equal to or exceeds the third threshold, and the number of customers in the store is equal to or exceeds the fourth threshold." At least one of the following is satisfied, and The notification system according to 1, wherein when the situation of the accounting work area indicated by the accounting work area information satisfies a predetermined condition, it is determined to notify the auxiliary request. 3. The notification system according to 1 or 2, wherein the accounting work area information generation means generates the accounting work area information indicating at least one of the number of store employees present in the accounting work area, the content of actions, positions, face orientations, and lines of sight. 4. The determination means determines to notify the auxiliary request when the situation of the accounting work area indicated by the accounting work area information satisfies a predetermined condition, The predetermined conditions are "the number of store employees present in the accounting work area is less than or equal to a fifth reference value", "the number of store employees present in the accounting work area and performing a predetermined action is less than or equal to a sixth reference value", "the number of store employees present in the accounting work area and at a predetermined position in the accounting work area is less than or equal to a seventh reference value", "the number of store employees present in the accounting work area and having a predetermined face orientation is less than or equal to an eighth reference value", "the number of store employees present in the accounting work area and having a predetermined line-of-sight state is less than or equal to a ninth reference value", "there is a store employee present in the accounting work area and performing a predetermined action other than accounting work", "there is a store employee present in the accounting work area and at a position different from the position where the employee will stay during accounting work", "there is a store employee present in the accounting work area and having a face orientation different from the state during accounting work", and The notification system according to 3, which is one or a combination of a plurality of the following connected by logical operators: "there is a store employee present in the accounting work area and having a line-of-sight state different from the state during accounting work". 5. The accounting work area information generation means generates the accounting work area information indicating the operating status of the equipment installed in the accounting work area based on an image taken inside the store or information obtained from an external device, 5. A notification system according to any one of 1 to 4, wherein the device includes at least one of an accounting device and a device other than an accounting device. 6. The decision means decides to notify the assistance request when the status of the accounting work area indicated by the accounting work area information satisfies a predetermined condition; The predetermined condition is: "The number of operating accounting devices is below the 10th standard" and The notification system described in 5, wherein one or more of the following are connected by a logical operator: "Specified equipment other than accounting equipment is in operation." 7. The determining means Detect the number of store clerks on duty, determining to notify the assistance request when the status of the accounting work area indicated by the accounting work area information satisfies a predetermined condition; 7. A notification system according to any one of 1 to 6, wherein the predetermined condition is that "the number of clerks present in the accounting work area is less than the number of clerks on duty at that time." 8. The notification system according to 7, wherein the determining means detects the number of store staff on duty based on shift information or information managed by a time attendance management device. 9. The computer generating customer status information indicating at least one of the number of customers waiting to pay and the number of customers present in the store based on images taken inside the store; generating accounting work area information indicating the status of the accounting work area where the store clerk will be located based on the image captured inside the store; determining whether to notify a request for assistance with accounting work based on the customer status information and the accounting work area information; a notification method for notifying the request for assistance via an output device when it is determined that the request for assistance should be notified; 10. Computer a customer status information generating means for generating customer status information indicating at least one of the number of customers waiting to pay and the number of customers present in the store based on an image taken inside the store; accounting work area information generation means for generating accounting work area information indicating the status of the accounting work area in which a store clerk performing accounting work will be located based on images taken inside the store; a determination means for determining whether to issue a request for assistance with accounting work based on the customer status information and the accounting work area information; a notification means for notifying the request for assistance via an output device when it is determined that the request for assistance should be notified; A program that functions as a

[0078] This application claims priority based on Japanese Patent Application No. 2020-196691, filed on November 27, 2020, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0079] 10. Notification System 11 Customer status information generation unit 12 Accounting work area information generation unit 13 Decision Section 14 Notification Department 1A processor 2A Memory 3A input / output I / F 4A peripheral circuit 5A Bus

Claims

1. Customer situation information generation means for generating customer situation information indicating at least one of the number of customers waiting for accounting and the number of customers in the store based on an image taken inside the store; Accounting work area information generation means for generating accounting work area information which is information indicating the situation of the accounting work area where a store clerk who performs accounting work will be located based on an image taken inside the store or information obtained from an external device, and which indicates the operating status of devices other than the accounting device installed in the accounting work area; Determination means for determining whether to notify an auxiliary request for accounting work based on the customer situation information and the accounting work area information; Notification means for notifying the auxiliary request via an output device when it is determined to notify the auxiliary request; comprising The determination means determines to notify the auxiliary request when at least one of "the number of customers in the store is equal to or more than a second reference value" and "the number of customers waiting for accounting is equal to or more than a third reference value and the number of customers in the store is equal to or more than a fourth reference value" is satisfied, and the situation of the accounting work area indicated by the accounting work area information satisfies a predetermined condition; The devices other than the accounting device include a microwave oven, a coffee maker, or a ticket vending machine notification system.

2. The accounting work area information generation means generates the accounting work area information indicating at least one of the number of store clerks present in the accounting work area, their action content, position, face orientation, and line of sight, according to the notification system described in Claim 1.

3. The determination means determines to notify the auxiliary request when the situation of the accounting work area indicated by the accounting work area information satisfies a predetermined condition; The predetermined conditions are "the number of store clerks present in the accounting work area is equal to or less than a fifth reference value", "the number of store clerks present in the accounting work area and performing a predetermined action is equal to or less than a sixth reference value", "the number of store clerks present in the accounting work area and at a predetermined position in the accounting work area is equal to or less than a seventh reference value", "the number of store clerks present in the accounting work area and having a predetermined face orientation is equal to or less than an eighth reference value", "the number of store clerks present in the accounting work area and having a predetermined line of sight state is equal to or less than a ninth reference value", "there is a store clerk present in the accounting work area and performing a predetermined action other than accounting work", "there is a store clerk present in the accounting work area and at a position different from the position where they will stay during accounting work". "There is a store employee who is present within the accounting work area and whose face orientation is in a state different from that during accounting work", and, The notification system according to claim 2, including one or a plurality of conditions obtained by connecting "There is a store employee who is present within the accounting work area and whose line-of-sight state is in a state different from that during accounting work" with a logical operator.

4. When the situation of the accounting work area indicated by the accounting work area information satisfies a predetermined condition, the determination means determines to notify the auxiliary request. The predetermined condition is "The number of operating accounting devices is equal to or less than the tenth reference value" and The notification system according to any one of claims 1 to 3, including one or a plurality of conditions obtained by connecting "Devices other than the accounting device are operating" with a logical operator.

5. The determination means detects the number of store employees on duty, When the situation of the accounting work area indicated by the accounting work area information satisfies a predetermined condition, the determination means determines to notify the auxiliary request. The notification system according to any one of claims 1 to 4, wherein the predetermined condition includes "The number of store employees present within the accounting work area is less than the number of store employees on duty at that time".

6. The notification system according to claim 5, wherein the determination means detects the number of store employees on duty based on shift information or information managed by an attendance management device.

7. A computer generates customer situation information indicating at least one of the number of customers waiting for accounting and the number of customers in the store based on an image taken inside the store, generates accounting work area information indicating the situation of the accounting work area where the store employee performing accounting work is located based on an image taken inside the store or information obtained from an external device, the accounting work area information indicating the operating status of devices other than the accounting device installed within the accounting work area, determines whether to notify an auxiliary request for accounting work based on the customer situation information and the accounting work area information, when it is determined to notify the auxiliary request, notifies the auxiliary request via an output device, determines to notify the auxiliary request when at least one of "The number of customers in the store is equal to or more than the second reference value" and "The number of customers waiting for accounting is equal to or more than the third reference value and the number of customers in the store is equal to or more than the fourth reference value" is satisfied, and the situation of the accounting work area indicated by the accounting work area information satisfies a predetermined condition. A notification method including devices other than the accounting device, such as a microwave oven, a coffee maker, or a ticket vending machine.

8. A computer, Customer situation information generation means for generating customer situation information indicating at least one of the number of customers waiting for accounting and the number of customers in the store based on an image taken inside the store, Accounting work area information generation means for generating accounting work area information indicating the situation of the accounting work area where the store clerk who performs the accounting work will be located based on the image taken inside the store or the information obtained from an external device, and indicating the operating status of devices other than the accounting device installed in the accounting work area, Determination means for determining whether to notify an auxiliary request for the accounting work based on the customer situation information and the accounting work area information, Notification means for notifying the auxiliary request via an output device when it is determined to notify the auxiliary request, Function as, The determination means, Determines to notify the auxiliary request when at least one of "the number of customers in the store is equal to or more than a second reference value" and "the number of customers waiting for accounting is equal to or more than a third reference value and the number of customers in the store is equal to or more than a fourth reference value" is satisfied and the situation of the accounting work area indicated by the accounting work area information satisfies a predetermined condition, A program including devices other than the accounting device, such as a microwave oven, a coffee maker, or a ticket vending machine.

Images