Monitoring device and program

Abstract

To provide a monitoring device capable of detecting availability of an accounting machine with high accuracy. [Solution] A monitoring device according to an embodiment includes an acquisition unit, a detection unit, a determination unit, and an output unit. The acquisition unit acquires a status indicating the completion of a transaction executed at a payment machine. The detection unit detects changes within a monitoring area that includes at least a portion of the payment machine after the transaction is completed. The determination unit determines the availability of the payment machine based on the status and the detection result of the changes within the monitoring area. The output unit outputs the availability determination result.

Description

[Technical Field]

[0001] An embodiment of the present invention relates to a monitoring device and a program. [Background technology]

[0002] In recent years, full-self-service POS (Point of Sales) terminals, so-called self-service POS terminals, have become widespread in retail stores such as supermarkets and convenience stores. The introduction of self-service POS terminals allows customers to operate the terminal themselves to perform all accounting tasks, from registering purchased items to paying for them, which has the advantage of reducing manpower and reducing personnel costs.

[0003] For example, multiple self-service POS terminals are installed in a checkout area. A customer finds an available self-service POS terminal at the entrance to the checkout area and uses it. However, it is sometimes not possible to see all of the self-service POS terminals from the entrance to the checkout area. To increase the operating efficiency of the self-service POS terminals and reduce unnecessary waiting time, store clerks inform customers at the entrance to the checkout area of ​​available self-service POS terminals. To do this, store clerks visually find available self-service POS terminals, but the task of visually checking for available terminals and verbally informing customers of available terminals places a burden on the clerk's work. Therefore, there is a need for technology that can detect available self-service POS terminals using output from a human presence sensor or the like and inform customers of available terminals. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-173751 Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the embodiments of the present invention is to provide a monitoring device and a program that can improve the accuracy of detecting whether a payment machine is available. [Means for solving the problem]

[0006] A monitoring device according to an embodiment includes an acquisition unit, a detection unit, a determination unit, and an output unit. The acquisition unit acquires a status indicating the completion of a transaction executed at a payment machine. The detection unit detects changes within a monitoring area that includes at least a portion of the payment machine after the transaction is completed. The determination unit determines the availability of the payment machine based on the status and the detection result of the changes within the monitoring area. The output unit outputs the availability determination result. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic diagram showing a schematic configuration of a checkout system according to an embodiment. [Figure 2] FIG. 2 is a schematic diagram showing the positional relationship between the self-service POS terminal and the purchaser who is its operator. [Figure 3] FIG. 3 is a schematic diagram showing the imaging area of ​​the camera. [Figure 4] FIG. 4 is a schematic diagram showing an example layout of a checkout area. [Figure 5] FIG. 5 is a block diagram showing the main circuit configuration of the monitoring device. [Figure 6] FIG. 6 is a block diagram showing the main functional configuration of the processor of the monitoring device. [Figure 7] FIG. 7 is a sequence diagram illustrating an example of the operation of the checkout system according to the embodiment. [Figure 8] FIG. 8 is a flowchart illustrating an example of the operation of the monitoring device according to the embodiment. [Figure 9] FIG. 9 is a schematic diagram showing a schematic configuration of a checkout system according to another embodiment. [Figure 10] FIG. 10 is an explanatory diagram of an image processing area in another embodiment. [Figure 11] FIG. 11 is an explanatory diagram of an image processing area in another embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, the embodiments will be described with reference to the drawings.

[0009] [Explanation of the self-checkout system] First, an embodiment of a checkout system 100 to which a monitoring device 50 is applied will be described with reference to FIGS.

[0010] 1 is a schematic diagram showing the overall configuration of a checkout system 100. The checkout system 100 includes multiple self-service POS terminals 10, an attendant terminal 20, a store server 30, and a guide device 70. The checkout system 100 connects each of the self-service POS terminals 10, the attendant terminal 20, the store server 30, and the guide device 70 via a communication network 40 such as a LAN (Local Area Network). The store server 30 outputs various information related to the checkout system 100 to each of the self-service POS terminals 10, the attendant terminal 20, and the guide device 70 connected via the communication network 40.

[0011] The multiple self-service POS terminals 10 are called registration checkout devices, and are each installed at the checkout counter RE (see FIG. 4) of a store. The operator is a consumer who has finished shopping, i.e., a purchaser. The registration checkout device has the function of registering data on the purchased items purchased by the consumer (purchaser) and the function of performing transaction operations related to the checkout of the registered items. A purchaser who places the purchased items in a shopping cart or the like in a sales area where items are displayed and moves to the checkout counter RE operates the self-service POS terminal 10 to perform a series of transactions by themselves. For example, the purchaser operates the self-service POS terminal 10 to perform the checkout operations from registering the purchased items to paying for them by themselves. The self-service POS terminal 10 is an example of a checkout machine. In other words, the registration checkout device is an example of a checkout machine.

[0012] The attendant terminal 20 is installed in a monitoring station located near the exit of the checkout area RE. The attendant terminal 20 displays, on a display device, a list of purchased items registered for each self-service POS terminal 10. If an error occurs in the self-service POS terminal 10, the attendant terminal 20 notifies the customer of the error. The store clerk at the monitoring station, i.e., the attendant, monitors the checkout area RE based on the information displayed and notified on the attendant terminal 20. Although FIG. 1 shows one attendant terminal 20, multiple attendant terminals 20 may be connected to the communication network 40.

[0013] Each self-service POS terminal 10 is equipped with a monitoring device 50. The monitoring device 50 may be located either inside or outside the self-service POS terminal 10. The monitoring device 50 is a device for monitoring a customer operating the self-service POS terminal 10. Specifically, the monitoring device 50 monitors the availability of the self-service POS terminal 10 based on information such as images captured by a camera 60 installed near the self-service POS terminal 10. The monitoring device 50 then outputs guidance information according to the availability. The guidance information is output to the attendant terminal 20 and the guidance device 70. Each monitoring device 50 is connected to the attendant terminal 20 and the guidance device 70 via the communication network 40 and outputs the guidance information to the attendant terminal 20 and the guidance device 70. Each monitoring device 50 may also output the guidance information to the attendant terminal 20 and the guidance device 70 without going through the communication network 40.

[0014] The output destination of the guidance information is not limited to the attendant terminal 20 and the guidance device 70. The output destination of the guidance information may also include the self-service POS terminal 10. Alternatively, the output destination of the guidance information may be other devices, such as a communication terminal such as a smartphone carried by the store clerk. The guidance information includes the availability of the self-service POS terminal 10. The availability includes terminal identification information that identifies an available self-service POS terminal 10. The availability may also include terminal identification information that identifies an unavailable self-service POS terminal 10 that is in use. The terminal identification information is the terminal's serial number or location information, etc.

[0015] Fig. 2 is a schematic diagram showing the positional relationship between the self-service POS terminal 10 and the purchaser SH who is its operator. Fig. 2 shows the self-service POS terminal 10 as viewed from above. As shown in the figure, the self-service POS terminal 10 has a terminal housing 11 sandwiched between it, with a shopping basket SB mounting stand 12 on one side and an automatic change dispenser 13 on the other side. Operation devices such as a touch panel 14 and a scanner 15 are provided on the top of the terminal housing 11, and a receipt printer 16 and the like are provided above the automatic change dispenser 13. In addition, the area in front of the touch panel 14 and scanner 15 at the top of the terminal housing 11 is a space SP for bagging.

[0016] The customer SH moves to the checkout area RE and stands in front of the terminal housing 11 so that the table 12 is located on the right side and the automatic change dispenser 13 is located on the left side. The customer SH then prepares a reusable bag or a plastic bag in the space SP, operates the touch panel 14 to select a reusable bag or a plastic bag, and registers the data of the purchased items in the self-service POS terminal 10. That is, the customer SH removes each item from the shopping cart SB placed on the table 12 and scans the barcode of each item with the scanner 15. If the purchased item does not have a barcode, the customer SH operates the touch panel 14 to display a list of items without barcodes and selects the purchased item from that list. The customer SH places the items whose data has been registered in the self-service POS terminal 10 into the reusable bag or plastic bag. After registering the data of all the purchased items in this way, the customer SH operates the touch panel 14 to select a payment method. If the customer SH selects cash payment, for example, the customer SH inserts cash into the automatic change dispenser 13. Thus, when payment is completed, a receipt is issued from the receipt printer 16, and the purchaser SH receives the receipt and leaves the checkout area RE with the bag or shopping bag containing the purchased items.

[0017] In order to monitor the transaction behavior of such customers, a camera 60 is attached above the self-service POS terminal 10. FIG. 3 is a schematic diagram showing the image capturing area ARa of the camera 60. As shown in the figure, the camera 60 captures an image of a monitoring area that includes at least a portion of the self-service POS terminal 10. The camera 60 captures an image of the image capturing area ARa, which is an example of a monitoring area. The image capturing area ARa includes the terminal housing 11, the placing table 12, and the automatic change dispenser 13 of the self-service POS terminal 10, as well as the space in front of them where customers enter and exit.

[0018] The monitoring device 50 captures an image of the shooting area ARa from the camera 60 and detects a person detection area ARb and an item detection area ARc from the shooting area ARa. The person detection area ARb is an area corresponding to the operation position of the customer SH, which is the front side of the terminal housing 11. The item detection area ARc is an area that includes the terminal housing 11 on which the customer SH may place their own bag or shopping bag, the placing table 12 on which the customer SH may place their shopping basket SB, and the automatic change machine 13 on which the customer SH may place their personal belongings. In other words, the shooting area ARa includes the person detection area ARb and the item detection area ARc. Note that the person detection area ARb and the item detection area ARc may partially overlap.

[0019] FIG. 4 is a schematic diagram showing an example layout of a checkout area RE. In this embodiment, the checkout area RE has a rectangular space, with one side of the space being an entrance ENT and the other side being an exit EXT. A plurality of self-service POS terminals 10 (four in the figure) are arranged facing each other on both sides of the space between the entrance ENT and the exit EXT. A guide device 70 is installed near the entrance ENT. A monitoring station is also installed near the exit EXT, and an attendant terminal 20 is installed at this monitoring station so that an attendant AT can monitor the checkout area RE.

[0020] In the checkout area RE with such a layout, a customer SH who has finished shopping in the sales area checks for an available self-service POS terminal 10 using the guide device 70, enters the checkout area RE from the entrance ENT, and stands in front of the available self-service POS terminal 10. The customer SH then operates the self-service POS terminal 10 to register the purchased items, pays for them, and then exits through the exit EXT.

[0021] As described above, the monitoring device 50 detects the availability of the self-service POS terminal 10. Specifically, the monitoring device 50 acquires a status indicating the completion of a transaction executed at the self-service POS terminal 10, and detects a change in an area including at least a part of the self-service POS terminal 10 after the transaction is completed. The monitoring device 50 determines the availability of the self-service POS terminal 10 based on the status and the detection result of the change in the area, and outputs the availability determination result. An embodiment of the monitoring device 50 that operates in this manner will be described below with reference to FIGS.

[0022] [Configuration of monitoring device] 5 is a block diagram showing the main circuit configuration of a monitoring device 50. The monitoring device 50 includes circuit components such as a processor 51, a main memory 52, an auxiliary storage device 53, a clock 54, a terminal interface 55, a camera interface 56, and a network interface 57, as well as a system transmission path 58. The system transmission path 58 includes an address bus, a data bus, a control signal line, etc. The monitoring device 50 configures a computer by connecting each circuit component to the system transmission path 58.

[0023] The processor 51 corresponds to the central part of a computer. The processor 51 controls each part to realize various functions of the monitoring device 50 in accordance with an operating system or an application program (application software). The processor 51 is, for example, a CPU (Central Processing Unit).

[0024] The main memory 52 corresponds to the main storage portion of the computer. The main memory 52 includes a nonvolatile memory area and a volatile memory area. The main memory 52 stores an operating system or application programs in the nonvolatile memory area. The main memory 52 may store data required for the processor 51 to execute processes for controlling each part in either the nonvolatile or volatile memory area. The main memory 52 uses the volatile memory area as a work area where data is rewritten by the processor 51 as appropriate. The nonvolatile memory area is, for example, ROM (Read Only Memory). The volatile memory area is, for example, RAM (Random Access Memory).

[0025] The auxiliary storage device 53 corresponds to the auxiliary storage portion of the computer. For example, an EEPROM (registered trademark) (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disc Drive), or an SSD (Solid State Drive) can be the auxiliary storage device 53. The auxiliary storage device 53 stores data used by the processor 51 when performing various processes, or data created by the processes of the processor 51. The auxiliary storage device 53 may also store the application programs described above.

[0026] The clock 54 keeps track of the date and time. The monitoring device 50 processes the date and time kept by the clock 54 as the current date and time.

[0027] The terminal interface 55 connects to the self-service POS terminal 10. The terminal interface 55 controls two-way data communication between the self-service POS terminal 10. The connection between the monitoring device 50 and the self-service POS terminal 10 may be wired or wireless.

[0028] The camera interface 56 connects to the camera 60 provided in the self-service POS terminal 10. The camera interface 56 outputs a control signal to the camera 60 to control the operation of the camera 60. The camera 60 performs a photographing operation in accordance with this control signal. The camera interface 56 then captures image data of the photographing area ARa photographed by the camera 60.

[0029] The network interface 57 is connected to the communication network 40. The network interface 57 performs data communication with, for example, the attendant terminal 20 and the guide device 70 via the communication network 40. The network interface 57 can also perform data communication with other devices connected to the communication network 40.

[0030] [Functional description of monitoring device] 6 is a block diagram showing the main functional configuration of the processor 51 of the monitoring device 50. As shown in the figure, the processor 51 includes an acquisition unit 511, a detection unit 512, a determination unit 513, and an output unit 514.

[0031] The acquisition unit 511 acquires a status signal indicating the completion of a transaction executed at the self-service POS terminal 10. The self-service POS terminal 10 outputs status signals corresponding to various statuses to the attendant terminal 20 and the monitoring device 50. The statuses of the self-service POS terminal 10 include default before the start of a transaction, registering after a command to start registration has been issued, registering after a command to start payment has been issued, and transaction completed when the transaction is complete.

[0032] In this embodiment, the default before transaction starts is defined as before the transaction starts, and transaction completion is defined as the completion of the transaction. The status of the self-service POS terminal 10 transitions from default to registering, then transitions to transaction in progress, and returns to default after transaction completion. The monitoring device 50 may receive the status signal via the attendant terminal 20 or may receive the status signal directly from the self-service POS terminal 10.

[0033] The detection unit 512 detects changes in an area including at least a part of the self-service POS terminal 10 after a transaction is completed. The detection unit 512 detects changes in the imaging area ARa based on captured images (video) output from the camera 60 monitoring the imaging area ARa. The detection unit 512 stores a reference image captured by the camera 60 from above the self-service POS terminal 10 in a state where the purchaser SH is not present at the operation position of the self-service POS terminal 10 where the transaction operation related to the transaction is performed by the purchaser SH and in a state where no object is placed on the self-service POS terminal 10. In other words, the detection unit 512 stores as a reference image the image captured by the camera 60 from above the self-service POS terminal 10 in a state where the purchaser SH is not present in the person detection area ARb and no object is placed in the item detection area ARc.

[0034] This state is defined as the state before the transaction operation for the transaction is initiated (before the transaction is completed). The transaction operation for the transaction is the operation from registering the purchased item to paying the price. The operation position is included in the person detection area ARb described above. The reference image includes a first reference image and a second reference image, where the first reference image corresponds to the image captured in the person detection area ARb (hereinafter referred to as the first captured image), and the second reference image corresponds to the image captured in the item detection area ARc (hereinafter referred to as the second captured image). The reference images may be stored in main memory 52 or in auxiliary storage device 53.

[0035] The detection unit 502 compares the reference image with the captured image. The captured image to be compared is, among the captured images output from the camera 60, an image captured after the purchaser SH has completed the transaction operation related to the transaction at the self-service POS terminal 10 (after the transaction is completed). The detection unit 512 compares the reference image with the captured image and detects changes in the captured area ARa based on the comparison result.

[0036] That is, after the transaction is completed based on the status signal, the detection unit 512 compares the first reference image with the first captured image corresponding to the person detection area ARb after the transaction is completed, and detects a change in the person detection area ARb based on the difference between the first reference image and the first captured image.Furthermore, after the transaction is completed based on the status signal, the detection unit 512 compares the second reference image with the second captured image corresponding to the item detection area ARc after the transaction is completed, and detects a change in the person detection area ARb based on the difference between the second reference image and the second captured image.

[0037] The detection unit 512 detects the presence or absence of a person based on a change in the person detection area ARb. That is, the detection unit 512 detects the presence or absence of a purchaser SH (person) based on a comparison result between the first captured image of the person detection area ARb and the first reference image. The purchaser is not included in the first reference image.

[0038] However, when the purchaser SH enters the person detection area ARb, the image of the purchaser SH is included in the first captured image corresponding to the person detection area ARb. The detection unit 512 compares the first reference image with the first captured image of the person detection area ARb, and detects the purchaser SH if the difference value between the first reference image and the first captured image of the person detection area ARb exceeds a reference value.

[0039] When the customer SH leaves the person detection area ARb, the image of the customer SH is no longer included in the first captured image corresponding to the person detection area ARb. The detection unit 512 detects that the customer SH has left (the customer SH is not present) when the difference value between the first reference image and the first captured image becomes equal to or less than a reference value.

[0040] Furthermore, the detection unit 512 detects the presence or absence of an object based on a change in the item detection area ARc. That is, the detection unit 512 detects the presence or absence of an object based on the comparison result between the second captured image corresponding to the item detection area ARc and the second reference image. The object is, for example, a reusable bag or a plastic bag placed in the bagging space SP of the terminal housing 11, a shopping basket SB placed on the platform 12, personal belongings placed on the automatic change machine 13, etc.

[0041] The second reference image does not show the above-mentioned objects, but when the customer SH prepares a reusable bag or a shopping bag in the bagging space SP, places a shopping basket SB on the platform 12, or places personal belongings on the automatic change dispenser 13, the second captured image corresponding to the item detection area ARc includes an image of the object.

[0042] The detection unit 512 compares the second reference image with the second captured image corresponding to the item detection area ARc, and detects an object if the difference between the second reference image and the second captured image of the item detection area ARc exceeds a reference value. The detection unit 512 also detects the absence of an object if the difference between the second reference image and the second captured image is equal to or less than the reference value.

[0043] Items that a purchaser determines are unnecessary may be left behind as residue in the bagging space SP of the self-service POS terminal 10, on the table 12, or on the top surface of the automatic change dispenser 13. For example, if a purchaser picks up cutlery such as a knife, fork, spoon, or disposable chopsticks provided around the self-service POS terminal 10 but then decides they are unnecessary and places them on the automatic change dispenser 13, or if the purchaser does not take home a receipt issued by the receipt printer 16, the cutlery, receipt, etc. are left behind as residue. In this embodiment, the items are detected, residue is detected from the detected items, and the target object is detected by excluding the residue from the items.

[0044] The detection unit 512 stores the images of the residue, detects the images of the residue from the images of the items detected from the item detection area ARc, and detects the images of the object from the images of the items by excluding the images of the residue from the images of the items. For example, if the similarity between the image of the residue and the image of the item detected from the item detection area ARc exceeds a predetermined threshold, the detection unit 512 detects the image of the item detected from the item detection area ARc as the image of the residue.

[0045] As described above, the detection unit 512 detects changes in the monitored area based on captured images output from one or more cameras 60 monitoring the monitored area, but this is not limiting. The detection unit 512 may detect changes in the monitored area based on sensor signals output from one or more sensors monitoring the monitored area, or may detect changes in the monitored area by combining captured images and sensor signals. The sensor may be either a human presence sensor that detects people in the monitored area, or a weight sensor that detects the weight of an object in the monitored area. For example, the human presence sensor detects the presence or absence of a person in the human detection area ARb, and the weight sensor detects the presence or absence of an object in the object detection area ARc.

[0046] The detection unit 512 may also include a wireless reader and detect changes within the monitoring area based on signals from wireless tags such as RFID (Radio Frequency Identification) tags. If a product with an RFID tag is left in the monitoring area, the wireless reader of the detection unit 512 receives a signal from the wireless tag of the product left in the monitoring area. The detection unit 512 detects the target object when it receives the signal.

[0047] The determination unit 513 determines whether the self-service POS terminal 10 is available or unavailable based on the status and the detection result of the change in the area. The determination unit 513 determines the self-service POS terminal 10 to be in use, indicating that it is in use, from when it acquires a status indicating the start of the transaction until it acquires a status indicating the completion of the transaction. The determination unit 513 determines the self-service POS terminal 10 to be in use while a person is detected after it acquires a status indicating the completion of the transaction. The determination unit 513 determines the self-service POS terminal 10 to be in use while a person is not detected and an object is detected after it acquires a status indicating the completion of the transaction. The determination unit 513 determines the self-service POS terminal 10 to be available, indicating that it is available, while a person is not detected and an object is not detected after it acquires a status indicating the completion of the transaction.

[0048] The output unit 514 outputs the determination result of the availability of the self-service POS terminal 10. The output unit 512 outputs, as the determination result, whether the self-service POS terminal 10 is in use or available. The output unit 51 may also output whether the self-service POS terminal 10 is in use or available, along with information indicating the number or location of the self-service POS terminal 10.

[0049] [Operational explanation of monitoring device] The processor 51 of the monitoring device executes the monitoring program to realize the functions of an acquisition unit 511, a detection unit 512, a determination unit 513, and an output unit 514.

[0050] The monitoring program is a type of application program stored in the main memory 52 or the auxiliary storage device 53. There are no particular limitations on the method for installing the monitoring program in the main memory 52 or the auxiliary storage device 53. The monitoring program can be recorded on a removable recording medium, or can be distributed via communication over a network and installed in the main memory 52 or the auxiliary storage device 53. The recording medium can be in any form, such as a CD-ROM or memory card, as long as it can store the program and is readable by the device.

[0051] 7 is a sequence diagram showing an example of the operation of the checkout system according to the embodiment. The camera 60 outputs a captured image of the monitoring area (ACT1). The captured image from the camera 60 is continuously output during the monitoring period. The self-service POS terminal 10 outputs a status signal indicating the completion of the transaction in response to the completion of the transaction (ACT1).

[0052] The acquisition unit 511 of the monitoring device 50 acquires a status signal indicating the completion of the transaction (ACT31). The self-service POS terminal 10 may output the status signal directly to the monitoring device 50, or may output the status signal indirectly to the monitoring device 50 via another terminal or a server. Alternatively, the acquisition unit 511 may inquire of another terminal or a server about the presence or absence of a status signal.

[0053] The detection unit 512 detects a change in the monitoring area including at least a part of the self-service POS terminal 10 after the transaction is completed based on the acquisition of a status signal indicating the completion of the transaction (ACT32). The detection unit 512 detects the change in the monitoring area ARa based on a captured image output from the camera 60 monitoring the monitoring area ARa. The detection unit 512 detects the change in the monitoring area based on the difference between a reference image of the monitoring area before the transaction is started and a captured image after the transaction is completed.

[0054] The determination unit 513 determines whether the self-service POS terminal 10 is available based on the status signal indicating the completion of the transaction and the detection result of the change in the monitoring area (ACT33). The determination unit 513 determines that the self-service POS terminal 10 is available when the transaction is completed, no person is detected, and no object is detected. Furthermore, the determination unit 513 determines that the self-service POS terminal 10 is in use when the transaction is completed, no person is detected, and an object is detected.

[0055] The output unit 514 outputs the determination result of the availability (ACT34). The network interface 57 transmits the availability to the guiding device 70 (ACT35). The guiding device 70 receives the availability and displays the availability via a display or the like. For example, the network interface 57 outputs the serial number and location information of an available self-service POS terminal 10, and the guiding device 70 displays the serial number and location information of the available self-service POS terminal 10. Furthermore, the network interface 57 outputs the serial number and location information of an in-use self-service POS terminal 10, and the guiding device 70 displays the serial number and location information of the in-use self-service POS terminal 10.

[0056] 8 is a flowchart showing an example of the operation of the monitoring device according to the embodiment. When the self-service POS terminal 10 outputs a status signal indicating the completion of the transaction in response to the completion of the transaction, the monitoring device 50 receives the status signal indicating the completion of the transaction and starts determining the availability of the self-service POS terminal 10. The acquiring unit 511 acquires the status signal indicating the completion of the transaction output from the self-service POS terminal 10 (ACT301, YES).

[0057] The detection unit 512, triggered by the acquisition timing of a status signal indicating the completion of the transaction, selects a captured image from the images captured by the camera 60 capturing the image of the imaging area ARa (ACT 302). In other words, the selected captured image is the image captured after the transaction is completed.

[0058] The detection unit 512 compares the first reference image corresponding to the person detection area ARb before the transaction is completed with the first captured image corresponding to the person detection area ARb after the transaction is completed, and detects a change in the person detection area ARb based on the difference between the first reference image and the first captured image. If the difference between the first reference image and the first captured image exceeds a reference value, the detection unit 512 detects a person based on the difference value (ACT303, YES), and if the difference is equal to or less than the reference value, the detection unit 512 does not detect a person based on the difference value (ACT303, NO).

[0059] The detection unit 512 also compares a second reference image corresponding to the person detection area ARc before the transaction is completed with a second captured image corresponding to the item detection area ARc after the transaction is completed, and detects a change in the item detection area ARc based on the difference between the second reference image and the second captured image. If the difference between the second reference image and the second captured image exceeds a reference value, the detection unit 512 detects the item based on the difference value (ACT304). If the difference is equal to or less than the reference value, the detection unit 512 does not detect the item based on the difference value (ACT304, NO). Furthermore, the detection unit 512 compares the image of the residue with the image of the item, and if the similarity between the image of the residue and the image of the item exceeds a predetermined threshold, the detection unit 512 detects the image of the item as an image of the residue. If the similarity is equal to or less than the predetermined threshold, the detection unit 512 detects the image of the item as an image of the object. In other words, if the similarity exceeds a predetermined threshold, the detection unit 512 does not detect the item as an object (ACT305, NO), and if the similarity is equal to or less than the predetermined threshold, the detection unit 512 detects the item as an object (ACT305, YES).

[0060] The determination unit 513 receives a status signal indicating the completion of the transaction (ACT301, YES), and when no person is detected (ACT303, NO), no article or object is detected (ACT304, NO) (ACT305, NO), and the time limit has elapsed (ACT306, YES), it determines whether the self-service POS terminal 10 is available (ACT307). The time limit is an arbitrarily set time, for example, 5 seconds. The output unit 514 outputs the availability determination result (ACT308).

[0061] The determination unit 513 acquires a status signal indicating the completion of the transaction (ACT301, YES), and determines that the self-service POS terminal 10 is in use during the period in which a person is detected (ACT309). The determination unit 513 also acquires a status signal indicating the completion of the transaction, and determines that the self-service POS terminal 10 is in use during the period in which no person is detected but an article is detected (ACT309). The output unit 514 outputs the determination result that the self-service POS terminal 10 is in use (ACT310).

[0062] The self-service POS terminal to which the monitoring device 50 is applied is not limited to the self-service POS terminal 10 described in this embodiment. For example, it may be a self-service POS terminal that can park a shopping cart instead of the stand 12. Alternatively, it may be a self-service POS terminal in which an automatic change dispenser 13 is built into the terminal housing 11 and a space SP for bagging is provided on one side of the terminal housing 11. Also, there is a checkout system in which a purchaser registers products themselves using an information terminal such as a tablet terminal or smartphone, and then pays for the products themselves using a dedicated checkout machine. The monitoring device 50 of this embodiment may be applied to the checkout machine of such a checkout system.

[0063] [Other embodiments] Although one embodiment has been described above, the embodiment is not limited to this. For example, in the above embodiment, one monitoring device 50 is provided for one self-service POS terminal 10. In another embodiment, as in the checkout system 200 shown in FIG. 9 , one monitoring device 500 may be provided for multiple self-service POS terminals 10, and the monitoring device 500 may centrally monitor customers at each self-service POS terminal 10. In this case, the monitoring device 500 captures images from the cameras 60 provided for each self-service POS terminal 10. The monitoring device 500 also acquires the status of each self-service POS terminal 10 via the attendant terminal 20. The monitoring device 500 then detects the availability of each self-service POS terminal 10 using the status and the images captured by the cameras 60. The monitoring device 500 is connected to a guiding device 70 and outputs the detection result of the availability to the guiding device 70. The output unit 512 of the monitoring device 500 may list the availability of the multiple self-service POS terminals 10 and output the list to the guiding device 70. The list may include the machine numbers or location information of available self-service POS terminals 10 and the machine numbers or location information of in-use self-service POS terminals 10. The guidance device 70 may receive the availability status of each self-service POS terminal 10 and list the availability status of each self-service POS terminal 10.

[0064] In the above embodiment, the front sides of the terminal housing 11, the table 12, and the automatic change dispenser 13 of the self-service POS terminal 10 are defined as the person detection area ARb. In another embodiment, as shown in FIG. 11 , the front side of the terminal housing 11, which is inside the person detection area ARb, is defined as the customer operation area ARd. The monitoring device 50 detects vacancy when a person is no longer detected in the customer operation area ARd and an object is no longer detected in the item detection area ARc. By doing so, even if there are multiple people, such as a family, in front of an adjacent self-service POS terminal 10 and one of them enters the person detection area ARb of the self-service POS terminal 10, the availability of the self-service POS terminal 10 can be detected with high accuracy.

[0065] In the above embodiment, the person detection area ARb and the article detection area ARc are described as different areas. In this regard, as shown in Fig. 11, the person detection area ARb and the article detection area ARc may be the same area. In other words, the monitoring device 50 may detect whether or not a person or an article is present in the same area.

[0066] In the embodiment described above, the detection unit 512 sets the item detection area ARc not only to the bagging space SP in the self-service POS terminal 10, but also to the top of the placing table 12 and the automatic change dispenser 13. In another embodiment, the detection unit 512 sets the item detection area ARc only to the bagging space SP. By doing so, the monitoring device 50 does not detect, for example, an empty shopping basket SB left on the placing table 12 as an object, and can detect the availability of the self-service POS terminal 10 with high accuracy.

[0067] The following is an example of a monitoring device and a program according to this embodiment. [C1] an acquisition unit that acquires a status indicating completion of a transaction executed on the accounting machine; a detector that detects a change in a monitored area including at least a portion of the checkout machine after the transaction is completed; a determination unit that determines whether the payment machine is available or not based on the status and the result of detecting changes in the monitoring area; an output unit that outputs the determination result of the availability; A monitoring device comprising: The monitoring device detects changes in the monitoring area after the transaction is completed, triggered by a status indicating the completion of the transaction, and determines the availability of a cashier based on the status and the detection results. If an attempt was made to determine the availability of a cashier solely based on the detection of changes in the monitoring area, there is a risk of falsely detecting an available cashier when a customer temporarily leaves the cashier during a transaction. However, this system prevents such false detections and can accurately determine the availability of a cashier. This frees store clerks from the task of visually checking for available terminals and verbally informing customers about available terminals, thereby reducing the workload of store clerks.

[0068] [C2-1] The monitoring device of [C1], wherein the detection unit detects changes within the monitoring area based on a sensor signal output from a sensor monitoring the monitoring area. By using a relatively inexpensive sensor, it is possible to provide a monitoring device that can determine the availability of a cash register at low cost and with high accuracy.

[0069] [C2-2] The monitoring device of [C1], wherein the detection unit detects changes within the monitoring area based on captured images output from a camera monitoring the monitoring area. By using the captured images output from the camera, the monitoring device can detect various changes within the monitoring area and determine the availability of payment machines with high accuracy.

[0070] [C3] The monitoring device of [C2-2], wherein the detection unit detects changes within the monitoring area based on the difference between a reference image of the monitoring area before the transaction is initiated and the captured image after the transaction is completed. If a monitoring device attempts to detect changes within the monitoring area using only captured images without using a reference image, the burden of image analysis will be heavy. For example, analyzing images using AI (Artificial Intelligence) requires not only high-performance hardware but also time for training, which places a heavy burden on the system. Furthermore, circumstances surrounding the cash register may make it difficult to achieve accurate detection. On the other hand, if the monitoring device detects changes in the monitoring area based on the difference between the reference image and the captured image, the burden on the monitoring device can be reduced, contributing to faster vacancy detection. Furthermore, by utilizing the difference between the reference image and the captured image, the monitoring device can achieve superior detection accuracy compared to when trying to detect changes in the monitoring area using only the captured image.

[0071] [C4-1] The monitoring device of [C2-2], wherein the detection unit detects the presence or absence of a person based on changes within a person detection area included in the monitoring area, and detects the presence or absence of an object based on changes within an item detection area included in the monitoring area. The monitoring device targets a person detection area included in the monitoring area and detects the presence or absence of a person from the person detection area. The monitoring device also targets an item detection area included in the monitoring area and detects the presence or absence of an object from the item detection area. By detecting people from some areas of the monitoring area and objects from other areas of the monitoring area, the monitoring device can determine the vacancy status of a cash register with high accuracy while eliminating the risk of false detection.

[0072] [C4-2] The monitoring device of [C4-1], wherein the detection unit detects the presence or absence of the target object by excluding residues included in the item detection area based on a registered residue image. The monitoring device detects whether or not the target object is present, excluding any remaining objects, and determines the availability of the cash register based on the detection results, thereby eliminating the risk of erroneously determining that the cash register is in use based on the detection of remaining objects that the purchaser has determined to be unnecessary.

[0073] [C5-1] The monitoring device of [C4-1], wherein the determination unit determines whether the cash register is available when the detection unit does not detect a person and the object. The monitoring device uses the status indicating transaction completion as a trigger to detect changes in the monitoring area after the transaction is completed, and determines whether a cash register is available if no people or objects are detected. By directing the next customer to an available cash register, the operating efficiency of the cash register can be improved. In other words, if there is a shopping basket, purchased items, personal belongings, or forgotten items around the cash register, the monitoring device detects these as objects, but if no objects are detected, the monitoring device determines whether the cash register is available and can guide the customer to an available cash register.

[0074] [C5-2] The monitoring device of [C4-1], wherein the determination unit determines that the payment machine is in use when the detection unit does not detect a person and the object is detected. The monitoring device uses the status indicating transaction completion as a trigger to detect changes in the monitoring area after the transaction is completed, and determines that the cash register is in use if no person is detected but an object is detected. Under such conditions, the customer may have temporarily left the cash register after completing the transaction, and unnecessary confusion can be avoided by not directing the next customer to the cash register. In other words, if there is a shopping basket, purchased items, personal belongings, or forgotten items around the cash register, the monitoring device can detect these as objects, determine that the cash register is in use, and not notify the customer that the cash register is available.

[0075] [C5-3] The monitoring device of [C4-1], wherein the determination unit determines that the payment machine is in use when the detection unit detects a person but not the object. The monitoring device uses the status indicating the completion of the transaction as a trigger to detect changes in the monitoring area after the transaction is completed, and determines that the payment machine is in use if a person is detected but no object is detected. Under these conditions, the monitoring device will not guide the next customer to the payment machine, thereby avoiding unnecessary confusion.

[0076] [C5-4] The monitoring device of [C4-1], wherein the determination unit determines that the payment machine is in use when the detection unit detects a person and the object. The monitoring device determines that the cash register is in use when it detects a change in the monitoring area after the transaction is completed, using the status indicating the completion of the transaction as a trigger, and if a person or object is detected, it will not guide the next customer to the cash register under such conditions, thereby avoiding unnecessary confusion.

[0077] [C6] On the computer, obtaining a status indicating completion of the transaction performed at the accounting machine; detecting a change within a monitored area including at least a portion of the cashiering machine after the transaction is completed; determining the availability of the checkout machine based on the status and the detection result of the change in the monitoring area; outputting the determination result of the availability; A program to execute. The computerized monitoring device detects changes in the monitoring area after the transaction is completed, triggered by a status indicating the completion of the transaction, and determines the availability of a cashier based on the status and the detection results. If an attempt was made to determine the availability of a cashier solely based on the detection of changes in the monitoring area, there is a risk of falsely detecting an available cashier when a customer temporarily leaves the cashier during a transaction. However, this system prevents such false detections and can accurately determine the availability of a cashier. This frees store clerks from the task of visually checking for available terminals and verbally informing customers about available terminals, thereby reducing the workload of the clerks.

[0078] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope of the invention and the scope of the inventions and their equivalents as defined in the claims. [Explanation of symbols]

[0079] 10...self-service POS terminal, 11...terminal housing, 12...mounting stand, 13...automatic change dispenser, 14...touch panel, 15...scanner, 16...receipt printer, 20...attendant terminal, 30...store server, 40...communication network, 50...monitoring device, 51...processor, 52...main memory, 53...auxiliary storage device, 54...clock, 55...terminal interface, 56...camera interface, 57...network interface, 58...system transmission path, 60...camera, 70...guidance device, 100...checkout system, 200...checkout system, 500...monitoring device, 511...acquisition unit, 512...detection unit, 513...determination unit, 514...output unit

Claims

1. an acquisition unit that acquires a status indicating completion of a transaction executed on the accounting machine; a detector that detects a change in a monitored area including at least a portion of the checkout machine after the transaction is completed; a determination unit that determines whether the payment machine is available or not based on the status and the result of detecting changes in the monitoring area; an output unit that outputs the determination result of the availability; A monitoring device comprising:

2. The monitoring device according to claim 1 , wherein the detection unit detects a change in the monitoring area based on a captured image output from a camera monitoring the monitoring area.

3. The monitoring device according to claim 2 , wherein the detection unit detects a change in the monitoring area based on a difference between a reference image of the monitoring area before the transaction is started and the captured image after the transaction is completed.

4. The monitoring device according to claim 2 , wherein the detection unit detects the presence or absence of a person based on a change in a person detection area included in the monitoring area, and detects the presence or absence of an object based on a change in an object detection area included in the monitoring area.

5. The determination unit determining whether the checkout machine is available when the person and the object are not detected by the detection unit; The monitoring device according to claim 4 , wherein the determining unit determines that the payment machine is in use when the detecting unit detects no person and the object.

6. On the computer, obtaining a status indicating completion of the transaction performed at the accounting machine; detecting a change within a monitored area including at least a portion of the cashiering machine after the transaction is completed; determining the availability of the checkout machine based on the status and the detection result of the change in the monitoring area; outputting the determination result of the availability; A program to execute.

Images