Monitoring device, monitoring system, and program

Abstract

To enable shoppers to control their unconscious and erroneous behavior.SOLUTION: A monitoring device includes an article determination unit, a person determination unit, and a warning unit. The article determination unit determines whether or not there is a purchased article in an article placement area where the purchased article for settlement by a settlement device equipped with an output device is placed. The person determination unit determines whether or not a person is present in an operation area having a predetermined positional relationship to the article placement area. When the article determination unit determines that there is no article to be purchased and the person determination unit determines that a person is present in a situation where the checkout of the purchased article has not been completed, the warning unit allows an output device to output warning information indicating the fact.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] Embodiments of the present invention relate to a monitoring device, a monitoring system, and a program.

Background Art

[0002] In recent years, self-checkout terminals called self-POS terminals for users to register and pay for purchased goods, i.e., perform accounting processing, have been provided, and the number of stores adopting a sales form in which shoppers perform product registration and accounting processing has been increasing. Generally, in such self-POS terminals, shoppers scan the code symbols attached to products with a scanner to register the products.

[0003] In such self-POS terminals, various techniques have been proposed to prevent fraud. For example, Patent Document 1 proposes a technique of making it appear that the customer is being monitored by making a robot face follow the product held by the customer, thereby suppressing the occurrence of fraud such as shoplifting. Further, Patent Document 1 also discloses notifying a store clerk such as an attendant when some operation mistake or fraud has occurred.

[0004] In actual settlement situations, for example, there is a case where while a wife is registering and accounting for purchased goods at a self-POS terminal, her husband carries out the purchased goods. When goods for which accounting has not been completed are thus carried out, there is no mechanism to notify the person who can perform the accounting operation of this fact.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] The problem to be solved by the embodiments of the present invention is to provide a monitoring device, a monitoring system, and a program that can notify a person capable of performing accounting operations when goods for which accounting has not been completed are shipped out.

Means for Solving the Problem

[0007] In one embodiment, the monitoring device includes a product discrimination unit, a person discrimination unit, and a warning unit. The product discrimination unit discriminates whether there is a purchased product in the product placement area where the purchased product to be accounted for by the payment device equipped with an output device is placed. The person discrimination unit discriminates whether there is a person in the operation area having a determined positional relationship with respect to the product placement area. When the product discrimination unit discriminates that there is no purchased product and the person discrimination unit discriminates that there is a person in a situation where the accounting of the purchased product has not been completed, the warning unit outputs warning information indicating this to the output device.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments of the monitoring device will be described with reference to the drawings.

[0010] [First Embodiment] In this embodiment, a payment system based on the self-service method will be described as an example.

[0011] FIG. 1 is a schematic configuration diagram showing a self-service payment system as a monitoring system according to a first embodiment, including a self-service POS terminal 1 to which a monitoring device according to the first embodiment is applied. The payment system includes a plurality of self-service POS terminals 1 and a monitoring terminal 2. The payment system connects each self-service POS terminal 1 and the monitoring terminal 2 via a communication network 3 such as a LAN (Local Area Network). The monitoring terminal 2 is a terminal operated by a store clerk, an attendant, who monitors each self-service POS terminal 1 connected via the communication network 3.

[0012] The self-service POS terminal 1 to which the monitoring device according to the first embodiment is applied is installed in the checkout area of the store, and the shopper who has finished shopping becomes the user. A customer who has put the purchased goods in a shopping basket or the like in the sales floor where the goods are displayed and moved to the checkout area operates the self-service POS terminal 1 to perform self-checkout for the transaction related to the settlement of the purchased goods, that is, from the registration of the goods to the payment. The self-service POS terminal 1 is an example of a full self-service compatible payment device. The payment device can be rephrased as a payment terminal, a settlement device, a settlement terminal, a checkout device, a checkout terminal, a product registration device, a product registration terminal, etc.

[0013] FIG. 2 is a perspective view showing the external configuration of the self-service POS terminal 1, and FIG. 3 is a block diagram showing the main circuit configuration of the self-service POS terminal 1.

[0014] As shown in FIG. 2, the self-POS terminal 1 includes a main body 101 installed on the floor surface and a weighing unit 102 installed beside the main body 101. The main body 101 has a display pole 103, a touch panel 104, a camera pole 105, and an operation area camera 106 attached to its upper part. The main body 101 is provided with a basket stand 107 at the central part of the side surface on the side opposite to the side where the weighing unit 102 is installed. The basket stand 107 is for placing baskets or the like in which customers coming from the sales floor put the purchased goods. The customer stands in front of the main body 101 in FIG. 2 so that the screen of the touch panel 104 can be seen and performs operations. Therefore, as seen from the customer, there is a basket stand 107 on the right side with the main body 101 in between, and a weighing unit 102 on the left side. In the following description, the side where the customer stands is regarded as the front of the main body 101, the side where the weighing unit 102 is installed is regarded as the left side of the main body 101, and the side where the basket stand 107 is provided is regarded as the right side of the main body 101.

[0015] The weighing unit 102 has a weighing pan 109 provided at the upper part of a housing 108, and a bag holder 110 is attached to the upper part of the weighing pan 109. The upper surface of the weighing pan 109 serves as a placement surface 111. The bag holder 110 includes a pair of holding arms 112, and the holding arms 112 hold a cash register bag or a shopping bag (so-called my bag) brought by the customer. The weighing unit 102 measures the weight of the goods placed on the placement surface 111 and put into the cash register bag or my bag held by the holding arms 112. The placement surface 111 is an example of a goods placement area where the purchased goods to be accounted for are arranged. The weighing unit 102 is an example of a weighing instrument that measures the weight of an object placed in the goods placement area.

[0016] The display pole 103 is provided with a light emitting part 113 at its tip end that selectively emits, for example, blue and red light. The display pole 103 displays the state of the self-POS terminal 1, such as standby, operation, call, error, etc., according to the light emission color of the light emitting part 113.

[0017] The touch panel 104 is composed of a display for displaying various screens to the user who operates the self-POS terminal 1, and a touch sensor for detecting touch input to the screen by the user. In the self-POS terminal 1, the user is usually a shopper.

[0018] A bagging area camera 114 is attached to the camera pole 105. The bagging area camera 114 has its mounting position and orientation set such that the placement surface 111 of the weighing pan 109 of the weighing unit 102 enters the angle of view, that is, the shooting area, as shown by the dashed-dotted line in Fig. 2. The bagging area camera 114 is an example of a camera that photographs the merchandise placement area. More specifically, the bagging area camera 114 is set so that it can image from above the opening for inserting merchandise into a plastic bag or a shopper's own bag whose shooting area is held by the holding arm 112. Hereinafter, the shooting area of this bagging area camera 114 will be referred to as the bagging area.

[0019] Furthermore, a bagging area infrared sensor 115 (see Fig. 3) and a bagging area ultrasonic sensor 116 (see Fig. 3) are arranged on the camera pole 105 facing the bagging area. The bagging area infrared sensor 115 and the bagging area ultrasonic sensor 116 are used to measure the distance to the placement surface 111 or the distance to the merchandise placed on the placement surface 111 using infrared rays or ultrasonic waves. The bagging area infrared sensor 115 and the bagging area ultrasonic sensor 116 are examples of distance sensors that measure the distance to the merchandise placement area. The weighing unit 102, the bagging area camera 114, the bagging area infrared sensor 115, and the bagging area ultrasonic sensor 116 are examples of sensors that use the merchandise placement area as a detection area.

[0020] The operation area camera 106 is set so that its shooting area is the front of the self-POS terminal 1. As a result, the operation area camera 106 can image a customer standing in front of the self-POS terminal 1 for operating the self-POS terminal 1 from the front side. The shooting area of this operation area camera 106 will be referred to as the operation area.

[0021] On the front of the main body 101, there are formed an operation area infrared sensor 117, an operation area ultrasonic sensor 118, a reading window 120 of a scanner 119 (see FIG. 3), a card insertion slot 122 of a card reader 121 (see FIG. 3), an issue port 124 for a receipt printed by a printer 123 (see FIG. 3), and a speaker 125. The operation area infrared sensor 117 and the operation area ultrasonic sensor 118 are used as human presence sensors for detecting the presence of a customer standing in front of the self-POS terminal 1 for operating the self-POS terminal 1, that is, the presence of a customer entering the operation area, by using infrared rays or ultrasonic waves. Further, on the front of the main body 101, there are also formed a coin insertion slot 127, a coin payout slot 128, a bill insertion slot 129, and a bill payout slot 130 of a coin dispenser 126 (see FIG. 3).

[0022] Also, a communication cable 131 extends externally from the right side surface of the main body 101, and a reader / writer 132 for an electronic money medium is connected to the tip of this communication cable 131. The reader / writer 132 is placed on a pedestal 133 provided on the upper part of the right side surface of the main body 101.

[0023] As shown in FIG. 3, the self-POS terminal 1 includes, in addition to the weighing unit 102, touch panel 104, light emitting unit 113, bagging area camera 114, bagging area infrared sensor 115, bagging area ultrasonic sensor 116, operation area infrared sensor 117, operation area ultrasonic sensor 118, scanner 119, card reader 121, printer 123, speaker 125, automatic change dispenser 126, reader / writer 132 described above, a processor 134, main memory 135, auxiliary storage device 136, communication interface 137, and system transmission path 138. The system transmission path 138 includes an address bus, data bus, control signal lines, and the like. The system transmission path 138 connects the processor 134 to each of the other units directly or via a signal input / output circuit, and transmits data signals exchanged therebetween. The connection of the processor 134, main memory 135, and auxiliary storage device 136 via the system transmission path 138 constitutes a computer of the self-POS terminal 1. The computer is an example of a monitoring device according to the first embodiment that controls notification members provided corresponding to each of a plurality of action areas that execute a plurality of actions included in a series of actions performed by a shopper.

[0024] The processor 134 corresponds to the central part of the computer. The processor 134 controls each unit in order to realize various functions as the self-POS terminal 1 according to an operating system or application program. The processor 134 is, for example, a CPU (Central Processing Unit). The processor 134 may be, for example, an MPU (micro processing unit), SoC (system on a chip), DSP (digital signal processor), GPU (graphics processing unit), ASIC (application specific integrated circuit), PLD (programmable logic device), or FPGA (field-programmable gate array). Alternatively, the processor 134 may be a combination of a plurality of these.

[0025] The main memory 135 corresponds to the main storage part of the above computer. The main memory 135 includes a non-volatile memory area and a volatile memory area. In the non-volatile memory area, the main memory 135 stores an operating system or an application program. The main memory 135 may store data necessary for the processor 134 to execute processes for controlling each part in a non-volatile or volatile memory area. The main memory 135 uses the volatile memory area as a work area where data is appropriately rewritten by the processor 134. The non-volatile memory area is, for example, a ROM (Read Only Memory). The volatile memory area is, for example, a RAM (Random Access Memory). For example, the main memory 135 stores a transaction file 139 and a detection data storage unit 140.

[0026] The transaction file 139 is a data file for storing data related to one commercial transaction processed by the self-POS terminal 1. The transaction file 139 stores data such as, for example, a transaction number, purchased product data, total points, total amount, discount amount, settlement amount, etc. The transaction number is a series of numbers issued each time a commercial transaction is processed by the self-POS terminal 1. The purchased product data is record data created for each product bought and sold in the commercial transaction identified by the transaction number. Here, the purchased product data is composed of items such as a product code, product name, price, points, amount, etc. The points are the number of purchased points of the product identified by the product code. The amount is the amount corresponding to the number of purchased points. The transaction file 139 can store a plurality of purchased product data. The total points is the total of the points of each purchased product data. The total amount is the total of the amounts of each purchased product data. The discount amount is the amount discounted from the total amount. The settlement amount is the amount obtained by subtracting the discount amount from the total amount.

[0027] FIG. 4 is a diagram showing an example of the stored content of the detection data storage unit 140. As shown in FIG. 4, the detection data storage unit 140 stores a bagging area image, a bagging area infrared sensor output value, a bagging area ultrasonic sensor output value, a scale unit output value, an operation area image, an operation area infrared sensor output value, and an operation area ultrasonic sensor output value. The bagging area image is the latest one among the captured images that are repeatedly captured by the bagging area camera 114. The bagging area infrared sensor output value is also the latest one among the output values of the bagging area infrared sensor 115 that are repeatedly acquired. Similarly, the bagging area ultrasonic sensor output value is the latest one among the output values of the bagging area ultrasonic sensor 116 that are repeatedly acquired. Also, the scale unit output value is the latest one among the output values of the scale unit 102 that are repeatedly acquired. The operation area image is the latest one among the captured images that are repeatedly captured by the operation area camera 106. The operation area infrared sensor output value is the latest one among the output values of the operation area infrared sensor 117 that are repeatedly acquired. The operation area ultrasonic sensor output value is the latest one among the output values of the operation area ultrasonic sensor 118 that are repeatedly acquired.

[0028] The auxiliary storage device 136 corresponds to the auxiliary storage part of the above computer. For example, an EEPROM (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disc Drive), or an SSD (Solid State Drive), etc. can be the auxiliary storage device 136. The auxiliary storage device 136 stores data used by the processor 134 for performing various processes, data created by the processes in the processor 134, and the like. For example, the auxiliary storage device 136 has a reference data storage unit 141. Note that the auxiliary storage device 136 may store the above application program.

[0029] FIG. 5 is a diagram showing an example of the stored content of the reference data storage unit 141. As shown in FIG. 5, the reference data storage unit 141 stores a bagging area reference image, a bagging area infrared sensor reference output value, a bagging area ultrasonic sensor reference output value, a weighing unit reference output value, an operation area reference image, an operation area infrared sensor reference output value, and an operation area ultrasonic sensor reference output value. The bagging area reference image is the reference output, i.e., the captured image, of the bagging area camera 114 taken when no product is placed on the placement surface 111 of the weighing pan 109 of the weighing unit 102. The bagging area infrared sensor reference output value is also the output value of the bagging area infrared sensor 115 detected when no product is placed. Similarly, the bagging area ultrasonic sensor reference output value is the output value of the bagging area ultrasonic sensor 116 detected when no product is placed. The weighing unit reference output value is the output value of the weighing unit 102 measured when no product is placed. The operation area reference image is the reference output, i.e., the captured image, of the operation area camera 106 taken when no person is in front of the self-POS terminal 1. The operation area infrared sensor reference output value is the output value of the operation area infrared sensor 117 detected when no person is in front of the self-POS terminal 1. The operation area ultrasonic sensor reference output value is the output value of the operation area ultrasonic sensor 118 detected when no person is in front of the self-POS terminal 1. The processor 134 acquires each of these reference outputs, i.e., each reference output, in advance, for example, when the self-POS terminal 1 is installed, and stores them in the reference data storage unit 141.

[0030] As described above, the reference data storage unit 141 is an example of a storage unit that stores, as reference outputs, the outputs of sensors acquired in advance when no products are placed in the product placement area. Note that, as the sensors in this case, it is not necessary to include all of them, and at least one of the bagging area camera 114, the bagging area infrared sensor 115, the bagging area ultrasonic sensor 116, and the weighing unit 102 may be included. Further, the reference data storage unit 141 is an example of a storage unit that stores, as reference outputs, the outputs of sensors acquired in advance when no person is present in front of the self-POS terminal 1 to which the payment device is applied. Note that, as the sensors in this case, it is not necessary to include all of them, and at least one of the operation area camera 106, the operation area infrared sensor 117, and the operation area ultrasonic sensor 118 may be included.

[0031] The communication interface 137 performs data communication with an external device connected via the communication network 3 in accordance with a preset communication protocol. The external device is, for example, a monitoring terminal 2 which is an example of a host device. The communication interface 137 is an example of a communication unit that communicates with a host device.

[0032] The scanner 119 reads a code symbol from a product obscured by the reading window 120. Each product sold in the store is attached with a code symbol in which a product ID or the like for identifying the product is encoded. The code symbol is, for example, a barcode. The code symbol may be, for example, a two-dimensional data code. The scanner 119 may be of a type that reads a code symbol by scanning a laser beam, or may be of a type that reads a code symbol from an image captured by an imaging device.

[0033] The card reader 121 reads card data recorded on a card medium such as a credit card or a point card. The card reader 121 draws a card medium inserted into the card insertion slot 122 into the main body 101, reads the card data, and then discharges it from the card insertion slot 122.

[0034] Printer 123 prints receipt data representing the details of a business transaction on receipt paper. The receipt paper on which the receipt data is printed is discharged from the issuing port 124, cut by a cutter (not shown), and issued as a receipt or a receipt voucher.

[0035] Speaker 125 generates voice messages and notification sounds.

[0036] The automatic change dispenser 126 includes a coin unit 142 and a bill unit 143. The coin unit 142 sorts the coins inserted into the coin insertion slot 127 one by one, identifies the denominations, and stores them in the safe by denomination. The coin unit 142 takes out the coins of the corresponding denomination from the safe based on, for example, the change data, and pays them out from the coin payout port 128. The bill unit 143 sorts the bills inserted into the bill insertion slot 129 one by one, identifies the denominations, and stores them in the safe by denomination. The bill unit 143 takes out the bills of the corresponding denomination from the safe based on, for example, the change data, and pays them out from the bill payout port 130.

[0037] The reader / writer 132 reads and rewrites the electronic money recorded on the electronic money medium. The electronic money medium is, for example, a non-contact IC card. The electronic money medium may also be an electronic device such as a smartphone or a tablet terminal.

[0038] The operation of the self-POS terminal 1 with such a configuration will be described below. FIG. 6 is a flowchart showing an example of the main procedure of information processing as a monitoring device, which is executed by the processor 134 of the self-POS terminal 1 to which the monitoring device according to the first embodiment is applied. Unless otherwise specified, the processing operations of the processor 134 shown in FIG. 6 transition from ACTn (n is a natural number) to ACT(n + 1). Also, the procedure shown in FIG. 6 is an example. The procedure is not particularly limited as long as the same result can be obtained.

[0039] After the power of the self-POS terminal 1 is turned on, the processor 134 waits for an operation start by the shopper. For example, when the touch panel 104 is touched by the shopper, the processor 134 performs a product registration process and a checkout process. Also, in parallel with this registration process and checkout process, the processor 134 starts the procedure shown in FIG. 6, which is a process as a monitoring device. As described above, data is stored in the reference data storage unit 141 in advance at the start.

[0040] As ACT11, the processor 134 determines whether the checkout process has ended. If the checkout process has not ended, that is, if the checkout of the purchased products has not ended, the processor 134 determines NO in ACT11 and proceeds to ACT12. If the checkout process has ended, the processor 134 determines YES in ACT11 and ends this process as the monitoring device.

[0041] As ACT12, the processor 134 acquires the sensor output. Specifically, the processor 134 acquires the captured image from the bagging area camera 114, the output value of the bagging area infrared sensor 115, the output value of the bagging area ultrasonic sensor 116, the output value of the scale unit 102, the captured image from the operation area camera 106, the output value of the operation area infrared sensor 117, and the output value of the operation area ultrasonic sensor 118, respectively, and stores them in the detection data storage unit 140.

[0042] As ACT13, the processor 134 determines whether there is a purchased item in the merchandise placement area. Specifically, the processor 134 determines the presence or absence of merchandise by comparing the outputs of the bagging area camera 114, the bagging area infrared sensor 115, the bagging area ultrasonic sensor 116, and the scale unit 102 stored in the detection data storage unit 140 with their reference outputs stored in advance in the reference data storage unit 141. The processor 134 that performs the processing of this ACT13 is an example of a merchandise discrimination unit that discriminates whether there is a purchased item in the merchandise placement area where the purchased item to be accounted for by the settlement device equipped with the output device is placed. If there is merchandise, the processor 134 determines YES in ACT13 and proceeds to ACT11. If there is no merchandise, the processor 134 determines NO in ACT13 and proceeds to ACT14.

[0043] In addition, when using the output of the bagging area camera 114 in the determination of the presence or absence of merchandise, known image processing techniques can be used. For example, the processor 134 calculates the HOG feature amounts from the bagging area image stored in the detection data storage unit 140 and the bagging area reference image stored in the reference data storage unit 141, and recognizes whether there is merchandise based on whether the Euclidean distance of the calculated HOG feature amounts exceeds a threshold value.

[0044] When using the output of the bagging area infrared sensor 115 or the bagging area ultrasonic sensor 116, the processor 134 recognizes whether there is merchandise based on whether the distance indicated by the output value stored in the detection data storage unit 140 has changed by a preset threshold value or more from the distance indicated by the reference output value stored in the reference data storage unit 141.

[0045] When using the output of the scale unit 102, the processor 134 recognizes whether there is merchandise based on whether the weight stored in the detection data storage unit 140 has changed by a preset threshold value or more from the reference weight stored in the reference data storage unit 141.

[0046] As ACT14, the processor 134 determines whether a person is present in front of the self-POS terminal 1. Specifically, the processor 134 compares the outputs of the operation area camera 106, the operation area infrared sensor 117, and the operation area ultrasonic sensor 118 stored in the detection data storage unit 140 with their reference outputs stored in advance in the reference data storage unit 141 to determine whether a person is present. The processor 134 that performs the processing of this ACT14 is an example of a person determination unit that determines whether a person is present or not in an operation area having a determined positional relationship with respect to the product placement area. If a person is present, the processor 134 determines YES in ACT14 and proceeds to ACT15. If no person is present, the processor 134 determines NO in ACT14 and proceeds to ACT17.

[0047] In addition, when using the output of the operation area camera 106 in the determination of whether a person is present, known image processing techniques can be used. For example, the processor 134 calculates the HOG feature amounts from the operation area image stored in the detection data storage unit 140 and the operation area reference image stored in the reference data storage unit 141, and recognizes whether a person is present based on whether the Euclidean distance of the calculated HOG feature amounts exceeds a threshold value.

[0048] When using the output of the operation area infrared sensor 117 or the operation area ultrasonic sensor 118, the processor 134 recognizes whether a person is present based on whether the distance indicated by the output value stored in the detection data storage unit 140 has changed by a preset threshold value or more from the distance indicated by the reference output value stored in the reference data storage unit 141.

[0049] As ACT15, the processor 134 outputs a warning. Specifically, the processor 134 displays a warning on the display of the touch panel 104 or makes the speaker 125 emit a warning sound or warning voice. The processor 134 that performs the processing of this ACT15 is an example of a warning unit that causes an output device to output warning information indicating that when the merchandise discrimination unit discriminates that there is no purchased merchandise and the person discrimination unit discriminates that there is a person in a situation where the accounting for the purchased merchandise has not been completed. The display of the touch panel 104 and the speaker 125 are examples of output devices.

[0050] FIG. 7 is a schematic diagram showing a warning display as an example of warning output. As shown in FIG. 7, in a state where a registration screen or an accounting screen 144 is displayed on the display of the touch panel 104, a predetermined warning display 146 indicating that the accounting has not been completed yet, such as "Have you completed the accounting?", is superimposed as a pop-up.

[0051] As ACT16, the processor 134 determines whether to end this warning output. For example, the processor 134 can determine whether to end based on whether there has been a touch operation on the touch panel 104. If the warning output is not ended, the processor 134 determines NO in ACT16 and proceeds to ACT15. If the warning output is ended, the processor 134 determines YES in ACT16 and proceeds to ACT11.

[0052] As ACT17, the processor 134 transmits an alarm notification to the monitoring terminal 2 via the communication network 3 by way of the communication interface 137. The alarm notification can include identification information such as a device number that identifies the self-POS terminal. By receiving this alarm notification, the monitoring terminal 2 can notify that there has been an illegal act of taking away a product without settlement. The processor 134 that performs the process of this ACT17 is an example of an alarm unit that, in a situation where the settlement of the purchased product has not been completed, when the product discrimination unit discriminates that there is no purchased product and the person discrimination unit discriminates that there is no person, transmits an alarm notification indicating that fact to a higher-level device by way of the communication unit. Thereafter, the processor 134 proceeds to ACT11.

[0053] As described above, the computer including the processor 134 of the self-POS terminal 1 is a monitoring device according to the first embodiment, and in a situation where the settlement of the purchased product has not been completed, if there is no product in the product placement area where the purchased product to be settled by the self-POS terminal 1 is placed, a warning is output by the touch panel 104 or the speaker 125. Accordingly, the processor 134 includes a product discrimination unit that discriminates whether there is a purchased product in the product placement area where the purchased product to be settled by the settlement device equipped with the output device is placed, a person discrimination unit that discriminates whether there is a person in the operation area having a determined positional relationship with respect to the product placement area, and a warning unit that, in a situation where the settlement of the purchased product has not been completed, when the product discrimination unit discriminates that there is no purchased product and the person discrimination unit discriminates that there is a person, causes the output device to output warning information indicating that fact. As described above, according to the self-POS terminal 1 to which the monitoring device according to the first embodiment is applied, when an attempt is made to carry out a purchased product in a situation where the settlement of the purchased product has not been completed, warning information is output to the person in front of the self-POS terminal 1. Therefore, according to the self-POS terminal 1 in the first embodiment, when a product for which settlement has not been made is carried out, it is possible to notify a person who can perform a settlement operation of that fact.

[0054] Then, the computer of the self-POS terminal 1 ends the warning display by a touch operation on the touch panel 104. As a result, shoppers can continue to register purchased items and perform checkout.

[0055] In addition, the self-POS terminal 1 is provided with a communication interface 137 for communicating with the monitoring terminal 2. When the accounting for the purchased items has not been completed and there are no purchased items and no people present, the computer of the self-POS terminal 1 transmits an alarm notification to the monitoring terminal 2 through the communication interface 137 for communication. Therefore, the processor 134 constitutes an alarm unit that, when the accounting for the purchased items has not been completed and the item discrimination unit discriminates that there are no purchased items and the person discrimination unit discriminates that there are no people, causes the communication unit to transmit an alarm notification indicating this to the upper device. Therefore, according to the self-POS terminal 1 in the first embodiment, if the purchased items are carried out and there are no people left without being accounted for, an alarm can be issued assuming that an illegal act has been committed. Conversely, in the self-POS terminal 1 in the first embodiment, if there are people even when the purchased items are carried out, it is not determined that an illegal act has been committed and no alarm is issued. Therefore, according to the self-POS terminal 1 in the first embodiment, the occurrence of false alarms can be suppressed.

[0056] The self-POS terminal 1 also includes sensors such as a weighing unit 102, a bagging area camera 114, a bagging area infrared sensor 115, and a bagging area ultrasonic sensor 116, which use the product placement area as a detection area, and a reference data storage unit 141 that stores, as a reference output, the output of the sensors obtained in advance when there are no products placed in the product placement area. Then, the computer of the self-POS terminal 1 compares the current output of the sensors with the reference output of the sensors stored in the reference data storage unit 141 to determine whether there are any purchased items in the product placement area. Therefore, according to the self-POS terminal 1 in the first embodiment, it is possible to easily determine the presence or absence of purchased items.

[0057] [Second Embodiment] Next, the second embodiment will be described. Regarding the configuration and operation similar to those of the first embodiment, the same reference numerals as those in the first embodiment are given, and the description thereof will be omitted.

[0058] FIG. 8 is a schematic configuration diagram showing a self-checkout payment system as a monitoring system according to the second embodiment including a server device 4 to which the monitoring device according to the second embodiment is applied. As shown in FIG. 8, the payment system includes a plurality of self-POS terminals 1, a monitoring terminal 2, and a server device 4 to which the monitoring device according to the second embodiment is applied, which are communicably connected via a communication network 3.

[0059] FIG. 9 is a block diagram showing an example of the main circuit configuration of a server device 4 to which the monitoring device according to the second embodiment is applied, that is, in which the monitoring device is incorporated. As shown in FIG. 9, the server device 4 includes a processor 41, a main memory 42, an auxiliary storage device 43, a communication interface 44, an input device 45, an output device 46, and a system transmission path 47. The system transmission path 47 includes an address bus, a data bus, control signal lines, and the like. The system transmission path 47 connects the processor 41 to each other part directly or via a signal input / output circuit, and transmits data signals exchanged therebetween. The computer of the server device 4 is configured by connecting the processor 41, the main memory 42, and the auxiliary storage device 43 via the system transmission path 47. The computer is an example of the monitoring device according to the second embodiment that monitors fraud by shoppers at a plurality of self-POS terminals 1.

[0060] The processor 41 corresponds to the central part of the above computer. The processor 41 controls each part in order to realize various functions as the monitoring device according to the present embodiment according to an operating system or an application program. The processor 41 may be, for example, a CPU, an MPU, an SoC, a DSP, a GPU, an ASIC, a PLD, or an FPGA. Alternatively, the processor 41 may be a combination of a plurality of these.

[0061] The main memory 42 corresponds to the main storage part of the above computer. The main memory 42 includes a non-volatile memory area and a volatile memory area. The main memory 42 stores an operating system or an application program in the non-volatile memory area. The main memory 42 may store data necessary for the processor 41 to execute processes for controlling each part in either the non-volatile or volatile memory area. The main memory 42 uses the volatile memory area as a work area where data can be appropriately rewritten by the processor 41. The non-volatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM. For example, the main memory 42 stores the terminal detection data storage unit 48.

[0062] The auxiliary storage device 43 corresponds to the auxiliary storage part of the above computer. For example, an EEPROM, an HDD, or an SSD, etc. can be the auxiliary storage device 43. The auxiliary storage device 43 stores data used by the processor 41 to perform various processes, data created by the processes in the processor 41, and the like. For example, the auxiliary storage device 43 has a terminal reference data storage unit 49. Note that the auxiliary storage device 43 may store the above application program.

[0063] FIG. 10 is a diagram showing an example of the stored contents of the terminal detection data storage unit 48 and the terminal reference data storage unit 49. As shown in FIG. 10, the terminal detection data storage unit 48 associates with a self-POS terminal ID such as a device number that uniquely identifies each of the plurality of self-POS terminals 1, and stores a bagging area image, a bagging area infrared sensor output value, a bagging area ultrasonic sensor output value, a scale unit output value, an operation area image, an operation area infrared sensor output value, and an operation area ultrasonic sensor output value as described in the first embodiment. That is, the terminal detection data storage unit 48 is a database that stores the contents of the detection data storage unit 140 of each self-POS terminal 1 shown in FIG. 4 as records associated with the self-POS terminal ID. Each output stored in the terminal detection data storage unit 48 is rewritten and stored with the latest one among the sensor outputs repeatedly transmitted from the self-POS terminal 1.

[0064] Similarly, the terminal reference data storage unit 49 stores, in association with the self-POS terminal ID, a bagging area reference image, a bagging area infrared sensor reference output value, a bagging area ultrasonic sensor reference output value, a scale unit reference output value, an operation area reference image, an operation area infrared sensor reference output value, and an operation area ultrasonic sensor reference output value as described in the first embodiment. That is, the terminal reference data storage unit 49 is a database that stores the contents of the reference data storage unit 141 of each self-POS terminal 1 shown in FIG. 5 as records associated with the self-POS terminal ID. Note that each reference output serving as a reference stored in this terminal reference data storage unit 49 is stored in advance. That is, for example, the sensor output when there are no products or people being transmitted at the time of installation of each self-POS terminal 1 or the like is stored in this terminal reference data storage unit 49.

[0065] Since the output of the sensor provided in each self-POS terminal 1 is stored in the server device 4 in this way, each self-POS terminal 1 does not necessarily need to include a detection data storage unit 140 and a reference data storage unit 141 as in the first embodiment.

[0066] The communication interface 44 performs data communication with an external device connected via the communication network 3 in accordance with a preset communication protocol. The external device is, for example, the self-POS terminal 1, the monitoring terminal 2, or the like.

[0067] The input device 45 is a user interface device such as a keyboard, a pointing device such as a mouse, or the like. The output device 46 is a user interface device such as a liquid crystal display or the like. Note that these input device 45 and / or output device 46 do not necessarily need to be possessed by the server device 4. That is, the input device 45 and / or output device 46 can be provided outside the server device 4 as a management terminal or the like connected to the communication network 3. In this case, the processor 41 can use these input device 45 and / or output device 46 via the communication network 3 by means of the communication interface 44.

[0068] FIG. 11 is a sequence diagram for explaining the operation of a settlement system including such a server device 4.

[0069] As shown in FIG. 11, each self-POS terminal 1 acquires sensor output as in ACT12 described in the first embodiment (step S1). Then, the self-POS terminal 1 transmits the acquired sensor output to the server device 4 (step S2).

[0070] The server device 4 receives the sensor output from the self-POS terminal 1 and stores it (step S3). Then, the server device 4 compares the stored sensor output with a reference sensor output stored in advance to determine the presence or absence of a product, and determines whether a warning is necessary (step S4). If a warning is necessary, the server device 4 transmits a warning output command instructing the self-POS terminal 1 to perform a warning output (step S5).

[0071] The self-POS terminal 1 that has received this warning output command performs a warning output (step S6).

[0072] In addition, even if a warning is not necessary, the server device 4 determines whether an alarm is necessary (step S7). This determination can be made by comparing the stored sensor output with a reference sensor output stored in advance to determine the presence or absence of both a product and a person. If an alarm is necessary, the server device 4 transmits an alarm output command instructing the monitoring terminal 2 to perform an alarm output (step S8).

[0073] The monitoring terminal 2 that has received this alarm output command performs an alarm output (step S9).

[0074] Next, a specific example of the operation of the monitoring device applied to the server device 4 will be described. FIG. 12 is a flowchart showing an example of the main procedure of information processing related to the monitoring operation executed by the processor 134 of each self-POS terminal 1, and FIG. 13 is a flowchart showing an example of the main procedure of information processing as a monitoring device executed by the processor 41 of the server device 4.

[0075] As described in the first embodiment, the processor 134 of the self-POS terminal 1 starts the procedure shown in FIG. 12 in parallel with the registration process and the accounting process. As described above, data is stored in advance in the terminal reference data storage unit 49 of the server device 4 at the start of this process.

[0076] As shown in FIG. 12, the processor 134 of the self-POS terminal 1 determines, as ACT11, whether or not the accounting process has ended. If the accounting process has not ended, the processor 134 determines NO in ACT11 and proceeds to ACT101. If the accounting process has ended, the processor 134 determines YES in ACT11 and ends this process.

[0077] As ACT101, the processor 134 acquires sensor outputs. Specifically, the processor 134 acquires the captured image from the packing area camera 114, the output value of the packing area infrared sensor 115, the output value of the packing area ultrasonic sensor 116, the output value of the scale unit 102, the captured image from the operation area camera 106, the output value of the operation area infrared sensor 117, and the output value of the operation area ultrasonic sensor 118, respectively.

[0078] As ACT102, the processor 134 transmits the acquired sensor outputs to the server device 4 via the communication network 3 by the communication interface 137. At this time, the processor 134 transmits the self-POS terminal ID, which is specific information for identifying the transmission source of this sensor output, together with the sensor output. In this way, the situation of transmitting the sensor output can be said to be a situation where accounting has not ended in the self-POS terminal 1.

[0079] When the processor 41 of the server device 4 starts the processing procedure shown in FIG. 13 in response to a predetermined input from, for example, the input device 45, as ACT41, it determines whether or not a predetermined fixed time has elapsed. If the fixed time has not elapsed, the processor 41 determines NO in ACT41 and repeats this ACT41. Thus, the processor 41 waits for the fixed time to elapse. When the fixed time has elapsed, the processor 41 determines YES in ACT41 and proceeds to ACT42.

[0080] As ACT42, the processor 41 receives the sensor output transmitted from each self-POS terminal 1 via the communication network 3 by the communication interface 44. Note that the sensor output is not transmitted from the self-POS terminal 1 that is not executing the processing procedure shown in FIG. 12 in parallel with the registration and accounting processing. In other words, if the sensor output is received, the self-POS terminal 1 that is the transmission source is in a situation where the accounting has not yet been completed.

[0081] As ACT43, the processor 41 stores the received sensor output. Specifically, the processor 41 identifies the corresponding record in the terminal detection data storage unit 48 where each sensor output should be stored based on the self-POS terminal ID transmitted together with the sensor output, and stores the received self-output in that record. Also, for the records in the terminal detection data storage unit 48 corresponding to the self-POS terminal 1 that has not received the sensor output, the already stored sensor output is deleted. As a result, the non-latest sensor output is deleted. Instead of deleting this non-latest sensor output, when storing the received sensor output, the reception time may also be stored together so that it can be determined whether the stored sensor output is the latest.

[0082] As ACT44, the processor 41 determines whether there is a purchased item in the product placement area of any of the self-POS terminals 1. Specifically, the processor 41 compares the latest bagging area image, bagging area infrared sensor output value, bagging area ultrasonic sensor output value, and scale unit output value stored in each record of the terminal detection data storage unit 48 with their reference outputs pre-stored in the terminal reference data storage unit 49 to determine the presence or absence of products at each self-POS terminal 1. The processor 41 that performs the processing of this ACT44 is an example of a product discrimination unit that discriminates whether there is a purchased item in the product placement area based on the output of the sensor transmitted from the settlement device. If there is a product at any of the self-POS terminals 1, the processor 41 determines YES in ACT44 and proceeds to ACT41. If there is no product at any of the self-POS terminals 1, the processor 41 determines NO in ACT44 and proceeds to ACT45.

[0083] As ACT45, for each self-POS terminal 1 where it is determined that there is no product, the processor 41 determines whether there is a person in front of the self-POS terminal 1. Specifically, the processor 134 compares the operation area image, operation area infrared sensor output value, and operation area ultrasonic sensor output value stored in the terminal detection data storage unit 48 with their reference outputs pre-stored in the terminal reference data storage unit 49 to determine whether there is a person. For the self-POS terminal 1 where a person is present, the processor 134 determines YES in ACT45 and proceeds to ACT46. For the self-POS terminal 1 where no person is present, the processor 134 determines NO in ACT46 and proceeds to ACT47.

[0084] As ACT46, for each self-POS terminal 1 where there is no product but a person is present, the processor 41 transmits a warning output command through the communication network 3 via the communication interface 44. After that, the processor 41 proceeds to ACT41.

[0085] Return to the description of FIG. 12. As shown in FIG. 12, the processor 134 of the self-POS terminal 1 that transmitted the sensor output in ACT102 determines whether it has received a warning output command transmitted from the server device 4 via the communication network 3 by means of the communication interface 137. If it has not received the warning output command, the processor 134 determines NO in ACT103 and proceeds to ACT11. If it has received the warning output command, the processor 134 determines YES in ACT103 and proceeds to ACT15.

[0086] As ACT15, the processor 134 performs a warning output as described in the first embodiment.

[0087] As ACT16, the processor 134 determines whether to end this warning output. If it does not end the warning output, the processor 134 determines NO in ACT16 and proceeds to ACT15. If it ends the warning output, the processor 134 determines YES in ACT16 and proceeds to ACT11.

[0088] Return to the description of FIG. 13. As shown in FIG. 13, the processor 41 of the server device 4 that determined in ACT45 that there is no merchandise and no person is present transmits, as ACT47, an alarm output command to the monitoring terminal 2 via the communication network 3 by means of the communication interface 44. This alarm output command can include the self-POS terminal ID, which is identification information for identifying the corresponding self-POS terminal 1, in order to indicate at which self-POS terminal 1 the irregularity has occurred. By receiving this alarm output command, the monitoring terminal 2 can notify that there has been an irregularity of taking away merchandise without paying. Note that, in addition to transmitting this command, the processor 41 may also output an alarm to the administrator of the server device 4 by means of the output device 46. Thereafter, the processor 41 proceeds to ACT41.

[0089] As described above, the computer including the processor 41 of the server device 4 is a monitoring device according to the second embodiment. When it is determined that there is no purchased item in the product placement area based on the output of the sensor transmitted from the self-POS terminal 1 in a situation where the accounting for the purchased item by the self-POS terminal 1 has not been completed, a warning output command is transmitted to the self-POS terminal 1 to cause the self-POS terminal 1 to perform a warning output. Therefore, the processor 41 includes a product determination unit that determines whether there is a purchased item in the product placement area based on the output of the sensor transmitted from the settlement device, and a transmission unit that transmits a warning output command to the settlement device when the product determination unit determines that there is no purchased item in a situation where the accounting for the purchased item by the settlement device has not been completed. Therefore, also in this second embodiment, the same effects as those of the first embodiment can be achieved.

[0090] [Third Embodiment] Next, the third embodiment will be described. Regarding the same configuration and operation as those of the first embodiment, the description thereof will be omitted by attaching the same reference numerals as those of the first embodiment.

[0091] FIG. 14 is a schematic configuration diagram showing a self-service settlement system as a monitoring system according to the third embodiment including the self-POS terminal 1 to which the monitoring device according to the third embodiment is applied. As shown in FIG. 14, the settlement system is communicably connected via a communication network 3 with a plurality of self-POS terminals 1, a monitoring terminal 2, and a plurality of monitoring cameras 5. Note that the monitoring camera 5 is installed as a dedicated camera, but if a security camera is already installed on the ceiling, it may be used.

[0092] FIG. 15 is a diagram showing the arrangement relationship between the self-POS terminal 1 and the monitoring camera 5. In the present embodiment, instead of the operation area camera 106 and the bagging area camera 114 in the first embodiment, one monitoring camera 5 is arranged corresponding to each self-POS terminal 1. Each monitoring camera 5 is installed, for example, by being embedded in or suspended from the ceiling so as to cover the imaging ranges of the operation area camera 106 and the bagging area camera 114. Of course, as in the first embodiment, a camera pole 105 may be provided on the self-POS terminal 1 and the monitoring camera 5 may be installed there. The monitoring camera 5 is an example of a camera that images both the product arrangement area and the operation area.

[0093] FIG. 16 is a block diagram showing an example of the main circuit configuration of the self-POS terminal 1. In the present embodiment, the auxiliary storage device 136 further has a corresponding camera ID storage unit 147. The corresponding camera ID storage unit 147 stores a camera ID such as a device number for uniquely identifying the monitoring camera 5 provided corresponding to the self-POS terminal 1. Based on the camera ID stored in the corresponding camera ID storage unit 147, the processor 134 can identify the monitoring camera 5 corresponding to the self-POS terminal 1 from among the plurality of monitoring cameras 5 connected to the communication network 3 and acquire its captured image.

[0094] FIG. 17 is a flowchart showing an example of the main procedure of the information processing as a monitoring device executed by the processor 134 of the self-POS terminal 1. In the present embodiment, when it is determined in ACT11 that the accounting process has not ended, as ACT111, the processor 134 acquires its own sensor output. Specifically, the processor 134 acquires the output values of the bagging area infrared sensor 115, the bagging area ultrasonic sensor 116, the scale unit 102, the operation area infrared sensor 117, and the operation area ultrasonic sensor 118 provided in the self-POS terminal 1 and stores them in the detection data storage unit 140.

[0095] As ACT112, the processor 134 acquires a captured image from the surveillance camera 5. Specifically, based on the camera ID stored in the corresponding camera ID storage unit 147, the processor 134 acquires, via the communication interface 137 and through the communication network 3, the captured image of the surveillance camera 5 corresponding to the self-POS terminal 1. The processor 134 stores the acquired captured image in the work area of the main memory.

[0096] As ACT113, the processor 134 extracts a product placement area image from the acquired captured image. The positional relationship between the self-POS terminal 1 and the corresponding surveillance camera 5 is fixed. Therefore, the processor 134 can know in advance which pixels in the captured image of the surveillance camera 5 correspond to the image of the product placement area in the self-POS terminal 1 and which pixels correspond to the image of the operation area in the self-POS terminal 1. Accordingly, the processor 134 can easily extract, that is, cut out, the product placement area image from the acquired captured image. The processor 134 stores the extracted product placement area image in the detection data storage unit 140 as a bagging area image.

[0097] As ACT13, as described in the first embodiment, the processor 134 compares the sensor output stored in the detection data storage unit 140 with those reference outputs stored in advance in the reference data storage unit 141 to determine the presence or absence of a product. If there is a product, the processor 134 determines YES in ACT13 and proceeds to ACT11. If there is no product, the processor 134 determines NO in ACT13 and proceeds to ACT114.

[0098] As ACT114, the processor 134 extracts an operation area image from the captured image acquired and stored in the work area of the main memory 135. Similar to the product placement area image, the processor 134 can easily extract, that is, cut out, the operation area image from the acquired captured image. The processor 134 stores the extracted operation area image in the detection data storage unit 140. However, different from the first embodiment, the operation area in this case is an area within a certain distance range from the main body 101 on the front side of the self-POS terminal 1.

[0099] After that, the processor 134 proceeds to ACT14. Regarding ACT14 to ACT17 hereinafter, it is the same as described in the first embodiment.

[0100] As described above, the computer including the processor 134 of the self-POS terminal 1 is a monitoring device according to the third embodiment, which extracts a product placement area image from the captured image of the monitoring camera 5 that captures both the product placement area and the operation area to determine the presence or absence of purchased products, and also extracts an operation area image from the captured image of the monitoring camera 5 to determine whether there is a person or not. Therefore, also in this third embodiment, the same effects as in the first embodiment can be achieved.

[0101] Note that the above description has been made by way of examples corresponding to the first embodiment, but it goes without saying that this embodiment can also be similarly applied to the second embodiment.

[0102] [Other Embodiments] Although the embodiments of the monitoring device have been described above, such embodiments are not limited thereto.

[0103] For example, in the second embodiment, the server device 4 is provided separately, but the function of the server device 4 may be incorporated into the monitoring terminal 2. That is, the monitoring device according to the second embodiment may be applied to the monitoring terminal 2. Also, the server device 4 may be configured as a server device arranged on the cloud outside the store.

[0104] In the third embodiment, the self-POS terminal 1 and the monitoring camera 5 are in a one-to-one relationship, but one monitoring camera 5 may be able to photograph a plurality of self-POS terminals 1.

[0105] Also, in each embodiment, the self-POS terminal 1 may be provided with only some of the sensors.

[0106] In addition, although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope of the invention and are included in the invention described in the claims and the equivalent scope thereof.

Explanation of Reference Numerals

[0107] 1... self-POS terminal, 2... monitoring terminal, 3... communication network, 4... server device, 5... monitoring camera, 41,134... processor, 42,135... main memory, 43,136... auxiliary storage device, 44,137... communication interface, 45... input device, 46... output device, 47,138... system transmission path, 48... terminal detection data storage unit, 49... terminal reference data storage unit, 101... main body, 102... weighing unit, 104... touch panel, 106... operation area camera, 107... cage, 108... housing, 109... weighing pan, 110... bag holder, 111... placement surface, 113... light emitting unit, 114... bagging area camera, 115... bagging area infrared sensor, 116... bagging area ultrasonic sensor, 117... operation area infrared sensor, 118... operation area ultrasonic sensor, 119... scanner, 121... card reader, 123... printer, 125... speaker, 126... automatic change dispenser, 132... reader / writer, 139... transaction file, 140... detection data storage unit, 141... reference data storage unit, 144... registration screen or accounting screen, 146... warning display, 147... corresponding camera ID storage unit.

Claims

1. A product discrimination unit that discriminates whether there is a purchased product in a product placement area where the purchased product to be accounted for by a settlement device equipped with an output device is placed; A person discrimination unit that discriminates whether there is a person in an operation area having a determined positional relationship with respect to the product placement area; A warning unit that causes the output device to output warning information indicating that when the product discrimination unit discriminates that there is no purchased product and the person discrimination unit discriminates that there is a person in a situation where the accounting of the purchased product has not been completed; A monitoring device comprising the above.

2. A communication unit that communicates with a host device; An alarm unit that, in a situation where the accounting of the purchased product has not been completed, when the product discrimination unit discriminates that there is no purchased product and the person discrimination unit discriminates that there is no person, transmits an alarm notification indicating this to the host device through the communication unit; The monitoring device according to claim 1, further comprising the above.

3. A sensor having the product placement area as a detection area; A storage unit that stores, as a reference output, the output of the sensor acquired in advance when no product is placed in the product placement area; Further comprising the above, The product discrimination unit determines whether there is a purchased product in the product placement area by comparing the output of the sensor at the current time with the reference output of the sensor stored in the storage unit. The monitoring device according to claim 1 or 2.

4. The sensor includes at least one of a camera that photographs the product placement area, a weighing device that measures the weight of an object placed in the product placement area, and a distance sensor that measures the distance to the product placement area. The monitoring device according to claim 3.

5. Further comprising a camera that photographs both the product placement area and the operation area, The product discrimination unit extracts a product placement area image corresponding to the product placement area from the photographed image of the camera, and based on the extracted product placement area image, discriminates whether there is a purchased product, The person discrimination unit extracts an operation area image corresponding to the operation area from the photographed image of the camera, and based on the extracted operation area image, discriminates whether there is a person. The monitoring device according to claim 2.

6. A monitoring system comprising a settlement device that accounts for purchased products and a control device that communicates with the settlement device, wherein The settlement device is A sensor that uses the product placement area where the purchase product to be accounted for is placed as a detection area, An output device, A warning unit that outputs a warning to a shopper by the output device, having, The control device, Based on the output of the sensor, a product discrimination unit that discriminates whether the purchase product is in the product placement area, In a situation where the accounting for the purchase product by the settlement device has not been completed, when the product discrimination unit discriminates that the purchase product is not present, a transmission unit that transmits a warning output command to the settlement device, having, The warning unit of the settlement device performs the warning output to the output device in response to the warning output command from the control device, a monitoring system.

7. A program for causing a computer including a processor and a memory and controlling output to an output device provided in a settlement device to function as A product discrimination unit that discriminates whether the purchase product to be accounted for by the settlement device is in the product placement area, In a situation where the accounting for the purchase product has not been completed, a warning unit that causes the output device to output warning information indicating that the product discrimination unit has discriminated that the purchase product is not present. ​

Images