Trading system, trading device, program, and method for preventing erroneous trading

Abstract

The present invention provides a transaction system that can prevent transaction processing, such as accounting, from being based on errors made by someone other than the actual shopper. [Solution] A transaction system that executes transactions in which the accounting for registered goods is performed by customer operations, comprising: a reception unit that receives operations related to the transaction; a transaction device that performs processing according to the operations received by the reception unit; and a detection unit that detects the operator performing the operations of the reception unit, wherein the transaction device enters an interrupted state in which the transaction is interrupted if the detection unit does not detect an operator while the transaction is being executed.

Description

Technical Field

[0004] , , , , , , ,

[0003] , ,

[0001] The present invention relates to a transaction system, a transaction device, a program, and a method for suppressing incorrect transactions.

Background Art

[0002] Conventionally, a settlement device has been proposed that can promptly respond to an operator's inappropriate departure. For example, the settlement device described in Patent Document 1 includes a settlement means, a detection means, and a notification means. The settlement means executes a settlement process for settling the price related to a transaction in response to an operation by an operator. The detection means detects the operator. The notification means performs a notification process for notifying a predetermined notification destination when the detection means does not detect the operator during the period when the settlement means is executing the settlement process.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

[0005] The present invention, completed for the above purpose, is a transaction system that executes transactions in which the accounting of registered goods is performed by customer operations, and comprises a reception unit that receives operations related to the transaction, a transaction device that performs processing according to the operations received by the reception unit, and a detection unit that detects the operator performing the operations of the reception unit, wherein the transaction device enters an interrupted state in which the transaction is interrupted if the detection unit does not detect the operator while the transaction is being executed. Here, the trading device may release the interrupted state if the detection unit detects the operator while it is in the interrupted state. Alternatively, the trading device may include a determination unit for determining the operator's companion, and when the device is in the interrupted state, it may release the interrupted state on the condition that the detection unit detects the companion determined by the determination unit. Furthermore, when the transaction is interrupted, the system may also be provided with a selection unit that allows the user to choose whether to resume trading using the trading device or to call an employee. Furthermore, the trading device may enter the suspended state if the detection unit does not detect the operator for a predetermined period of time while a transaction is being executed. Furthermore, if the detection unit does not detect the operator for a period shorter than the predetermined period after the transaction has started but before the transaction is completed, the trading device may enter a transition state before transitioning to the interrupted state. Furthermore, the system may also include a storage unit that stores the faces of operators that the detection unit has stopped detecting over the predetermined period. The system may further include an employee terminal usable by an employee, and a notification unit that notifies the employee terminal that the interruption has occurred. The employee terminal may, upon receiving notification from the notification unit, be able to accept whether or not to register the face of the operator who has not been detected by the detection unit for a predetermined period of time in the list of persons of interest. Furthermore, the transaction device may also include a device that allows the operator to perform accounting operations themselves, a recognition unit that recognizes when a person stored in the memory unit makes another visit to the store where the transaction device is installed, and a notification unit that, when the recognition unit recognizes the return visit, notifies the returning person that a store employee will use the device to perform the accounting operations. Furthermore, the system may also include a recognition unit that recognizes when a person stored in the memory unit makes another visit to the store where the transaction device is installed, and a notification unit that notifies an employee terminal usable by an employee that the recognition unit has recognized the return visit. Furthermore, the recognition unit has a camera capable of taking pictures of the front of the trading device, and uses the face extracted from the image taken by the camera to recognize the return visit, and the trading device may enter the suspended state when the recognition unit recognizes the return visit. Furthermore, the staff terminal may be capable of receiving input of the actions taken by the staff member towards the customer who made a return visit. Furthermore, the staff terminal may be configured to display a history of the actions taken by the staff member towards the person who made the return visit when the notification unit notifies the person of the return visit. Furthermore, the trading device has a registration device that accepts product registration, and in the transaction, product registration is also performed by the customer, and if the detection unit does not detect the operator while the transaction is in progress, the transaction may be suspended. Furthermore, the trading device may also include a registration device for accepting product registrations, and may further include an instruction unit that instructs the registration device to enter the interrupted state if the detection unit does not detect the operator after the transaction has started but before the transaction is completed. Furthermore, the transaction device may also include a change dispenser for depositing and withdrawing money, and may further include an instruction unit that instructs the change dispenser to enter the interrupted state if the detection unit does not detect the operator after the transaction has started but before the transaction is completed. Furthermore, from another perspective, the present invention is a transaction device that executes transactions in which the accounting of registered goods is performed by customer operations, comprising a reception unit that receives operations and a detection unit that detects the operator performing the operations of the reception unit, and entering an interrupted state in which the transaction is interrupted if the detection unit does not detect the operator while the transaction is being executed. Furthermore, from another perspective, the present invention is a program that causes a computer to execute a processing function that performs accounting processing in accordance with an operation received by a reception unit that receives operations, and a detection function that detects the operator performing the operation of the reception unit, and the processing function interrupts the accounting processing if the detection function does not detect the operator while the accounting processing is being executed. Furthermore, from another perspective, the present invention is a method for preventing erroneous transactions in which a transaction device having a reception unit that receives operations and in which the accounting for registered goods is performed by the customer operating the reception unit automatically puts the transaction by the transaction device into an interruption state if it does not detect an operator operating the reception unit while the transaction is being executed. Furthermore, from another perspective, the present invention is a trading system comprising: a receiving unit that receives operations related to a transaction, a trading device that performs processing according to the operations received by the receiving unit, a detection unit that detects the operator performing the operation of the receiving unit, and a determination unit that determines the operator's companions, wherein the trading device enters an interrupted state in which the transaction is interrupted if the detection unit does not detect the operator while the transaction is being executed, and the interrupted state is released on the condition that the detection unit detects a companion determined by the determination unit while the transaction is interrupted. [Effects of the Invention]

[0006] According to the present invention, it is possible to provide a transaction system, etc., that can suppress transaction processing such as accounting based on erroneous operations by someone other than the true shopper. [Brief explanation of the drawing]

[0007] [Figure 1]It is a diagram showing an example of the configuration of a store S where the transaction system to which the first embodiment is applied is used. [Figure 2] It is a diagram showing an example of the overall configuration of the transaction system to which the first embodiment is applied. [Figure 3] It is a diagram showing an example of the schematic configuration of the transaction device to which the first embodiment is applied. [Figure 4] It is a block diagram showing an example of the functional configuration of the transaction device to which the first embodiment is applied. [Figure 5] It is a diagram showing an example of the schematic configuration of the management server. [Figure 6] It is a diagram showing an example of a normal screen displayed on the auxiliary display operation unit. [Figure 7] It is a diagram showing an example of a prohibited use screen displayed on the auxiliary display operation unit. [Figure 8] It is a diagram showing an example of a stop transition screen displayed on the auxiliary display operation unit. [Figure 9] It is a diagram showing an example of an alert screen displayed on the auxiliary display operation unit. [Figure 10] It is a diagram showing an example of an operation status screen displayed on the display unit of the staff terminal. [Figure 11] It is a diagram showing an example of an alert screen displayed on the display unit of the staff terminal. [Figure 12] It is a diagram showing an example of a registration screen displayed on the display unit of the staff terminal. [Figure 13] It is a flowchart for explaining an example of the process in the customer waiting state. [Figure 14] It is a flowchart for explaining an example of the process in the transaction state. [Figure 15] It is a flowchart for explaining an example of the process in the processing interruption state. [Figure 16] It is a flowchart for explaining an example of the process in the customer waiting state of the second embodiment. [Figure 17] It is a diagram showing an example of a return visit notification screen displayed on the display unit of the staff terminal. [Figure 18]It is a diagram showing an example of an unauthorized history screen displayed on the display unit of the staff terminal. [Figure 19] It is a diagram showing an example of a result report screen displayed on the display unit of the staff terminal.

Embodiments for Carrying Out the Invention

[0008] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. <First Embodiment> (Overall Configuration of Transaction System 1) FIG. 1 is a diagram showing an example of the configuration of a store S in which a transaction system 1 to which the first embodiment is applied is used. FIG. 2 is a diagram showing an example of the overall configuration of a transaction system 1 to which the first embodiment is applied. The transaction system 1 includes a staff terminal 10, a photographing device 20, an auxiliary display operation unit 28, a transaction device 30, an administrator terminal 80, and a management server 100. The staff terminal 10, the photographing device 20, the transaction device 30, the administrator terminal 80, and the management server 100 are connected via a network 90. The network 90 is not particularly limited as long as it is a communication network used for data communication between devices, and for example, it can be exemplified as a LAN (Local Area Network). The communication line used for data communication may be wired or wireless, or a combination of these. The wireless LAN can be exemplified as, for example, WiFi (registered trademark) or Bluetooth (registered trademark). In the first embodiment, the transaction system 1 or the management server 100 is an example of an information processing system.

[0009] Transaction system 1 executes transactions in which the accounting for goods registered in the transaction device 30 is performed by the customer. In this embodiment, if the customer leaves the transaction device 30 during a transaction by transaction system 1 ("departure during transaction"), transaction system 1 prevents a person other than the customer who was conducting the transaction from taking over the transaction being processed by the transaction device 30. Hereinafter, a person other than the customer who was conducting the transaction and who does not intend to take over the transaction being executed by transaction system 1 may be referred to as a third party. Here, "transaction" refers to the exchange of money in connection with the buying and selling of goods. This includes both the exchange of money in physical currency and the exchange of money using electronic means. Examples of electronic means of money exchange include payments using payment cards such as credit cards, debit cards, and IC cards, as well as code-based payments using QR codes (registered trademarks) and barcodes. Furthermore, the customer operations performed in this transaction include operations to register the goods to be bought and sold in the transaction device 30 (hereinafter sometimes referred to as registration operations) and operations to hand over the amount of money corresponding to the registered goods (hereinafter sometimes referred to as accounting operations). Examples of registration operations include scanning the barcode attached to the goods, and inputting text information that identifies the goods and the number of goods. Examples of accounting operations include putting cash into the change machine and inputting credit card information or IC card information into the transaction system 1. Examples of transaction devices 30 operated by the customer include self-checkout registers and semi-self-checkout registers. Here, a self-checkout register is a system in which the customer performs both registration and accounting operations. A semi-self-checkout register is a system in which a store employee performs the registration operations and the customer performs the accounting operations. When using a semi-self-checkout register as an example, the accounting device in which the customer performs the accounting operations corresponds to the transaction device 30. Hereinafter, a person who performs registration or accounting operations on the trading device 30 may be referred to as an operator. Here, "in progress" refers to the period from the start of a transaction until its completion. Here, "start of a transaction" refers to, for example, when a customer declares that they are starting a transaction by operating the "start transaction" button to decide to start a transaction. "Completion of a transaction" refers to, for example, when payment for the goods is completed. Furthermore, the processes performed by the transaction device 30 include, for example, the process of receiving an operation from the customer and registering the goods, and the process of settling the payment amount according to the registered goods.

[0010] The store S in which the transaction system 1 is used is not particularly limited, but examples include convenience stores, supermarkets, and drugstores. Typically, store S has a sales floor where goods are displayed and customers shop, and a back office used by store employees and other staff. Figure 1 shows only the sales floor of store S. In the description of the first embodiment, the sales floor of store S may be simply referred to as store S.

[0011] Store S has multiple product shelves 4. Products are displayed on each product shelf 4. Store S also has a transaction device 30. In this example, store S has multiple transaction devices 30. Customers who enter the store S through entrance 5 walk along the aisles formed between the shelves 4, select items displayed on the shelves 4, and place them in their shopping basket. Then, using the transaction device 30 located in the checkout area 3, the customer registers the items in their shopping basket with the device 30. Once the item registration is complete, the customer starts the checkout process by pressing a button that displays something like "Checkout," and makes the payment.

[0012] (Staff terminal 10) The staff terminal 10 is a device used by a person who monitors the use of the transaction device 30 by customers at store S. The staff terminal 10 displays alerts related to customers leaving a transaction at store S, which are output from the management server 100. Examples of people who use the staff terminal 10 include staff working at store S. In the following description, the user of the staff terminal 10 may be referred to as a staff member. The staff terminal 10 is also a device through which staff members input various information into the management server 100. Information input into the management server 100 may include, for example, the history of actions taken by staff members when an alert for a customer leaving a transaction occurs.

[0013] The staff terminal 10 includes a control unit 11 which contains a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory). The ROM stores the control program executed by the CPU. The CPU reads the control program stored in the ROM and executes the control program using the RAM as the work area. When the CPU executes the control program, each part of the staff terminal 10 is controlled. Furthermore, the staff terminal 10 is equipped with a display unit 12 that displays various information to the staff member. The display unit 12 may be an example of a liquid crystal display or an organic EL (Electro-Luminescence) display. Furthermore, the staff terminal 10 is equipped with a reception unit 13 for receiving operations from staff members. The reception unit 13 may be a touch panel or the like. Furthermore, the staff terminal 10 is equipped with an alarm unit 14 that provides information and warnings to staff. The alarm unit 14 may be an example of a speaker that transmits information to staff by voice. Alternatively, the alarm unit 14 may be an example of a buzzer that alerts staff by sound, or a vibration motor that alerts staff by vibration.

[0014] The employee terminal 10 can be exemplified as a computer operated by an employee of store S. The employee terminal 10 can be exemplified as a tablet device, a personal digital assistant (PDA), a multifunction mobile phone (a so-called "smartphone"), etc. In the illustrated example, the staff terminal 10 is carried by a staff member stationed in the accounting area 3. The staff terminal 10 may also be carried by a staff member stationed outside of the accounting area 3.

[0015] (Administrator terminal 80) The administrator terminal 80 is a device used by a person who monitors the use of the transaction device 30 by customers at store S and the information entered into the management server 100 from the staff terminal 10. The administrator terminal 80 is a device that displays alerts from the management server 100 regarding customers leaving the store S during a transaction. An example of someone who uses the administrator terminal 80 is a store manager who manages the staff working at store S.

[0016] The administrator terminal 80 includes a CPU, a control unit 81 which includes ROM and RAM. The ROM stores the control program executed by the CPU. The CPU reads the control program stored in the ROM and executes the control program using RAM as the work area. When the control program is executed by the CPU, various parts of the administrator terminal 80 are controlled. Furthermore, the administrator terminal 80 is equipped with a display unit 82 that displays various information. The display unit 82 may be an example of a liquid crystal display or an organic EL display. Furthermore, the administrator terminal 80 is equipped with a reception unit 83 that accepts operations. The reception unit 83 may be exemplified by a keyboard or the like.

[0017] The administrator terminal 80 can be exemplified as a computer operated by an employee of store S. The employee terminal 10 can be exemplified as a desktop PC, notebook PC, or tablet PC. In the illustrated example, the administrator terminal 80 is located in the back office.

[0018] (Photography device 20) The camera 20 photographs customers entering the store S and acquires images. The images acquired by the camera 20 may be videos or still images acquired at predetermined time intervals. The camera 20 then outputs the acquired images to the management server 100. The camera 20 can be a small camera such as a CCD camera, for example.

[0019] In the first embodiment, multiple cameras 20 are placed in the store S. Specifically, the cameras 20 include an entry camera 21 that photographs customers entering the store S through the entrance 5. The cameras 20 also include an exit camera 22 that photographs customers leaving the store S through the entrance 5. Furthermore, the cameras 20 include an in-store camera 23 that photographs customers moving around the store S and selecting products displayed on the shelves 4. In this example, multiple in-store cameras 23 are placed in the store S to ensure that customers are always being photographed and to avoid creating blind spots within the store S. In this example, the in-store cameras 23 may also photograph the line of customers waiting to use the transaction device 30 at the entrance to the checkout area 3.

[0020] The imaging device 20 also includes a person detection camera 24 and a face camera 25, which are positioned for each trading device 30. The person detection camera 24 is positioned above the trading device 30 and photographs the customer operating the trading device 30 from above. The face camera 25 photographs the upper body, including the face, of the customer operating the trading device 30. The image captured by the face camera 25 is used by the authentication unit 113 (see Figure 5), which will be described later, for facial recognition. Note that Figure 2 omits the multiple in-store cameras 23, the multiple people detection cameras 24, and the multiple face cameras 25, showing only one of each.

[0021] (Auxiliary display operation section 28) The auxiliary display operation unit 28 presents information regarding withdrawal during trading to customers and staff using the trading device 30. The auxiliary display operation unit 28 is a device that displays still images, moving images, etc., and can be exemplified by a liquid crystal display or an organic EL display. The auxiliary display operation unit 28 is controlled via the network 90 by the auxiliary display control unit 119 of the management server 100 (described later), and displays a screen that presents information regarding withdrawal during trading (for example, the usage prohibition screen 220, the stop transition screen 230, the alert screen 240, etc., described later).

[0022] (Trading device 30) The transaction device 30 is a self-checkout system operated by the customer. In this example, multiple transaction devices 30 are located within the store S. Note that Figure 2 shows only one transaction device 30, omitting the multiple devices. Figure 3 shows an example of a schematic configuration of a trading device 30 to which the first embodiment is applied. Figure 4 is a block diagram showing an example of the functional configuration of a trading device 30 to which the first embodiment is applied. The transaction device 30 includes a POS register 40 for registering products and a change machine 50 for depositing and withdrawing money. The transaction device 30 also includes an unregistered product table 31 for placing unregistered products and a registered product table 32 for placing registered products. In the example shown in Figure 3, as viewed from an operator standing in front of the transaction device 30, the unregistered product table 31 is located to the right of the transaction device 30, and the registered product table 32 is located to the left of the transaction device 30. The arrangement of the unregistered product table 31 and the registered product table 32 is not particularly limited and is determined according to the flow of customers in the store S. Furthermore, the unregistered product table 31 and the registered product table 32 do not have to be provided separately, and the table for unregistered products and the table for registered products may be the same table. Furthermore, the device housing 33 of the transaction device 30 is fitted with a pole 29 for mounting a human detection camera 24, a face camera 25, and an auxiliary display operation unit 28. The POS register 40 and the change dispenser 50 will be described in detail later.

[0023] The human detection camera 24 is mounted on a pole 29 extending from the device housing 33 of the transaction device 30. The human detection camera 24 is positioned at the end of the pole 29 and its field of view is directed towards the operation area R1 in front of the transaction device 30. Here, the operation area R1 is assumed to be the place where an operator would normally stand to operate the transaction device 30. More specifically, the operation area R1 is within reach of the unregistered product table 31 and the registered product table 32, and is a position where the operator can have the scanner 42 read the product they are holding. In the example shown in Figure 3, the operation area R1 is shown as a rectangular frame, but the shape of the operation area R1 does not have to be rectangular. As will be described later, in this embodiment, whether or not there is a person in the operation area R1 is used to determine whether or not there is a person intending to use the transaction device 30. For this reason, text is painted on the floor to guide people who intend to use the transaction device 30 to stand in the operation area R1. In the example shown in Figure 3, the words "Self-checkout operation area" are painted within the frame indicating the operation area R1. Note that the frame or text guiding the user to stand in this operating area R1 does not need to be drawn.

[0024] The face camera 25 is positioned so that it captures the upper body of the operator standing in the operating area R1, with its field of view directed from the back of the trading device 30 towards the front. The auxiliary display operation unit 28 is mounted on the pole 29 via a display arm (not shown), and its display screen is positioned to face the operator.

[0025] (POS register 40) The POS register 40 includes a POS display and operation unit 41, a scanner 42, a card reader 43, a printing unit 44, and a communication unit 45. The POS display and operation unit 41 can be exemplified as a liquid crystal touch panel display. Scanner 42 acquires information such as the product name and price by optically reading the image of the barcode attached to the product. Scanner 42 only needs to read information that identifies the product, and may read information other than barcodes, for example. Scanner 42 may also read information other than information that identifies the product. For example, scanner 42 may acquire information about customers who are members of store S by reading the image of the barcode attached to the store S's membership card, etc. For example, scanner 42 may read QR codes for code payments or barcodes. In addition, although scanner 42 shown in Figure 3 is fixed to the device housing 33 of the transaction device 30, it may also be a handheld scanner that can be held and read by an operator, for example.

[0026] The card reader 43 reads information from credit cards, debit cards, prepaid cards, etc. The printing unit 44 prints the transaction details on a receipt and ejects it from the receipt ejection port 44a. The transaction details printed on the receipt may include, for example, the name of the purchased item, its price, the amount of money inserted, the amount of change given, and the date and time. The communication unit 45 is a communication interface that communicates with the change dispenser 50 and the management server 100.

[0027] Furthermore, the POS register 40 includes a CPU, ROM, and RAM, and is equipped with a POS control unit 47 that controls the entire POS register 40. Furthermore, the POS register 40 is equipped with a storage unit 48 that stores various programs such as the OS (Operating System) and applications, input data for various programs, and output data from various programs. The storage unit 48 can be exemplified as a storage device such as an HDD (Hard Disk Drive) or semiconductor memory.

[0028] The POS control unit 47 includes a purchased product registration unit 471, a purchase amount calculation unit 472, a payment processing unit 473, and a display control unit 474. The purchased product registration unit 471 registers the product using the information obtained when the scanner 42 reads the barcode attached to the product and acquires information such as the product name and price.

[0029] The purchase amount calculation unit 472 calculates the purchase amount by summing the prices of all products registered by the purchase product registration unit 471.

[0030] The settlement processing unit 473 settles the purchase amount calculated by the purchase amount calculation unit 472, completes the transaction, and issues a receipt. In other words, the settlement processing unit 473 prints the transaction details on the printing unit 44 and discharges the receipt from the receipt output port 44a. The purchase amount may be settled by a payment card such as a credit card, or by cash. If cash payment is selected, the settlement processing unit 473 transmits the purchase amount to the change dispenser 50. The settlement is then completed when the change dispenser 50 sends a notification that the cash settlement is complete. Furthermore, when a payment is completed, the payment processing unit 473 outputs a payment completion notification to the management server 100 indicating that the payment has been completed.

[0031] The display control unit 474 causes the POS display operation unit 41 to display a transaction start button (not shown) for the operator to decide to start a transaction when the system is in a customer waiting state. Here, the customer waiting state is a state in which no transaction has been started by the transaction device 30, and it is possible to start a new transaction using the transaction device 30. The display control unit 474 also causes the POS display operation unit 41 to display a checkout start button (not shown) for the operator to decide to start checkout after completing product registration. The POS display operation unit 41 displays information to prompt the operator to register the products to be purchased. For example, the display control unit 474 displays the text information "Please scan the product barcode." on the POS display operation unit 41. Furthermore, the display control unit 474 causes the POS display operation unit 41 to display a list of products registered by the purchased product registration unit 471. In addition, the display control unit 474 causes the POS display operation unit 41 to display the purchase amount calculated by the purchase amount calculation unit 472. Furthermore, when cash payment is selected, the display control unit 474 causes the POS display operation unit 41 to display the amount received, the amount of change, etc.

[0032] (Change machine 50) The change dispenser 50 includes a communication unit 51, a change display and operation unit 52, and a storage unit 53. The communication unit 51 is a communication interface that communicates with the POS register 40 and the management server 100. The change display and operation unit 52 is an LCD touch panel display or the like. The change display and operation unit 52 provides information to the customer. In addition, the change display and operation unit 52 displays the status and settings of the change machine 50 and accepts operations from the store staff. The memory unit 53 can be exemplified as a storage device such as an HDD or semiconductor memory.

[0033] Furthermore, the change dispenser 50 includes a CPU, ROM, and RAM, a change control unit 57 that controls the entire change dispenser 50, a banknote processing unit 60, and a coin processing unit 70. The change dispenser 50 also includes a banknote slot 61 used for inserting banknotes and a banknote dispensing port 62 used for dispensing banknotes. The change dispenser 50 also includes a coin slot 71 used for inserting coins and a coin dispensing port 72 used for dispensing coins.

[0034] The change control unit 57 includes a deposit processing unit 571 that processes the deposit of currency and a withdrawal processing unit 572 that processes the withdrawal of currency. When the deposit processing unit 571 receives the purchase amount from the POS register 40, it authorizes the insertion of money into the banknote processing unit 60 and the coin processing unit 70. The deposit processing unit 571 then obtains the number of coins of each denomination inserted from the banknote processing unit 60 and the coin processing unit 70 and calculates the total amount of the inserted money. If the total amount of the inserted money exceeds the purchase amount, the deposit processing unit 571 calculates the difference between the total amount and the purchase amount as change. The deposit processing unit 571 then instructs the withdrawal processing unit 572 to withdraw the calculated change. Meanwhile, if the total amount of the inserted money matches the purchase amount, or if the withdrawal processing unit 572 has successfully withdrawn the change, the deposit processing unit 571 sends a cash settlement completion notification to the POS register 40.

[0035] When the withdrawal processing unit 572 receives a change payment instruction from the deposit processing unit 571, it determines the denominations and number of bills to be paid out according to the amount of change. The withdrawal processing unit 572 then performs the withdrawal process by outputting a payout instruction to the banknote processing unit 60 and the coin processing unit 70. The withdrawal processing unit 572 also notifies the deposit processing unit 571 when the change payment has been successfully completed.

[0036] When a customer wants to register items that are in their shopping basket, they place the items they wish to purchase, still in the basket, on the unregistered items stand 31. Then, the customer stands in the operating area R1, takes the items out of the shopping basket, scans the barcodes attached to the items with the scanner 42 to register them, and repeats the process of moving them to the registered items stand 32. Once all items have been registered, the customer completes the payment process based on the purchase amount displayed on the POS display unit 41. After completing the payment process, the customer typically leaves the store S through the exit 5 (see Figure 1), carrying or with the purchased items in their cart.

[0037] (Management Server 100) Figure 5 shows an example of the schematic configuration of the management server 100. The management server 100 includes a CPU, ROM, and RAM, and is equipped with a control unit 110 that controls the entire management server 100. Furthermore, the management server 100 includes a storage unit 130 that stores various programs such as the OS and applications, input data for various programs, and output data from various programs. The storage unit 130 can be exemplified as a storage device such as an HDD or semiconductor memory. Furthermore, the management server 100 is equipped with a communication unit 140 that communicates with other devices constituting the trading system 1, such as the staff terminal 10, the camera 20, the auxiliary display operation unit 28, the trading device 30, and the administrator terminal 80. The communication unit 140 can be exemplified as a communication interface.

[0038] The management server 100 can be exemplified as a computer that has the function of sending and receiving information with other devices that make up the trading system 1. The management server 100 can be exemplified as a notebook PC or a desktop PC. In this example, the management server 100 is located in the back office of store S. However, the management server 100 may also be located in a headquarters or other location that manages multiple stores, including store S.

[0039] (Control Unit 110) The control unit 110 includes an acquisition unit 111, a dwell detection unit 112, an authentication unit 113, a companion determination unit 114, a completion determination unit 115, a memory control unit 116, an instruction unit 117, a notification unit 118, and an auxiliary display control unit 119. The control unit 110 includes an acquisition unit 111 that acquires captured images taken by the imaging device 20 and various types of information output from the trading device 30.

[0040] The acquisition unit 111 acquires images captured by each of the cameras of the camera 20: the entry camera 21, the exit camera 22, the in-store camera 23, the person detection camera 24, and the face camera 25. Furthermore, the acquisition unit 111 acquires information output from the POS control unit 47 of the POS register 40 of the transaction device 30. Specifically, the acquisition unit 111 acquires information about registered products output from the purchased product registration unit 471 of the POS control unit 47. The acquisition unit 111 also acquires a payment completion notification output from the payment processing unit 473 of the POS control unit 47.

[0041] The dwelling detection unit 112 detects the number of people dwelling in the operating area R1 (see Figure 3), which is predetermined as the area where customers normally stand when operating the trading device 30. The dwelling detection unit 112 uses images from a human detection camera 24 that photographs the operating area R1 from above to detect the number of people present in the operating area R1. For example, the dwelling detection unit 112 may use skeletal recognition, which recognizes the skeletons of people from images captured by the human detection camera 24, to detect the number of people in the operating area R1.

[0042] The authentication unit 113 acquires information to identify a person and authenticates whether or not they are a specific person. The method of authenticating a person is not particularly limited, and examples include authentication using human physical characteristics such as facial recognition, fingerprint recognition, skeletal recognition, and voiceprint recognition. Another example is the use of object authentication, such as authentication using an IC chip on a membership card. In this embodiment, an example of authenticating whether or not they are the same person using facial recognition will be used for explanation.

[0043] The authentication unit 113 comprises an extraction unit 113a and a comparison unit 113b. The extraction unit 113a identifies a human face from the image and extracts the features of the identified face. Hereinafter, the facial features are a set of features from a predetermined set of sample points in the face image. The facial features extracted by the extraction unit 113a may be referred to as facial features. The predetermined set of sample points here are, for example, the distance between the pupils of the right and left eyes, or the distance between the nose and mouth.

[0044] The comparison unit 113b uses the facial features extracted by the extraction unit 113a to determine whether the facial features match. The determination of whether they match is made, for example, by calculating the similarity for each feature of each sample point, applying a bias to each of the calculated similarities, and then taking the average to calculate the overall similarity. If the overall similarity is greater than a predetermined value, it is determined that they match. The magnitude of the bias for each sample point may be adjusted, for example, using machine learning based on deep learning.

[0045] The companion determination unit 114 determines whether a customer in the store is accompanied by another customer in the store. The companion determination unit 114 then forms a group of companions consisting of the customers determined to be accompanied. This group of companions can be treated as a group of people who may take over operations related to a transaction after one of the individuals in the group has initiated the transaction. The group of companions could be, for example, a family, friends, or acquaintances.

[0046] The companion determination unit 114 uses the images captured by the camera 20 to determine whether a person is a companion. For example, the companion determination unit 114 may use images from the store entrance camera 21 to determine that "a person who entered store S together" is a companion. Another example is using images from the in-store camera 23 to determine that "a person walking together in the store" or "a person waiting in line at the register together" is a companion. Yet another example is using images from the face camera 25 to determine that "a person (face) near the operator" during a transaction is a companion. As for methods of determining whether someone is a companion, for example, it may use audio information acquired by a microphone installed in the store to determine if customers are conversing with each other. For example, if a camera is installed in the parking lot, it may determine that a person who gets out of the same car is a companion. Furthermore, it is possible to determine whether or not someone is a companion using any one of these determination methods, or to calculate the degree of probability that someone is a companion by combining multiple determination methods.

[0047] The completion determination unit 115 determines whether the payment has been completed. For example, the completion determination unit 115 determines that the payment has been completed when it receives a payment completion notification from the POS register 40. Alternatively, the completion determination unit 115 may determine what stage of the accounting process is being performed based on the display screen of the POS display operation unit 41 of the POS register 40. Specifically, the completion determination unit 115 may determine that the payment has been completed when text indicating that the payment has been completed (for example, "Payment completed. Thank you for your purchase.") is displayed on the display screen of the POS display operation unit 41 of the POS register 40. The information on the display screen of the POS display operation unit 41 is obtained from the POS control unit 47 of the POS register 40 via the communication unit 140. Furthermore, the completion determination unit 115 may, for example, analyze images acquired from the human detection camera 24 to determine whether the payment has been completed. For example, the completion determination unit 115 may analyze images acquired from the human detection camera 24 and determine that the payment has been completed when it detects that a receipt has been ejected from the receipt ejection port 44a of the POS register 40. Alternatively, the completion determination unit 115 may determine what stage of the accounting process is being performed from images of the POS display operation unit 41 captured by the human detection camera 24. Specifically, for example, character recognition processing may be applied to images of the display screen of the POS display operation unit 41 captured by the human detection camera 24 to recognize the characters displayed on the display screen of the POS display operation unit 41. Then, the completion determination unit 115 may determine what stage of the accounting process is being performed according to the recognized characters. In this way, when determining whether the payment has been completed by analyzing images acquired from the human detection camera 24, it is not necessary to acquire payment completion notifications and information from the display screen of the POS display operation unit 41 from the POS register 40. In this case, there is no need to develop an interface for obtaining payment completion notifications and information from the display screen of the POS display operation unit 41 from the POS register 40, making it easy to use an existing POS register 40, for example.

[0048] The memory control unit 116 causes the management server 100 to store various information in the memory unit 130. The information stored in the memory unit 130 includes facial features used for facial recognition, customer facial images, and a history of customer fraudulent activity. Examples of lists of facial features used for facial recognition include lists of persons of interest, lists of operators, and lists of accompanying persons.

[0049] The list of persons of interest is compiled by memorizing the facial features of customers who were determined to have engaged in fraudulent activities at store S. The list of persons of interest is used to determine whether or not a person attempting to use the transaction device 30 has a history of fraudulent activity.

[0050] An operator list is created for each transaction conducted by the trading device 30. The operator list stores the facial features of the person in the operating area R1 when a transaction is initiated by the trading device 30. It also stores the facial features of the new operator if the operator changes during the transaction. The operator list is used to determine whether the person attempting to operate the trading device 30 after the operator has left the device is the same operator who initiated the transaction.

[0051] The companion list is a list of facial features of customers constituting each group of companions determined by the companion determination unit 114. The companion list is used to determine whether a person attempting to operate the trading device 30 after the operator has left the trading device 30 is the operator's companion. If the person attempting to operate the trading device 30 after the operator has left the trading device 30 is the operator's companion, they are treated as someone who intends to take over the transaction the operator was conducting. On the other hand, if the person attempting to operate the trading device 30 after the operator has left in the middle of a transaction is not the operator's companion, they are treated as a third party who does not intend to take over the transaction the operator was conducting.

[0052] The face images stored by the memory control unit 116 include face images used when facial features were extracted by the extraction unit 113a, and face images from which facial features have not yet been extracted. Furthermore, it is desirable that the face images from which facial features have been extracted be stored in association with those facial features.

[0053] The history of fraudulent activity stored by the memory control unit 116 is stored in association with the history of fraudulent activity of the customer, using identification information to identify the customer who has previously committed fraudulent activity at store S. In the description of the first embodiment, the identification information used to identify the customer who has previously committed fraudulent activity at store S may be referred to as the customer's identification information. Examples of customer identification information include images captured by the face camera 25 when the customer has previously committed fraudulent activity at store S. Examples of customer identification information include information acquired by the transaction device 30 when the customer has previously committed fraudulent activity at store S. For example, information acquired by the card reader 43 of the transaction device 30 when it reads a credit card may be used as customer identification information. Examples of information acquired by reading a credit card include the credit card number, name, and other information that can identify the customer using the credit card. For example, membership information acquired by the scanner 42 of the transaction device 30 when it reads a barcode attached to a membership card of store S may be used as customer identification information. Furthermore, customer identification information may include information such as identification numbers or IDs assigned to each customer who has a history of fraudulent activity.

[0054] The instruction unit 117 generates instructions for controlling the trading device 30. For example, if the person operating the trading device 30 leaves the operating area R1, the instruction unit 117 sends an instruction to the trading device 30 to interrupt the trading process. Here, interruption means temporarily stopping the trading process, stopping it in a way that allows it to be resumed. Hereafter, this interruption instruction may be referred to as an interruption instruction. Furthermore, if the instruction unit 117 determines that the person operating the trading device 30 is registered on the list of persons of interest by the authentication unit 113, it may send an instruction to the trading device 30 to interrupt the processing of transactions by the trading device 30. The instruction unit 117 includes a POS instruction unit 117a and a change dispenser instruction unit 117b. The POS instruction unit 117a generates instructions for controlling the POS register 40. Instructions for controlling the POS register 40 include, for example, instructions to interrupt the processing that the POS register 40 is currently performing. An example of such an interruption is when the POS register 40 is performing product registration, in which case it would stop accepting new product registrations.

[0055] The change dispenser instruction unit 117b generates instructions for controlling the change dispenser 50. Instructions for controlling the change dispenser 50 include, for example, instructions to interrupt the processing that the change dispenser 50 is performing. Instructions to interrupt the processing that the change dispenser 50 is performing include, for example, instructions to stop accepting cash or instructions to stop dispensing change.

[0056] The notification unit 118 notifies the staff terminal 10 in response to detections by the dwell detection unit 112 and the authentication unit 113. For example, if the dwell detection unit 112 detects that an operator has left the trading device 30 during a transaction, the notification unit 118 notifies the staff terminal 10. Also, for example, if the authentication unit 113 detects that a person attempting to operate the trading device 30 is a person of interest, the notification unit 118 notifies the staff terminal 10.

[0057] The auxiliary display control unit 119 controls the display on the auxiliary display operation unit 28 in response to detections by the dwell detection unit 112 and the authentication unit 113. For example, if the dwell detection unit 112 detects that an operator has left the trading device 30 during a transaction, the auxiliary display control unit 119 displays a stop transition screen 230 (described later) on the auxiliary display operation unit 28. Also, for example, if the authentication unit 113 detects that a person attempting to operate the trading device 30 is a person of interest, the auxiliary display control unit 119 displays an alert screen 240 (described later) on the auxiliary display operation unit 28.

[0058] Next, we will explain the display screen of the auxiliary display operation unit 28. Figure 6 shows an example of a normal screen 210 displayed on the auxiliary display operation unit 28. Here, the normal screen 210 is the screen displayed when no instructions to display an alert have been received from the management server 100. In the illustrated example, the normal screen 210 displays the video captured by the face camera 25 in the display area 211, and the video captured by the person detection camera 24 in the display area 212. The content displayed on the normal screen 210 is not particularly limited; for example, it may display text or images explaining how to use the POS register 40 in accordance with the progress of processing by the POS register 40. The progress of processing by the POS register 40 can be determined, for example, by obtaining information about the progress from the POS register 40. Alternatively, the progress of processing by the POS register 40 may be determined by character recognition of the screen of the POS display operation unit 41 (see Figure 3) included in the image captured by the human detection camera 24 (see Figure 3).

[0059] Figure 7 shows an example of the "Use Prohibited" screen 220 displayed on the auxiliary display operation unit 28. The "No Use" screen 220 is displayed when a person attempting to operate the transaction device 30 is registered on the list of persons of interest. The change dispenser instruction unit 117b causes the auxiliary display operation unit 28 to display the "No Use" screen 220. The "No Use" screen 220 displays text information 221 encouraging the use of a manned register. In the example shown in Figure 7, the text information 221 displays "Please use a manned register." The "No Use" screen 220 also displays a release button 222 to return the transaction device 30 to a usable state. In the example shown in Figure 7, the release button 222 displays the text "Release Error." This release button 222 is intended to be operated by an employee and may be displayed in a way that makes it difficult for customers to see at first glance. For example, the display of the release button 222 may be the same color as the background of the "No Use" screen 220 to make it difficult to see.

[0060] Figure 8 shows an example of the stop transition screen 230 displayed on the auxiliary display operation unit 28. The stop transition screen 230 is displayed when no user is detected in the operating area for a predetermined period after trading has started. The stop transition screen 230 displays text information 231 indicating that the transaction has not been completed. In the example shown in Figure 8, the text information 231 displays "Unsettled". The stop transition screen 230 also displays text information 232 indicating the reason why the stop transition screen 230 is being displayed. In the example shown in Figure 8, the text information 232 displays "Operator cannot be recognized. Please move in front of the camera". The stop transition screen 230 also displays text information 233 indicating the number of seconds until processing is temporarily suspended. In the example shown in Figure 8, the text information 233 displays "10 seconds until processing is temporarily suspended".

[0061] Figure 9 shows an example of an alert screen 240 displayed on the auxiliary display operation unit 28. The alert screen 240 displays text information 241 indicating that the accounting process is not complete. In the example shown in Figure 9, the text information 241 displays "Unsettled. Payment is not complete." The alert screen 240 also displays text information 242 indicating that the transaction device 30's processing is interrupted. In the example shown in Figure 9, the text information 242 displays "Processing stopped." The alert screen 240 also displays an image of the operator in the display area 243. This display area 243 allows, for example, if an operator realizes they forgot to buy an item during a transaction, returns to the sales floor, picks up the item, and returns to the accounting area 3, the transaction device 30 that the operator was using can be identified. Also, for example, if a companion of the operator wants to resume processing the transaction, the transaction device 30 that the operator was using can be identified. Furthermore, the alert screen 240 displays a resume button 244 to restart the transaction process. The alert screen 240 also displays a call button 245 to summon a staff member. The alert screen 240 also displays a cancel button 246 to cancel the transaction. In the example shown in Figure 9, the resume button 244, call button 245, and cancel button 246 display the words "Restart Transaction," "Call Staff," and "Cancel Transaction," respectively.

[0062] Figure 10 shows an example of the operating status screen 310 displayed on the display unit 12 of the staff terminal 10. The control unit 11 (see Figure 2) displays the operating status screen 310 on the display unit 12 of the staff terminal 10. The operating status screen 310 is displayed so that staff can understand the operating status of multiple trading devices 30. The operating status screen 310 displays the operating status of each trading device 30 along with an identification number for each device. In the example shown in Figure 10, the operating status of nine trading devices 30 is shown in a list. Note that in the example shown in Figure 1, four trading devices 30 were illustrated, but in Figure 10, nine trading devices 30 are shown. In the example shown in Figure 10, three types of operating status are shown: "In Operation," "Not Settled," and "Closed." Here, "In Operation" means that the trading device 30 is available for use. "Closed" means, for example, that the power to the trading device 30 is turned off and the trading device 30 is unavailable for use. "Not Settled" means that the operator has left the trading device 30 during a transaction. In the example shown in Figure 10, the indicator 312 showing the "unsettled" status and the indicator 311 showing the "operating" status are shown in the same color (black). However, to make the indicator 312 stand out, it may be displayed in a different color (for example, red).

[0063] In the example shown in Figure 10, a portion of the alert screen 320 (see Figure 11) is displayed superimposed on the bottom of the operating status screen 310. The alert screen 320 displays the trading device number indicating which trading device 30 the information pertains to, and an operator 321 for displaying the entire alert screen 320. In the example shown in Figure 10, the alert screen 320 displays the words "Register No. 3" along with a double-layered mountain-shaped symbol with an upward-pointing vertex as the operator 321. Touching this operator 321 pulls the alert screen 320 up to the top of the screen, making the entire alert screen 320 viewable.

[0064] Figure 11 shows an example of an alert screen 320 displayed on the display unit 12 of the staff terminal 10. The control unit 11 (see Figure 2) displays an alert screen 320 on the display unit 12 of the staff terminal 10 if the operator leaves the trading device 30 during a transaction. The display unit 12 shows text information 322 to inform the staff of the situation, as well as text information 323 indicating instructions for the staff. In the example shown in Figure 11, the text information 322 to inform the staff of the situation is displayed as "Payment not completed." In the example shown in Figure 11, the text information 323 indicating instructions for the staff is displayed as "Please check the payment."

[0065] Furthermore, to allow staff to recognize the operator's face, the operator's facial image is displayed in the display area 324. If there are multiple operators of the trading device 30, for example, the facial image of the person who was operating the device immediately before the withdrawal occurred (in other words, the person who is presumed to have withdrawn from the transaction) may be displayed. Alternatively, multiple facial images may be displayed side by side. The alert screen 320 displays an "Unsettled Exit" button 325 and a "Confirm" button 326, which are used by the staff to select the result of the payment confirmation. The "Unsettled Exit" button 325 is for the staff to select if the operator leaves the store without making a payment. The "Confirm" button 326 is for the staff to select if they have confirmed that a payment has been made or that the operator has returned to the transaction device 30 and is continuing the transaction. In the example shown in Figure 11, the words "Unsettled Exit" button 325 and "Confirm" button 326 are displayed, respectively.

[0066] Figure 12 shows an example of a registration screen 330 displayed on the display unit 12 of the staff terminal 10. If the unpaid exit button 325 on the alert screen 320 (see Figure 11) is selected, the control unit 11 displays a registration screen 330 on the display unit 12 of the staff terminal 10, allowing the user to choose whether or not to register the operator in the list of persons of concern. The registration screen 330 displays the face image of the operator to be registered in the display area 331, and shows a registration button 332 to press if registering the face image, and a non-registration button 333 to press if not registering. The non-registration button 333 is selected, for example, when the system mistakenly detects the face of a person waiting in line at the register and displays the face image of a person different from the one who left the transaction midway. The non-registration button 333 is also selected, for example, when the operator returns on their own, resumes the transaction, and completes it. In the example shown in Figure 12, the text "Register face image" is displayed on the registration button 332, and the text "Do not register" is displayed on the non-registration button 333. In the example shown in Figure 12, if the registration button 332 is selected, the memory control unit 116 registers the operator's facial features in the list of persons of interest and stores the operator's facial image in the memory unit 130 in association with the operator's facial features. On the other hand, in the example shown in Figure 12, if the unregister button 333 is selected, the memory control unit 116 does not register the operator's facial features in the list of persons of interest.

[0067] Furthermore, if the register button 332 or the non-register button 333 is selected, registration history information indicating which was selected, along with the identification information of the employee who made the selection, may be stored in association with the history of fraudulent activity. In this case, for example, an administrator such as the store manager of store S may be able to view the registration history information using the administrator terminal 80 (see Figure 2). The administrator may be able to judge whether the decision to register the operator on the list of persons of interest was appropriate, and if it was not appropriate, they may be able to decide whether or not to register them again.

[0068] The following flowchart illustrates the processes performed by the management server 100. Figure 13 is a flowchart illustrating an example of processing in a customer waiting state.

[0069] First, the management server 100 detects whether or not there are people in the operation area R1 (see Figure 3) (step 1001). Specifically, the occupancy detection unit 112 of the management server 100 uses the image captured by the person detection camera 24 to determine the number of people in the operation area R1. If there are no people (NO in step 1001), the system returns to step 1001. If there are people in the operation area R1 (YES in step 1001), the management server 100 determines whether or not the people in the area are registered in the list of persons of concern (step 1002). Specifically, the authentication unit 113 of the management server 100 uses the image captured by the face camera 25 to determine whether the facial features of the people in the area match the facial features already registered in the list of persons of concern. If multiple people are in the operation area R1, it is preferable to perform facial authentication on all of them.

[0070] If the person staying there is registered on the list of persons of interest (YES in step 1002), the auxiliary display control unit 119 displays the "No Use" screen 220 (see Figure 7) on the auxiliary display operation unit 28 (step 1003). Then, the notification unit 118 notifies the staff terminal 10 (see Figure 1) that a person of interest has entered the store (step 1004). When the release button 222 is pressed, the auxiliary display control unit 119 cancels the display of the "No Use" screen 220 (step 1005) and returns to step 1001.

[0071] If the person staying in the area is not registered in the list of persons of interest (NO in step 1002), the memory control unit 116 adds the facial features of the person staying in the area to the operator list (step 1006). If multiple people are staying in the operation area R1, the facial features of all of them are added to the operator list. The instruction unit 117 then instructs the trading device 30 to start processing the transaction (step 1007). The system then proceeds to the transaction status flowchart shown in Figure 14.

[0072] Figure 14 is a flowchart illustrating an example of processing in a transaction state. Here, "transaction status" refers to the state in which the trading device 30 is performing transaction-related processing. The flowchart shown in Figure 14 is an example of processing performed by the management server 100 in parallel with the transaction-related processing performed by the trading device 30. The management server 100 determines whether the transaction processing by the transaction device 30 has been completed (step 2001). More specifically, the completion determination unit 115 of the management server 100 determines whether it has received a payment completion notification from the POS register 40. If the transaction processing is completed (YES in step 2001), the storage control unit 116 deletes the operator list (step 2002). In this case, since the transaction is complete, the flowchart transitions to the customer waiting state (see Figure 13) so that the next customer can use the transaction device 30.

[0073] If it is determined that the transaction processing is not complete (NO in step 2001), the system detects whether a person is lingering in the operating area R1 (step 2003). If a person is lingering (YES in step 2003), the system returns to step 2001. On the other hand, if no person is lingering (NO in step 2003), the system turns on the timer to measure the passage of time (step 2004).

[0074] Then, the management server 100 determines whether or not 3 seconds have elapsed since the timer was set (step 2005). If 3 seconds have not elapsed since the timer was set (NO in step 2005), it detects whether or not a person is staying in the operation area R1 (step 2006). If no one is staying in the operation area R1 (NO in step 2006), it returns to step 2005. On the other hand, if a person is staying in the operation area R1 (YES in step 2006), the memory control unit 116 adds the facial features of the person staying there to the operator list (step 2007). Then, the management server 100 ends the timer measurement and sets the timer value to 0 (step 2008), and returns to step 2001.

[0075] Furthermore, if the timer measurement time elapses to 3 seconds in step 2005 (YES in step 2005), the auxiliary display control unit 119 displays the stop transition screen 230 (see Figure 8) on the auxiliary display operation unit 28 (step 2009). The management server 100 then determines whether or not 30 seconds have elapsed in the timer measurement time (step 2010). If 30 seconds have not elapsed in the timer measurement time (NO in step 2010), it detects whether or not a person is lingering in the operation area R1 (step 2011). If no person is lingering (NO in step 2011), it returns to step 2010. On the other hand, if a person is lingering in the operation area R1 (YES in step 2010), the display of the stop transition screen 230 shown on the auxiliary display operation unit 28 is cleared (step 2012). The memory control unit 116 then adds the facial features of the lingering person to the operator list (step 2007). Then, the management server 100 terminates the timer measurement and sets the timer value to 0 (step 2008), and returns to step 2001.

[0076] In step 2010, if the timer measurement time has elapsed to 30 seconds (YES in step 2010), the management server 100 terminates the timer measurement and sets the timer value to 0 (step 2013), and the notification unit 118 of the management server 100 notifies the staff terminal 10 (step 2014). Upon receiving the notification from the notification unit 118 of the management server 100, the staff terminal 10 displays an alert screen 320 (see Figure 11) on the display unit 12 of the staff terminal 10 indicating that a transaction withdrawal has occurred. The staff terminal 10 may also emit an audio message from its alarm unit 14 indicating that a transaction withdrawal has occurred. The staff terminal 10 may also vibrate its alarm unit 14 to prompt the staff to look at the display unit 12 of the staff terminal 10.

[0077] Then, the instruction unit 117 sends an interruption instruction to the trading device 30, and the auxiliary display control unit 119 displays an alert screen 240 (see Figure 9) on the auxiliary display operation unit 28 (step 2015), and transitions to a processing interruption state (see Figure 15). The management server 100 may also emit an audio message from a speaker (not shown) to inform the customer or staff that a transaction has been interrupted when displaying the alert screen 240 on the auxiliary display operation unit 28. This speaker may be installed, for example, on the trading device 30, or on the ceiling or wall of the accounting area 3.

[0078] In the above explanation, it is assumed that the stop transition screen 230 is displayed when the timer measurement time has elapsed to 3 seconds, and the alert screen 240 is displayed when the timer measurement time has elapsed to 30 seconds. However, the length of this time is not limited to 3 seconds or 30 seconds, and the length of the time can be set as appropriate. Alternatively, the instruction unit 117 may send an interruption instruction to the trading device 30 without displaying the stop transition screen 230, and the auxiliary display control unit 119 may display the alert screen 240. More specifically, for example, when the timer measurement time has elapsed to 3 seconds, the instruction unit 117 may send an interruption instruction to the trading device 30, and the auxiliary display control unit 119 may display the alert screen 240.

[0079] In the above explanation, it was stated that if there is a person remaining in the operation area R1 while the stop transition screen 230 is displayed (YES in step 2011), the stop transition screen 230 displayed on the auxiliary display operation unit 28 is canceled (step 2012). However, the condition in step 2011 may be configured to cancel the stop transition screen 230 only if the person remaining in the operation area R1 is the operator or a companion of the operator. In other words, if the person remaining in the operation area R1 is a third party (not the operator or a companion of the operator), the process may be returned to step 2010. Alternatively, to prevent erroneous accounting by a third party, the system may be configured to immediately send an interruption instruction to the transaction device 30 if a third party is present in the operating area R1 while the stop transition screen 230 is displayed. Specifically, the conditions in step 2011 may be changed so that the system proceeds to step 2013 if the person remaining in the operating area R1 is a third party, and to step 2012 if the person remaining in the operating area R1 is the operator or a companion.

[0080] Furthermore, in the above explanation, when displaying the stop transition screen 230, no interruption instruction is sent to the trading device 30 (see step 2009), but when displaying the alert screen, an interruption instruction is sent to the trading device (see step 2015). However, an interruption instruction may also be sent to the trading device 30 when displaying the stop transition screen 230. For example, processes that are significantly affected by third-party errors may be interrupted, while those that are less affected by third-party errors may not be interrupted. For example, product registration operations may not be interrupted, while accounting operations may be interrupted.

[0081] Figure 15 is a flowchart illustrating an example of processing during a processing interruption state. The flowchart shown in Figure 15 illustrates an example of the processes executed by the management server 100 while trading on the trading device 30 is interrupted. In this interrupted state, the auxiliary display operation unit 28 displays an alert screen 240 (see Figure 9).

[0082] In the process shown in Figure 15, first, it is determined whether or not the call button 245 has been pressed (step 3001). If the call button 245 has been pressed (YES in step 3001), the notification unit 118 notifies the staff terminal 10 (step 3002), and the process proceeds to step 3003. Upon receiving the notification, the control unit 11 of the staff terminal 10 displays on the display unit 12 of the staff terminal 10 that a staff member has been called. On the other hand, if the call button 245 is not pressed (NO in step 3001), proceed directly to step 3003.

[0083] In step 3003, it is determined whether or not the resume button 244 has been pressed. If the resume button 244 has been pressed (YES in step 3003), the instruction unit 117 cancels the interruption instruction to the trading device 30, the auxiliary display control unit 119 clears the display of the alert screen 240 on the auxiliary display operation unit 28 (step 3004), and the system proceeds to the transaction status flowchart (see Figure 14).

[0084] If the resume checkout button is not pressed in step 3003 (NO in step 3003), it is determined whether the cancel button 246 was pressed (step 3006). If the cancel button 246 was pressed (YES in step 3006), the transaction on the transaction device 30 is canceled, the operator list is deleted (step 3007), and the system proceeds to the customer waiting state flowchart (see Figure 13). When a transaction is canceled, the state of the transaction device 30 is initialized so that the next customer can start a transaction. For example, if a product is registered in the POS register 40, the registered product is deleted.

[0085] In step 3006, if the cancel button 246 is not pressed, it is determined whether or not a person is present in the operating area R1 (step 3009). If no one is present in the operating area R1 (NO in step 3009), the process returns to step 3001. Furthermore, in step 3009, if a person is present in the operation area R1 (YES in step 3009), it is determined whether the present person is an operator (step 3010). More specifically, it is determined whether the facial features of the person present in the operation area R1 match the facial features in the operator list. If the present person is an operator (YES in step 3010), the instruction unit 117 cancels the interruption instruction to the trading device 30, the auxiliary display control unit 119 clears the display of the alert screen 240 on the auxiliary display operation unit 28 (step 3004), and the system proceeds to the transaction status flowchart (see Figure 14).

[0086] In step 3010, if the person lingering is not the operator (NO in step 3010), it is determined whether the person lingering is a companion or not (step 3011). More specifically, it is determined whether the facial features of the person lingering match the facial features in the companion list. If the person lingering is not a companion (NO in step 3011), the process returns to step 3001. If the person lingering is a companion (YES in step 3011), the facial features of the person lingering are added to the operator list (step 3012). Then, the instruction unit 117 cancels the interruption instruction to the trading device 30, the auxiliary display control unit 119 clears the display of the alert screen 240 on the auxiliary display operation unit 28 (step 3004), and the process moves to the trading status flowchart (see Figure 14).

[0087] As described above, the transaction system 1 of this embodiment is a transaction system that executes transactions in which the accounting of registered goods is performed by customer operations, and includes a POS display operation unit 41 (an example of a reception unit) that receives operations related to the transaction, a transaction device 30 (an example of a transaction device) that performs processing according to the operations received by the POS display operation unit 41, and a stagnation detection unit 112 (an example of a detection unit) that detects the operator performing the POS display operation unit 41, and the transaction device 30 enters an interruption state in which the transaction is interrupted if the stagnation detection unit 112 does not detect an operator for a predetermined period of time while the transaction is being executed. With the transaction system 1 configured as described above, it is possible to suppress transaction processing such as accounting based on erroneous operations by a third party other than the true operator. In other words, by putting the system into an interrupted state when the operator leaves the transaction device 30 during a transaction, it is suppressed that a third party other than the operator operates the transaction device 30. More specifically, for example, if the operator leaves a transaction in the middle of accounting processing, the transaction device 30 enters an interrupted state, which prevents an erroneous operation in which a third party who later enters the operation area R1 of the transaction device 30 might pay the account of the previous person.

[0088] Furthermore, when the trading device 30 is in an interrupted state, it will release the interruption state on the condition that the authentication unit 113 (an example of a detection unit) detects the operator. As a result, the operator can resume trading without having to perform any operations to resume trading, thus preventing erroneous operations by third parties without increasing the workload of the actual operator.

[0089] Furthermore, the trading device 30 is equipped with a companion determination unit 114 (an example of a determination unit) that determines whether the operator is accompanied by another person. When the trading device 30 is in an interrupted state, it will release the interrupted state on the condition that the authentication unit 113 detects a companion determined by the companion determination unit 114. As a result, a companion, such as a family member of the true operator, can resume trading without having to perform any operations to resume trading, thus preventing accidental operation by a third party without increasing the burden on the companion.

[0090] Furthermore, when the transaction is interrupted, at least an alert screen 240 (an example of a selection screen) is displayed on the POS display operation unit 41 of the trading device 30, allowing the user to choose whether to resume trading or call an attendant. This allows the trading device 30 to be quickly returned to a usable state even if the actual operator leaves the trading device 30.

[0091] Furthermore, if the trading device 30 does not detect an operator for a period shorter than a predetermined period (e.g., 3 seconds) after initiating a transaction but before completing it, the device displays a stop transition screen 230 indicating the transition state before transitioning to the interrupted state. This encourages the operator to move to the operating area R1 before the interrupted state occurs, especially if the operator is standing a short distance away from the operating area R1.

[0092] Furthermore, the management server 100 includes a storage unit 130 that stores the faces of operators that the dwell detection unit 112 has not detected for a predetermined period of time. This allows the server to recognize the visit of an operator whose face has been stored when they visit the store again.

[0093] Furthermore, the transaction system 1 further includes an employee terminal 10 that can be used by an employee, and a notification unit 118 (an example of a notification unit) that notifies the employee terminal 10 of an interruption. When the employee terminal 10 receives a notification from the notification unit 118, a registration screen 330 is displayed that allows the employee to decide whether or not to register the face of the operator who has not been detected by the authentication unit 113 for a predetermined period of time in the list of persons of interest. This increases the reliability of the list of persons of interest by allowing the employee to decide whether or not to register the person of interest.

[0094] Furthermore, the transaction device 30 is a device that allows the operator to perform accounting operations themselves, and may further include an authentication unit 113 (an example of a detection unit) that detects when a person stored in the list of persons of interest in the memory unit 130 makes another visit to the store S where the transaction device 30 is installed, and an auxiliary display control unit 119 (an example of a notification unit) that, when the authentication unit 113 detects a repeat visit, displays a usage prohibition screen 220 on an auxiliary display operation unit 28 that the repeat visitor can see, informing them that the store employee will be using the device to perform accounting operations. This can deter persons of interest from using the transaction device 30 and prevent repeat offenses of fraud.

[0095] Furthermore, the authentication unit 113 may use the face extracted from the image captured by the face camera 25, which is capable of capturing the front of the trading device 30, to detect the return visit of a person registered on the list of persons of interest. If the authentication unit 113 detects a return visit, the trading device 30 may send a command to suspend the trading device 30 from the instruction unit 117. This can deter persons of interest from using the trading device 30 and prevent repeat offenses of fraud.

[0096] Furthermore, the transaction device 30 has a POS register 40 that accepts product registration, and in a transaction, product registration is also performed by the customer. If the authentication unit 113 does not detect the operator for a predetermined period of time while a transaction is in progress, the transaction may be suspended. This prevents transactions from being carried out based on the erroneous operation of a third party even while products are being registered.

[0097] Furthermore, the transaction device 30 includes a POS register 40 that accepts product registration, and further includes a POS instruction unit 117a that instructs the POS register 40 to enter a suspended state if the authentication unit 113 does not detect an operator for a predetermined period of time after the transaction has started but before the transaction is completed. This allows the process to be interrupted without controlling the change dispenser 50.

[0098] Furthermore, the transaction device 30 has a change dispenser 50 for depositing and withdrawing money, and is further equipped with a change dispenser instruction unit 117b that instructs the change dispenser 50 to enter a suspended state if the authentication unit 113 does not detect the operator for a predetermined period after the transaction has started but before the transaction is completed. This prevents the accidental payment of change to a third party.

[0099] Furthermore, the transaction device 30 described above is an accounting device that executes transactions in which the accounting for registered goods is performed by customer operations, and comprises a POS register 40 that accepts operations and an authentication unit 113 that detects the operator performing the operation of the POS register 40, and enters an interruption state in which the transaction is interrupted if the authentication unit 113 does not detect an operator for a predetermined period of time while the transaction is being executed.

[0100] Furthermore, the processing performed by the management server 100, the trading device 30, and the staff terminal 10, as described above, can be realized through the cooperation of software and hardware resources. In this case, the CPU of the control unit (e.g., control unit 110) of each device (e.g., management server 100) executes a program that realizes each function of the device, thereby realizing each of these functions. For example, a non-temporary computer-readable recording medium on which a program is recorded is provided to each device (e.g., management server 100), and the CPU of the device (e.g., management server 100) reads the program stored on the recording medium. Alternatively, the CPU of the device (e.g., management server 100) downloads it via the network 90. ​​In these cases, the program read from the recording medium or the downloaded program itself realizes the functions of the embodiments described above, and the program itself and the recording medium on which it is recorded constitute the present invention.

[0101] The program that implements the functions performed by the management server 100 and the transaction device 30, as described above, causes the computer to execute a processing function that performs accounting processing in accordance with the operations received by the POS register 40 that accepts operations, and an authentication function (an example of a detection function) that detects the operator performing the POS register 40. The processing function interrupts the accounting processing if the authentication function (an example of a detection function) fails to authenticate (detect) the operator for a predetermined period of time while the accounting processing is being performed. Examples of recording media for supplying such a program include flexible disks, CD-ROMs, DVD-ROMs, hard disks, optical disks, magneto-optical disks, CD-Rs, magnetic tapes, non-volatile memory cards, and ROMs.

[0102] The method described above is a method for preventing erroneous transactions, in which a transaction device 30, which has a POS register 40 that accepts operations and executes transactions in which the accounting for registered goods is performed by the customer operating the POS register 40, automatically puts the transaction by the transaction device 30 into an interruption state if it does not detect an operator operating the POS register 40 for a predetermined period of time while the transaction is being executed.

[0103] The transaction system 1 described above comprises a transaction device 30 having a POS register 40 and processing operations in accordance with the operations received by the POS register 40, an authentication unit 113 that detects the operator performing the operation of the POS register 40, and an accompanying person determination unit 114 that determines the operator's companions. The transaction device 30 enters an interrupted state if the authentication unit 113 does not detect the operator for a predetermined period of time while a transaction is being executed, and the interrupted state is released when the authentication unit 113 detects an accompanying person determined by the accompanying person determination unit 114.

[0104] <Second Embodiment> The system according to the second embodiment differs from the trading system 1 according to the first embodiment in that the control unit 110 of the management server 100 performs different processing. Components that have the same function in the first and second embodiments are denoted by the same reference numerals, and their detailed descriptions are omitted. In the first embodiment, individuals with a history of fraudulent activity were instructed to use a manned register instead of a self-checkout register. In the second embodiment, individuals with a history of fraudulent activity were instructed to use a self-checkout register, and the presence of such an individual was notified to the staff terminal 10.

[0105] Figure 16 is a flowchart illustrating an example of the processing performed by the control unit 110 in the customer waiting state of the second embodiment. In the flowchart shown in Figure 16, the same processing numbers are used for the same processing as in the flowchart shown in Figure 13, and detailed explanations are omitted. In the first embodiment, if the person loitering is registered on the list of persons of interest (YES in step 1002), the auxiliary display control unit 119 displays a prohibited use screen 220 (see Figure 7) on the auxiliary display operation unit 28 (step 1003 (see Figure 13)). In the second embodiment, if the person loitering is registered on the list of persons of interest (YES in step 1002), the notification unit 118 notifies the staff terminal 10 (see Figure 1) that a person of interest has entered the store (step 1004). Then, the memory control unit 116 adds the facial features of the loitering person of interest to the operator list (step 1006), and the instruction unit 117 causes the transaction device 30 to start transaction processing (step 1007).

[0106] Figure 17 shows an example of a return visit notification screen 340 displayed on the display unit 12 of the staff terminal 10. The return visit notification screen 340 is displayed on the display unit 12 of the staff terminal 10 when the notification unit 118 notifies that a person of interest has visited the store.

[0107] The return visit notification screen 340 displays text information 341 indicating that a person of interest has returned to the store. In the example shown in Figure 17, the text information 341 is displayed as the word "return visit" enclosed in a rectangle.

[0108] The return visit notification screen 340 displays a video captured by the face camera 25 in the display area 342 to inform staff of the current state of the person of interest. Alternatively, the video captured by the person detection camera 24 may also be displayed in the display area 342 to understand the overall state of the trading device 30 and the actions of the person of interest. The display area 343 of the return visit notification screen 340 displays the image used for face recognition during the previous visit. Additionally, the display area 343 displays associated text information 344 indicating the date of the previous visit. In the example shown in Figure 17, "2024.9.30" is displayed as text information 344.

[0109] Furthermore, the display area 345 of the return visit notification screen 340 displays the facial image used for facial recognition during the current visit. The staff member visually checks the image used for facial recognition from the previous visit and the image used for facial recognition from the current visit to determine whether to take any action. The return visit notification screen 340 displays selection buttons 346 and 347 for selecting whether or not an employee will assist the customer. In the example shown in Figure 17, the selection button 346 for selecting not to assist the customer displays "Do not assist as it is doubtful that this is the same person." In the example shown in Figure 16, the selection button 347 for selecting to assist the customer displays "Assist."

[0110] In the example shown in Figure 17, facial recognition is performed using images from the face camera 25. However, for example, images from the entrance camera 21 or the in-store camera 23 could be used to authenticate suspicious individuals. In this case, the video footage from the entrance camera 21 or the in-store camera 23 capturing the suspicious individual could be displayed.

[0111] Figure 18 shows an example of the fraud history screen 350 displayed on the display unit 12 of the staff terminal 10. The fraud history screen 350 is displayed on the display unit 12 of the staff terminal 10 when "Respond" is selected on the return visit notification screen 340 (see Figure 17). The fraud history screen 350 may also be displayed on the display unit 12 of the staff terminal 10 when the notification unit 118 notifies that a person of interest has visited the store. The fraud history screen 350 displays, in association with the date information 351 indicating the date the fraud occurred, the fraud details information 352 indicating the nature of the fraud, the response details information 353 indicating the actions taken in response to the detected fraud, and the fraud loss information 354 indicating whether or not damage occurred as a result of the detected fraud. Here, the fraudulent activity information 352 indicates the type of fraud that was detected. Response Information 353 indicates the type of action taken with the customer when fraud was detected. If no action was taken with the customer, a "-" is displayed to indicate that no action was taken.

[0112] The fraudulent loss information 354 indicates whether or not store S suffered damage due to fraud. Hereafter, damage incurred by store S due to fraud may be referred to as fraudulent loss. For example, if an employee speaks to the customer when a scan skipping fraud is detected, the skipped item may be registered. In this case, since store S has not suffered damage, the fraudulent loss information 354 will show "none". Note that scan skipping here is a fraudulent act in which an item is moved to the registered item stand 32 (see Figure 3) without having the item's barcode scanned during the item registration operation. On the other hand, for example, if a scan skipping fraud is detected, but an employee does not take action and the skipped item is taken by the customer, store S has suffered damage, and the fraudulent loss information 354 will show "yes".

[0113] Furthermore, even if an alert is issued when a person who has committed fraud returns to the store, it is still included in the history of fraudulent activity, although it is not fraudulent activity itself. In the example shown in Figure 18, for example, the history entry for "2024 / 6 / 03" is indicated with "(returning visit)" in parentheses.

[0114] In the example shown in Figure 18, the date information 351 displays "2024 / 5 / 13". The fraudulent activity information 352 displays "Items left at the bottom of the cart". The corresponding activity information 353 displays "-". The fraudulent loss information 354 displays "Yes". These "2024 / 5 / 13", "Items left at the bottom of the cart", "-", and "Yes" are displayed in correspondence. Here, "Items left at the bottom of the cart" refers to the fraudulent act of proceeding to checkout without scanning the barcodes of items at the bottom of the cart (for example, canned beer in a cardboard box).

[0115] Furthermore, the fraud history screen 350 is equipped with a display field 355 for displaying text information entered by an employee in association with the history of fraudulent activity. This display field 355 displays, for example, text information entered in the input field 363 of the results reporting screen 360 (see Figure 19), which will be described later, and stored in association with the history of fraudulent activity. In the example shown in Figure 18, the display field 355 displays "Every Monday, 14:00-15:00, register operation, mainly prepared foods such as bento boxes, register 3 or 4 used."

[0116] Furthermore, the fraud history screen 350 displays a recommended response display field 356 that indicates the actions that the staff member should take. In the example shown in Figure 18, it displays "<Recommended Action> Speaking to the person." Here, the actions that the staff member should take may be determined by settings, for example, or they may be determined according to the content of the fraudulent activity history.

[0117] Furthermore, the fraud history screen 350 displays selection buttons 357a to c for reporting the actions taken. In the example shown in Figure 18, the selection buttons 357a to c are labeled "Verbal Response," "Fraud Confirmation Response," and "Reporting Response." Here, "Verbal Response" is the option selected when greeting a person of concern with a "Welcome" or similar greeting. "Fraud Confirmation Response" is the option selected when confirming that a person of concern is engaging in fraudulent activity and warning them to stop. "Reporting Response" is the option selected when reporting to security guards who crack down on fraudulent activity at store S or when reporting to the police. The number and content of these selection buttons 357a to c can be changed through settings, and the settings may be changed on the staff terminal 10. Alternatively, the number and content of selection buttons 357a to c may be changed only on, for example, the administrator terminal 80 located in the back office. In addition to the selection buttons 357a to c, the fraud history screen 350 may also have a text input field for staff to freely write and input the details of the actions taken.

[0118] Furthermore, in the example shown in Figure 18, the history of fraudulent activity is shown with the date information 351, the fraudulent activity details 352, the response details 353, and the fraudulent loss information 354 all associated with each other. However, other information may also be associated and displayed. For example, the history of fraudulent activity may include information identifying the employee who took action (e.g., the employee's name).

[0119] Figure 19 shows an example of a results reporting screen 360 displayed on the display unit 12 of the staff terminal 10. The results reporting screen 360 is displayed when one of the selection buttons 357a to c (see Figure 18) is selected to select the action taken. The results reporting screen 360 is a screen for reporting the results of the action taken by the staff member. In the example shown in Figure 19, the results reporting screen 360 is a screen for reporting whether or not fraudulent loss occurred as a result of the action taken by the staff member. In the example shown in Figure 19, the results reporting screen 360 displays three options 361a to c for selecting the action taken, and radio buttons 362 corresponding to each of the three options. Note that only one of the multiple radio buttons 362 can be selected, and in the example shown in Figure 19, option 361a is shown to be selected.

[0120] In the example shown in Figure 19, options 361a to 361c are labeled "Fraudulent Loss Present," "Unconfirmed," and "No Fraudulent Loss," respectively. Option 361a, labeled "Fraudulent Loss Present," is selected when the staff member determines that a fraudulent loss occurred due to fraudulent activity. Option 361c, labeled "No Fraudulent Loss," is selected when the staff member determines that no fraudulent loss occurred due to fraudulent activity. Option 361b, labeled "Unconfirmed," is selected when the staff member cannot determine whether or not a fraudulent loss occurred due to fraudulent activity. Options 361a to c are examples, and the number and content of options 361a to c may be changed by configuration. Also, the number and content of options 361a to c may differ depending on the type of fraudulent activity detected. For example, the content of options 361a to c may show the reaction of the person who committed the fraudulent activity. In this case, for example, as a reaction to being spoken to by an attendant, options 361a to c may be to select whether the person "complied willingly," "complied reluctantly," or "did not comply." Furthermore, the number and content of options 361a to c may be changed, for example, on the staff terminal 10. Alternatively, the number and content of options 361a to c may be changed, for example, only on the administrator terminal 80 located in the back office.

[0121] Furthermore, the results reporting screen 360 includes an input field 363 for staff to enter text information when reporting the details of the response. The input field 363 can be accessed, for example, by touching it, and text information can be entered, for example, using a software keyboard. In the example shown in Figure 19, the input field 363 is labeled "Free Entry Field". The text information entered in this input field 363 will be displayed, for example, in the display field 355 of the fraud history screen 350 (see Figure 18) when the customer visits again. For example, information such as "When the customer returned, we greeted them with 'Welcome' and observed the payment process, but there was no suspicious activity" can be entered in the input field 363.

[0122] Furthermore, the results reporting screen 360 displays an execution button 364 for submitting a report of the response results. When this execution button 364 is selected, the response results selected by the radio button 362 and the text information entered in the input field 363 are sent to the management server 100. In the example shown in Figure 19, the execution button 364 displays "Confirm".

[0123] As described above, the transaction system 2 according to the second embodiment is a transaction system 2 that executes transactions in which the accounting for registered goods is performed by customer operations, and includes a POS display operation unit 41 (an example of a reception unit) that receives operations related to the transaction, a transaction device 30 (an example of a transaction device) that performs processing according to the operations received by the POS display operation unit 41, and a queuing detection unit 112 (an example of a detection unit) that detects the operator performing the operation of the POS display operation unit 41, and the transaction device 30 enters an interrupted state in which the transaction is interrupted if the queuing detection unit 112 does not detect an operator for a predetermined period of time while the transaction is being executed. Furthermore, it includes an authentication unit 113 that detects when a person registered on the list of persons of interest visits the store S where the transaction device 30 is installed again, and a notification unit 118 that displays a return visit notification screen 340 to an employee terminal 10 that can be used by an employee, informing the employee that the authentication unit 113 has detected the return visit. This makes it possible for an employee to respond when a person of interest visits the store.

[0124] Furthermore, the staff terminal 10 displays a fraud history screen 350 that allows the staff to input the actions taken by the staff member when the customer returns to the store. This allows the staff member to remember the history of the actions taken and to be provided with the information when the customer returns to the store.

[0125] Furthermore, when the notification unit 118 notifies the customer of a return visit, the staff terminal 10 may also be capable of displaying a fraud history screen 350 showing the history of the actions taken by the staff member towards the customer who has returned. This allows the staff member to easily grasp the history of the actions taken.

[0126] <Other> In this embodiment, information regarding the withdrawal during a transaction (for example, an alert screen 240) is displayed on the auxiliary display operation unit 28. However, all or part of the information regarding the withdrawal during a transaction may be displayed on the POS display operation unit 41. This embodiment describes a transaction system for buying and selling goods, but it can also be used for transactions involving the exchange of money for the provision of services. For example, this embodiment can be applied to transactions involving the provision of food and beverages in restaurants, or the exchange of money for medical treatment in medical institutions. All or part of the functions of the management server 100 may be provided in the POS register 40 or the change dispenser 50. In this embodiment, the transaction device 30 included a POS register 40 and a change dispenser 50. However, the transaction device 30 does not necessarily have to include a change dispenser 50. For example, it could be a so-called cashless-only device that only handles the exchange of money associated with the buying and selling of goods using electronic means. [Explanation of symbols]

[0127] 1...Transaction system, 10...Staff terminal, 20...Photography device, 21...Entry camera, 22...Exit camera, 23...In-store camera, 24...Person detection camera, 25...Face camera, 30...Transaction device, 40...POS register, 50...Change dispenser, 100...Management server, 110...Control unit, 111...Acquisition unit, 112...Stay detection unit, 113...Authentication unit, 113a...Extraction unit, 113b...Comparison unit, 114...Companion determination unit, 115...Completion determination unit, 116...Memory control unit, 117...Instruction Unit, 117a...POS Instruction Unit, 117b...Cash Dispenser Instruction Unit, 118...Notification Unit, 119...Auxiliary Display Control Unit, 130...Storage Unit, 140...Communication Unit, 210...Normal Screen, 220...Use Prohibited Screen, 230...Stop Transition Screen, 240...Alert Screen, 310...Operating Status Screen, 311...Display, 312...Display, 320...Alert Screen, 330...Registration Screen, 340...Return Visit Notification Screen, 350...Fraud History Screen, 360...Result Report Screen

Claims

1. In a transaction system that executes transactions in which the accounting for registered products is performed by customer operations, A trading device having a reception unit that receives operations related to transactions, and which processes operations according to the operations received by the reception unit, A detection unit for detecting the operator performing the operation of the reception unit, Equipped with, The trading device enters an interruption state if, while executing a transaction, the detection unit does not detect the operator for a predetermined period of time. Trading system.

2. The trading device, when in the interrupted state, will release the interrupted state on the condition that the detection unit detects the operator. The trading system according to claim 1.

3. The system includes a determination unit that determines the identity of the operator's companion, The trading device, when in the interrupted state, releases the interrupted state on the condition that the detection unit detects a companion determined by the determination unit. The trading system according to claim 1.

4. When the aforementioned interruption state occurs, the system further includes a selection unit that allows the user to choose whether to have the trading device resume trading or to call an employee. The trading system according to claim 1.

5. The trading device enters the interrupted state if the detection unit does not detect the operator for a predetermined period of time while a transaction is being executed. The trading system according to claim 1.

6. If, after initiating a transaction but before completing it, the trading device enters a transition state prior to the interruption state if the detection unit does not detect the operator for a period shorter than the predetermined period. The transaction system according to claim 5.

7. The detection unit further includes a storage unit that stores the face of the operator that the detection unit has stopped detecting over the predetermined period of time. The transaction system according to claim 5.

8. Staff terminals that can be used by staff members, A notification unit that notifies the staff terminal that the aforementioned interruption state has occurred, Furthermore, The staff terminal, upon receiving notification from the notification unit, can accept whether or not to register the face of the operator who has not been detected by the detection unit for a predetermined period of time in the list of persons of interest. The transaction system according to claim 7.

9. The transaction device is a device that allows the operator to perform accounting operations themselves. The memory unit records when a person who has made a return visit to the store where the transaction device is installed, and the recognition unit recognizes when such a person makes a return visit to the store where the transaction device is installed. When the tracking unit detects the customer's return visit, the notification unit notifies the customer that the store clerk will use the payment processing device. The transaction system according to claim 7, further comprising:

10. The memory unit records when a person who has made a return visit to the store where the transaction device is installed, and the recognition unit recognizes when such a person makes a return visit to the store where the transaction device is installed. The aforementioned recognition unit notifies an employee terminal usable by an employee that the recognition unit has recognized the return visit, The transaction system according to claim 7, further comprising:

11. The recognition unit has a camera capable of photographing the front of the trading device, and uses the face extracted from the image captured by the camera to identify the repeat customer. The transaction device enters the interrupted state when the recognition unit recognizes the customer's return visit. The transaction system according to claim 10.

12. The staff terminal is capable of receiving input of the actions taken by the staff member towards the person who made a return visit. The transaction system according to claim 10.

13. The staff terminal is capable of displaying a history of the actions taken by the staff member towards the person who made the return visit when the notification unit notifies the person of the return visit. The trading system according to claim 12.

14. The aforementioned trading device has a registration device that accepts registration of goods, In the aforementioned transaction, the product registration was also performed by the customer. If the detection unit does not detect the operator while a transaction is being executed, the transaction will be suspended. The trading system according to claim 1.

15. The aforementioned trading device has a registration device that accepts registration of goods, The system further includes an instruction unit that, after a transaction has been initiated but before it has been completed, instructs the registration device to enter the interrupted state if the detection unit does not detect the operator. The trading system according to claim 1.

16. The aforementioned transaction device has a change machine for depositing and withdrawing money, The system further includes an instruction unit that, after a transaction has started but before it is completed, if the detection unit does not detect the operator, instructs the change dispenser to enter the interrupted state. The trading system according to claim 1.

17. In a trading device that executes transactions in which the accounting for registered goods is performed by customer operations, The reception desk that accepts requests, A detection unit for detecting the operator performing the operation of the reception unit, Equipped with, If the detection unit does not detect the operator while a transaction is being executed, the transaction will be suspended. Trading device.

18. On the computer, A reception unit that receives operations has a processing function that performs accounting processing according to the operations received, A detection function for detecting the operator performing the operation of the reception unit, Make it run, The processing function interrupts the accounting process if the detection function fails to detect the operator while the accounting process is being executed. program.

19. A trading device having a reception unit for receiving operations, which executes transactions in which the accounting for registered goods is performed by the customer through the operation of the reception unit, automatically puts the trading device into an interruption state if it does not detect an operator performing the operation of the reception unit while a transaction is being executed. Methods to prevent erroneous transactions.

20. A trading device having a reception unit that receives operations related to transactions, and which processes operations according to the operations received by the reception unit, A detection unit for detecting the operator performing the operation of the reception unit, A determination unit for determining the accompanying person of the operator, Equipped with, The trading device enters an interrupted state if the detection unit does not detect the operator while a transaction is being executed, and the interrupted state is released on the condition that the detection unit detects a companion determined by the determination unit while the transaction is in the interrupted state. Trading system.

Images