POS terminal and program

Abstract

To suitably prevent a fraudulent activity of a customer.SOLUTION: An adjustment system includes: clerk registration means for a clerk to register a commodity; adjustment means for a customer to operate to perform adjustment; image-pickup means for picking up an image of an operation status of the customer when adjustment is performed by the adjustment means; display means for displaying a result of image pickup performed by the image-pickup means; state control means for exerting control to a first state in which registration of a commodity is mainly performed by the clerk registration means and a second state other than the first state; and display control means for changing control over display presented by the display means in accordance with the state controlled by the state control means.SELECTED DRAWING: Figure 15

Description

[Technical Field]

[0001] The present invention relates to a POS terminal and a program. [Background technology]

[0002] Conventionally, supermarkets and other stores use point-of-sale (POS) registers to register the products purchased by customers and to settle the bill. Self-checkout registers, which allow customers to perform the checkout themselves, are becoming more common. Some self-checkout registers allow customers to register the products and settle the bill themselves. Since customers operate the POS register themselves, there is a risk of fraudulent activity by customers in self-checkout registers. Therefore, various countermeasures have been implemented to prevent fraudulent activity.

[0003] A related technology is a weighing device that has a built-in scale in the platform on which the product is placed, and when weighing the product, it is possible to detect fraudulent acts in which the weight of an item appears to be lighter than the actual weight, and when such fraudulent acts are detected, the weighing result is not confirmed (see, for example, Patent Document 1 below). Also, measures have been taken to prevent fraudulent acts by customers at the time of payment by monitoring customers with a camera. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2017-187821 Summary of the Invention [Problem to be solved by the invention]

[0005] However, conventional technology has had the problem that excessive camera surveillance can make customers feel uncomfortable about being watched, and it may not be possible to effectively prevent fraudulent behavior by customers.

[0006] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a technique that can suitably prevent fraudulent acts by customers. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems, one aspect of the present invention is a checkout system comprising: a clerk registration means by which a clerk registers products; a checkout means which is operated by a customer to settle the payment; an imaging means which captures images of the customer's operations when the payment is made by the checkout means; a display means which displays the images captured by the imaging means; a state control means which controls the clerk registration means to a first state in which products are mainly registered, and a second state other than that; and a display control means which changes the control of the display by the display means depending on the state controlled by the state control means.

[0008] Another aspect of the present invention is a program that causes a computer of a checkout system that includes an imaging unit and a display unit to execute a process in which a store clerk registers an item, a customer operates the system to settle the payment, the imaging unit captures an image of the customer's operations during the checkout, the image captured by the imaging unit is displayed on the display unit, the system is controlled to a first state in which the store clerk mainly registers items, and a second state other than the first state, and the display control by the display unit is changed depending on the controlled state. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a network configuration diagram of a POS (Point Of Sales) system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram showing an example of installation of a POS terminal 20. [Figure 3] 1 is a diagram showing an example of the appearance of a POS terminal 20. FIG. [Figure 4] FIG. 2 is a diagram illustrating an example of the configuration of a POS terminal 20. [Figure 5] FIG. 10 is a schematic diagram illustrating an outline of operation in a normal mode. [Figure 6]10 is a flowchart showing an example of a process executed by the POS terminal 20 in a normal mode. [Figure 7] FIG. 10 is a schematic diagram illustrating an outline of operation in a transaction-only mode. [Figure 8] 10 is a flowchart showing an example of processing executed by the POS terminal 20-2 in the transaction-only mode. [Figure 9] FIG. 10 is a schematic diagram illustrating an outline of the operation in full self mode. [Figure 10] 10 is a flowchart showing an example of a process executed by the POS terminal 20 in the full self-service mode. [Figure 11] FIG. 10 is an explanatory diagram showing an example of a screen displayed on the POS terminal 20-1 in the normal mode. [Figure 12] FIG. 10 is an explanatory diagram showing an example of a screen displayed on the POS terminal 20-1 in the normal mode. [Figure 13] FIG. 10 is an explanatory diagram showing an example of a standby screen displayed on the customer-side display unit 205 of the POS terminal 20 in the self-service mode. [Figure 14] FIG. 10 is an explanatory diagram showing an example of a screen displayed on the customer display unit 205 when settlement is performed in the accounting-only mode. [Figure 15] FIG. 10 is an explanatory diagram showing an example of a screen displayed on the customer side display unit 205 during product registration in full self-service mode. [Figure 16] FIG. 10 is an explanatory diagram showing a first modified example of the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] (Embodiment) FIG. 1 is a network configuration diagram of a POS (Point Of Sales) system according to an embodiment of the present invention. The POS system 1 shown in FIG. 1 includes three POS terminals 20-1, 20-2, and 20-3, a store controller (store computer, management device) 10, and a monitoring terminal 11. Hereinafter, when there is no need to distinguish between the POS terminals 20-1, 20-2, and 20-3, they will be collectively referred to as the POS terminal 20. The store controller 10, the monitoring terminal 11, and the POS terminal 20 are communicatively connected via a LAN 55. Note that although the number of POS terminals 20 in the POS system 1 is three, it may be one, or four or more.

[0011] The POS system 1 can be installed in a variety of stores, including supermarkets, home improvement stores, convenience stores, and general merchandise stores. The store controller 10 records various information such as the items and prices of merchandise in the store, inventory status, sales history, and deposit and withdrawal records. The monitoring terminal 11 displays the status of the POS terminal 20 (operation mode, processing status, etc.) and controls the POS terminal 20. The POS terminal 20 is a cash register device that registers merchandise and performs settlement.

[0012] The POS system 1 may also include a portable terminal carried by a store clerk. The portable terminal can display the status of the POS terminal 20 (operation mode, processing status, etc.) and control the POS terminal 20. The portable terminal can also receive notification information from the POS terminal 20 that a store clerk should be called and display that information.

[0013] FIG. 2 is a diagram showing an example of the installation of the POS terminal 20. FIG. 2(A) is a perspective view of the POS terminal 20 as seen from the customer side. FIG. 2(B) is a perspective view of the POS terminal 20 as seen from the store clerk side. As shown in FIG. 2(A), a counter is placed on the right side of the POS terminal 20 as seen from the customer side. Although not shown in the figure, a counter is also placed on the left side of the POS terminal 20 as seen from the customer side in FIG. 2(A). In other words, counters are placed on both sides of the POS terminal 20. A shopping cart can be placed on the counter.

[0014] The POS terminal 20 also includes a sign pole 220. The sign pole 220 includes a light-emitting unit. The light-emitting unit of the sign pole 220 is, for example, a lamp or an LED (light emitting diode), and can light up in a predetermined color or in a predetermined flashing pattern. The lighting pattern of the sign pole 220 indicates that the pole is in use or issues a warning. The sign pole 220 is provided at the highest position of the POS terminal 20, and its lighting pattern can be recognized even by store staff who are not around the POS terminal 20.

[0015] Next, the configuration of the POS terminal 20 will be described with reference to FIGS. Fig. 3 is a diagram showing an example of the appearance of the POS terminal 20. Fig. 3(A) is a front view of the POS terminal 20 as seen from the customer side. Fig. 3(B) is a front view of the POS terminal 20 as seen from the store clerk side. Fig. 4 is a diagram showing an example of the configuration of the POS terminal 20. In Fig. 3 and Fig. 4, the same parts are given the same reference numerals.

[0016] An example of the configuration of the POS terminal 20 shown in Fig. 4 will be described below with reference to Fig. 3. The POS terminal 20 includes a CPU 201, a ROM 202, a RAM 203, a hard disk 204, a customer display unit 205, a customer scanner unit 206, a card payment unit 208, a change dispenser 209, a store clerk display unit 210, a key operation unit 211, a store clerk scanner unit 212, a printing unit 213, an audio output unit 214, a communication unit 215, and a camera 216. These components can communicate with each other via a bus.

[0017] The CPU 201 is a central processing unit that reads and executes various programs stored in the ROM 202 to control the operation of the POS terminal 20. The various programs include a settlement program according to this embodiment. The ROM 202 is a read-only memory that stores various types of information used by the CPU 201, including programs.

[0018] The RAM 203 is a readable and writable memory that stores various information. For example, the RAM 203 stores information acquired from the outside (e.g., a product master acquired from the store controller 10) and information generated during processing. This information includes, for example, registration information (registration data) generated during a registration process for registering products, and settlement information generated during a settlement process for settling (paying for) registered products (purchased products).

[0019] The hard disk 204 stores various types of information. For example, the hard disk 204 may store programs executed by the CPU 201 instead of the ROM 202. Furthermore, the hard disk 204 may store information acquired from the outside or information generated during processing instead of the RAM 203.

[0020] The customer-side display unit 205 is a touch display for customers. The customer-side display unit 205 displays various information to customers and receives various inputs from customers. The customer-side scanner unit 206 is a scanner unit for customers, and optically reads various types of information. For example, the customer-side scanner unit 206 optically reads barcodes (such as product codes) attached to products and codes (such as barcodes and two-dimensional codes) printed on receipts (registered trademarks). In addition to the above, the customer-side scanner unit 206 may also read codes (such as barcodes and two-dimensional codes) printed on gift certificates (gift certificates, coupons, and complimentary coupons) and various cards (such as membership cards and point cards). Note that product registration is not limited to registration by reading codes using the customer-side scanner unit 206. For example, a preset key (a button for ordering a product) corresponding to the product may be displayed on the customer-side display unit 205, and the product may be registered by the customer operating (pressing) the preset key.

[0021] The card payment unit 208 is a payment mechanism that accepts various cards (credit cards, prepaid cards such as transportation cards, point cards, etc.). The card payment unit 208 is equipped with a card recognition unit (reading unit), a display unit, and an operation unit. The card recognition unit magnetically or electrically reads information from various cards. The read information is used to settle the purchase. The card recognition unit can also recognize information to be used in settling the purchase, for example, when using points held on a point card. The card recognition unit can also recognize information that is not used in settling the purchase, for example, when adding points to a point card.

[0022] In this embodiment, the card payment unit 208 includes a card recognition unit, a display unit, and an operation unit, but is not limited to these and may include at least a card recognition unit. Furthermore, the card recognition unit in this embodiment is compatible with contact cards (IC cards, magnetic cards), but is not limited to this. For example, the card recognition unit may be compatible with contactless cards (IC cards) instead of or in addition to a card recognition unit compatible with contact cards.

[0023] The change machine 209 (cash settlement unit) is a cash settlement mechanism, and has an input port for banknotes and coins, and an output port for banknotes and coins. The change machine 209 calculates the amount inserted into the input port, calculates the change amount, which is the difference between the input amount and the purchase amount, and outputs the change from the output port. The change machine 209 faces the customer side and accepts various operations and cash insertions from customers. The change machine 209 also has a sensor that detects banknotes and coins inserted into the input port. The sensor detects that banknotes and coins have been inserted into the input port, and detects the number of banknotes by denomination. The card settlement unit 208 and the change machine 209 form a settlement unit.

[0024] The store clerk display unit 210 is a touch display for the store clerk. The store clerk display unit 210 displays various information to the store clerk and receives various inputs from the store clerk.

[0025] The key operation unit 211 is made up of various keys (hardware keys, buttons). The key operation unit 211 accepts various inputs from the store clerk. Specifically, the key operation unit 211 includes a mode switching button 211a, a collective switching button 211b, and a checkout-only mode switching button 211c. The mode switching button 211a is a button for switching the operation mode. The collective switching button 211b is a button for switching the operation mode of all POS terminals 20 at once by being operated on a specific POS terminal 20 (for example, a POS terminal 20 into which a store manager or the like is logged in). The checkout-only mode switching button 211c is a button for switching to the "checkout-only mode (semi-self mode)" described below.

[0026] The mode switching button 211a is a button that can switch the mode to be transitioned to in a predetermined order each time it is pressed. This order is set in advance, for example, as follows: normal mode → full self-service → checkout only mode → normal mode → ... Therefore, to switch from normal mode to checkout only mode, the store clerk needs to press the mode switching button 211a twice.

[0027] The button for switching modes is not limited to a hard key (mechanical key) such as the mode switching button 211a, but may also be a selection button (soft key) displayed on the store clerk display unit 210. This selection button may, for example, display multiple buttons corresponding to the destination modes. Specifically, if the current mode is the normal mode, a button for switching to the checkout-only mode and a button for switching to the full self-service mode may be displayed. This makes it possible to switch modes with a single touch. In other words, the store clerk does not need to press a button multiple times, but simply presses the button for the mode to which the clerk wants to switch.

[0028] However, the selection button displayed on the store clerk display unit 210 may be a single button, similar to the mode switching button 211a, that can switch to the destination mode in a predetermined order each time it is pressed.

[0029] Furthermore, the button for switching modes is generally displayed on the clerk-side display unit 210, but may also be displayed on the customer-side display unit 205. For example, if it is determined that a clerk is clearly on the customer side, it is also possible to display the button on the customer-side display unit 205. Examples of situations in which a clerk is clearly on the customer side include when the customer-side scanner unit 206 is used to transition to a clerk-only maintenance screen, or when the customer-side display unit 205 is operated to transition to a clerk-only maintenance screen.

[0030] The store clerk scanner unit 212 is a scanner unit for store clerks and optically reads various types of information. For example, the store clerk scanner unit 212 optically reads barcodes attached to products and store clerk codes attached to store clerk name tags. In addition to the above, the store clerk scanner unit 212 may also read codes printed on receipts, gift certificates, and various cards.

[0031] It should be noted that product registration is not limited to registration by reading a code using the store clerk-side scanner unit 212. For example, a key corresponding to a product (e.g., a key corresponding to a sports newspaper) may be arranged on the key operation unit 211, and the product may be registered by the store clerk operating (pressing) the key. Also, a preset key corresponding to a product may be displayed on the store clerk-side display unit 210, and the product may be registered by the store clerk operating the preset key.

[0032] The printing unit 213 prints and outputs various media (receipts, bills, etc.). The printing unit 213 can change the direction of the medium issuing slot. Specifically, the printing unit 213 has a rotatable mechanism and is configured so that the medium issuing slot faces from the store clerk side to the customer side, and from the customer side to the store clerk side. The direction of the medium issuing slot may be changeable manually, or may be changeable automatically in response to a change in the operating mode. The printing unit 213 may also be equipped with a sensor that detects whether the orientation of the printing slot is correct. In the following, a change in the operating mode may sometimes be referred to as a transition in the operating mode.

[0033] The audio output unit 214 outputs audio. For example, the audio output unit 214 outputs audio guidance, warning sounds, etc. The audio guidance and warning sounds are related to product registration and payment. The communication unit 215 is an interface for transmitting and receiving information to and from other devices (the store controller 10, the monitoring terminal 11, and other POS terminals 20).

[0034] Camera 216 is attached to the upper right of customer-side display unit 205 when viewed from the customer side. Camera 216 continuously captures video or still images. Camera 216 captures images of the customer's operations during checkout. Specifically, camera 216 captures images of bills and coins held by the customer, change dispenser 209, hand movements, etc. Camera 216 also captures images of the customer's operations during product registration. Specifically, camera 216 can capture images of the inside (products) of shopping carts on counters provided on both sides of POS terminal 20, as well as the customer's operations during registration.

[0035] (Overview of each operation mode) Next, the operation modes of the POS terminal 20 will be described. The POS terminal 20 has multiple operation modes. The multiple operation modes are operation modes during normal business (operation modes related to registration processing and settlement processing). The multiple operation modes are a normal mode, a checkout-only mode, and a full self-service mode. The POS terminal 20 is controlled in one of the multiple operation modes.

[0036] In addition to the above modes, there are other operating modes such as a counting mode, a maintenance mode, and a training mode. The counting mode is a mode for counting and checking sales and inventory. The maintenance mode is a mode in which store clerks and maintenance personnel perform setup and maintenance work. The training mode is a mode in which new employees undergo training.

[0037] The following mainly describes in detail the normal mode, the checkout only mode, and the full self-service mode. Note that in the following, the checkout only mode and the full self-service mode may be collectively referred to as the "self-service mode."

[0038] (Normal mode) The normal mode is an operating mode in which the clerk's product registration (hereinafter sometimes referred to as "product registration") is enabled and the customer's product registration is disabled. In other words, the normal mode is an operating mode in which the clerk's registration process is executed without executing the customer's registration process. In the clerk's product registration, the purchased product is registered using the clerk's scanner unit 212, the clerk's display unit 210, and the key operation unit 211.

[0039] In addition, in the normal mode, settlement is possible by inserting currency (bills and coins) and reading various cards. Specifically, in the normal mode, for example, it is possible to accept cash settlement operations (inserting currency into the change dispenser 209). Hereinafter, settlement in the normal mode may be referred to as "face-to-face settlement."

[0040] Furthermore, in the normal mode, it is possible to transmit registration information to other POS terminals 20. Transmitting registration information to other POS terminals 20 means transmitting the registration information generated in the registration process to other POS terminals 20 that can execute the settlement process. The registration information may be transmitted directly from one POS terminal 20 to another POS terminal 20, or may be transmitted indirectly to another POS terminal 20 via another device such as the store controller 10 or the monitoring terminal 11. Although the following description does not go into detail about the transmission of information between the devices, the information may be transmitted directly or indirectly, similar to the transmission of registration information.

[0041] In normal mode, it is also possible to issue a receipt. Issuing a receipt means that the registration information generated in the registration process is coded and printed on a print medium (receipt). Another POS terminal 20 can read the code on the receipt to carry out the payment process.

[0042] In normal mode, the POS terminal 20 can also receive registration information from other POS terminals 20. That is, in normal mode, the POS terminal 20 can execute a payment process based on registration information generated by other POS terminals 20. When the POS terminal 20 receives registration information in normal mode, it may transition to a payment-only mode (semi-self-service mode). Similarly, when the POS terminal 20 reads a code on a receipt in normal mode, it may transition to the payment-only mode. After transitioning to the payment-only mode and completing the payment process, it may return from the payment-only mode to the normal mode automatically or with the permission of a store clerk. Furthermore, the payment-only mode may remain in effect even after transitioning to the payment-only mode and completing the payment process. In normal mode, the POS terminal 20 may disable the reception of registration information from other POS terminals 20, the reading of receipts on receipts, or both.

[0043] (Accounting only mode) The transaction-only mode is an operating mode in which the reception of registration information from other POS terminals 20, the reading of transaction tickets, and the insertion of coins are enabled, and product registration by the store clerk and customer is disabled. The reception of registration information from other POS terminals 20 is a function for receiving registration information generated in the registration process of other POS terminals 20. The registration information may be received directly from other POS terminals 20, or may be received indirectly from other POS terminals 20 via other devices such as the store controller 10 or monitoring terminal 11. Although the following description does not go into detail about the reception of information between devices, it may be received directly or indirectly, as with the reception of registration information.

[0044] Reading a receipt ticket means reading the code printed on the receipt ticket or reading the coded information. The receipt-only mode is an operating mode in which the terminal does not perform the registration process, but instead performs the settlement process solely based on the registration information generated by another POS terminal 20. Note that because the receipt-only mode is an operating mode in which the registration process is not performed, i.e., no registration information is generated, the sending of registration information to other POS terminals 20 and the issuance of receipt tickets are both disabled.

[0045] (Full selfie mode) The full self-service mode is an operating mode that enables product registration on the customer side. In other words, the full self-service mode is an operating mode that assumes that registration processing will be performed on the customer side. In product registration on the customer side, purchased products are registered using the customer side scanner unit 206 and the customer side display unit 205.

[0046] In the full self-service mode, it is possible to enable product registration by the store clerk. In other words, the full self-service mode is an operating mode that assumes registration processing by the customer, but also allows registration processing by the store clerk. A state in which registration processing is performed by both the customer and the store clerk is sometimes called a double scan mode. In the full self-service mode, product registration by the store clerk may be disabled.

[0047] The full self-service mode is an operating mode in which the terminal can perform settlement processing at its own terminal. Specifically, the full self-service mode is an operating mode in which insertion of coins is enabled, and transmission of registration information to other POS terminals 20 and issuance of receipts are disabled.

[0048] Similarly to the checkout-only mode, the full self-service mode is an operating mode in which both the reception of registration information from other POS terminals 20 and the reading of receipts are enabled. In other words, similar to the checkout-only mode, in the full self-service mode, the settlement process can be performed based on registration information generated by other POS terminals 20.

[0049] Note that the POS terminal 20 may switch to accounting-only mode (semi-self-service mode) when it receives registration information in full self-service mode. Similarly, the POS terminal 20 may switch to accounting-only mode when it reads the code on a receipt in full self-service mode. After switching to accounting-only mode and completing the settlement process, the POS terminal 20 may automatically return from accounting-only mode to full self-service mode. Also, even after switching to accounting-only mode and completing the settlement process, the POS terminal 20 may remain in accounting-only mode. Note that in full self-service mode, the reception of registration information from other POS terminals 20 may be disabled, the reading of receipts on receipts may be disabled, or both may be disabled.

[0050] The following provides additional information about the restricted mode and registration-only mode in the normal mode.

[0051] (Restricted mode in normal mode) The restricted mode in the normal mode is an operating mode that disables the transmission of registration information to other POS terminals 20 and the issuance of receipts. In other words, the restricted mode is an operating mode that limits the function of allowing other POS terminals 20 to execute payment processing.

[0052] (Registration only mode in normal mode) The registration-only mode in the normal mode is an operating mode that enables product registration by the store clerk, sending of registration information to other POS terminals 20, and issuance of receipts, and disables product registration by the customer, insertion of coins, reception of registration information from other POS terminals 20, and reading of receipts. In other words, the registration-only mode is an operating mode in which the terminal itself exclusively performs the registration process and other POS terminals 20 perform the settlement process. Note that the registration-only mode is intended to be performed by the store clerk, and therefore disables product registration by the customer.

[0053] (About enabling and disabling various functions) In the above explanation, it has been explained that the various functions (item registration by the clerk, item registration by the customer, insertion of coins, reading of the receipt, etc.) of the POS terminal 20 are enabled or disabled depending on the operation mode. In other words, it has been explained that the operation mode of the POS terminal 20 is set by disabling some of the functions of the POS terminal 20.

[0054] However, it is sufficient that the POS terminal 20 has different executable functions for each operation mode. In other words, the POS terminal 20 does not necessarily have all of the functions. For example, the POS terminal 20 may acquire a program for realizing a function required for each operation mode from an external device (e.g., the store controller 10, the monitoring terminal 11, or a server outside the store) and make it executable, and if the POS terminal 20 holds a program for realizing an unnecessary function for each operation mode, it may make the program inexecutable (e.g., by erasing it).

[0055] It is also possible to make a program for realizing an unnecessary function in an unexecutable state, and then acquire a program for realizing a necessary function and make it executable. Furthermore, for example, when switching the operation mode, the POS terminal 20 may first make all programs in an unexecutable state regardless of the operation mode to which the operation mode is switched, and then acquire a program from an external device to realize a function required in the new operation mode and make it executable. In other words, the POS terminal 20 may be configured to disable some of the various functions originally provided depending on the operation mode, or to be provided with only the necessary functions as appropriate depending on the operation mode.

[0056] (Switching (transitioning) operation modes) Next, we will explain how to switch (transition) the operation mode of the POS terminal 20. The POS terminal 20 switches the operation mode in accordance with a mode switching operation, a store clerk code reading operation, a mode switching command, or the like.

[0057] Specifically, the POS terminal 20 switches between operation modes in accordance with an explicit mode switching operation by a store clerk. The mode switching operation is performed by operating the mode switching button 211a (see FIG. 3(B)). The POS terminal 20 also switches between operation modes in accordance with other operations different from the mode switching operation, such as reading a store clerk code.

[0058] The POS terminal 20 also switches its operating mode in response to a mode switching command from another POS terminal 20, the monitoring terminal 11, a mobile terminal, etc. The POS terminal 20 may also switch its operating mode in response to a time condition, such as the time elapsed since the last operation or a scheduled time.

[0059] The POS terminal 20 may also be configured to switch its operating mode at the start of processing, such as when a settlement process based on registration information received from another POS terminal 20 starts, or when a settlement process based on reading a receipt starts.

[0060] The POS terminal 20 may also switch its operating mode at the end of a process, such as when a settlement process based on registration information received from another POS terminal 20 is completed, or when a settlement process based on reading a receipt is completed.

[0061] Next, the transition between modes will be described.

[0062] (Normal mode → Full self mode) First, switching from normal mode to full self mode will be explained. When controlled in normal mode, for example, if a mode switching operation, a mode switching command, or a predetermined time has elapsed (a predetermined time of non-use) occurs, the operation mode will switch from normal mode to full self mode. The mode switching command here is a mode switching command that specifies full self mode as the operation mode to be transitioned to.

[0063] (Normal mode → Accounting-only mode) Next, we will explain how to switch from normal mode to accounting-only mode. When the device is in normal mode, for example, if a mode switching operation or mode switching command is issued, the operating mode will switch from normal mode to accounting-only mode. The mode switching command here is a mode switching command that specifies accounting-only mode as the operating mode to be transitioned to. Furthermore, when the device is in normal mode, the operating mode may also be switched from normal mode to accounting-only mode if, for example, registration information is received from another POS terminal 20 or a bill is read.

[0064] (Full self mode → Normal mode) Next, switching from full self mode to normal mode will be described. When the device is in full self mode, for example, if a mode switching operation or a mode switching command is issued, the operating mode switches from full self mode to normal mode. The mode switching command here is a mode switching command that specifies normal mode as the destination operating mode.

[0065] (Full self-service mode → Accounting-only mode) Next, switching from full self-service mode to accounting-only mode will be described. When the device is in full self-service mode, for example, if a mode switching operation or mode switching command is issued, the operating mode switches from full self-service mode to accounting-only mode. The mode switching command here is a mode switching command that specifies accounting-only mode as the operating mode to transition to. Furthermore, when the device is in full self-service mode, the operating mode may be switched from full self-service mode to accounting-only mode, for example, if registration information is received from another POS terminal 20 or if a bill is read.

[0066] (Accounting mode → Normal mode) Next, switching from the accounting-only mode to the normal mode will be described. When the device is in the accounting-only mode, for example, if a mode switching operation or a mode switching command is received, the operating mode will switch from the accounting-only mode to the normal mode. The mode switching command here is a mode switching command that specifies the normal mode as the operating mode to transition to. Furthermore, when the device is in the accounting-only mode, the operating mode may be switched from the accounting-only mode to the normal mode, for example, if the settlement process based on the received registration information or the settlement process based on a receipt is completed.

[0067] (Accounting-only mode → Full self-service mode) Next, we will explain how to switch from the accounting-only mode to the full self-service mode. When the device is in the accounting-only mode, for example, if a mode switching operation or a mode switching command is issued, the operating mode switches from the accounting-only mode to the full self-service mode. The mode switching command here is a mode switching command that specifies the full self-service mode as the destination operating mode.

[0068] In addition, when the device is controlled in the accounting-only mode, the operating mode may be switched from the accounting-only mode to the full self-service mode, for example, when the settlement process based on the received registration information or the settlement process based on the bill is completed.

[0069] The mode switching operation may be any operation that specifies the destination operation mode in response to the operation. For example, if there are buttons for each destination, the operation mode may be switched in response to the mode switching operation of pressing each button. Also, if there is one button that switches the destination each time it is pressed, the operation mode may be switched each time the button is pressed. Note that there may be separate buttons for selecting the destination operation mode and for confirming the transition to the operation mode selected by that button.

[0070] (Double scan mode in full self mode) Next, switching to double scan mode in full self-service mode will be described. In full self-service mode, for example, if a store clerk code is read, the full self-service mode switches to double scan mode.

[0071] Note that if a clerk code is read while in full self-service mode, the device may always switch to double scan mode regardless of the product registration status, or may not switch to double scan mode depending on the product registration status. For example, if a clerk code is read when a product has not been registered by a customer, the device may switch to normal mode. Also, if a clerk code is read when a product has been registered by a customer, the device may switch to double scan mode.

[0072] (Operation in each operation mode) Next, the operation in each operation mode will be described with reference to FIGS.

[0073] (Normal mode operation) Fig. 5 is a schematic diagram outlining the operation in normal mode. Specifically, Fig. 5 is a schematic diagram showing the flow of processing and the actions of people (clerks and customers) in normal mode. As shown in the upper part of Fig. 5, in normal mode, the POS terminal 20 accepts operations by the clerk using the clerk-side scanner unit 212, the clerk-side display unit 210, and the key operation unit 211, and registers the items purchased by the customer. While the items are being registered by the clerk, the POS terminal 20 does not display the image screen showing the image capture results of the camera 216 on the customer-side display unit 205.

[0074] Once the clerk has completed the registration of the purchased items, the POS terminal 20 displays the total price of the purchased items and the like on the customer display unit 205. Then, as shown in the lower part of FIG. 5, the customer checks the total price of the purchased items displayed on the customer display unit 205 and settles the bill. Specifically, the customer settles the bill by inserting cash into the change dispenser 209 or by operating the card settlement unit 208. Thus, in normal mode, the POS terminal 20 can execute the settlement process according to the customer's operation. Furthermore, the POS terminal 20 can accept the customer's selection of the settlement type (payment method) before the registration process is completed.

[0075] At the time of payment, problems may arise due to fraudulent behavior by the customer. For example, when a customer actually inserted a 5,000 yen bill into the slot, they may falsely or mistakenly say that they inserted a 10,000 yen bill, which can cause problems between the store and the customer.

[0076] Therefore, in this embodiment, when the customer starts to settle their account, the POS terminal 20 displays an image screen (reduced image screen 1200 in FIG. 12) on the customer-side display unit 205. The start of settlement is, for example, when the customer selects a payment method. This makes the customer aware that they are being monitored, and has the effect of deterring fraudulent acts related to settlement.

[0077] The POS terminal 20 may be configured to accept cash being inserted into the change dispenser 209 before the clerk has completed the registration process (before the total amount has been determined). In this case, the POS terminal 20 may start displaying the captured image screen when cash is inserted while the clerk is performing the registration process. In other words, the POS terminal 20 may be configured to display the captured image screen on the customer-side display unit 205 even while the clerk is registering the purchased items. Note that the POS terminal 20 may not accept cash being inserted before the clerk has completed the registration process.

[0078] In normal mode, the POS terminal 20 can register the items purchased by the next customer even before the customer has completed the payment (even before the change has been taken out or the receipt has been printed). In other words, the POS terminal 20 can register the items purchased by the next customer while the payment is being processed at the terminal (lower part of FIG. 5). Also, the store clerk may be absent while the customer is paying (lower part of FIG. 5). In other words, the store clerk may finish serving the customer while the customer is paying.

[0079] Furthermore, if there is change, the POS terminal 20 may issue a receipt after the change has been taken out. Specifically, the POS terminal 20 may be provided with a sensor that detects the change and change tag, and after controlling the dispensing of the change and change tag, may control the printing unit 213 to issue a receipt when the sensor detects that the change and change tag have been taken out. This makes it possible to prevent the user from forgetting to take the change. Note that in other operating modes as well, a receipt may be issued after the change has been taken out.

[0080] (Normal mode flowchart) Fig. 6 is a flowchart showing an example of processing executed by the POS terminal 20 in the normal mode. As shown in Fig. 6, the POS terminal 20 (for example, the POS terminal 20-1) determines whether the normal mode has started (step S601). The POS terminal 20 waits until the normal mode has started (step S601: NO). When the normal mode has started (step S601: YES), the POS terminal 20 hides the captured screen (reduced captured screen 1200 in Fig. 12) from the customer-side display unit 205 (step S602).

[0081] Then, the POS terminal 20 determines whether or not the product has been scanned (step S603). Scanning includes reading a code using the store clerk scanner unit 212, pressing a preset key displayed on the store clerk display unit 210, pressing a key corresponding to the product on the key operation unit 211, etc. If the product has not been scanned (step S603: NO), the POS terminal 20 proceeds to step S605.

[0082] If the product has been scanned (step S603: YES), the POS terminal 20 registers the product (step S604). Then, the POS terminal 20 determines whether or not a subtotal key has been pressed (step S605). The subtotal key is, for example, a subtotal key displayed on the store clerk display unit 210 or a subtotal key located on the key operation unit 211. If the subtotal key has not been pressed (step S605: NO), the POS terminal 20 returns to step S603.

[0083] If the subtotal key is pressed (step S605: YES), the POS terminal 20 determines whether or not it has accepted the designation of the POS terminal 20 to which the registration information is to be sent (the POS terminal 20 to which the settlement is to be made) (step S606). If it has accepted the designation of the POS terminal 20 to which the registration information is to be sent (step S606: YES), the POS terminal 20 sends the registration information to the designated POS terminal 20 (for example, the POS terminal 20-2) (step S607), and proceeds to step S612.

[0084] If the POS terminal 20 to which the registration information is to be sent is not specified (step S606: NO), the POS terminal 20 determines whether or not to settle the transaction at its own terminal (step S608). Settling the transaction at its own terminal means, for example, accepting a selection of the payment type from the customer. Note that if the payment type is cash, selecting the payment type includes pressing a selection button indicating the cash payment type or accepting the insertion of cash. Note that when the POS terminal 20 is controlled to the registration-only mode in the normal mode, it does not accept a selection of the payment type from the customer.

[0085] If the settlement will not be performed at the own terminal (step S608: NO), the POS terminal 20 returns to step S606. If the settlement will be performed at the own terminal (step S608: YES), the POS terminal 20 displays an image screen (reduced image screen 1200 in FIG. 12) on the customer side display unit 205 (step S609). This image screen includes the card payment unit 208 and the change machine 209 (cash insertion and ejection slots) and the customer's hands. Note that the POS terminal 20 can also accept cash insertion before the subtotal key is pressed. In this case, the insertion of cash can be the trigger for starting the display of the image screen.

[0086] Then, the POS terminal 20 performs the settlement process (step S610). When the settlement process is completed, the POS terminal 20 hides the captured screen from the customer side display unit 205 (step S611). After this, the POS terminal 20 determines whether or not the normal mode has ended (step S612). If the normal mode has not ended (step S612: NO), the POS terminal 20 returns to step S603. If the normal mode has ended (step S612: YES), the POS terminal 20 ends the series of processes.

[0087] 6, in step S606, the issuance of a receipt may be accepted in addition to accepting the designation of another POS terminal 20. Specifically, in step S606, in addition to a key for accepting the designation of another POS terminal 20, a key for accepting the issuance of a receipt may be displayed, and the store clerk may operate either key.

[0088] In addition, in the example shown in FIG. 6, as shown in steps S605 and S606, the specification of another POS terminal 20 is accepted after the subtotal key is pressed, but the specification of another POS terminal 20 may also be accepted before the subtotal key is pressed.

[0089] (Accounting-only mode operation) 7 is a schematic diagram for explaining an outline of operation in the transaction-only mode, in which the POS terminal 20-1 is in the normal mode and the POS terminals 20-2 and 20-3 are in the transaction-only mode.

[0090] As shown in the upper part of Figure 7, in the POS terminal 20-1 in normal mode, the clerk registers the customer's purchases, as in the upper part of Figure 5. At this time, the captured image screen is not displayed on the customer-side display unit 205. Also, while the clerk is registering the products at the POS terminal 20-1, the POS terminals 20-2 and 20-3 are in standby mode. In standby mode in the transaction-only mode, the POS terminals 20-2 and 20-3 display the captured image screen on the customer-side display unit 205. This makes it possible to make the customer aware that they are being photographed even in standby mode in the transaction-only mode, thereby enhancing the deterrent effect against fraud.

[0091] When the registration process by the store clerk is completed, the POS terminal 20-1 transmits the registration information to the POS terminal 20-2, which is controlled in the transaction-only mode. For example, the POS terminal 20-1 receives from the store clerk a designation of the POS terminal 20 to execute the payment process (in the example of FIG. 7, either the POS terminal 20-2 or the POS terminal 20-3). Alternatively, the POS terminal 20-1 may receive a request to issue a receipt to be read by the POS terminals 20-2 and 20-3 to execute the payment process.

[0092] When POS terminal 20-2, which is controlled in the transaction-only mode, receives registration information from POS terminal 20-1 or reads the code on the transaction ticket, it displays the total price of the purchased items and the like on customer-side display unit 205. Then, as shown in the lower part of Figure 7, the customer moves to POS terminal 20-2, checks the total price of the purchased items displayed on customer-side display unit 205 of POS terminal 20-2, and settles the bill. Specifically, the customer deposits cash into change dispenser 209 of POS terminal 20-2 or operates card payment unit 208 to settle the bill.

[0093] Even when making a payment, the POS terminal 20-2 continues to display the captured image on the customer side display unit 205. This makes the customer aware that he or she is being monitored, and has the effect of deterring fraudulent acts related to payment.

[0094] In addition, POS terminals 20-2 and 20-3 may not display the captured image on customer display unit 205 when in standby mode for the transaction only. In this case, POS terminals 20-2 and 20-3 may display the captured image on customer display unit 205 of their own terminal when the transaction starts. The transaction starts here may be when registration information is received from POS terminal 20-1, when the code on the transaction ticket is read, or when the payment type is selected by the customer.

[0095] After specifying the other POS terminal 20-2, the POS terminal 20-1 can register the purchased items of the next customer (lower part of FIG. 7). Also, after specifying the other POS terminal 20-2, the store clerk may be absent.

[0096] (Accounting only mode flowchart) Fig. 8 is a flowchart showing an example of processing executed by the POS terminal 20-2 in the transaction-only mode. As shown in Fig. 8, the POS terminal 20-2 determines whether the standby screen in the self-timer mode (standby screen 1300 in Fig. 13) is currently being displayed on the customer-side display unit 205 (step S801). If the standby screen in the self-timer mode is not currently being displayed (step S801), the POS terminal 20-2 ends the series of processing. If the standby screen in the self-timer mode is currently being displayed (step S801: YES), the POS terminal 20-2 displays an enlarged image screen (enlarged image screen 1310 in Fig. 13) (step S802).

[0097] Then, the POS terminal 20-2 determines on the standby screen whether a transaction has started (step S803). The start of a transaction means, for example, receiving consent from the customer to take an image during the transaction. If the transaction has not started (step S803: NO), the POS terminal 20-2 waits. If the transaction has started (step S803: YES), the POS terminal 20-2 determines whether it is controlled to the transaction-only mode (step S804).

[0098] If the POS terminal 20-2 is controlled to the transaction-only mode (step S804: YES), the POS terminal 20-2 displays a reduced captured image (reduced captured image 1200 in FIG. 14) on the customer side display unit 205 (step S805).

[0099] The POS terminal 20-2 then performs the settlement process (step S806). The settlement process is a series of processes, such as accepting the selection of the payment type and dispensing the change. The POS terminal 20-2 then determines whether the settlement process has been completed (step S807). If the settlement process has not been completed (step S807: NO), the POS terminal 20-2 returns to step S806. If the settlement process has been completed (step S807: YES), the POS terminal 20-2 ends the series of processes.

[0100] In step S804, if the POS terminal 20-2 is not controlled to the transaction-only mode (step S803: NO), that is, if the POS terminal 20-2 is controlled to the full self-service mode, the POS terminal 20-2 performs the full self-service mode process (step S808) and ends the series of processes. The full self-service mode process, the details of which will be described later, is the process shown in steps S1004 to S1009 in FIG. 10.

[0101] (Full self mode operation) Fig. 9 is a schematic diagram illustrating an outline of the operation of the full self-service mode. As shown in the upper part of Fig. 9, in the full self-service mode, POS terminal 20 accepts operations by the customer using customer-side display unit 205 and customer-side scanner unit 206, and the customer registers the purchased items. In the full self-service mode, POS terminal 20 displays an image on customer-side display unit 205.

[0102] In the full self-service mode, the POS terminal 20 displays a wide-area captured screen. The wide-area captured screen is a screen on which the customer can grasp the customer's registration operation. Specifically, the wide-area captured screen is a screen on which the customer can grasp the counters (shopping baskets) on both sides of the POS terminal 20, the unregistered products in one shopping basket, the registered products in the other shopping basket, the customer's hand movements, etc. As a result, the wide-area captured screen displays a series of registration operations in which products are transferred from one shopping basket to the other.

[0103] When the customer has completed registering the purchased items, the POS terminal 20 displays the total price of the purchased items and the like on the customer-side display unit 205. Then, as shown in the lower part of Fig. 9, the customer checks the total price of the purchased items displayed on the customer-side display unit 205 and settles the bill (lower part of Fig. 9). Specifically, the customer deposits cash into the change dispenser 209 or operates the card payment unit 208 to settle the bill. In this way, in the full self-service mode, the POS terminal 20 performs the registration process and settlement process according to the customer's operation.

[0104] Furthermore, in the full self-service mode, the POS terminal 20 continues to display the captured image screen even after the customer has completed product registration. When the customer has completed product registration, the POS terminal 20 may switch from the wide-area captured image screen to the narrow-area captured image screen. The narrow-area captured image screen is a screen with the same captured area as the captured image screen displayed in the checkout-only mode or normal mode, and specifically, is a screen on which the customer can grasp the customer's payment operation. More specifically, the narrow-area captured image screen is a screen on which the cash slot, the customer's hands as they insert cash, and the cash inserted by the customer can be grasped.

[0105] In full self-service mode, both the registration process and the payment process are performed on the customer side, but in double scan mode in full self-service mode, the store clerk can scan the product and display various information. In double scan mode, since the store clerk is nearby, the display control of the captured image screen may be different from that in full self-service mode. Specifically, for example, in double scan mode, the captured image screen may not be displayed during registration, but may be displayed during payment. Furthermore, the display area of ​​the captured image screen in double scan mode may be different (for example, smaller) from that in full self-service mode.

[0106] (Full Self Mode Flowchart) Fig. 10 is a flowchart showing an example of processing executed by the POS terminal 20 in the full self-service mode. As shown in Fig. 10, the POS terminal 20 determines whether or not the standby screen in the self-service mode (standby screen 1300 in Fig. 13) is being displayed on the customer-side display unit 205 (step S1001). If the standby screen in the self-service mode is not being displayed (step S1001), the POS terminal 20 ends the series of processing. If the standby screen in the self-service mode is being displayed (step S1001: YES), the POS terminal 20 displays an enlarged image screen (enlarged image screen 1310 in Fig. 13) (step S1002).

[0107] Then, the POS terminal 20 determines on the standby screen whether a transaction has started (step S1003). The start of a transaction means, for example, receiving consent from the customer to take an image during the transaction. If the transaction has not started (step S1003: NO), the POS terminal 20 waits. If the transaction has started (step S1003: YES), the POS terminal 20 determines whether the POS terminal 20 is controlled in the full self-service mode (step S1004).

[0108] If the POS terminal 20 is controlled to the full self-time mode (step S1004: YES), the POS terminal 20 displays a wide-area image capture screen (wide-area image capture screen 1510 in FIG. 15) on the customer-side display unit 205 (step S1005). The wide-area image capture screen is an image capture screen with a smaller display area than the enlarged image capture screen.

[0109] Next, the POS terminal 20 determines whether or not the product has been scanned (step S1006). Scanning includes reading a code using the customer-side scanner unit 206, pressing a preset key displayed on the customer-side display unit 205, etc. If the product has not been scanned (step S1006: NO), the POS terminal 20 proceeds to step S1008.

[0110] If the product has been scanned or the like (step S1006: YES), the POS terminal 20 registers the product (step S1007). Then, the POS terminal 20 determines whether or not a registration completion key has been pressed (step S1008). The registration completion key is, for example, a key (e.g., a checkout button) displayed on the customer side display unit 205 for starting payment. If the registration completion key has not been pressed (step S1008: NO), the POS terminal 20 returns to step S1006.

[0111] If the registration completion key is pressed (step S1008: YES), the POS terminal 20 performs the settlement process (step S1009). The settlement process is a series of processes such as accepting the selection of the payment type and paying out the change.

[0112] Thereafter, the POS terminal 20 determines whether the settlement process has been completed (step S1010). If the settlement process has not been completed (step S1010: NO), the POS terminal 20 returns to step S1009. If the settlement process has been completed (step S1010: YES), the POS terminal 20 ends the series of processes.

[0113] If the POS terminal 20 is not controlled to the full self-service mode in step S1004 (step S1004: NO), the POS terminal 20 performs the transaction-only mode process (step S1011) and ends the transaction-only mode process. The transaction-only mode process is the process shown in steps S805 to S807 in FIG. 8.

[0114] (Normal mode screen) Next, examples of screens displayed on the POS terminal 20-1 during face-to-face settlement in the normal mode will be described with reference to FIGS. 11 and 12 are explanatory diagrams showing example screens displayed on the POS terminal 20-1 in normal mode. FIG. 11(A) shows an example screen displayed on the clerk-side display unit 210 in normal mode. In FIG. 11(A), registered product display 1101 shows the products most recently registered by the clerk. Registered product list display 1102 shows a list of products registered by the clerk. Total price display shows the total price of the products registered by the clerk.

[0115] The preset keys 1104 are displays that show multiple products, and are keys that accept the registration of the corresponding products when pressed by a store clerk. The preset keys 1104 can display products according to type, such as vegetables, fruits, and meat. In Fig. 11(A), the preset keys 1104 show the type of vegetables, but can be switched to display other types, such as fruits and meat, depending on the operation of the store clerk.

[0116] The mode display 1105 indicates the current mode of the POS terminal 20-2 (for example, the checkout only mode), and the mode display 1106 indicates the current mode of the POS terminal 20-3 (for example, the full self mode).

[0117] The subtotal button 1107 is a button that accepts the completion of product registration. When the registration of all products is completed, the store clerk presses the subtotal button 1107. The receipt button 1108 is a button that causes the printing unit 213 to issue a receipt. When settling the account at another POS terminal 20, the store clerk presses the receipt button 1108.

[0118] The register designation button 1109 and the register designation button 1110 are buttons for designating the POS terminal 20 to which the registration information is to be sent. The register designation button 1109 accepts the designation of POS terminal 20-2 as the destination of the registration information. When the register designation button 1109 is pressed, the settlement will be carried out at POS terminal 20-2. The register designation button 1110 accepts the designation of POS terminal 20-3 as the destination of the registration information. When the register designation button 1110 is pressed, the settlement will be carried out at POS terminal 20-3.

[0119] Figure 11(B) shows the screen displayed on the customer display unit 205 when the screen shown in Figure 11(A) is displayed on the store clerk display unit 210. In Figure 11(B), a registered product display 1120 is displayed. The registered product display 1120 shows the products most recently registered by the store clerk and a list of products registered by the store clerk.

[0120] The POS terminal 20 can also accept the selection of the payment type before the subtotal key is pressed. In this case, a payment type selection screen can be displayed along with the registered product display 1120. The payment type selection screen has buttons for accepting cash payments, credit card payments, and electronic money payments. When a customer presses one of the buttons, the POS terminal 20-1 accepts the settlement using the payment type indicated by the pressed button, even while the store clerk is registering the products. The POS terminal 20-1 can also consider cash to be selected as the payment type when it accepts the insertion of cash, even if no button on the payment type selection screen is pressed.

[0121] (Normal mode checkout screen) 12 shows a screen that is displayed on the customer-side display unit 205 when the store clerk presses the subtotal button 1107. As shown in FIG. 12, during payment, a screen including a reduced-size image 1200 captured by the camera 216 and a payment details screen 1210 is displayed. The reduced-size image 1200 is a screen that includes a cash image 1202 showing the customer's cash at the time of payment, a cash image 1203 showing the cash to be inserted by the customer, an insertion slot image 1204 showing the insertion slot of the change machine 209, and an ejection slot image 1205 showing the ejection slot of the change machine 209. Note that even if the customer selects a payment type (for example, when cash is inserted into the change machine 209) before the store clerk presses the subtotal button 1107, the POS terminal 20-1 may display the reduced-size image 1200 on the customer-side display unit 205.

[0122] In this way, the POS terminal 20-1 does not display the reduced image screen 1200 before face-to-face settlement in normal mode, but displays the reduced image screen 1200 on the customer-side display unit 205 during face-to-face settlement, thereby making the customer aware that they are being monitored and providing a deterrent effect to fraudulent acts related to settlement.

[0123] (Standby screen in self mode) Next, the standby screen displayed on the POS terminal 20 in the self-service mode (checkout only mode and full self-service mode) will be described with reference to FIG. 13 is an explanatory diagram showing an example of a standby screen displayed on the customer-side display unit 205 of the POS terminal 20 in the self-service mode. Note that, in the following description, the checkout-only mode and the full self-service mode are described as having the same standby screen, but different standby screens may be used for each of these modes.

[0124] As shown in FIG. 13 , a standby screen 1300 in self-service mode is displayed on the customer-side display unit 205 of the POS terminal 20. The standby screen 1300 displays information indicating that the checkout is a self-service checkout and that a photo will be taken during the transaction. The standby screen 1300 also includes an enlarged image 1310 and confirmation buttons (a "no accept" button 1321 and an "accept" button 1322). The enlarged image 1310 is an image displayed in a large display area to let the customer know that an image is being captured. The enlarged image 1310 is a screen to let the customer know that the customer-side area of ​​the POS terminal 20-2 is constantly being captured by the camera 216. For example, the customer-side area including the change dispenser 209 is always displayed on the enlarged image 1310. When a customer approaches the POS terminal 20-2, the enlarged image 1310 displays an image of the change dispenser as well as a hand image 1202 showing the approaching customer's hands. Note that an image showing a customer may be displayed on the enlarged capture screen 1310. In other words, the enlarged capture screen 1310 may display a wide-area image.

[0125] In this way, by displaying the enlarged image screen 1310 on the standby screen 1300 in the self mode, the customer can be made aware that an image is being captured before making a payment. This makes the customer aware that they are being monitored, which has the effect of deterring fraudulent acts related to payment.

[0126] Furthermore, if the controlled mode on the standby screen 1300 is the checkout-only mode, pressing the OK button 1322 will transition to a screen where payment can be made (see FIG. 14). If the controlled mode is the full self-service mode, pressing the OK button 1322 on the standby screen 1300 will transition to a screen where product registration can be made (see FIG. 15).

[0127] On the other hand, if the Disapproval button 1321 is pressed on the standby screen 1300, the transaction will not start. In this case, the POS terminal 20 may, for example, notify the customer that they will be guided to a POS terminal 20 where a store clerk is present. Furthermore, even if the Disapproval button 1321 is pressed, the payment may be allowed to be settled. If the payment is allowed to be settled, there is a risk of fraud because no image is captured. For this reason, the POS terminal 20 may, for example, light up the sign pole 220 in a lighting mode indicating this, or have the monitoring terminal 11 issue a notification indicating this, thereby prompting the store clerk to monitor the customer.

[0128] As shown on the standby screen 1300, confirmation buttons (a no-approval button 1321 and an approve button 1322) are displayed, so that the customer can be given permission to be photographed. This makes it possible to prevent the customer from feeling uncomfortable about being monitored.

[0129] It is also possible to forcibly capture an image without displaying the confirmation button. Specifically, a start button may be displayed instead of the confirmation button on the standby screen 1300, and when the start button is pressed, a transaction involving image capture may be started.

[0130] Furthermore, the POS terminal 20 may display confirmation buttons (a non-approval button 1321 and an approval button 1322) not only before starting the self-service mode but also before starting face-to-face settlement in the normal mode. Specifically, the POS terminal 20 may display the confirmation button on the customer-side display unit 205 before accepting the selection of the payment type, and when the confirmation button is pressed, a payment type selection screen (not shown) may be displayed.

[0131] (Screen during checkout in accounting-only mode) When the payment-only mode is initiated and a payment is made, the screen shown in FIG. 14 is displayed. Fig. 14 is an explanatory diagram showing an example of a screen displayed on the customer-side display unit 205 when settlement is being made in the checkout-only mode. The screen shown in Fig. 14 differs from the screen shown in Fig. 12 in that a store clerk call button 1400 is displayed. The store clerk call button 1400 is a button that accepts a call to a store clerk from a customer. When the store clerk call button 1400 is pressed, a notification to that effect is sent to the POS terminal 20-1 and the monitoring terminal 11.

[0132] 14, the reduced image screen 1200 has a smaller display area than the enlarged image screen 1310 shown in Fig. 13. This ensures sufficient display area for the payment details screen 1210, the store clerk call button 1400, etc., and allows the customer to be properly notified of information. Furthermore, displaying the reduced image screen 1200 can prevent customers from committing fraudulent acts during payment in the cashier-only mode.

[0133] (Full selfie mode screen) When the device is in the full self-service mode, if the customer presses the OK button 1322 on the standby screen 1300 shown in FIG. 13 and the full self-service mode starts, the screen shown in FIG. 15 is displayed. FIG. 15 is an explanatory diagram showing an example of a screen displayed on the customer display unit 205 during product registration and payment in the full self-service mode.

[0134] 15, a registration screen 1500 in full self-service mode is displayed on the customer-side display unit 205 of the POS terminal 20. The registration screen 1500 includes a guide display 1501, a registered product display 1502, a store clerk call button 1503, a checkout button 1504, and a wide-angle imaging screen 1510.

[0135] Guidance display 1501 shows guidance regarding product registration and payment. Registered product display 1502 shows a list of products registered by the customer. Store clerk call button 1503 is a button that accepts a call from the customer to a store clerk. Checkout button 1504 is an example of a registration completion key, and specifically, is a button that accepts the start of payment processing.

[0136] The wide-angle imaging screen 1510 is a screen on which the customer's registration status is displayed. Specifically, the wide-angle imaging screen 1510 is an imaging screen with a larger imaging area than other imaging screens (the reduced imaging screen 1200 in FIGS. 12 and 14 and the enlarged imaging screen 1310 in FIG. 13). Note that, in the following, the reduced imaging screen 1200 and the enlarged imaging screen 1310 are narrow-angle imaging screens (hereinafter sometimes referred to as "narrow-angle imaging screens") compared to the wide-angle imaging screen 1510.

[0137] More specifically, wide-angle imaging screen 1510 is a screen that includes customer image 1201 showing the customer's feet, hand image 1202 showing the customer's hands, inlet image 1204 showing the inlet of change machine 209, and outlet image 1205 showing the outlet of change machine 209. Furthermore, wide-angle imaging screen 1510 is a screen that includes basket image 1511a showing the shopping basket in which the product before registration is placed, basket image 1511b showing the shopping basket in which the product after registration will be placed, product image 1512a showing the product before registration, product image 1512b showing the product after registration, and product image 1512c showing the product to be registered.

[0138] The wide-angle image capture screen 1510 can capture a series of registration actions, such as the customer removing an item from the shopping cart, registering the item, and placing the registered item in the shopping cart. This makes the customer aware that they are being monitored in full self-service mode, which can have the effect of deterring fraudulent behavior during payment.

[0139] Furthermore, the wide-angle imaging screen 1510 has a smaller display area than the enlarged imaging screen 1310 shown in Fig. 13. In other words, the wide-angle imaging screen 1510 is a reduced imaging screen. Because the wide-angle imaging screen 1510 has a small display area, it is possible to secure a display area for the registration screen 1500 guide display 1501, the registered product display 1502, etc., and to appropriately notify the customer of information.

[0140] Note that even when the checkout button 1504 is pressed, the wide-angle image screen 1510 continues to be displayed. However, when the checkout button 1504 is pressed, the screen may switch to the reduced image screen 1200 in the checkout-only mode shown in Fig. 14. In other words, the screen may switch to one that displays the customer's hand at the time of payment, cash, the insertion slot and ejection slot of the change dispenser 209, etc.

[0141] (Functional configuration of POS system 1) Next, the functional configuration of the POS system 1 will be described. The POS system 1 of this embodiment has a clerk registration unit, a settlement unit, an imaging unit, a display unit, a status control unit, a display control unit, a customer operation unit, an area control unit, a selection unit, and a transaction start unit. These functional units may be provided in a single POS terminal 20 or in multiple POS terminals 20 depending on the operation mode of the POS terminal 20. Specifically, each functional unit is provided in a single POS terminal 20 in normal mode (when settling in person) or full self-service mode, and in multiple POS terminals 20 in checkout-only mode. For example, in the checkout-only mode, the clerk registration unit is provided in POS terminal 20-1, and the functional units excluding the clerk registration unit are provided in POS terminal 20-2.

[0142] The clerk registration unit, the settlement unit, the status control unit, the display control unit, the area control unit, the selection unit, and the transaction start unit are realized by the CPU 201 of the POS terminal 20. That is, the functions of each unit are realized by the CPU 201 executing the settlement program. The imaging unit is realized by, for example, the camera 216. The display unit is realized by, for example, the customer side display unit 205. The customer operation unit is realized by, for example, the customer side display unit 205 and the customer side scanner unit 206.

[0143] The clerk registration unit is a functional unit that allows a clerk to register a product. The clerk registration unit registers a product by the clerk operating any one of the clerk-side display unit 210, the key operation unit 211, and the clerk-side scanner unit 212.

[0144] The settlement unit is a functional unit that is operated by the customer to settle the bill. The settlement unit settles the bill when the customer operates either the card settlement unit 208 or the change dispenser 209.

[0145] The imaging unit captures images of the customer's operations when the payment is settled by the settlement unit. The customer's operations are operations related to the settlement, and include, for example, inserting cash, receiving change, inserting a credit card, etc. In this embodiment, camera 216, which is an example of an imaging unit, is located above customer display unit 205. However, the location of the imaging unit is not limited to this. For example, the imaging unit may be located on the ceiling, or on a sign pole of POS terminal 20 as described below. Furthermore, in this embodiment, the imaging unit is realized by one camera 216, but is not limited to this and may be realized by multiple cameras 216.

[0146] The display unit displays the imaging results obtained by the imaging unit. The imaging results are a moving image capture screen, but may also be a capture screen of continuously captured still images. The imaging results may also include a text image such as a message saying "imaging in progress" or a mark image indicating that imaging is in progress. In this embodiment, the display unit simply displays the results captured by the imaging unit. In other words, the display unit displays the results captured by the imaging unit without any processing or editing. In this embodiment, the imaging results displayed on the display unit will be described as a "capture screen."

[0147] The state control unit controls the state between a first state in which the clerk registration unit mainly registers products, and a second state other than the first state. The first state is, for example, a state in which the clerk registration unit is enabled. The enabled state of the clerk registration unit is a state in which the clerk is present in the clerk's area of ​​the POS terminal 20. The enabled state of the clerk registration unit is, for example, a state in which the clerk is controlled to operate in normal mode, or in double scan mode in full self-service mode. The second state is, for example, a state in which the clerk registration unit is disabled. The disabled state of the clerk registration unit is a state in which the clerk is controlled to checkout-only mode, or in full self-service mode excluding double scan mode. The state control unit is also a functional unit that controls the operation mode.

[0148] The display control unit changes the control of the display by the display unit according to the state controlled by the state control unit. Specifically, the display unit controls the captured image screen displayed by the display unit according to the state controlled by the state control unit. Control of the captured image screen is, for example, control of the display area of ​​the captured image screen, and specifically includes controlling the size of the display area. For example, the display control unit displays a reduced captured image screen 1200 (see FIGS. 12 and 14) or an enlarged captured image screen 1310 (see FIG. 13).

[0149] Furthermore, controlling the captured image screen includes controlling to display the captured image screen and controlling not to display the captured image screen. In this embodiment, the display control unit controls not to display the captured image screen on the display unit when the state control unit is controlled to the first state. Specifically, for example, when the operation mode is controlled to the normal mode, the display control unit controls not to display the captured image screen on the display unit.

[0150] Furthermore, even when the display control unit is controlled to the first state by the state control means, the display control unit controls the display unit to display the captured image screen when the settlement unit is performing settlement. The time when the settlement unit is performing settlement is when settlement begins, for example, when a payment type is selected. However, the time when the settlement unit is performing settlement may also be when settlement is in progress. Specifically, even when the display control unit is controlled to the normal mode, the display control unit controls the display unit to display the captured image screen when face-to-face settlement begins.

[0151] The area control unit controls the imaging area of ​​the imaging unit according to the state controlled by the state control unit. Controlling the imaging area means controlling it to a wide area or a narrow area. The display control unit controls the display unit to display an imaging screen of the area controlled by the area control unit. Specifically, the display control unit displays a wide-area imaging screen 1510 (see FIG. 15) or a narrow-area imaging screen (reduced imaging screen 1200 in FIG. 12 or enlarged imaging screen 1310 in FIG. 13) on the display unit.

[0152] The customer registration unit is a functional unit that allows customers to register products by operating either the customer-side display unit 205 or the customer-side scanner unit 206.

[0153] The area control unit controls the imaging area to the first imaging area when the customer registration unit has not registered the product. The first imaging area is a narrow imaging area. Specifically, the area control unit controls the imaging area to the narrow imaging area in the normal mode or the checkout-only mode.

[0154] On the other hand, when a product is registered by the customer registration unit, the area control unit controls the imaging area to a second imaging area that is wider than the first imaging area. The second imaging area is a wide imaging area. Specifically, the area control unit controls the imaging area to a wide area in the full selfie mode. Note that in the double scan mode of the full selfie mode, the area control unit may control the imaging area to a narrow area.

[0155] The customer operation unit is a functional unit (for example, the customer side display unit 205 and the customer side scanner unit 206) that is operated by the customer. When the state control unit is in the second state, the display control unit controls the display unit to display captured images of different sizes before and after an operation is performed by the customer operation unit. Before an operation is performed by the customer operation unit refers to, for example, standby mode in self-timer mode (full self-timer mode and checkout-only mode). The display control unit displays enlarged captured image 1310 with a large display area on standby screen 1300 (see FIG. 13) in self-timer mode (full self-timer mode and checkout-only mode).

[0156] After an operation is performed by the customer operation unit refers to, for example, after an operation to start the checkout-only mode or full self-time mode (the OK button 1322 in FIG. 13) is accepted. When an operation to start the checkout-only mode is accepted, the display control unit displays the reduced capture screen 1200, which has a smaller display area than the enlarged capture screen 1310. Furthermore, when an operation to start the full self-time mode is accepted, the display control unit displays the wide-angle capture screen 1510, which has a smaller display area than the enlarged capture screen 1310.

[0157] The selection unit causes the display unit to select whether or not to display the image capture results captured by the imaging unit. Specifically, the selection unit causes the display unit to display a selection screen for whether or not to display the image capture results captured by the imaging unit, and accepts a selection from the customer between displaying the image capture results and not displaying the image capture results. The selection unit may also cause the customer to select whether or not to display the image capture results captured by the imaging unit depending on the controlled mode. For example, the selection unit may allow the customer to make this selection in selfie mode and not allow the customer to make this selection in normal mode.

[0158] The transaction initiation unit initiates a transaction when the selection unit selects to display the image capture results. The transaction may be, for example, product registration and payment in the full self-service mode, or payment in the normal mode or the checkout-only mode. The transaction initiation unit may not initiate a transaction when the selection unit selects not to display the image capture results. When the selection unit selects not to display the image capture results, the POS terminal 20 may notify the user that they will be guided to a POS terminal 20 where a store clerk is present.

[0159] The POS system 1 according to the embodiment described above is controlled between a first state, in which a store clerk mainly registers products, and a second state, in which the system is otherwise controlled, and changes the display control of the captured image results depending on the controlled state. Specifically, the captured image screen is controlled depending on whether or not a store clerk is present in the store clerk's area of ​​the POS terminal 20. Therefore, when a store clerk is present in the store clerk's area of ​​the POS terminal 20, the captured image screen can be controlled to have low visibility or can be hidden. This prevents excessive surveillance by the camera 216 and reduces customer discomfort caused by being monitored. Therefore, the POS system 1 according to the embodiment can effectively prevent fraudulent behavior by customers. This reduces payment-related problems.

[0160] Furthermore, the POS system 1 is configured not to display the captured image when it is controlled to the first state in which product registration is mainly performed by a store clerk. That is, the captured image is not displayed when a store clerk is present in the store clerk's area of ​​the POS terminal 20. This prevents excessive monitoring by the camera 216 and prevents customers from feeling uncomfortable about being monitored.

[0161] Furthermore, even when the POS system 1 is in the first state where the clerk mainly registers products, the captured image is displayed when the customer is paying. This makes the customer aware that they are being monitored during the payment process, which effectively prevents fraudulent transactions by customers.

[0162] The POS system 1 is controlled between a first state, in which product registration is primarily performed by a store clerk, and a second state, in which the POS system 1 is not performed, and the imaging area of ​​the camera 216 is controlled according to the controlled state. Specifically, for example, during face-to-face settlement in normal mode or in the settlement-only mode, a reduced imaging screen 1200 (see FIGS. 12 and 14) is displayed as a narrow-angle imaging screen, and in full self-service mode, a wide-angle imaging screen 1510 (see FIG. 15) is displayed. Therefore, when only settlement is being performed, it is sufficient to display an imaging screen showing the customer's operation status during settlement. When product registration is also being performed, an imaging screen showing the operation status of product registration can be displayed. Therefore, an appropriate imaging screen can be displayed. This prevents excessive monitoring by the camera 216 and effectively prevents customer fraud.

[0163] Furthermore, the POS system 1 controls the imaging area to a narrow imaging area when a customer does not register a product, and controls the imaging area to a wide imaging area when a customer registers a product. Specifically, in the checkout-only mode, a reduced imaging screen 1200 (see FIG. 14) is displayed as a narrow-area imaging screen, and in the full self-service mode, a wide-area imaging screen 1510 (see FIG. 15) is displayed. Therefore, even in the self-service mode, in the checkout-only mode, where only payment is made, it is sufficient to display an imaging screen showing the customer's operation status during payment, and in the full self-service mode, where product registration is also made, it is possible to display an imaging screen showing the operation status of product registration. Therefore, even in the self-service mode, an appropriate imaging screen can be displayed depending on the operating mode. This prevents excessive monitoring by the camera 216 and effectively prevents customer fraud.

[0164] Furthermore, when the POS system 1 is controlled to the second state, the POS system 1 is configured to display an image screen of different sizes before and after a customer operation. Specifically, before the full self-service mode is initiated, an enlarged image screen 1310 (see FIG. 13) with a large display area is displayed, and after the full self-service mode is initiated, a wide-angle image screen 1510 (see FIG. 15) with a small display area is displayed. This allows the customer to be aware that monitoring by the camera 216 is being performed by displaying an image screen with a large display area before a customer operation is initiated. Furthermore, after a customer operation is initiated, an image screen with a small display area is displayed, allowing the image screen to be displayed in a size that does not obstruct the display of various information. This allows the appropriate image screen to be displayed.

[0165] (Modification of the embodiment) Modifications of the embodiment will be described below. Note that in each of the following modifications, the contents described in the above embodiment will be omitted as appropriate.

[0166] (Variation 1) First, a first modification of the embodiment will be described. In the above-described embodiment, a configuration has been described in which a camera 216 serving as an imaging unit is disposed above a customer-side display unit 205. In addition to or instead of such a configuration, a first modification will be described in which a camera 1600 is disposed on a shaft 221 of a sign pole 220.

[0167] FIG. 16 is an explanatory diagram showing a first modification of the embodiment. As shown in FIG. 16, camera 1600 is disposed on shaft 221 of sign pole 220. In the first modification, camera 1600 is disposed at a higher position than camera 216 in the embodiment. This allows capturing images of a wider area. Furthermore, if camera 216 is disposed on customer-side display unit 205, camera 216 is disposed within reach of customers, which may lead to fraudulent activity, for example, if a customer covers the lens of camera 216 with their hand. In the first modification, camera 1600 is disposed at a higher position, which can prevent such fraudulent activity.

[0168] (Variation 2) In the above-described embodiment, a configuration has been described in which the image capture results of the camera 216 are displayed on the image capture screen as they are. In Modification 2, a configuration will be described in which, in addition to or instead of such a configuration, the image capture results of the camera 216 are processed and displayed on the image capture screen.

[0169] The customer's face may appear in the captured image by the camera 216. This may cause the customer to feel uncomfortable that their privacy is not being protected. In the second modification, the POS terminal 20 has a function for recognizing the face portion of the captured image. When the face portion is recognized, the POS terminal 20 does not display the face portion. Specifically, the POS terminal 20 displays the area below the face portion on the captured image screen. The POS terminal 20 may also display the captured image screen with the face portion blurred. This makes it possible to protect the customer's privacy and prevent the customer from feeling uncomfortable.

[0170] (Variation 3) In the above-described embodiment, a configuration has been described in which the customer does not select a mode on the standby screen of the self-mode (see FIG. 13). In Modification 3, in addition to or instead of such a configuration, a configuration will be described in which the customer selects a mode on the standby screen of the self-mode (see FIG. 13).

[0171] The display control unit according to the third modification displays a mode selection screen that accepts the selection of one of a plurality of modes when the state control unit controls the camera to the second state. The plurality of modes are a full self-timer mode and a checkout-only mode. The mode selection screen is, for example, a screen that includes a selection button for the self-timer mode (a full self-timer mode button and a checkout-only mode button). The display control unit controls the display of the mode selection screen and the captured image screen on the same screen (for example, the standby screen 1300) of the display unit.

[0172] When the customer presses the full self-service mode button, a transaction in the full self-service mode is started. When a transaction in the full self-service mode is started, a notification may be displayed that a wide-area image capture screen will be displayed.

[0173] On the other hand, when the customer presses the transaction-only mode button, a transaction in the transaction-only mode is initiated. When a transaction in the transaction-only mode is initiated, a notification may be displayed indicating that a narrow-area image capture screen will be displayed.

[0174] When the POS terminal 20 (for example, the POS terminal 20-2) receives registration information from another POS terminal 20 (for example, the POS terminal 20-1), it may send a notification urging the user to press the transaction-only mode button. This allows even customers who are unfamiliar with self-checkouts to easily start the transaction-only mode.

[0175] Furthermore, when the POS terminal 20-2 receives registration information from the POS terminal 20-1, the POS terminal 20-2 may not display the full self-time mode button and the transaction-only mode button. In this case, the enlarged image capture screen 1310 may be displayed until the customer approaches the POS terminal 20-2. Whether or not the customer has approached the POS terminal 20-2 can be determined using the image capture results of the camera 216. Then, the POS terminal 20-2 may start the transaction-only mode when the customer approaches.

[0176] In the above-described embodiment, the POS terminal 20 displays confirmation buttons (a non-approval button 1321 and an approval button 1322) on the standby screen 1300 (see FIG. 13) in the checkout only mode or full self-service mode. In the third modification, the confirmation buttons (a non-approval button 1321 and an approval button 1322) can also be displayed. Specifically, the POS terminal 20 may display a full self-service mode button and a checkout only mode button after a confirmation button (for example, the approval button 1322) is pressed.

[0177] In the third modification, the POS system 1 is configured to display a selection button for selecting either the checkout-only mode or the full self-service mode, and an image screen (for example, the enlarged image screen 1310) on the standby screen 1300. This makes it possible to make customers aware that they are being monitored before the checkout-only mode or the full self-service mode is activated. This can therefore enhance the deterrent effect against fraud.

[0178] (Variation 4) In the above-described embodiment, a configuration for controlling the captured image screen depending on the operation mode of the POS terminal 20 has been described. In Modification 4, a configuration for controlling the captured image screen depending on whether or not a person is near the POS terminal 20 will be described in addition to or instead of the above configuration. In Modification 4, the POS terminal 20 does not display the captured image screen when a store clerk is nearby. For example, the POS terminal 20 may determine that a store clerk is near the terminal when the store clerk-side display unit 210 or the key operation unit 211 is operated. Also, when another POS terminal 20 is located near the POS terminal 20 operated by a customer (the terminal itself), the POS terminal 20 may determine that a store clerk is near the terminal itself when the other POS terminal 20 is operated by the store clerk. Also, the POS terminal 20 may be provided with a camera that captures an image of the area near the store clerk and determine that a store clerk is near the terminal itself using the image captured by the camera.

[0179] In addition, in Modification 4, the POS terminal 20 may be configured not to display the captured image screen when a store clerk is near the terminal even when the operating mode is the checkout-only mode or the full self-service mode. Furthermore, in the checkout-only mode or the full self-service mode, the POS terminal 20 may be configured to start displaying the captured image screen at the timing when the selection of the payment type is accepted when a store clerk is near the terminal.

[0180] In addition, in Modification 4, the POS terminal 20 may be configured to display the captured image screen when a customer is nearby. For example, the POS terminal 20 may be configured to display the captured image screen when it is determined that a customer is nearby using the image capture result of the camera 216.

[0181] According to the fourth modification, the frequency with which the captured image screen is displayed can be reduced, which further prevents excessive surveillance by the camera.

[0182] (Variation 5) In the above-described embodiment, a configuration in which control of the captured image screen is always performed has been described. In Modification 5, in addition to or instead of such a configuration, a configuration in which the function for controlling the captured image screen can be turned on and off will be described. In Modification 5, the POS terminal 20 displays a switch button for switching the function for controlling the captured image screen on and off on the store clerk display unit 210. For example, when a command to turn off the function is received from the store clerk, the captured image screen is not displayed.

[0183] The POS terminal 20 may also turn off the function according to a preset time period. The POS terminal 20 may also turn off the function according to the congestion situation. The congestion situation can be determined from the frequency with which the POS terminal 20 is used, the waiting time, etc. For example, when the terminal is not crowded, it is easier for a store clerk to monitor the situation, so the POS terminal 20 may turn off the function.

[0184] According to the fifth modification, the function for controlling the captured image can be turned on and off, so that the frequency with which the captured image is displayed can be reduced, thereby further preventing excessive surveillance by the camera.

[0185] (Variation 6) In the above-described embodiment, a configuration in which the imaging results are simply used for display has been described. In Modification 6, a configuration in which the imaging results are used for purposes other than display, in addition to or instead of such a configuration, will be described.

[0186] In Modification 6, the POS terminal 20 may record the captured image (captured image). This allows evidence of fraudulent activity to be preserved. The POS terminal 20 may also be configured to be able to play back the captured image. For example, the POS terminal 20 may display (play back) the recorded image on the customer display unit 205 or the store clerk display unit 210. This makes it possible to determine whether fraud has occurred by playing back the recorded image when a problem occurs with payment.

[0187] In addition, in Modification 6, the POS terminal 20 may detect fraudulent behavior by a customer, for example, by analyzing the captured image. A fraudulent behavior by a customer is when a product is removed from a shopping cart but not scanned (registered). For example, the POS terminal 20 detects fraudulent behavior when a product is removed next without the "beep" sound that is output when a product is scanned.

[0188] Furthermore, the POS terminal 20 may detect that the customer is having difficulty in operation, for example, by analyzing the captured image. For example, the POS terminal 20 may detect that the customer is having difficulty in operation when the customer is present in the customer area but does not scan a product for a certain period of time or more.

[0189] When the POS terminal 20 detects fraudulent activity or difficulty in operation, it issues a notification to call a store clerk. This notification is made by lighting up the sign pole 220 in a predetermined lighting mode or by notifying the monitoring terminal 11 of the situation.

[0190] Furthermore, the POS terminal 20 may analyze the recorded images and identify customers who have been detected to have frequently engaged in fraudulent activities or who have frequently been detected to have difficulty in operations by image recognition. When the identified customer visits the store next time or later and performs operations such as payment, the POS terminal 20 may notify the store staff to urge them to keep an eye on the customer.

[0191] Here, the display and recording of captured images will be explained. In this embodiment, the POS terminal 20 displays the captured image on the customer side display unit 205. On the other hand, the POS terminal 20 can store the displayed captured image in any other device, such as another POS terminal 20. Also, the captured image can be controlled for display and for storage (recording) simultaneously. Furthermore, the start and end timings of each control may be the same (synchronized timing), or may not be the same (asynchronous timing). Below, a case where the start and end timings of each control are asynchronous will be explained for each mode.

[0192] <Timing of display control in full selfie mode> In the full self-service mode, the display of the captured image begins when the full self-service mode begins. Therefore, in the full self-service mode, the image is displayed regardless of whether the device is in standby, registration, or payment. In the full self-service mode, the display of the captured image ends when the full self-service mode ends.

[0193] <Timing of control for recording in full selfie mode> In the full self-service mode, the timing to start recording the captured image is the timing when an operation to start the full self-service mode is performed on the standby screen (for example, pressing the OK button 1322 in FIG. 13). In the full self-service mode, the timing to stop recording the captured image is the timing when payment is completed.

[0194] <Timing of display control in accounting-only mode> In the above-described embodiment, in the checkout-only mode, the timing at which the captured image starts to be displayed is, for example, when the checkout-only mode starts. Therefore, in the checkout-only mode, the captured image is displayed whether the device is in standby mode or during payment. Also, in the checkout-only mode, the timing at which the captured image stops to be displayed is when the checkout-only mode ends. However, in the checkout-only mode, the POS terminal 20 may not display the captured image at all. The POS terminal 20 only needs to display the captured image at least in the full self-service mode.

[0195] <Timing of control for recording in accounting-only mode> In the cashier-only mode, the timing for starting recording of captured images is, for example, when registration information is received. However, this timing is not limited to this, and it may also be when an operation to start the cashier-only mode is performed on the standby screen (for example, when the OK button 1322 in FIG. 13 is pressed). In the cashier-only mode, the timing for stopping recording of captured images is when payment is completed.

[0196] <Timing of display control in normal mode> In the above-described embodiment, in the normal mode, the timing to start displaying the captured image is, for example, when the payment type is selected. Also, in the normal mode, the timing to end displaying the captured image is when the settlement is completed. However, in the normal mode, the POS terminal 20 may not display the captured image at all. It is sufficient that the POS terminal 20 displays the captured image at least in the full self-service mode.

[0197] <Timing of control for recording in normal mode> In the normal mode, the timing for starting recording of the captured image is, for example, when the store clerk starts registering the product, and the timing for ending recording of the captured image is when the payment is completed.

[0198] In this way, the start and end timings of each control are asynchronous, so captured images can be displayed and recorded at timings that suit the situation, such as various modes, etc. Note that the start and end timings of each control may be changed to any timing by the store clerk.

[0199] According to the sixth modification, the imaging results can be effectively utilized.

[0200] (Variation 7) In the above-described embodiment, a configuration in which a screen is displayed on one display unit (customer-side display unit 205) has been described. In Modification 7, a configuration in which a screen is displayed on multiple display units will be described in addition to or instead of such a configuration.

[0201] In the seventh modification, the POS terminal 20 may be provided with a display unit (hereinafter referred to as a "monitor") that is different from the customer-side display unit 205. This monitor is, for example, a separate display unit that can be connected to the POS terminal 20. The POS terminal 20 displays the captured image on the monitor, but does not display the captured image on the customer-side display unit 205. The POS terminal 20 may display only the captured image on the monitor, or may also display a screen (information) other than the captured image. The captured image may also be displayed on both the monitor and the customer-side display unit 205.

[0202] According to the seventh modification, the captured image can be prevented from being displayed on the customer-side display unit 205, thereby making effective use of the display area excluding the captured image. Therefore, various information, such as information about registered products and information about payment, can be efficiently notified to customers. In addition, the captured image can be displayed on the monitor, which enhances the effectiveness of monitoring.

[0203] (Variation 8) In the above-described embodiment, a configuration in which the captured image screen is displayed in a fixed state has been described. In Modification 8, in addition to or instead of such a configuration, a configuration in which the captured image screen is displayed in an adjustable (variable) manner will be described.

[0204] First, manual adjustment by a store clerk will be described. In Variation 8, the POS terminal 20 can adjust various settings such as the size of the display area of ​​the captured image screen, the display timing, and the display position. Specifically, the POS terminal 20 displays adjustment buttons on the store clerk display unit 210 to accept changes to various display settings. The adjustment buttons are, specifically, a zoom-in button for enlarging the display area of ​​the captured image screen and a zoom-out button for reducing the display area of ​​the captured image screen. For example, while a customer is paying or registering, the POS terminal 20 displays the adjustment buttons on the store clerk display unit 210 in real time to accept changes to various display settings from the store clerk.

[0205] According to the eighth modification, various settings related to the captured image can be freely changed by the store clerk. For example, the store clerk can change the size of the captured image to an appropriate size while observing the customer's usage. Therefore, the settings can be freely changed depending on the time of day, the degree of congestion, the customer demographics, etc., so the captured image can be displayed with settings that are optimal for the store and the store clerk.

[0206] Next, automatic adjustment of the captured image screen will be described. The POS terminal 20 may automatically adjust the captured image screen depending on the transaction status. For example, in the full self-service mode, if the registration time for registering a product exceeds a certain time, it may be assumed that some kind of fraud has occurred and the display area of ​​the captured image screen may be enlarged. Also, in the full self-service mode, if the number of registered products or the total amount exceeds a certain amount, the display area of ​​the captured image screen may be enlarged to let the customer know that the transaction is being monitored.

[0207] The POS terminal 20 is equipped with a proximity sensor near the customer-side scanner unit 206, which can detect the approach of a customer's hand or the like in full self-service mode. By using this proximity sensor, the following fraud detection can be performed.

[0208] <Conditions for determining that there is no fraud> The proximity sensor detects the approach of a hand (product) → the customer side scanner unit 206 reads the product barcode → the proximity sensor detects the hand (product) moving away. <Conditions for determining that fraud has occurred> (=Detecting a false scan) The proximity sensor detects the approach of a hand (product) → the customer side scanner unit 206 reads the product barcode "no" → the proximity sensor detects that the hand (product) is moving away.

[0209] If the POS terminal 20 determines that fraud has occurred, it will enlarge the captured image or emphasize the frame of the captured image. This will notify the customer that it is being monitored, which will help to deter fraud. If fraud has been determined, the POS terminal 20 may also display animations or illustrations showing the correct product registration method (scanning method) to encourage the customer to perform the correct operation.

[0210] (Variation 9) In the above-described embodiment, a configuration was described in which, in the checkout-only mode, the display of the captured image screen begins when the selection of the checkout-only mode is accepted on the standby screen. In addition to or instead of this configuration, Variation 9 describes a configuration in which, in the checkout-only mode, the display of the captured image screen begins at a timing different from the timing at which the selection of the checkout-only mode is accepted. Below, we will explain the cases in which the display of the captured image screen begins when the selection of the payment type is accepted and when the registration information is received.

[0211] First, we will explain the case where the timing for starting display of the captured image is the timing when the selection of the payment type is accepted. The POS terminal 20 does not display the captured image on the payment type selection screen, which allows selection of payment types such as cash, credit card, and electronic money. Then, once a payment type is selected on the payment type selection screen, the POS terminal 20 starts displaying the captured image. This makes it possible to not display the captured image until the payment type is selected, as there is little need for monitoring.

[0212] The POS terminal 20 also displays an image screen showing the image capture results of the area corresponding to the selected payment type. For example, when cash is selected as the payment type, the POS terminal 20 displays the cash slot as the center. When credit card is selected as the payment type, the POS terminal 20 displays the credit card insertion section of the card payment unit 208 as the center. This allows for more appropriate monitoring. The POS terminal 20 may also display the image screen at a display position corresponding to the selected payment type.

[0213] Next, a case will be described in which the timing for starting display of the captured image is the timing for receiving registration information. In the transaction-only mode, the POS terminal 20 does not display the captured image while on standby. On the other hand, when the POS terminal 20 receives registration information from another POS terminal 20, it starts displaying the captured image. This makes it possible to prevent the captured image from being displayed while on standby, when there is little need for monitoring.

[0214] The embodiments will be summarized below. [Technical field] Accounting system and program The present invention relates to a settlement system and a program. [Background technology] Conventionally, supermarkets and other stores use point-of-sale (POS) registers to register the products purchased by customers and to settle the bill. Self-checkout registers, which allow customers to perform the checkout themselves, are becoming more common. Some self-checkout registers allow customers to register the products and settle the bill themselves. Since customers operate the POS register themselves, there is a risk of fraudulent activity by customers in self-checkout registers. Therefore, various countermeasures have been implemented to prevent fraudulent activity. A related technology is a weighing device that has a built-in scale in the platform on which the product is placed, and when weighing the product, it is possible to detect fraudulent acts in which the weight of an item appears to be lighter than the actual weight, and when such fraudulent acts are detected, the weighing result is not confirmed (see, for example, Patent Document 1 below). Also, measures have been taken to prevent fraudulent acts by customers at the time of payment by monitoring customers with a camera. [Prior art document] [Patent documents] [Patent Document 1] JP 2017-187821 A [Summary of the Invention] [Problem to be solved by the invention] However, conventional technology has had the problem that excessive camera surveillance can make customers feel uncomfortable about being watched, and it may not be possible to effectively prevent fraudulent behavior by customers. The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a technique that can suitably prevent fraudulent acts by customers. [Means for solving the problem] In order to solve the above-mentioned problems, one aspect of the present invention is a checkout system comprising: a clerk registration means by which a clerk registers products; a checkout means which is operated by a customer to settle the payment; an imaging means which captures images of the customer's operations when the payment is made by the checkout means; a display means which displays the images captured by the imaging means; a state control means which controls the clerk registration means to a first state in which products are mainly registered, and a second state other than that; and a display control means which changes the control of the display by the display means depending on the state controlled by the state control means. According to the above configuration, excessive monitoring by imaging can be prevented, and customers can be prevented from feeling uncomfortable about being monitored, thereby effectively preventing fraudulent acts by customers. In the above configuration, the display control means may perform control not to display the imaging result on the display means when the state control means controls the display means to be in the first state. According to the above configuration, excessive surveillance by imaging can be prevented, and customers can be prevented from feeling uncomfortable about being monitored. In the above configuration, the display control means may perform control to cause the display means to display the imaging result when the settlement means performs settlement. According to the above configuration, the customer can be made aware that he or she is being monitored when making a payment, which makes it possible to effectively prevent fraudulent acts by customers when making a payment. In the above configuration, the device may further include an area control means for controlling the imaging area of ​​the imaging means in accordance with the state controlled by the state control means, and the display control means may perform control to cause the display means to display the imaging results of the area controlled by the area control means. According to the above configuration, an appropriate captured image can be displayed, which prevents excessive monitoring by capturing images and effectively prevents fraudulent acts by customers. In the above configuration, the device may further include a customer registration means for customers to register products, and the area control means may control the imaging area to a first imaging area when a product is not registered by the customer registration means, and may control the imaging area to a second imaging area that is larger than the first imaging area when a product is registered by the customer registration means. According to the above configuration, even in the self mode, an appropriate captured image can be displayed depending on the operation mode, thereby preventing excessive monitoring by capturing images and effectively preventing fraudulent acts by customers. In the above configuration, the device may further include a customer operation means operated by a customer, and when the display control means is controlled to the second state by the state control means, the display control means may control the display means to display the imaging results with a display area that differs before and after operation by the customer operation means. According to the above configuration, an appropriate captured image can be displayed. In the above configuration, the display control means may, when controlled to the second state by the state control means, display a mode selection screen that accepts selection of one of a plurality of modes, and may also perform control to display the mode selection screen and the imaging result on the same screen of the display means. According to the above configuration, the customer can be made aware that he or she is being monitored before any of the modes is started, thereby enhancing the effect of deterring fraud. In the above configuration, the display means may be provided with a selection means for allowing the display means to select whether or not to display the image capture result captured by the imaging means, and a transaction start means for starting a transaction when the selection means selects to display the image capture result. According to the above configuration, it is possible to obtain the customer's consent to taking an image, and therefore it is possible to prevent the customer from feeling uncomfortable about being monitored. In order to solve the above-mentioned problems, another aspect of the present invention is a program that causes a computer of a checkout system that includes an imaging unit and a display unit to execute processing in which a store clerk registers an item, a customer operates the system to settle the payment, the imaging unit captures the customer's operations during the checkout, the image captured by the imaging unit is displayed on the display unit, the system is controlled to a first state in which the store clerk mainly registers items, and a second state other than the first state, and the display control by the display unit is changed depending on the controlled state. According to the above configuration, excessive monitoring by imaging can be prevented, and customers can be prevented from feeling uncomfortable about being monitored, thereby effectively preventing fraudulent acts by customers.

[0215] In the above description, the POS terminal 20 is described as having a configuration including a clerk registration unit, a settlement unit, a status control unit, a display control unit, and an area control unit. However, these functional units may be provided in other computer devices. For example, these functional units may be provided in the store controller 10, the monitoring terminal 11, or other computer devices. Furthermore, the number of computer devices provided with these functional units is not limited to one, and may be multiple. For example, some of these functional units may be provided in one computer device, and other functional units may be provided in other computer devices.

[0216] The program for implementing the POS system 1 and POS terminal 20 described above may be recorded on a computer-readable recording medium and loaded into a computer system for execution. The term "computer system" as used herein includes hardware such as an operating system (OS) and peripheral devices. The term "computer-readable recording medium" also refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into a computer system. The term "computer-readable recording medium" also includes devices that retain the program for a certain period of time, such as volatile memory (RAM) within a computer system that acts as a server or client when the program is transmitted via a network such as the Internet or a communication line such as a telephone line. The program may also be transmitted from a computer system storing the program in a storage medium to another computer system via a transmission medium or by transmission waves within the transmission medium. The term "transmission medium" used to transmit the program refers to a medium capable of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may also be used to implement part of the functions described above. Furthermore, the above-mentioned functions may be realized in combination with a program already recorded in the computer system, that is, a so-called differential file (differential program). [Explanation of symbols]

[0217] 1. POS system 10...Store Controller 11...Monitoring terminal 20...POS terminal 201...CPU 202...ROM 203...RAM 204...Hard disk 205…Customer side display section 206...Customer side scanner 208...Card Payment Department 209...Change machine 210…Staff side display section 211...Key operation section 212…Clerk side scanner 213…Printing Department 214...Audio output unit 215…Communications Department 216...Camera 1200...Reduced image screen 1310...Enlarged image screen 1510...Wide-area image capture screen

Claims

1. a registration means for registering a product; A payment means operated by a customer to settle a bill; an imaging means for imaging the operation status of the customer when the payment is made by the payment means; a display means for displaying an image captured by the imaging means; a mode control means for controlling a first mode in which the registration means is operated by a store clerk to register a commodity, and a second mode in which the registration means is operated by a customer to register a commodity; a display control means for changing the display control by the display means in accordance with the mode controlled by the mode control means; Equipped with the display control means controls not to display the imaging result in the first mode, and controls to display the imaging result in the second mode. A POS terminal characterized by:

2. the display control means controls the display of the image capture result when the product is registered by the registration means and when payment is made by the payment settlement means in the second mode.

2. The POS terminal according to claim 1, wherein:

3. the display control means, when the image capture result includes a face of a customer, performs control so as not to display the face of the customer on the display means; 3. The POS terminal according to claim 1 or 2.

4. a POS terminal computer including an imaging unit that captures an image of a customer's operation status and a display unit that displays the image captured by the imaging unit; a registration means for registering the product; A payment means operated by the customer to settle the bill; a mode control means for controlling a first mode in which the registration means is operated by a store clerk to register a commodity, and a second mode in which the registration means is operated by a customer to register a commodity; a display control means for controlling the display unit to display an image of the customer's operation when the payment is being made by the payment means, and for changing the display control of the display unit in accordance with the mode controlled by the mode control means; It functions as the display control means controls not to display the imaging result in the first mode, and controls to display the imaging result in the second mode. A program characterized by:

Images