Product sales data processing device and computer program

Abstract

To provide a device capable of displaying a screen with excellent operability and visibility.SOLUTION: A POS terminal 20 includes a camera 216 photographing an operation state of an operator and a customer-side display unit 205 displaying predetermined information. The customer-side display unit 205 includes a first display region displaying an operation screen receiving operation of the operator and a second display region displaying a photographed image taken by the imaging means.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a technique for displaying a captured image on an operation screen of a POS terminal in an easy-to-view manner. [Background technology]

[0002] Conventionally, supermarkets and other stores use POS (Point Of Sales) registers to register products purchased by customers and to settle the bill. Self-service registers, where customers can perform the settlement operation, are becoming more and more common. In self-service registers, customers operate the POS register themselves, so there is a risk of fraud by customers. For this reason, various measures have been taken to prevent fraudulent activities. For example, Patent Document 1 discloses a system that notifies errors or fraud using a sign light or the like. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-187821 A Summary of the Invention [Problem to be solved by the invention]

[0004] On the other hand, in recent years, the displays of POS registers have become larger, and when displaying information on the screen, consideration must be given to operability and visibility.

[0005] SUMMARY OF THE PRESENT EMBODIMENTS Accordingly, an object of the present invention is to provide a device capable of displaying a screen that is both easy to use and has good visibility. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the product sales data processing device of the present invention has an imaging means for imaging the operation status of an operator and a display means for displaying specified information, and the display means has a first display area for displaying an operation screen that accepts operations by the operator, and a second display area for displaying an image captured by the imaging means. [Brief description of the drawings]

[0007] [Figure 1] 1 is a network configuration diagram of a POS system according to an embodiment of the present invention. [Diagram 2] 1A and 1B are external perspective views showing POS terminals according to an embodiment of the present invention, in which (A) is an example of a terminal operated by a customer, and (B) is an example of a terminal operated by a store clerk. [Diagram 3] 1 is a block diagram showing a functional configuration of a POS terminal according to an embodiment of the present invention. [Figure 4] 1 is a diagram showing an example of the screen configuration of a customer display unit and a store clerk display unit of a POS terminal according to an embodiment of the present invention. FIG. [Diagram 5] 11 is a process flow diagram showing a flow of processes executed in a face-to-face self-service mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 6] FIG. 11 shows an example of a screen displayed in face-to-face self-service mode in a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. [Figure 7] FIG. 11 shows an example of a screen displayed in face-to-face self-service mode in a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. [Figure 8] FIG. 11 shows an example of a screen displayed in face-to-face self-service mode in a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. [Figure 9]FIG. 11 shows an example of a screen displayed in face-to-face self-service mode in a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. [Figure 10] FIG. 11 shows an example of a screen displayed in face-to-face self-service mode in a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. [Figure 11] 4 is a process flow diagram showing the flow of processes executed in a self-checkout mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 12] 11 is a diagram showing an example of a screen displayed in a self-checkout mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 13] 11 is a diagram showing an example of a screen displayed in a self-checkout mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 14] 11 is a diagram showing an example of a screen displayed in a self-checkout mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 15] 11 is a diagram showing an example of a screen displayed in a self-checkout mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 16] FIG. 11 is a process flow diagram showing the flow of processes executed in a full self-service mode in the POS terminal according to the embodiment of the present invention. [Figure 17] 11 is a diagram showing an example of a screen displayed in a full self mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 18] 11 is a diagram showing an example of a screen displayed in a full self mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 19] 11 is a diagram showing an example of a screen displayed in a full self mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 20] 11 is a diagram showing an example of a screen displayed in a full self mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 21] 11A to 11C are diagrams illustrating an example of a notification mode of a notification unit according to a status in the POS terminal according to the embodiment of the present invention. [Figure 22] 13A and 13B are diagrams showing an example of the screen configuration of a customer display unit and a store clerk display unit of a POS terminal according to another embodiment of the present invention. [Figure 23] FIG. 11 shows an example of a screen displayed in face-to-face self-service mode in a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. [Figure 24] FIG. 11 shows an example of a screen displayed in face-to-face self-service mode in a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. [Diagram 25] 11 is a diagram showing an example of a screen displayed in a self-checkout mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 26] 11 is a diagram showing an example of a screen displayed in a self-checkout mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 27] 11 is a diagram showing an example of a screen displayed in a self-checkout mode in the POS terminal according to the embodiment of the present invention. FIG. [Figure 28] FIG. 11 is a process flow diagram showing the flow of processes executed in a full self-service mode in the POS terminal according to the embodiment of the present invention. [Figure 29] 11 is a diagram showing an example of a screen displayed in a full self mode in the POS terminal according to the embodiment of the present invention. FIG. [Diagram 30] 11 is a diagram showing an example of a screen displayed in a full self mode in the POS terminal according to the embodiment of the present invention. FIG. [Diagram 31] 11 is a diagram showing an example of a screen displayed in a full self mode in the POS terminal according to the embodiment of the present invention. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] A POS system or a POS terminal that realizes a product sales data processing device according to an embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a network configuration diagram of a POS (Point Of Sales) system according to an embodiment of the present invention. The POS system 1 shown in FIG. 1 includes three POS terminals 20-1, 20-2, and 20-3, a store controller (store computer, management device) 10, and a transaction status management device 11. Hereinafter, the POS terminals 20-1, 20-2, and 20-3 are collectively referred to as POS terminals 20 when there is no particular distinction between them. The store controller 10, the transaction status management device 11, and the POS terminals 20 are communicatively connected via a LAN 55. Note that, although the number of POS terminals 20 in the POS system 1 is three, it may be one, or four or more.

[0009] The POS system 1 can be introduced in various stores such as supermarkets, home centers, convenience stores, and various supply stores. The store controller 10 records various information such as the types and prices of products in the store, inventory status, sales history, and deposit and withdrawal records. The transaction status management device 11 displays the status of the POS terminal 20 (operation mode, processing status, change inventory status, fault status, etc., and remote operation of clerk approval processing for age authentication products, etc.) and controls the POS terminal 20. The POS terminal 20 is a cash register device that registers products and settles accounts. From the viewpoint of executing settlement of registered products, the POS terminal 20 can be said to constitute a settlement device.

[0010] The POS system 1 may include a mobile terminal carried by a store clerk. The mobile terminal can display the status of the POS terminal 20 (operation mode, processing status, change inventory status, fault status, remote operation of store clerk approval processing for age authentication products, etc.) and control the POS terminal 20. The mobile terminal can also receive notification information from the POS terminal 20 to call a store clerk and display that fact.

[0011] In addition, the functions may be provided to a client terminal such as a tablet POS by a cloud service. This type of configuration is also called Web-Pos, and specifically, a server device executes some or all of the functions executed by a client terminal such as a tablet POS by a so-called thin client method or a web client method that webifies an application. In this case, the client terminal may be held by the customer, and a series of processes may be completed without the intervention of a store clerk or a store terminal. EXAMPLES

[0012] ●Function configuration FIG. 2 is a diagram showing an example of the POS terminal 20. As shown in FIG. 2(A) shows a terminal operated by a customer, and FIG. 2(B) shows a terminal operated by a store clerk, and the POS terminal 20 is made up of these two terminals. However, in the example of FIG. 2, the terminal operated by the customer and the terminal operated by the store clerk are configured as separate devices capable of communicating with each other, but the customer side display unit 205 and the store clerk side display unit 210 may be configured as an integrated unit with their backs facing each other. Furthermore, a counter on which a shopping basket can be placed may be provided beside the POS terminal 20 as appropriate.

[0013] An example of the configuration of POS terminal 20 will be described below with reference to Fig. 3. POS terminal 20 includes a CPU 201, a ROM 202, a RAM 203, a hard disk 204, a customer display unit 205, a customer scanner unit 206, a notification unit 207, a card payment unit 208, a change dispenser 209, a store clerk display unit 210, a key operation unit 211, a store clerk scanner unit 212, a printing unit 213, an audio output unit 214, a communication unit 215, and a camera 216. These can communicate with each other via a bus.

[0014] The CPU 201 is a central processing unit, and controls the operation of the POS terminal 20 by reading and executing various programs stored in the ROM 202. The various programs include a settlement program according to this embodiment. The ROM 202 is a read-only memory, and stores various types of information used by the CPU 201, including programs.

[0015] The RAM 203 is a readable and writable memory, and stores various information. For example, the RAM 203 stores information acquired from the outside (e.g., a product master acquired from the store controller 10) and information generated during processing. This information is, for example, registration information (registration data) generated during a registration process for registering a product, and settlement information generated during a settlement process for settling (paying) the registered product (purchased product).

[0016] The hard disk 204 stores various information. For example, the hard disk 204 may store programs executed by the CPU 201 instead of the ROM 202. Also, instead of the RAM 203, the hard disk 204 may store information acquired from the outside and information generated during processing.

[0017] Customer-side display unit 205 is a touch display for customers. This customer-side display unit 205 constitutes one of the display means for displaying predetermined information to customers, and also constitutes one of the input means for accepting input of predetermined information from customers. In addition, customer-side display unit 205 constitutes one of the registration means for registering products by accepting input of product information.

[0018] This customer side display unit 205 is a vertically long display, for example, a wide display corresponding to a resolution of 1920×1080. As shown in Figure 4, in this embodiment, the display area of ​​the customer side display unit 205 is composed of a first display area G1 at the bottom and a second display area G2 at the top, and while the product registration process and payment process are being executed, different information can be displayed in the first display area G1 and the second display area G2, respectively.

[0019] As an example of the display content, an operation screen that accepts operations from the customer (operator), such as product registration and settlement, can be displayed in the first display area G1, and an image captured by the camera 216 can be displayed in the second display area G2. In such an example, the captured image displayed in the second display area G2 can be displayed at various times. For example, in a self-checkout mode or a full self-service mode described later, the captured image is displayed in response to the start of an operation by a customer who is an operator. The timing of the start of an operation can be grasped, for example, by pressing a predetermined operation start button, or by providing a human presence sensor in the POS terminal 20 and detecting a customer standing in front of the POS terminal 20 with the human presence sensor. In another example, in a face-to-face self-service mode described later, the captured image may be displayed at a timing such as the detection of the insertion of cash into the change dispenser 209. In these examples, the functional unit that detects the pressing of the operation start button, the human presence sensor, and the functional unit that detects the insertion of cash constitute a detection unit that detects the operator.

[0020] In another example of the display content, the first display area G1 displays a small plan screen, settlement screen, maintenance screen, etc., and the second display area G2 displays operation history, change balance, maintenance history (connected communication history), etc.

[0021] In the example of Fig. 4, the first display area G1 and the second display area G2 are arranged in two levels, one above the other, and the first display area G1 is slightly larger than the second display area G2. Regardless of this, the vertical widths of the first display area G1 and the second display area G2 can be set to any width. This allows, for example, the second display area G2 to be provided in the approximate middle in the vertical direction of the customer-side display unit 205, and the captured image can be shown to the customer at a position that matches the customer's line of sight. This allows the customer's attention to be directed to the captured image, and the customer can easily view the captured image even while operating the device. Specific examples of information displayed in each area and screen transitions will be described later.

[0022] The customer-side scanner unit 206 is a scanner unit for customers, and optically reads various information. For example, the customer-side scanner unit 206 optically reads barcodes (product codes, etc.) attached to products and codes (barcodes, two-dimensional codes, etc.) printed on bills (registered trademarks). In addition to the above, the customer-side scanner unit 206 may also read gift certificates (gift certificates, coupons, and complimentary coupons) and codes (barcodes, two-dimensional codes, etc.) printed on various cards (e.g., membership cards, point cards, etc.). The customer-side scanner unit 206 is also used for reading processing in code settlement. The customer-side scanner unit 206 may be either a fixed scanner or a handy scanner, or may be configured with both. The customer-side scanner unit 206 constitutes one of the registration means for registering products by reading the barcodes of the products, etc. However, product registration is not limited to registration by reading the code by the customer-side scanner unit 206. For example, it is also possible to display a preset key (a button for ordering the product) corresponding to the product on the customer-side display unit 205 and register the product by the customer operating (pressing) the preset key.

[0023] The notification unit 207 is a light emitting unit that emits light according to the status of the POS terminal 20, and notifies the outside of the status by a predetermined blinking pattern or color. The notification unit 207 is, for example, a sign lamp configured with a lamp or an LED (Light Emitting Diode), and can be lit in a predetermined color or a predetermined blinking pattern. The notification unit 207 is provided at the highest position of the POS terminal 20, and can allow even store clerks who are not around the POS terminal 20 to recognize the lighting pattern.

[0024] The card payment unit 208 is a payment mechanism that uses various cards (credit cards, prepaid cards such as transportation cards, point cards, etc.) and is compatible with IC cards, magnetic cards, etc. The card payment unit 208 is equipped with a card recognition unit (reading unit), a display unit, and an operation unit. The card recognition unit magnetically or electrically reads information from various cards. The read information is used to settle the purchase. The card recognition unit is also capable of recognizing information to be used in settling the purchase, for example, when using points held on a point card. The card recognition unit is also capable of recognizing information that is not used in settling the purchase, for example, when adding points to a point card.

[0025] In this embodiment, the card payment unit 208 includes a card recognition unit, a display unit, and an operation unit, but is not limited thereto, and may include at least a card recognition unit. In this embodiment, the card recognition unit supports contact cards (IC cards, magnetic cards), but is not limited thereto. For example, the card recognition unit may support non-contact cards (IC cards) instead of or in addition to a card recognition unit that supports contact cards.

[0026] The change machine 209 (cash settlement unit) constitutes a deposit / withdrawal unit that deposits and withdraws cash, and performs settlement with cash. This change machine 209 faces the customer side, and has an input port for banknotes and coins, and an output port for banknotes and coins. When the change machine 209 accepts various operations or cash input from a customer, it calculates the amount of money inserted through the input port. When it calculates the change amount, which is the difference between the input amount and the purchase amount, it ejects the change or change bills from the output port. The change machine 209 has a sensor that detects bills and coins inserted into the insertion slot. The sensor detects that bills and coins have been inserted into the insertion slot, and detects the number of bills and coins by denomination. The card settlement unit 208 and the change machine 209 form a settlement unit.

[0027] The salesclerk display unit 210 is a touch display for salesclerks. This salesclerk display unit 210 constitutes one of the display means for displaying predetermined information to salesclerks, and also constitutes one of the input means for accepting input of predetermined information from salesclerks. In addition, the salesclerk display unit 210 constitutes one of the registration means for registering products by accepting input of product information. In this embodiment, the clerk-side display unit 210 is vertically long like the customer-side display unit 205, and is composed of a first display area G1 on the lower side and a second display area G2 on the upper side as shown in Fig. 4, and different information can be displayed in the first display area G1 and the second display area G2 while product registration processing and payment processing are being performed. However, while the customer-side display unit 205 is a vertically long touch display, the clerk-side display unit 210 is a square display compatible with a resolution of 1024 x 768, and the clerk-side display unit 210 can also be composed of only one display area.

[0028] Like the customer display unit 205, the clerk-side display unit 210 can display an operation screen in the first display area G1 for accepting operations by the clerk as an operator, such as product registration and settlement, and can display captured images captured by the camera 216 in the second display area G2. The captured images displayed in the second display area G2 can be displayed at various times, such as when a customer or clerk starts an operation. The vertical widths of the first display area G1 and the second display area G2 can also be set to any width.

[0029] The key operation unit 211 is composed of various keys (hardware keys, buttons). The key operation unit 211 accepts various inputs from a store clerk. Specifically, the key operation unit 211 includes a mode switching button, a collective switching button, and a self-checkout machine mode switching button. The mode switching button is a button for switching the operation mode. The collective switching button is a button for collectively switching the operation mode of each POS terminal 20 by being operated on a specific POS terminal 20 (for example, a POS terminal 20 to which a store manager or the like is logged in). The self-checkout machine mode switching button is a button for switching to the "self-checkout machine mode (semi-self-checkout mode)" described later.

[0030] The mode switching button is a button that can switch the mode to be transitioned to in a predetermined order each time it is pressed. This order is preset, for example, as follows: face-to-face self-service mode → full self-service → self-service checkout machine mode → face-to-face self-service mode → ... For this reason, to switch from face-to-face self-service mode to self-service checkout machine mode, the store clerk needs to press the mode switching button twice.

[0031] The button for switching modes is not limited to a hard key (mechanical key) such as a mode switching button, but may be a selection button (soft key) displayed on the store clerk display unit 210. This selection button may, for example, display multiple buttons corresponding to the destination mode. Specifically, if the current mode is the face-to-face self-service mode, a button for switching to the self-service checkout mode and a button for switching to the full self-service mode may be displayed. This makes it possible to switch modes with a single touch. In other words, the store clerk does not need to press a button multiple times, but only needs to press the button for the mode to be switched to.

[0032] However, the selection button displayed on the store clerk display unit 210 may be a single button, similar to the mode switching button, which can switch to a destination mode in a predetermined order each time it is pressed.

[0033] Furthermore, the button for switching modes is generally displayed on the clerk-side display unit 210, but may also be displayed on the customer-side display unit 205. For example, when it is clearly determined that a clerk is on the customer side, it is also possible to display the button on the customer-side display unit 205. Examples of situations in which a clerk is clearly on the customer side include when the customer-side scanner unit 206 is used to transition to a clerk-only maintenance screen, or when the customer-side display unit 205 is operated to transition to a clerk-only maintenance screen.

[0034] The clerk scanner unit 212 is a scanner unit for use by the clerk, and optically reads various types of information. For example, the clerk scanner unit 212 optically reads barcodes attached to products and clerk codes attached to the clerk's nametags. In addition to the above, the clerk scanner unit 212 may also read codes printed on bills, gift certificates, and various cards. The clerk scanner unit 212 is also used for reading processes in code settlement. The clerk scanner unit 212 may be either a fixed scanner or a handy scanner, or may be configured with both.

[0035] The store clerk scanner unit 212 constitutes one of the registration means for registering a product by reading a barcode or the like of the product. However, product registration is not limited to registration by reading a code by the store clerk scanner unit 212. For example, a key corresponding to a product (e.g., a key corresponding to a sports newspaper, etc.) may be arranged on the key operation unit 211, and the product may be registered by the store clerk operating (pressing) the key. It is also possible to display a preset key corresponding to the product on the store clerk display unit 210, and register the product by the store clerk operating the preset key.

[0036] The printing unit 213 prints and outputs various media (receipts, bills, etc.). The printing unit 213 can change the direction of the medium issuing port. Specifically, the printing unit 213 has a rotatable mechanism, and is configured so that the medium issuing port faces from the store clerk side to the customer side, and from the customer side to the store clerk side. The orientation of the medium issuing port may be manually changeable, or may be automatically changeable in response to a change in the operating mode. The printing unit 213 may be equipped with a sensor that detects whether the orientation of the printing issuing port is correct. In the following, a change in the operating mode may be referred to as a transition in the operating mode.

[0037] The audio output unit 214 outputs audio. For example, the audio output unit 214 outputs audio guidance, warning sounds, etc. The audio guidance and warning sounds are related to product registration and payment.

[0038] The communication unit 215 is an interface for transmitting and receiving information to and from other devices (the store controller 10, the transaction status management device 11, and other POS terminals 20).

[0039] The camera 216 is an imaging means for continuously capturing moving or still images of the operating status of an operator such as a customer or a store clerk. The camera 216 is attached to the upper right of the customer side display unit 205 when viewed from the customer side. For example, the camera 216 captures an image of the customer's operation during checkout. Specifically, the camera 216 captures images of bills and coins held by the customer, the change dispenser 209, hand movements, and other operational statuses of depositing and withdrawing cash during depositing and withdrawing cash. The camera 216 also captures images of the customer's operation during product registration. Specifically, the camera 216 can capture images of the inside (products) of a shopping basket on the counter provided on both sides of the POS terminal 20, and the customer's operation during registration.

[0040] Note that the captured image capturing the imaging location as described above may be an image obtained by enlarging or cutting out a specific location from a wide captured image, or may be an image obtained by focusing the camera 216 on a specific location. In addition, the captured images displayed on the customer display unit 205 and the store clerk display unit 210 can be live footage captured by the camera 216, or the capture can be started and stopped at a specified timing, or the captured images can be temporarily stored recorded footage.

[0041] Overview of each operation mode Next, the operation modes of the POS terminal 20 will be described. The POS terminal 20 has a plurality of operation modes. The plurality of operation modes are operation modes during normal business (operation modes related to registration processing and settlement processing). The plurality of operation modes are a face-to-face self-service mode, a self-service checkout machine mode, and a full self-service mode. The POS terminal 20 is controlled to one of the plurality of operation modes.

[0042] In addition to registration and settlement, other processing modes include tallying mode, maintenance mode, training mode, etc. The tallying mode is a mode for tallying and inquiring about sales and inventory. The maintenance mode is a mode in which store clerks and maintenance personnel perform setting and maintenance work. The training mode is a mode in which new employees receive training.

[0043] The following mainly describes in detail the face-to-face self-service mode, the self-service payment machine mode, and the full self-service mode. Note that in the following, the self-service payment machine mode and the full self-service mode may be collectively referred to as the "self-service mode."

[0044] (Face-to-face selfie mode) The face-to-face self-service mode is an operation mode in which product registration by the store clerk (hereinafter sometimes referred to as "product registration") is enabled and product registration by the customer is disabled. In other words, the face-to-face self-service mode is an operation mode in which registration processing by the store clerk is executed without executing registration processing by the customer. In product registration by the store clerk, purchased products are registered using the store clerk scanner unit 212, store clerk display unit 210, and key operation unit 211.

[0045] In addition, in the face-to-face self-service mode, settlement is possible, such as inserting currency (bills and coins) and reading various cards. Specifically, in the face-to-face self-service mode, for example, settlement operations with cash (inserting currency into the change dispenser 209) can be accepted. In the following, settlement in the face-to-face self-service mode may be referred to as "face-to-face settlement."

[0046] In addition, in the face-to-face self mode, it is possible to transmit registration information to another POS terminal 20. Transmitting registration information to another POS terminal 20 means transmitting registration information generated in the registration process to another POS terminal 20 capable of executing a settlement process. The registration information may be transmitted directly from the POS terminal 20 to the other POS terminal 20, or may be transmitted indirectly to the other POS terminal 20 via another device such as the store controller 10 or the transaction status management device 11. In the following description, the transmission of information between the devices is not described in detail, but it may be transmitted directly or indirectly, similar to the transmission of registration information.

[0047] In addition, in the face-to-face self-service mode, it is possible to issue a receipt. Issuing a receipt means that the registration information generated in the registration process is coded and printed on a print medium (receipt). Another POS terminal 20 can carry out the settlement process by reading the code on the receipt.

[0048] In addition, in the face-to-face self-service mode, it is also possible to receive registration information from another POS terminal 20. That is, in the face-to-face self-service mode, it is possible to execute a settlement process based on registration information generated in another POS terminal 20. In addition, when the POS terminal 20 receives registration information in the face-to-face self-service mode, it may switch to a self-payment machine mode (semi-self-service mode). Similarly, in the face-to-face self-service mode, the POS terminal 20 may switch to a self-payment machine mode when it reads a code on a bill in the face-to-face self-service mode. In addition, after switching to the self-payment machine mode and completing the settlement process, it may return from the self-payment machine mode to the face-to-face self-service mode automatically or according to the permission of the store clerk. In addition, even after switching to the self-payment machine mode and completing the settlement process, it may remain in the self-payment machine mode. In addition, in the face-to-face self-service mode, it may be possible to disable the reception of registration information from another POS terminal 20, to disable the reading of a bill, or to disable both of these.

[0049] (Self-payment mode) The self-checkout mode is an operation mode in which reception of registration information from other POS terminals 20, reading of bills, and insertion of coins are enabled, and product registration by the store clerk and customer is disabled. A POS terminal 20 operating in this self-checkout mode constitutes a checkout device, and has a function of receiving registration information generated in the registration process of other POS terminals 20. The registration information may be received directly from another POS terminal 20, or indirectly from another POS terminal 20 via another device such as the store controller 10 or the transaction status management device 11. In the following description, the reception of information between the devices is not specifically described, but the reception may be direct or indirect, similar to the reception of the registration information.

[0050] Reading a receipt means reading the code printed on the receipt or reading the encoded information. The self-payment machine mode is an operating mode in which the registration process is not performed in the own terminal, but the payment process is performed solely based on the registration information generated in the other POS terminal 20. Note that since the self-payment machine mode is an operating mode in which the registration process is not performed, i.e., no registration information is generated, the sending of registration information to other POS terminals 20 and the issuance of receipts are both disabled.

[0051] (Full self mode) The full self-service mode is an operation mode that enables product registration on the customer side. In other words, the full self-service mode is an operation mode that assumes registration processing on the customer side. In product registration on the customer side, the customer side scanner unit 206 and customer side display unit 205 are used to register purchased products.

[0052] In the full self-service mode, it is possible to enable product registration by the store clerk. In other words, the full self-service mode is an operating mode that assumes registration processing on the customer side, but also allows registration processing on the store clerk side. A state in which registration processing is performed on both the customer side and the store clerk side is sometimes called a double scan mode. In the full self-service mode, product registration by the store clerk may be disabled.

[0053] The full self-service mode is an operation mode in which the terminal can perform settlement processing at its own terminal. Specifically, the full self-service mode is an operation mode in which insertion of coins is enabled, and transmission of registration information to other POS terminals 20 and issuance of accounting tickets are disabled.

[0054] Similarly to the self-service checkout mode, the full self-service mode is an operation mode in which the reception of registration information from other POS terminals 20 and the reading of accounting tickets are both enabled. In other words, similar to the self-service checkout mode, in the full self-service mode, the checkout process can be performed based on registration information generated in other POS terminals 20.

[0055] In addition, when the POS terminal 20 receives registration information in the full self-service mode, it may switch to the self-service checkout machine mode (semi-self-service mode). Similarly, when the POS terminal 20 reads a code on a bill in the full self-service mode, it may switch to the self-service checkout machine mode. After switching to the self-service checkout machine mode and completing the checkout process, it may automatically return from the self-service checkout machine mode to the full self-service mode. In addition, even after switching to the self-service checkout machine mode and completing the checkout process, it may remain in the self-service checkout machine mode. In addition, in the full self-service mode, the reception of registration information from other POS terminals 20 may be disabled, the reading of bills may be disabled, or both of these may be disabled.

[0056] The POS terminal 20 does not necessarily have to have all the functions. For example, the POS terminal 20 may obtain a program for implementing a function required for each operation mode from an external device (e.g., the store controller 10, the transaction status management device 11, a server outside the store, etc.) and make it executable, and when the POS terminal 20 holds a program for implementing an unnecessary function for each operation mode, the program may be made inexecutable (e.g., deleted).

[0057] Also, after making a program for realizing an unnecessary function in an unexecutable state, a program for realizing a necessary function may be acquired and made executable. Also, for example, when switching the operation mode, the POS terminal 20 may make all programs unexecutable once, regardless of the operation mode to which the operation mode is to be switched, and then acquire a program for realizing a function required in the operation mode from an external source and make it executable. In other words, the configuration of the POS terminal 20 may be such that some of the various functions originally provided are disabled according to the operation mode, or such that only the necessary functions are provided appropriately according to the operation mode. Also, it may be a dedicated terminal provided with only the functions corresponding to a predetermined operation mode.

[0058] ● Switching (transitioning) operation modes Next, a description will be given of switching (transition) of the operation mode of the POS terminal 20. The POS terminal 20 switches the operation mode in accordance with a mode switching operation, a store clerk code reading operation, a mode switching command, or the like.

[0059] More specifically, the POS terminal 20 switches between operation modes in response to an explicit mode switching operation, such as a store clerk pressing a mode switching button. In addition, the POS terminal 20 switches the operation mode in accordance with an operation other than the mode switching operation, such as an operation of reading a store clerk code.

[0060] The POS terminal 20 also switches its operation mode in response to a mode switching command from another POS terminal 20, the transaction status management device 11, a mobile terminal, etc. The POS terminal 20 may also switch its operation mode in response to a time condition, such as the time elapsed since the last operation or a fixed time according to a schedule.

[0061] The POS terminal 20 may also switch the operation mode at the start of processing, for example, when a settlement process based on registration information received from another POS terminal 20 starts, or when a settlement process based on reading a bill starts, etc.

[0062] The POS terminal 20 may also switch the operation mode when a process ends, for example, when a payment process based on registration information received from another POS terminal 20 ends, or when a payment process based on reading a bill ends.

[0063] (Face-to-face self-mode → Full self-mode) First, switching from the face-to-face self-mode to the full self-mode will be described. When the device is controlled in the face-to-face self-mode, for example, when a mode switching operation, a mode switching command, or a predetermined time has elapsed (a predetermined time of non-use) occurs, the operation mode switches from the face-to-face self-mode to the full self-mode. The mode switching command here is a mode switching command that specifies the full self-mode as the operation mode to be transitioned to.

[0064] (Face-to-face self-service mode → Self-service payment machine mode) Next, switching from the face-to-face self-service mode to the self-service checkout machine mode will be described. When the face-to-face self-service mode is being controlled, for example, if there is a mode switching operation or a mode switching command, the operation mode switches from the face-to-face self-service mode to the self-service checkout machine mode. The mode switching command here is a mode switching command that specifies the self-service checkout machine mode as the operation mode to be transitioned to. In addition, when the face-to-face self-service mode is being controlled, for example, if registration information is received from another POS terminal 20 or if a bill is read, the operation mode may be switched from the face-to-face self-service mode to the self-service checkout machine mode.

[0065] (Full self-mode → Face-to-face self-mode) Next, switching from the full self-service mode to the face-to-face self-service mode will be described. When the full self-service mode is being controlled, for example, if there is a mode switching operation or a mode switching command, the operation mode switches from the full self-service mode to the face-to-face self-service mode. The mode switching command here is a mode switching command that specifies the face-to-face self-service mode as the operation mode to be switched to.

[0066] (Full self-service mode → Self-service payment machine mode) Next, switching from the full self-service mode to the self-service checkout machine mode will be described. When the full self-service mode is being controlled, for example, if a mode switching operation or a mode switching command is issued, the operation mode switches from the full self-service mode to the self-service checkout machine mode. The mode switching command here is a mode switching command that specifies the self-service checkout machine mode as the operation mode to be transitioned to. In addition, when the full self-service mode is being controlled, for example, if registration information is received from another POS terminal 20 or if a bill is read, the operation mode may be switched from the full self-service mode to the self-service checkout machine mode.

[0067] (Self-service checkout mode → Face-to-face self-service mode) Next, switching from the self-checkout mode to the face-to-face self-service mode will be described. When the self-checkout mode is being controlled, for example, if there is a mode switching operation or a mode switching command, the operation mode switches from the self-checkout mode to the face-to-face self-service mode. The mode switching command here is a mode switching command that specifies the face-to-face self-service mode as the operation mode to be transitioned to. In addition, when the self-checkout mode is being controlled, for example, if the payment process based on the received registration information or the payment process based on the bill is completed, the operation mode may be switched from the self-checkout mode to the face-to-face self-service mode.

[0068] (Self-service mode → Full self-service mode) Next, switching from the self-checkout mode to the full self-checkout mode will be described. When the self-checkout mode is being controlled, for example, if a mode switching operation or a mode switching command is issued, the operation mode switches from the self-checkout mode to the full self-checkout mode. The mode switching command here is a mode switching command that specifies the full self-checkout mode as the operation mode to be transitioned to.

[0069] In addition, when the machine is controlled in the self-service checkout mode, the operating mode may be switched from the self-service checkout mode to the full self-service mode, for example, when the checkout process based on the received registration information or the checkout process based on the bill is completed.

[0070] The mode switching operation may be any operation that specifies the operation mode of the destination according to the operation. For example, when there are buttons for each destination, the operation mode may be switched according to the mode switching operation in which each button is pressed. When there is one button that switches the destination each time it is pressed, the operation mode may be switched each time the button is pressed. It is also possible to have a separate button for selecting the destination operation mode and a separate button for confirming the transition to the operation mode selected by the button.

[0071] ●Processing flow and screen layout in face-to-face self-mode Next, the process flow and screen examples of the POS terminal 20 in each operation mode will be described. FIG. 5 shows a process flow of the POS terminal 20 in the face-to-face self-service mode. First, the store clerk starts the process of registering the purchased items that have been placed in a shopping cart or the like by a customer (S101).

[0072] The POS terminal 20 captures images of the operation status of a customer in front of the customer-side display unit 205 using the camera 216. The camera 216 may capture images at all times while the POS terminal 20 is in operation, but it is performed at least during a series of processes from registration of purchased items to settlement. The images captured by the camera 216 are recorded in a reproducible manner in a storage unit such as the RAM 203 or a separately stored HDD. The captured images may be stored in a server or the like configured to be able to communicate via a network, and in this case, for example, the POS terminal 20 transmits the captured images to the server or the like in association with transaction identification information at a predetermined timing.

[0073] 6 shows an example of a screen displayed on the POS terminal 20 at the start of a product registration operation in the face-to-face self-service mode. For ease of explanation, in the following explanation of the screen in the face-to-face self-service mode, the above-mentioned first display area G1 and second display area G2 will be referred to as the first display area G1-1 and the second display area G2-1 on the customer-side display unit 205, and as the first display area G1-2 and the second display area G2-2 on the store clerk-side display unit 210.

[0074] As shown in FIG. 6(A), the customer-side display unit 205 displays a message "Welcome" in the first display area G1-1, and an advertisement in the second display area G2-1. As shown in FIG. 6(B), the store clerk's display unit 210 displays a product registration operation screen in the first display area G1-2, and displays the change status of the POS terminal 20 in the second display area G2-2. Regardless of the example of FIG. 6(A), a screen saver or the like can be displayed instead of the advertisement until the customer operates the POS terminal 20.

[0075] The POS terminal 20 accepts operations by the clerk using the clerk scanner unit 212, the clerk display unit 210, and the key operation unit 211, and starts registering the products purchased by the customer. In response to this, the screen changes to an execution screen for product registration operations, as shown in Fig. 7. Fig. 7(A) is an example of a screen on the customer display unit 205, and Fig. 7(B) is an example of a screen on the clerk display unit 210.

[0076] 7(A), the customer-side display unit 205 displays the product registration status in the first display area G1-1, and continues to display advertisements in the second display area G2-1. The product registration status includes information such as the name, price, and quantity of each registered product, as well as the total price of the registered products. It should be noted that while the product is being registered by the store clerk, the image screen showing the image captured by camera 216 is not displayed on customer side display unit 205. As shown in Fig. 7(B), the store clerk display unit 210 displays a product registration screen in the first display area G1-2, and displays registered products, prices, etc. In the second display area G2-2, the change status of the POS terminal 20 is continuously displayed.

[0077] When the store clerk has finished registering the purchased items, the store clerk completes the registration process by, for example, pressing a subtotal button (S102). If the customer selects to pay by credit card, the store clerk instructs the POS terminal 20 to settle the payment by credit card (S103), and the card settlement unit 208 executes the settlement process (S106). Note that this also applies to payment by credit card, code payment, points, electronic money, etc.

[0078] On the other hand, if the customer selects cash payment, the store clerk instructs the POS terminal 20 to settle the payment in cash (S103). In response to this, the first display area G1-1 of the customer side display unit 205 displays the message "Please insert money" together with the information on the total price of the purchased items, as shown in FIG. 8(A). The customer checks the total amount of the purchased items displayed on the customer side display unit 205 and inserts cash into the change machine 209.

[0079] When a customer inserts cash into the change machine 209, the POS terminal 20 detects this (S104), and displays images captured by the camera 216 in the second display area G2-1 of the customer display unit 205 and in the second display area G2-2 of the clerk display unit 210 (S105), as shown in Fig. 9. Note that Fig. 9(A) shows an example screen of the customer display unit 205, and Fig. 9(B) shows an example screen of the clerk display unit 210.

[0080] At this time, the captured images displayed in the second display areas G2-1 and G2-2 are images that have been rewound a predetermined time from the current time and played back, allowing the customer to confirm the state in which he or she has inserted cash into the change machine 209. The captured image also includes images of locations such as the customer's hands when the customer inserts cash into the change machine 209, the cash to be inserted, and the insertion slot of the change machine 209. The captured image may be one that focuses on the location from a wider captured image captured by the camera 216, or may be one that focuses on the location. The display of such captured images is performed to prevent trouble caused by fraudulent acts by customers at the time of payment, etc. For example, a customer may falsely or mistakenly say that they inserted a 10,000 yen note when in fact they inserted a 5,000 yen note into the insertion slot, causing trouble between the store and the customer.

[0081] When the insertion of cash is completed, settlement processing, such as calculation of change, is executed (S106). As shown in Fig. 10(A), the first display area G1-1 of the customer side display unit 205 displays the message "If you wish, please press the Finish button", as well as information on the deposited cash and change, a button to request the issuance of a receipt, and an "End (Receipt)" button to announce the end of the series of processes. When the customer presses the "End (receipt)" button and receives a receipt from the printing unit 213, if there is any change or change tag, the change machine 209 will eject the change or change tag. If there is any change or change tag, the customer will receive it, and the settlement process will end (S107).

[0082] At this time, the first display area G1-2 of the store clerk's display unit 210 displays information on the amount of cash deposited by the customer into the change machine 209 (amount deposited in the change machine), as well as a "Cancel deposit" button for canceling the deposit and a "Register next customer" button for moving on to the product registration operation for the next customer.

[0083] In the above-mentioned processing in the face-to-face self-service mode, the POS terminal 20 may be configured to accept insertion of cash into the change dispenser 209 before the registration processing by the clerk is completed (before the total amount is determined). In this case, the POS terminal 20 may start displaying a captured image when detecting insertion of cash while the clerk is performing the registration processing. That is, even if the clerk is registering the purchased items, the POS terminal 20 may display a captured image in the second display area G2-1 of the customer-side display unit 205 or the second display area G2-2 of the clerk-side display unit 210. In addition, the POS terminal 20 may not accept insertion of cash before the registration processing by the clerk is completed.

[0084] Furthermore, in the face-to-face self-service mode, the POS terminal 20 can register the items purchased by the next customer even before the customer has completed the payment (even before the change has been taken out or the receipt has been printed). In other words, the POS terminal 20 can register the items purchased by the next customer while the payment is being processed at the terminal. Also, the store clerk may not be present during the customer's payment. In other words, the store clerk may finish serving the customer while the customer is paying.

[0085] Furthermore, if there is change, the POS terminal 20 may issue a receipt after the change is taken out. Specifically, the POS terminal 20 may be provided with a sensor that detects change and change tags, and after controlling the dispensing of the change and change tags, may control the printing unit 213 to issue a receipt when the sensor detects that the change and change tags have been taken out. This makes it possible to prevent the change from being forgotten. Note that in other operation modes as well, a receipt may be issued after the change is taken out in a similar manner.

[0086] Furthermore, the POS terminal 20 can receive a selection of a settlement type (payment method) from the customer before the registration process is completed. Furthermore, when the POS terminal 20 receives the insertion of cash in addition to pressing a predetermined button or the like to select the payment type (payment method), it can also regard cash as being selected as the payment type.

[0087] Furthermore, in the above-described process, when it is detected that cash has been inserted into the change machine 209, captured images from a predetermined time back are displayed on the customer display unit 205 and the store clerk display unit 210, so that the customer can check the state of inserting the cash into the change machine 209. On the other hand, the captured images may be displayed when the store clerk accepts a selection of a payment type from the customer and issues a payment request corresponding to the selection to the POS terminal 20. In this case, the customer has not yet inserted cash, so the captured images may be live images.

[0088] ●Processing flow and screen layout in self-payment mode FIG. 11 shows a flow of processing of the POS terminal 20 in the self-checkout mode. In the self-payment machine mode, the POS terminal 20 is divided into a terminal (registration machine) operated by a store clerk to register products, and a terminal (payment machine) to allow a customer to settle payments. In the following explanation, the former (registration machine) is referred to as the "POS terminal 20-1," and the latter (payment machine) is referred to as the "POS terminal 20-2." In practice, a plurality of POS terminals 20-2 as payment machines may be provided for one POS terminal 20-1 as a registration machine, and in that case, the POS terminal 20-1 designates one of the plurality of POS terminals 20-2 to settle payments.

[0089] First, the store clerk starts the process of registering the purchased items that have been placed in a shopping cart or the like by a customer using the POS terminal 20-1 (S201). As in the above-mentioned face-to-face self-service mode, the POS terminal 20-2 captures an image of the operation status of the customer in front of the customer-side display unit 205 using the camera 216.

[0090] FIG. 12 shows an example of a screen displayed on the POS terminal 20-2 during product registration processing in the self-checkout mode. The customer side display unit 205 displays in the first display area G1 that the POS terminal 20-2 is operating as a settlement machine and is in a standby state to receive registration data. Also, an advertisement is displayed in the second display area G2.

[0091] In addition, in the standby state of the self-checkout mode, the POS terminal 20-2 can also display the captured image in the second display area G2 of the customer-side display unit 205. This makes it possible to make the customer aware that he or she is being photographed even in the standby state of the self-checkout mode, thereby enhancing the effect of preventing fraud.

[0092] When the store clerk completes the registration process of the purchased items by the POS terminal 20-1 (S202), he designates the POS terminal 20-2 controlled in the self-checkout mode and transmits the registration data (S203). After transmitting the registration data to the POS terminal 20-2, the store clerk moves on to the registration process of the purchased items of the next customer (S204). Instead of transmitting the registration data, the POS terminal 20-1 may issue a bill to be read by the POS terminal 20-2 that executes the settlement process.

[0093] When the POS terminal 20-2, which is controlled in the self-payment machine mode, receives registration information from the POS terminal 20-1 (S205) or reads the code on the bill, it displays a screen showing the captured image on the customer side display unit 205, as shown in FIG. 13 (S206). 13, the first display area G1 displays the total price of the purchased items, a message saying "Please press the payment method," and a button for selecting the payment method. The second display area G2 displays an image of the customer's operation, captured by the camera 216. The captured image displayed in the second display area G2 is, for example, the entire image captured by the camera 216, or an image of the customer and the surrounding area of ​​the customer-side display unit 205 being operated by the customer.

[0094] If the customer selects to pay by credit card (S207), the card payment unit 208 executes the settlement process (S209). Note that this applies not only to credit card payments, but also to code payments, points, electronic money, and the like.

[0095] On the other hand, when the customer selects cash payment (S207), the captured image displayed in the second display area G2 of the customer-side display unit 205 is switched to a captured image of the customer's hands when the customer inserts cash into the change machine 209, the cash to be inserted, the insertion slot of the change machine 209, etc. (S208). Such switching of captured images may be one that focuses on the relevant location from a wider captured image captured by the camera 216, or one that focuses on the relevant location. The screen of the customer-side display unit 205 at this time is shown in Fig. 14. In the first display area G1, a message "Please insert money" is displayed together with information on the total amount of the purchased items. In the second display area G2, a captured image of the periphery of the change machine 209 is displayed.

[0096] When the customer checks the total amount of the purchased items displayed on the customer side display unit 205, the customer inserts cash into the change machine 209 and carries out the settlement process (S209). The state at this time is displayed as a captured image in the second display region G2, as shown in FIG. Furthermore, when the settlement process is completed, the first display area G1 will display the message "If you are satisfied, please press the Finish button", along with information on the deposited cash and change, a button to request the issuance of a receipt, and an "End (Receipt)" button to declare the end of the process. When the customer presses the "End (receipt)" button and receives a receipt from the printing unit 213, if there is change or a change tag, the change machine 209 will eject the change or a change tag. If there is change or a change tag, the customer will receive the change or the change tag, and the settlement process will end (S210).

[0097] As in the above-mentioned face-to-face self-service mode, in the self-service payment mode, the POS terminal 20-2 may issue a receipt after the change is taken out if there is any. In addition, when selecting a payment type (payment method), the POS terminal 20-2 may regard cash as the payment type selected when it receives cash insertion, not just when a predetermined button or the like is pressed.

[0098] In the above-described process flow in the self-payment mode, the captured image is displayed on the customer display unit 205 in response to receiving registration information or reading the code on the bill, but regardless of this, the captured image can also be displayed when the customer selects the payment type. Also, a human presence sensor can be provided in the POS terminal 20, and the captured image can start to be displayed when the human presence sensor detects a customer standing in front of the POS terminal 20.

[0099] ●Processing flow and screen layout in full self mode FIG. 16 shows a flow of processing of the POS terminal 20 in the full self-service mode. The POS terminal 20 is in a standby state before the customer starts operation. Fig. 17 shows an example of a screen in such a standby state. A button labeled "Start registration" is provided on the screen. The customer presses the "Start registration" button to start operation (S301). As in the self-checkout mode described above, the POS terminal 20 captures images of the operation status of a customer in front of the customer-side display unit 205 using the camera 216 .

[0100] When the operation is started, the screen of the customer side display unit 205 transitions to the screen shown in Fig. 18. On the screen, a product registration operation screen is displayed in the first display area G1, and an advertisement is displayed in the second display area G2. The registration operation screen in the first display area G1 displays the message "Please register a product", as well as a "No barcode" button for registering products without barcodes, information about the registered products, the total price of the purchased products, and a "Checkout" button to proceed to checkout for the registered products.

[0101] The customer performs an operation to register the product by reading the barcode of the product with the customer-side scanner unit 206 or by pressing a preset key displayed on the customer-side display unit 205 (S302). When the product registration operation is started, as shown in FIG. 19, a captured image is displayed in the second display area G2 of the customer side display unit 205 (S303).

[0102] When registering a product that does not have a barcode, the customer presses the "No barcode" button shown in Fig. 18. This causes the screen on the customer side display unit 205 to change to the screen shown in Fig. 20. The screen displays the name and price of the product, as well as a virtual numeric keypad that allows the customer to input the number of products. The customer inputs the quantity of the product to be registered and confirms it.

[0103] The customer registers the products to be purchased (S304), and when registration of all the products has been completed, the customer proceeds to payment by, for example, pressing the "Checkout" button shown in FIG. 18 (S305). When the "Checkout" button is pressed, a screen similar to that shown in Fig. 13 above is displayed. That is, in the first display area G1, the total price of the purchased items and a message saying "Please press the payment method" are displayed along with a button for selecting the payment method. In the second display area G2, an image of the customer's operation status captured by the camera 216 is displayed. The captured image displayed in the second display area G2 is, for example, the entire image captured by the camera 216, or an image of the customer and the surrounding area of ​​the customer-side display unit 205 being operated by the customer.

[0104] If the customer selects to pay by credit card (S306), the card payment unit 208 executes the settlement process (S308). Note that this applies not only to card payments by credit card, but also to code payments, points, electronic money, and the like.

[0105] On the other hand, when the customer selects cash payment (S306), the captured image displayed in the second surface area of ​​the customer-side display unit 205 is switched to an image of the customer's hands when inserting cash into the change machine 209, the cash to be inserted, the insertion slot of the change machine 209, etc. (S307). Such switching of captured images may be one that focuses on the relevant location from a wider captured image captured by the camera 216, or one that focuses on the relevant location. The screen of the customer display unit 205 at this time is the same as that shown in Fig. 14 described in the self-payment mode. That is, the first display area G1 displays the message "Please insert money" together with the total amount of the purchased items. The second display area G2 displays a captured image of the area around the change machine 209.

[0106] When the customer checks the total amount of the purchased items displayed on the customer side display unit 205, he or she inserts cash into the change machine 209 and carries out the settlement process (S308). The state at this time is displayed as a captured image in the second display region G2, similar to the screen shown in FIG. 15 and receives a receipt from the printing unit 213, the change or change tag, if any, is dispensed from the change dispenser 209. The customer receives the change or change tag, if any, and the settlement process is then completed (S309).

[0107] As in the above-mentioned face-to-face self-service mode, in the full self-service mode, the POS terminal 20 may issue a receipt after the change is taken out if there is any. Also, when selecting a payment type (payment method), the POS terminal 20 can consider that cash has been selected as the payment type when it receives the insertion of cash, not just when a predetermined button or the like is pressed.

[0108] In the above-mentioned process flow in the full self-service mode, the captured image is displayed on the customer side display unit 205 in response to the customer's registration of the product, but regardless of this, the captured image can also be displayed when the customer presses the "Registration Start" button. Also, a human presence sensor can be provided in the POS terminal 20, and the captured image can be started to be displayed when the human presence sensor detects a customer standing in front of the POS terminal 20.

[0109] ● Notifications according to status In each of the above operation modes, the POS terminal 20 notifies the status by the notification unit 207. FIG. 21 shows an example of the status of the POS terminal 20 and a notification mode by the notification unit 207 according to the status. There are various statuses that can be assumed when using the POS terminal 20, such as, for example, out of service, registration in progress, change not collected, change near end, and clerk being called. The notification manner corresponding to each status is unique, and may differ depending on the luminous color, whether the light is off, on, or blinking, or may illuminate in different colors in sequence. In this way, by operating the notification unit 207 in a unique notification mode for each status, various statuses can be easily recognized.

[0110] The status shown in FIG. 21 is an example, and other statuses can be handled. For example, in the full self-service mode, when a customer registers a product without a barcode, a multiplication registration is performed by inputting the quantity of the product. In this case, the status that the multiplication registration is being performed may be notified in a predetermined notification manner so as to prevent fraud or errors in the quantity. Also, when a product that requires age authentication, such as alcohol, is registered, the status may be notified as one of the predetermined statuses. Furthermore, the status information is transmitted to the transaction status management device 11, etc., and the store clerk can grasp the status of each POS terminal 20 in real time by a monitor that outputs information obtained from the transaction status management device 11. In addition, customer operation patterns may be learned by AI (Artificial Intelligence), and when an operation that deviates from the learned operation pattern is detected as an unauthorized operation, this may be reported in a predetermined manner.

[0111] According to the POS terminal 20 of the present embodiment, a screen display that combines operability and visibility is possible. In particular, since a customer can clearly see the captured image of the operation status while performing the operation, it is possible to effectively prevent fraud. In addition, since the captured image to be displayed can be switched according to the operation content, or captured images can be played back going back a predetermined time, the situation to be focused on can be accurately displayed as a captured image. In addition, since the customer can check their own operation while performing the operation, problems due to operational errors or misunderstandings can be prevented. EXAMPLES

[0112] ●Function configuration In this embodiment, the customer side display unit 205 of the POS terminal 20 is composed of a first display area G1 at the bottom, a second display area G2 at the middle, and a third display area G3 at the top, as shown in Figure 22, and while the product registration process and payment process are being executed, different information can be displayed in the first display area G1, the second display area G2, and the third display area G3, respectively.

[0113] In one example of the display contents, the first display area G1 displays an operation screen for accepting operations by the customer as an operator, such as product registration and settlement. The second display area G2 displays an image captured by the camera 216. The third display area G3 displays the status of the device (the POS terminal 20), thereby informing the customer and the store clerk of the status of the device. In addition, when there is no abnormality in the status of the POS terminal 20, the second display area G2 and the third display area G3 can be regarded as a single display area, and the captured image can be displayed in this single display area. In addition to the status, the third display area G3 may display the machine number of the POS terminal 20, etc.

[0114] In this embodiment, not only the customer side display unit 205 of the POS terminal 20, but also the store clerk side display unit 210 can be configured in this manner with the first display area G1, the second display area G2, and the third display area G3.

[0115] ●Processing flow and screen layout in face-to-face self-mode Below, examples of the contents displayed in the first display area G1, the second display area G2, and the third display area G3 will be described along with examples of screens in each operation mode. The basic process flow is as described above for any of the operation modes.

[0116] First, a screen example in the face-to-face self-timer mode will be described. Fig. 23 shows an example of a screen when a customer settles a payment in cash. When a customer inserts cash into the change dispenser 209, the POS terminal 20 detects this and displays an image captured by the camera 216 on the customer display unit 205 and the store clerk display unit 210, as shown in Fig. 23. Here, in the customer side display unit 205, as shown in Fig. 23(A), the captured image is displayed by regarding the second display area G2 and the third display area G3 as one display area. Regardless of this example, the captured image may be displayed only in the second display area G2, and a status such as "payment in progress" may be displayed in the third display area G3. On the store clerk's display unit 210, as shown in FIG. 23(B), the captured image is displayed in the second display area G2, and the third display area G3 displays the information "Near 10 yen" as the status of the POS terminal 20, notifying the user that the 10 yen coin is running low.

[0117] At this time, the captured image displayed on the customer display unit 205 and the store clerk display unit 210 is, as described above, a video that has been rewound a predetermined amount of time from the current time and played back, allowing the customer to see themselves inserting cash into the change machine 209.

[0118] FIG. 24 shows a screen that appears after the insertion of cash has been completed, and is an example of a screen that appears when change is due but has been forgotten to be taken. As shown in FIG. 24(A), in the customer-side display unit 205, a captured image is displayed in the second display area G2, and a message informing the customer that change has been left behind is displayed in the third display area G3. Also on the store clerk display unit 210, as shown in FIG. 24(B), the captured image is displayed in the second display area G2, and a message informing the customer that change has been forgotten is displayed in the third display area G3. It should be noted that the notification of the status by a message in FIG. 24 is one example, and the background color may be made to flash or light up in a predetermined color depending on the status of forgetting to take the change.

[0119] ●Processing flow and screen layout in self-payment mode Next, an example of a screen in the self-payment mode will be described. FIG. 25 shows an example of a screen displayed on the payment POS terminal 20 operated by a store clerk while the store clerk is performing product registration processing using the product registration POS terminal 20 in the self-payment mode. The customer side display unit 205 displays in the first display area G1 that the POS terminal 20 is operating as a settlement machine and is in a standby state ready to receive registration data. The second display area G2 displays the message "Welcome." The third display area G3 displays the message "Waiting" as the status of the POS terminal 20, and further displays the unit number assigned to the terminal among the multiple POS terminals 20. Since the machine number is displayed, a customer who is told by a store clerk to go to the POS terminal 20 with a specific machine number can look at the machine number displayed in the third display area G3 and identify the POS terminal 20 with that specific machine number.

[0120] FIG. 26 shows an example of a screen displayed on the POS terminal 20 controlled in the self-checkout mode when registration information is received from the POS terminal 20 for product registration. On the screen, the first display area G1 displays the total amount of the purchased items, a message saying "Please press the payment method", and a button for selecting the payment type. The second display area G2 displays an image of the customer's operation status captured by the camera 216. The third display area G3 displays the status of the POS terminal 20 as in FIG. 25. In this case, the POS terminal 20 has received the registration information and is in a state where the customer is asked to select a payment type, so a guide saying "Settlement in progress" is displayed as the status. In addition, the background color of the third area is different from the "Waiting" state shown in FIG. 25 so that it is clearly understood that the status is different. Note that the effect given to the third display area G3 to make it easier to recognize the difference in status may be a difference in the background color, or may be other forms such as flashing or lighting in a predetermined color.

[0121] FIG. 27 shows an example of a screen in a state immediately before completing the settlement process, such as receiving a receipt after the customer has performed the settlement process by inserting cash into the change dispenser 209. In this example, the customer has not pressed the "End (receipt)" button that ends the settlement process, and a predetermined time has passed. Therefore, a message "Settlement time exceeded" is displayed as a status in the third display area G3. Note that the background color of the third area is different from the background colors used for the statuses "Waiting" and "Settlement" so that it is clearly understood that this status "Settlement time exceeded" is different from the statuses "Waiting" in FIG. 25 and "Settlement in progress" in FIG. 26. Note that, as described above, the effect given to the third display area G3 to make it easier to recognize the difference in status may be achieved in other ways.

[0122] ●Processing flow and screen layout in full self mode Next, an example of a screen in the full selfie mode will be described. 28 is an example of a screen of the POS terminal 20 in a standby state before a customer starts operation. On the screen, the first display area G1 and the second display area G2 are combined into one display area, and a button labeled "Start registration" is displayed. In the third display area G3, a message "Waiting" is displayed as the status of the POS terminal 20, and further, the unit number assigned to the terminal among the multiple POS terminals 20 is displayed.

[0123] Fig. 29 is an example of a screen at the start of product registration processing. On the screen, a product registration operation screen is displayed in the first display area G1, and an advertisement is displayed in the second display area G2. Furthermore, the status is displayed in the third display area G3. Here, since no products have been registered yet, the status remains "Waiting".

[0124] 30 is an example of a screen of the POS terminal 20 when a product registration operation is being performed. The first display area G1 displays information about the product that was just registered, and the second display area G2 displays a captured image. The third display area G3 displays a status of "Registering." Even in full self mode, the background color and other aspects of the third area are different for each status, such as "Waiting" in Figures 28 and 29, "Registering" in Figure 30, and other statuses such as "Settlement" so that it is clearly understood that these are different statuses.

[0125] According to the POS terminal 20 according to the present embodiment, the status of the POS terminal 20 can be accurately notified without providing the notifying unit 207. In addition, even when the area for notifying the status is provided, the visibility of the operation screen and the display screen for the captured image is ensured.

[0126] In the above description of this embodiment, the status displayed in the third display area G3 of the POS terminal 20 is just one example, and different types of display can be displayed on the third display area depending on the various statuses described in the first embodiment.

[0127] Furthermore, when a product that requires age authentication, such as alcoholic beverages, is registered, the status information may be not only displayed on the POS terminal 20 but also transmitted to the transaction status management device 11, etc., if necessary. The information obtained from the transaction status management device 11 can be output to a specified monitor, etc., allowing store clerks to grasp the status of each POS terminal 20 in real time and to perform remote operations according to the status.

[0128] In the above embodiment of the present invention, the POS terminal 20 is described as being switched between a face-to-face self-service mode, a self-service checkout mode, and a full self-service mode, but the present invention is also applicable to a POS terminal that operates in a so-called normal mode, in which the process from product registration to checkout is completed only by the operation of the store clerk. That is, in this case, too, the screen of the POS terminal can be configured with two display areas, the first display area G1 and the second display area G2, or with three display areas, the first display area G1, the second display area G2, and the third display area G3. In addition, in each display area, for example, a product registration screen can be displayed in the first display area G1, a change status in the second display area G2, and a status in the third display area G3.

[0129] The computer program for realizing the functions constituting the POS system 1 or POS terminal 20 according to the embodiment of the present invention described above can be provided by downloading via a network such as the Internet, or by recording it on various computer-readable recording media such as a CD-ROM.

[0130] Furthermore, these software resources can be distributed or consolidated into any of the hardware resources through appropriate design, and the hardware resources can also be configured as a physically integrated device or as separate devices. Summary of the implementation form

[0131] The present invention relates to a technique for displaying a captured image on an operation screen of a POS terminal in an easy-to-view manner.

[0132] Conventionally, supermarkets and other stores use POS (Point Of Sales) registers to register products purchased by customers and to settle the bill. Self-service registers, where customers can perform the settlement operation, are becoming more and more common. In self-service registers, customers operate the POS register themselves, so there is a risk of fraud by customers. For this reason, various measures have been taken to prevent fraudulent activities. For example, Japanese Patent Application Laid-Open No. 2017-187821 discloses a system that notifies errors or fraud using a sign light or the like.

[0133] On the other hand, in recent years, the displays of POS registers have become larger, and when displaying information on the screen, consideration must be given to operability, visibility, etc. More specifically, portrait displays are becoming more common, but because the aspect ratios are different, screen layouts that correspond to those ratios are required.

[0134] SUMMARY OF THE PRESENT EMBODIMENTS Accordingly, an object of the present invention is to provide a device capable of displaying a screen that is both easy to use and has good visibility.

[0135] In order to achieve the above-mentioned object, a product sales data processing device according to one aspect of the present invention has an imaging means for imaging an operation status of an operator, and a display means for displaying specified information, and the display means has a first display area for displaying an operation screen that accepts operations by the operator, and a second display area for displaying an image captured by the imaging means.

[0136] The display means may display an image captured by the imaging means in the second display area in response to a start of an operation on the operation screen.

[0137] The image display device may further include a detection means for detecting the operator, and the display means may display an image captured by the imaging means in the second display area in response to detection of the operator.

[0138] The display means may be configured to provide the second display area above the first display area.

[0139] The display means may further include a registration means for registering a product, and the display means may display an image capturing an operation status of the registration operation in the second display area while the registration operation is being executed by the registration means, and the second display area may be located approximately in the middle in the vertical direction.

[0140] The cash deposit / withdrawal unit may further include a cash deposit / withdrawal unit that executes cash deposits and withdrawals, and the display means may display an image capturing an image of the cash deposit / withdrawal operation status in the second area while the cash is being deposited or withdrawn in the cash deposit / withdrawal unit, and the second display area may be located approximately in the middle.

[0141] The display means may include a third display area for notifying a status of the display means itself, the third display area being provided above the second display area.

[0142] A settlement device according to another aspect of the present invention has an imaging means for imaging the operation status of an operator and a display means for displaying specified information, and the display means has a first display area for displaying an operation screen for accepting operations, and a second display area for displaying an image captured by the imaging means.

[0143] A computer program according to another aspect of the present invention causes a computer to execute an imaging process for imaging an operator's operation status and a display process for displaying specified information, and the display process displays a first display area for displaying an operation screen that accepts operations by the operator, and a second display area for displaying an image captured by the imaging means.

[0144] According to the above-described product sales data processing device of the embodiment of the present invention, a screen display that combines operability and visibility is possible. In particular, since the customer can clearly see the captured image of the operation status while performing the operation, it is possible to effectively prevent fraud. In addition, the captured image to be displayed can be switched or rewound or played back in accordance with the operation, so that the customer can perform the operation while checking his / her own operation. Furthermore, by providing a third display area to display the status, the status of the product sales data processing device can be accurately notified without providing a separate notification unit such as a sign lamp, etc. Furthermore, even when a status notification area is provided, the visibility of the operation screen and the display screen for captured images is ensured. [Explanation of symbols]

[0145] 1: POS system 10: Store Controller 11: Transaction status management device 20: POS terminal 201: CPU 202 :ROM 203:RAM 204: Hard disk 205:Customer side display section 206: Customer side scanner section 207: Information Department 208: Card Payment Department 209: Change machine 210: Clerk side display section 211: Key operation section 212: Store clerk scanner unit 213: Printing Department 214: Audio output unit 215: Communications Department 216: Camera G1: First display area G2:Second display area G3: Third display area

Claims

1. An imaging means for imaging an operating status of an operator; A display means for displaying predetermined information; A deposit / withdrawal unit for depositing and withdrawing cash, the display means includes a first display area that displays an operation screen for receiving an operation by the operator, and a second display area that displays an image captured by the imaging means, During the depositing or withdrawing of the cash in the depositing or withdrawing unit, an image capturing an operation status of the depositing or withdrawing of the cash is displayed in the second display area, and the second display area is provided in a substantially central area. Product sales data processing device.

2. The display means includes a third display area for notifying a status of the device itself, and the third display area is provided above the second display area.

2. The product sales data processing device according to claim 1.

3. A computer having a deposit / withdrawal unit for executing deposits and withdrawals of cash, An imaging process for imaging an operation status of an operator; A display process for displaying predetermined information is executed; In the display process, a first display area is displayed to display an operation screen for receiving an operation by the operator, and a second display area is displayed to display an image captured by the imaging process. During the depositing or withdrawing of the cash in the depositing or withdrawing unit, an image capturing an operation status of the depositing or withdrawing of the cash is displayed in the second display area, and the second display area is provided in a substantially central area. Computer program.

Images