Processing device, program

Abstract

To enable input that is appropriate for a situation.SOLUTION: A processor includes: display means for displaying a screen including an operator; contact detection means capable of detecting contact operation to the operator; non-contact detection means capable of detecting non-contact operation to the operator; and determination means for determining one of a contact input mode with the contact operation and a non-contact input mode with the non-contact operation as an input mode to the operator.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a processing device and a program. [Background technology]

[0002] BACKGROUND ART Electronic devices that accept contact input and non-contact input are known (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6833981 Summary of the Invention [Problem to be solved by the invention]

[0004] However, since contact input and non-contact input are controlled depending on the operation regardless of the situation, there is a problem in that it is not possible to input using an input method that suits the situation.

[0005] The present invention has been made in view of the above circumstances, and aims to provide a technique that enables suitable input depending on the situation. [Means for solving the problem]

[0006] One aspect of the present invention for solving the above-mentioned problems is a processing device characterized by comprising: a display means for displaying a screen including an operator; a contact detection means capable of detecting a contact operation on the operator; a non-contact detection means capable of detecting a non-contact operation on the operator; and a determination means for determining, as an input mode for the operator, one of a contact input mode using the contact operation and a non-contact input mode using the non-touch operation. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a conceptual diagram of a network for explaining a sales system. [Figure 2] 1 is an example of the appearance of a registration and settlement device. [Figure 3] 1 is a configuration example of a registration and settlement device. [Figure 4] 10A and 10B are diagrams illustrating input operations on the customer display unit and the store clerk display unit. [Figure 5] FIG. 2 is a diagram illustrating a distance sensor unit. [Figure 6] 10A and 10B are diagrams illustrating the status of operations performed by an operator on a customer-side display unit. [Figure 7] FIG. 10 is a diagram illustrating a detection mode (input mode). [Figure 8] 10 is a flowchart showing an example of the operation of the registration and settlement device. [Figure 9] 10 is a flowchart showing an example of the operation of the registration and settlement device. [Figure 10] 10 is a flowchart showing an example of the operation of the registration and settlement device. [Figure 11] 10 is a display example of a registration settlement device. [Figure 12] 10 is a display example of a registration settlement device. [Figure 13] 10 is a display example of a registration settlement device. [Figure 14] 10 is a display example of a registration settlement device. [Figure 15] 10 shows an example of a display on a mobile terminal. [Figure 16] 10 is a display example of a payment device. [Figure 17] 10 is a display example of a payment device. [Figure 18] 10 is a display example of a mobile terminal. [Figure 19] 10 is a display example of a weighing and pricing device. [Figure 20] 10 is a display example of a printing device. [Figure 21] 10 is a display example of a printing device. [Figure 22] 10 is a display example of a payment device. DETAILED DESCRIPTION OF THE INVENTION

[0008] Fig. 1 is a conceptual diagram of a network for explaining a sales system 1 of this embodiment. The sales system 1 shown in Fig. 1 includes a headquarters server 10, a cloud server 20, a store controller 30 (e.g., a server), a transaction status management device 40 (e.g., a personal computer), a registration settlement device 50, a settlement device 51, and a mobile terminal 60.

[0009] The sales system 1 can be introduced into various business types (supermarkets, convenience stores, drug stores, home centers, electronics retailers, etc.). The following description will be given assuming that the sales system 1 is introduced into a supermarket S. In FIG. 1, the dashed line T indicates the interior of the supermarket S (product display area, checkout area, back-of-house area, etc.). As shown in FIG. 1, a store controller 30, a transaction status management device 40, a registration and settlement device 50, and a settlement device 51 are installed inside the supermarket S. These are connected to each other so that they can communicate via a LAN 19 (which may be wired or wireless). A mobile terminal 60 is present inside the store. The headquarters server 10 and cloud server are installed outside the store (for example, at the head office or a data center, etc.).

[0010] In Fig. 1, the number of each device (terminal) is an example. For example, in Fig. 1, "..." is shown to the right of the transaction status management device 40, but the number of transaction status management devices 40 installed in a store may be one or more. Also, for example, in Fig. 1, two mobile terminals 60 are shown, but the number of mobile terminals 60 used in a store varies depending on the number of customers.

[0011] The registration and settlement device 50 is used by a store clerk or a customer. Specifically, the registration and settlement device 50 registers products based on the operation of the store clerk or the customer, and settles the payment for the registered products based on the operation of the customer.

[0012] The mobile terminal 60 is used by a customer. Specifically, the mobile terminal 60 registers products based on operations by the customer. The mobile terminal 60 may be owned by the customer or may be loaned by the store. The mobile terminal 60 may be used while attached to a shopping cart (not shown).

[0013] The settlement device 51 is used by a customer. Specifically, the settlement device 51 settles the payment for products registered by the mobile terminal 60 based on the customer's operation. In other words, the sales system 1 provides a service (sometimes referred to as service A) in which the customer registers products by themselves using the mobile terminal 60 and settles the payment using the settlement device 51.

[0014] The headquarters server 10 is a server that manages the entire sales system 1. The headquarters server 10 stores, for example, various setting information (e.g., product master, sale file, etc.) and various performance information (e.g., sales performance information, product sales performance information, etc.). The headquarters server 10 communicates with the cloud server 20 and the store controller 30. The headquarters server 10 may also communicate with other devices (e.g., a transaction status management device 40, a registration settlement device 50, a settlement device 51, etc.). The headquarters server 10 may be composed of multiple servers.

[0015] Cloud server 20 is a server that provides service A. Cloud server 20 stores, for example, various information necessary for the operation of service A (e.g., product master, transaction information (also referred to as cart information), etc.). Cloud server 20 communicates with headquarters server 10 and mobile terminal 60. Cloud server 20 may also communicate with other devices (e.g., store controller 30, transaction status management device 40, settlement device 51, etc.). Cloud server 20 may be composed of multiple servers.

[0016] The store controller 30 is a device that mainly controls the transmission and reception of information between devices inside the store and devices outside the store. That is, the store controller 30 communicates with each device inside the LAN 19 (e.g., the registration and settlement device 50, the settlement device 51, etc.) and each device outside the LAN 19 (e.g., the headquarters server 10). For example, the store controller 30 receives a product master and a sale file from the headquarters server 10 and provides them to the registration and settlement device 50 and the settlement device 51.

[0017] The transaction status management device 40 is a device that mainly manages (monitors and controls) devices within the store. For example, the transaction status management device 40 communicates with each device within the LAN 19 and monitors the processing status, operating status, etc. of each device within the LAN 19. The transaction status management device 40 may also communicate (directly or via the store controller 30) with devices outside the store (e.g., the headquarters server 10, the cloud server 20) and refer to transaction information (cart information) stored in the cloud server 20, for example.

[0018] (Registration settlement device 50) FIG. 2 shows an example of the appearance of the registration and settlement device 50. FIG. 2(A) is a perspective view seen from the customer side. FIG. 2(B) is a perspective view seen from the side closer to the store clerk side. FIG. 3 shows an example of the configuration of the registration and settlement device 50. In FIG. 2 and FIG. 3, the same parts are given the same symbols.

[0019] An example of the configuration of the registration and settlement device 50 shown in Figure 3 will be described below with reference to Figure 2. The registration and settlement device 50 includes a CPU 201, a ROM 202, a RAM 203, a hard disk 204, a customer display unit 205, a distance sensor unit 206, a customer scanner unit 207, a card payment unit (non-cash payment unit) 208, a change dispenser (cash payment unit) 209, a store clerk display unit 210, a key operation unit 211, a store clerk scanner unit 212, a printing unit 213, an audio output unit 214, a communication unit 215, an imaging unit 216, and a sign pole 217. These can communicate with each other via a bus.

[0020] The CPU 201 is a central processing unit that controls the operation of the registration and settlement device 50 by reading and executing programs stored in the ROM 202 . The ROM 122 is a read-only memory that stores various types of information used by the CPU 201, including programs.

[0021] The RAM 203 is a read / write memory that stores various information as a main storage device, such as information read from the ROM 202 or the hard disk 204, information acquired from the outside, and information generated during processing.

[0022] The hard disk 204 stores various information as an auxiliary storage device. For example, the hard disk 204 may store programs executed by the CPU 201, instead of the ROM 202. The hard disk 204 may store information read from the ROM 202, information obtained from the outside, information generated during processing, etc., instead of the RAM 203. Note that the hard disk 204 may be replaced by a storage device such as an SSD (Solid State Drive).

[0023] The customer-side display unit 205 displays various information to customers. The customer-side display unit 205 also has a built-in touch sensor (e.g., a capacitance sensor). The touch sensor detects input operations made by touching the display screen displayed by the customer-side display unit 205.

[0024] Distance (distance measurement) sensor unit 206 (e.g., an infrared sensor) is installed outside (on the frame of) the display screen of customer-side display unit 205, and detects non-contact input operations on the display screen displayed by customer-side display unit 205. Details of distance sensor unit 206 will be described later.

[0025] The customer-side scanner unit 207 is a scanner unit for customers, and optically reads various information. Specifically, the customer-side scanner unit 207 scans codes attached to products and reads product codes (JAN codes, etc.). The customer-side scanner unit 207 may also scan codes attached to gift certificates and various cards and read the respective information. The customer-side scanner unit 207 may also scan codes attached to store clerk name tags, etc., and read store clerk codes. The customer-side scanner unit 207 may also scan codes printed on receipts (registered trademark) printed and issued by other devices (such as other registered settlement devices 50) and read the information required for settlement processing.

[0026] Although the customer-side scanner unit 207 is used when a customer registers a product, the customer may register the product by other methods. For example, if a preset button (preset key) corresponding to the product is displayed on the customer-side display unit 205, the customer may operate the preset button to register the product.

[0027] The card settlement unit 208 is a settlement mechanism that accepts various cards (credit cards, prepaid cards such as transportation cards, cash cards for debit payments, point cards for point payments, etc.). The card settlement unit 208 may be composed of multiple components according to the cards to be read. In other words, the registration and settlement device 50 may be equipped with multiple card settlement units 208, such as a first card settlement unit 208a for prepaid cards and a second card settlement unit 208b for credit cards.

[0028] The change dispenser 209 is a cash settlement mechanism that has an input port for banknotes and coins and an output port for banknotes and coins, calculates the amount of money inserted into the input port, calculates the change amount, which is the difference between the input amount and the purchase amount, and outputs the change from the output port. When banknotes or coins are inserted into the input port, they are detected by a sensor (detecting that they have been inserted, the number of coins by denomination, etc.).

[0029] The store clerk display unit 210 displays various information to the store clerk. The store clerk display unit 210 also has a built-in touch sensor (e.g., a capacitance sensor). The touch sensor detects input operations made by touching the display screen displayed by the customer display unit 205.

[0030] The key operation unit 211 has various buttons (for example, an operation mode switching button for switching between operation modes) arranged thereon that are operated by a store clerk.

[0031] The clerk scanner unit 212 is a scanner unit for use by clerks, and optically reads various information. Specifically, the clerk scanner unit 212 scans codes attached to products and reads product codes (JAN codes, etc.). The clerk scanner unit 212 may also scan codes attached to gift certificates and various cards and read the respective information. The clerk scanner unit 212 may also scan codes attached to the clerk's name tag, etc., and read the clerk code. The clerk scanner unit 212 may also scan codes printed on receipts and read the information required for payment processing.

[0032] Although the store clerk's scanner unit 212 is used when the store clerk registers a product, the store clerk may register the product by other methods. For example, if a key corresponding to a product (such as a key corresponding to a sports newspaper) is arranged on the key operation unit 211, the store clerk may operate (press) that key to register the product. Also, if a preset button corresponding to a product is displayed on the store clerk's display unit 210, the store clerk may operate that preset button to register the product.

[0033] The printing unit 213 prints and issues various media (receipts, bills, etc.). The printing unit 213 can be rotated to face from the store clerk side to the customer side, or from the customer side to the store clerk side (the direction of the media issuing port). The orientation of the printing unit 213 may be changed manually, or may be changed automatically (mechanically controlled, etc.) based on, for example, a change in operating mode. The audio output unit 214 outputs audio. For example, the audio output unit 214 outputs a confirmation sound, a warning sound, audio guidance, and the like. The communication unit 215 transmits and receives information to and from other devices (for example, the store controller 30, the transaction status management device 40, etc.).

[0034] The imaging unit 216 captures, for example, an image of the operator (customer). The registration and settlement device 50 may be equipped with two or more imaging units 216, and may simultaneously capture images of the face and hands (near the insertion slot and ejection slot of the change dispenser 209). The sign pole 217 has a light emitting part at the tip, and notifies various information (such as calling a store clerk, operating status, etc.) depending on the light emitting mode of the light emitting part.

[0035] The registration and settlement device 50 may further include a human sensor or the like that detects the presence of an operator (customer, store clerk).

[0036] (Operation mode of the registration settlement device 50) As described above, the registration and settlement device 50 has multiple operation modes. The operation modes are described below. In the above, it has been explained that the registration and settlement device 50 switches operation modes based on the operation of the operation mode switching button, but the operation mode may also be switched based on, for example, the passage of time, the reception of registration information, the reading of a store clerk code, the reception of an operation mode switching command sent from another device, etc.

[0037] (Face-to-face mode) The face-to-face mode (also referred to as face-to-face semi-self mode or normal mode) is an operating mode in which a store clerk registers products using one side (the store clerk side) of the registration and settlement device 50, and the customer settles the payment using the other side (the customer side) of the registration and settlement device 50. Therefore, when the operating mode is the face-to-face mode, the store clerk and the customer meet face to face, the store clerk registers the products, and the customer settles the payment.

[0038] (Full selfie mode) The full self-service mode is an operating mode in which a customer registers products and pays for them using one side (customer side) of the registration and settlement device 50. Therefore, when the operating mode is the full self-service mode, the customer registers products and pays for them using the customer side (without using the store clerk side).

[0039] (Registration only mode) The registration-only mode (also referred to as the multiple-machine semi-self-service registration mode) is an operating mode in which a store clerk registers products using one side (the store clerk side) of the registration and settlement device 50. Therefore, when the operating mode is the registration-only mode, the store clerk registers products using the store clerk side (without using the customer side).

[0040] (Settlement only mode) The settlement-only mode (also referred to as the multiple-machine semi-self-service settlement mode) is an operating mode in which a customer settles a bill using one side (customer side) of the registered settlement device 50. Therefore, when the operating mode is the settlement-only mode, the customer settles a bill using the customer side (without using the store clerk side).

[0041] A registered settlement device 50 in registration-only mode sends registration information to another registered settlement device 50 (specifically, a registered settlement device 50 in settlement-only mode) (either indirectly via another device or directly), thereby causing the other registered settlement device 50 (registered settlement device 50 in settlement-only mode) to settle the payments for the products registered by that registered settlement device 50 (registered settlement device 50 in registration-only mode). In other words, a registered settlement device 50 in settlement-only mode receives (either indirectly via another device or directly) the registration information sent by the other registered settlement device 50 (specifically, a registered settlement device 50 in registration-only mode), thereby settling the payments for the products registered by the other registered settlement device 50 (registered settlement device 50 in registration-only mode).

[0042] A registered settlement device 50 in registration-only mode may issue a receipt and have another registered settlement device 50 (registered settlement device 50 in settlement-only mode) settle the payment for products registered by that registered settlement device 50 (registered settlement device 50 in registration-only mode). In other words, a registered settlement device 50 in settlement-only mode may settle the payment for products registered by another registered settlement device 50 (registered settlement device 50 in registration-only mode) by reading a code printed on a receipt issued by the other registered settlement device 50 (registered settlement device 50 in registration-only mode).

[0043] Note that the operations in each operation mode described above are merely examples. For example, a registered settlement device 50 in registration-only mode may send registration information to a registered settlement device 50 in face-to-face mode or a registered settlement device 50 in full self-service mode, or may issue a receipt. In other words, a registered settlement device 50 in face-to-face mode (as well as a registered settlement device 50 in full self-service mode) may settle the payment for products registered by the registered settlement device 50 in registration-only mode. For example, a registered settlement device 50 in face-to-face mode may send registration information to a registered settlement device 50 in full self-service mode or a registered settlement device 50 in settlement-only mode, or may issue a receipt. In other words, a registered settlement device 50 in full self-service mode (as well as a registered settlement device 50 in settlement-only mode) may settle the payment for products registered by a registered settlement device 50 in face-to-face mode. For example, a registered settlement device 50 in face-to-face mode may send registration information to another registered settlement device 50 in face-to-face mode, or may issue a receipt. In other words, a registration and settlement device 50 in face-to-face mode may settle the payment for products registered by another registration and settlement device 50 in face-to-face mode.

[0044] 4 is a diagram illustrating input operations on the customer-side display unit 205 and the clerk-side display unit 210. As described above, the customer-side display unit 205 has a built-in touch sensor that detects input operations made by touching the display screen, and a distance sensor unit 206 that detects input operations made by non-contact on the display screen is provided on the outside of the customer-side display unit 205. On the other hand, the clerk-side display unit 210 has a built-in touch sensor that detects input operations made by touching the display screen, but does not have a distance sensor unit such as the one described above on the outside of the clerk-side display unit 210. Therefore, as shown in FIG. 4, it is possible to detect contact operations on the display screen of the customer-side display unit 205 using the touch sensor and to detect non-contact operations using the distance sensor unit 206, and it is possible to detect contact operations on the display screen of the clerk-side display unit 210 using the touch sensor. In other words, both the customer-side display unit 205 and the store clerk-side display unit 210 can accept contact input, which is an input method that involves touching the display screen, but the customer-side display unit 205 can also accept non-contact input, which is an input method that does not involve touching the display screen, in addition to contact input.

[0045] 5 is a diagram illustrating distance sensor unit 206. As shown in FIG. 5(A), customer-side display unit 205 has a vertically long display screen (designated by symbol A in the figure). Distance sensor unit 206 has a length approximately equal to the height of display screen A, and is installed on the left side of display screen A (the left side of display screen A as viewed from the customer operating display screen A). By installing it on the left side of display screen A, it does not interfere with the movement of eyes or hands between it and card payment unit 208, which is installed on the right side of display screen A.

[0046] Distance sensor unit 206 has a plurality of infrared light emitters (not shown) arranged in the longitudinal direction (height direction of display screen A) and a plurality of infrared light receivers (not shown) corresponding to the respective infrared light emitters. As shown in FIG. 5(B), each infrared light emitter emits (emits) infrared light in the width direction of display screen A, in the space in front of display screen A (a space a predetermined distance from display screen A (e.g., a space about several centimeters away in the normal direction of display screen A). Note that FIG. 5(B) shows the upper left corner of customer-side display unit 205. Each infrared light receiver mainly receives reflected light of infrared light emitted from its corresponding infrared light emitter. In other words, if an object (such as a finger of a customer who is the operator) is present on the optical path of infrared light emitted from a certain infrared light emitter, the infrared light is reflected by the object and is mainly received by the infrared light receiver corresponding to that infrared light emitter.

[0047] When an obstruction is present in the space in front of a certain position (position in the height direction Y and width direction X of the display screen A) of the display screen A, the distance sensor unit 206 detects that position of the display screen A. Specifically, the distance sensor unit 206 identifies the height direction Y based on the position of the infrared receiving unit that received the reflected light, and identifies the width direction X by evaluating the received reflected light (for example, calculating the distance to the obstruction using a conversion formula between intensity and distance, etc.).

[0048] FIG. 6 is a diagram for explaining the status (operation status) of an operation by an operator on the customer-side display unit 205. FIG. 6(A) is a schematic diagram showing a detection surface (display screen) A that detects a touch operation by the operator (customer), and a detection space B that detects a non-touch operation by the operator. The detection surface A is the display screen A of the customer-side display unit 205. A touch operation on the detection surface (display screen) A is detected by a touch sensor of the customer-side display unit 205. A non-touch operation on the detection space B is detected by the distance sensor unit 206.

[0049] 6(B) to 6(E) are schematic diagrams showing classifications of operation situations of the operator on the customer-side display unit 205. FIG. 6(F) summarizes each operation situation (operation situations 1 to 3) shown in FIG. 6(B) to 6(E). Operation situation 1 shown in FIG. 6(B) is an operation situation in which the customer's finger or the like (hereinafter referred to as the finger) has not reached detection space B. In other words, as summarized in FIG. 6(F), operation situation 1 is an operation situation in which the finger is not present in detection space B and is not in contact with detection surface A. Operation situation 2 shown in FIG. 6(C) and FIG. 6(D) is an operation situation in which the finger has reached detection space B but has not reached detection surface A. In other words, as summarized in FIG. 6(F), operation situation 2 is an operation situation in which the finger is present in detection space B but is not in contact with detection surface A. Operation situation 3 shown in FIG. 6(E) is a situation in which the finger has reached detection surface A. That is, as summarized in FIG. 6(F), operation situation 3 is an operation situation in which the finger is present in detection space B and also in contact with detection surface A.

[0050] Note that, unlike operation situations 2 and 3, operation situation 1 has a finger outside the detection space B, and therefore, as shown in FIG. 6(F), the operation in operation situation 1 may be referred to as an operation outside the detection space (simply referred to as "outside the detection space" in FIG. 6(F)). Also, unlike operation situations 1 and 2, operation situation 3 has a finger on the detection surface A, and therefore, as shown in FIG. 6(F), the operation in operation situation 3 may be referred to as an operation on the detection surface (simply referred to as "on the detection surface" in FIG. 6(F)). Also, to distinguish operation situation 2 from operation situation 1 (outside the detection space) and operation situation 3 (on the detection surface), as shown in FIG. 6(F), it may be referred to as an operation within the detection space (simply referred to as "inside the detection space" in FIG. 6(F)).

[0051] (Method for detecting registered settlement device 50) The registration and settlement device 50 has a plurality of operation detection modes (sometimes simply referred to as detection modes) as an operation detection method (sometimes simply referred to as detection method) for detecting operations (contact operation, non-contact operation) on the customer side display unit 205. The registration and settlement device 50 also has a plurality of input methods (input modes) corresponding to the detection methods (detection modes) as an operation input method (sometimes simply referred to as input method) on the customer side display unit 205. The detection modes and input modes correspond to each other.

[0052] Fig. 7 is a diagram for explaining detection modes (input modes) and the like. In Fig. 7, "Non-contact detection unit: ON" indicates that non-contact detection is performed by the distance sensor unit 206. "Non-contact detection unit: OFF" indicates that non-contact detection is not performed by the distance sensor unit 206 (for example, the module related to the distance sensor unit 206 is stopped). "Contact detection unit: ON" indicates that contact detection is performed by the touch sensor. "Contact detection unit: OFF" indicates that contact detection is not performed by the touch sensor (for example, the module related to the touch sensor is stopped).

[0053] (Non-contact detection mode (non-contact operation dedicated input mode)) Fig. 7(A) is a diagram illustrating a non-contact detection mode, which is one of the detection modes. The non-contact detection mode corresponds to a non-contact operation dedicated input mode, which is one of the input modes. In the non-contact detection mode, as shown in Fig. 7(A), non-contact detection is performed by the non-contact detection unit (distance sensor unit 206), but contact detection is not performed by the contact detection unit (touch sensor).

[0054] In FIG. 7(A), the row marked with the symbol a indicates whether or not there is detection (non-contact detection) by the non-contact detection unit. In operation situation 1 (outside the detection space), the non-contact detection unit does not detect a finger (indicated as "no detection" in the figure). In operation situation 2 (inside the detection space) and operation situation 3 (on the detection surface), the non-contact detection unit detects a finger (indicated as "detected" in the figure). Note that in operation situation 1, because the finger has not reached the detection space, the non-contact detection unit cannot detect the finger, regardless of whether or not non-contact detection is performed by the non-contact detection unit. The same is true for the other detection modes.

[0055] In FIG. 7(A), the row marked with the symbol b indicates whether or not there is detection (contact detection) by the contact detection unit. As in operation situations 1 and 2, the contact detection unit does not detect a finger in operation situation 3. Note that in operation situations 1 and 2, the finger does not reach the operation surface, so the contact detection unit cannot detect a finger regardless of whether or not contact detection is performed by the contact detection unit. The same is true for other detection modes.

[0056] In Fig. 7(A), the row marked with symbol c indicates whether or not input (contactless input, contact input) is accepted. In the contactless detection mode, input is not accepted in operation situation 1 (indicated as "no input" in the figure), but contactless input is accepted in operation situations 2 and 3 (indicated as "input accepted (contactless input)" in the figure). In other words, in the contactless detection mode, contact detection is not performed by the contact detection unit, so in operation situation 3, contactless input by the contactless detection unit is accepted, not contact input by the contact detection unit.

[0057] (Contact detection mode (contact operation-only input mode)) 7(B) is a diagram illustrating the contact detection mode, which is one of the detection modes. The contact detection mode corresponds to the contact operation-only input mode, which is one of the input modes. In the contact detection mode, as shown in FIG. 7(B), non-contact detection by the non-contact detection unit (distance sensor unit 206) is not performed, but contact detection by the contact detection unit (touch sensor) is performed.

[0058] 7B, the row marked with the symbol d indicates whether or not there is detection by the non-contact detection unit (non-contact detection). As in operation situation 1, the non-contact detection unit does not detect a finger in operation situations 2 and 3.

[0059] In Fig. 7(B), the row marked with symbol e indicates whether or not there is detection (contact detection) by the contact detection unit. In operation situation 1 and operation situation 2, the contact detection unit does not detect a finger. In operation situation 3, the contact detection unit detects a finger.

[0060] In Fig. 7(B), the row marked with symbol f indicates whether or not input (contactless input, contact input) is accepted. In contactless detection mode, input is not accepted in operation situation 1 or operation situation 2 (indicated as "no input" in the figure), but contact input is accepted in operation situation 3 (indicated as "input accepted (contact input)" in the figure). In other words, in contact detection mode, contactless detection is not performed by the contactless detection unit, so contactless input by the contactless detection unit is not accepted in operation situation 2.

[0061] (First combined detection mode (non-contact operation priority input mode)) 7(C) is a diagram illustrating a first combined detection mode, which is one of the detection modes. The first combined detection mode corresponds to a non-contact operation priority input mode, which is one of the input modes. In the first combined detection mode, as shown in FIG. 7(C), both non-contact detection by the non-contact detection unit (distance sensor unit 206) and contact detection by the contact detection unit (touch sensor) are performed.

[0062] In Fig. 7(C), the row marked with symbol g indicates whether or not there is detection by the non-contact detection unit (non-contact detection). The row marked with symbol g in Fig. 7(C) is the same as the row marked with symbol a in Fig. 7(A), so a description thereof will be omitted.

[0063] In Fig. 7(C), the row marked with the symbol h indicates whether or not there is detection (contact detection) by the contact detection unit. The row marked with the symbol h in Fig. 7(C) is the same as the row marked with the symbol e in Fig. 7(B), and therefore a description thereof will be omitted.

[0064] In Fig. 7(C), the row marked with the symbol i indicates whether or not input (contactless input, contact input) is accepted. In the first combined detection mode, input is not accepted in operation situation 1 (indicated as "no input" in the figure), but contactless input is accepted in operation situations 2 and 3 (indicated as "input accepted (contactless input)" in the figure). In other words, in the first combined detection mode, both contactless detection by the contactless detection unit and contact detection by the contact detection unit are performed, but contact detection by the contact detection unit is not reflected in the input (because, as will be described later, contact detection by the contact detection unit is used to control the transition to contact detection mode), so contactless input by the contactless detection unit is accepted in operation situation 3, not contact input by the contact detection unit.

[0065] In the first combined detection mode, if detection (contact detection) by the contact detection unit in operation situation 3 continues for a certain period of time, the mode transitions to the contact detection mode. That is, as described above, in the first combined detection mode, detection by the contact detection unit is not reflected in the input, but the transition to the contact detection mode is controlled by the detection by the contact detection unit. Note that if detection (contact detection) by the contact detection unit in operation situation 3 continues for a certain period of time, the mode may transition to the second combined detection mode instead of the contact detection mode.

[0066] (Second combined detection mode (touch operation priority input mode)) 7(D) is a diagram illustrating the second combined detection mode, which is one of the detection modes. The second combined detection mode corresponds to the contact operation priority input mode, which is one of the input modes. In the second combined detection mode, as shown in FIG. 7(D), both non-contact detection by the non-contact detection unit (distance sensor unit 206) and contact detection by the contact detection unit (touch sensor) are performed.

[0067] In Fig. 7(D), the row marked with the symbol j indicates whether or not there is detection by the non-contact detection unit (non-contact detection). The row marked with the symbol j in Fig. 7(D) is the same as the row marked with the symbol a in Fig. 7(A) (the row marked with the symbol g in Fig. 7(C)), so a description thereof will be omitted.

[0068] In Fig. 7(D), the row marked with symbol k indicates whether or not there is detection (contact detection) by the contact detection unit. The row marked with symbol k in Fig. 7(D) is the same as the row marked with symbol e in Fig. 7(B) (the row marked with symbol h in Fig. 7(C)), and therefore a description thereof will be omitted.

[0069] In Fig. 7(D), the row marked with the symbol l indicates whether or not input (contactless input, contact input) is accepted. In the second combined detection mode, input is not accepted in operation situation 1 or operation situation 2 (indicated as "no input" in the figure), but contact input is accepted in operation situation 3 (indicated as "input accepted (contact input)" in the figure). In other words, in the second combined detection mode, both contactless detection by the contactless detection unit and contact detection by the contact detection unit are performed, but contactless detection by the contactless detection unit is not reflected in the input (because contactless detection by the contactless detection unit is used to control the transition to contactless detection mode, as will be described later), so contactless input by the contactless detection unit is not accepted in operation situation 2.

[0070] In the second combined detection mode, if detection by the non-contact detection unit (non-contact detection) in operation situation 2 continues for a certain period of time, the mode transitions to the non-contact detection mode. In other words, as described above, in the second combined detection mode, detection by the non-contact detection unit is not reflected in the input, but the transition to the non-contact detection mode is controlled by detection by the non-contact detection unit. Note that if detection by the non-contact detection unit (non-contact detection) in operation situation 2 continues for a certain period of time, the mode may transition to the first combined detection mode instead of the non-contact detection mode.

[0071] Four types of detection modes (non-contact detection mode, contact detection mode, first combined detection mode, second combined detection mode) have been described above using Fig. 7. In other words, four types of input modes (non-contact operation-only input mode, contact operation-only input mode, non-contact operation priority input mode, contact operation priority input mode) have been described.

[0072] Although the registration and settlement device 50 has been described as having four detection modes (input modes), the registration and settlement device 50 may have multiple detection modes (input modes) and may not implement all four of the detection modes (input modes). For example, the registration and settlement device 50 may implement two detection modes (input modes): the non-contact detection mode (non-contact operation-only input mode) shown in FIG. 7(A) and the contact detection mode (contact operation-only input mode) shown in FIG. 7(B). Alternatively, the registration and settlement device 50 may implement two detection modes (input modes): the non-contact detection mode (non-contact operation-only input mode) shown in FIG. 7(A) and the second combined detection mode (contact operation-prioritized input mode) shown in FIG. 7(D). Alternatively, the registration and settlement device 50 may implement two detection modes (input modes): the first combined detection mode (non-contact operation-prioritized input mode) shown in FIG. 7(C) and the contact detection mode (contact operation-only input mode) shown in FIG. 7(B). Alternatively, the registration and settlement device 50 may implement two detection modes (input modes): a first combined detection mode (non-contact operation priority input mode) shown in Figure 7(C) and a second combined detection mode (contact operation priority input mode) shown in Figure 7(D). Alternatively, the registration and settlement device 50 may not implement all four detection modes (input modes). The same applies to the other devices described below (the settlement device 51, the weighing and pricing device 70, and the printer 80).

[0073] The "non-contact detection mode" described in Fig. 7(A) and the "first combined detection mode" described in Fig. 7(C) are both detection modes that support non-contact input. The "contact detection mode" described in Fig. 7(B) and the "second combined detection mode" described in Fig. 7(D) are both detection modes that support non-contact input.

[0074] Note that the "non-contact operation dedicated input mode" described in Fig. 7(A) and the "non-contact operation priority input mode" described in Fig. 7(C) are both input modes that accept non-contact input. In the following description, when there is no need to distinguish between the "non-contact operation dedicated input mode" and the "non-contact operation priority input mode," they may be referred to as the "non-contact input mode." The "priority" in the "non-contact operation priority input mode" described in Fig. 7(C) indicates that both non-contact and contact operations are detected, but the non-contact operation is reflected as the input.

[0075] Furthermore, the "touch operation-only input mode" described in Fig. 7(B) and the "touch operation priority input mode" described in Fig. 7(D) are both input modes that accept contact input. In the following description, when there is no need to distinguish between the "touch operation-only input mode" and the "touch operation priority input mode," they may be referred to as the "contact input mode." The "priority" in the "touch operation priority input mode" described in Fig. 7(D) indicates that both non-touch operations and contact operations are detected, but contact operations are reflected as input.

[0076] 8 to 10 are flowcharts showing an example of the operation of the registration and settlement device 50. Specifically, the flowchart in FIG. 8(A) shows the operation related to a contactless input to the customer-side display unit 205 in the contactless detection mode (contactless operation-only input mode). The flowchart in FIG. 8(B) shows the operation related to a contact input to the customer-side display unit 205 in the contact detection mode (contact operation-only input mode). The flowchart in FIG. 9 shows the operation related to a contactless input to the customer-side display unit 205 in the first combined detection mode (contactless operation-priority input mode). The flowchart in FIG. 10 shows the operation related to a contact input to the customer-side display unit 205 in the second combined detection mode (contact operation-priority input mode). The above-mentioned flowcharts are started as appropriate (repeatedly started when the device is in an operable state).

[0077] (Flowchart of Figure 8(A)) Step S1: The registration and settlement device 50 (distance sensor unit 206) determines whether or not a non-contact operation (operation in operation status 2 or operation status 3) has been detected on the customer-side display unit 205. If a non-contact operation has been detected (step S1: YES), the process proceeds to step S2. If a non-contact operation has not been detected (step S1: NO), the process ends.

[0078] Step S2: The registration and settlement device 50 (CPU 201, distance sensor unit 206, etc.) determines whether or not the non-contact operation corresponds to an input area on the display screen (for example, the display area of a button) (a non-contact operation in the detection space on the front side (normal direction) of the detection surface on which the button is displayed). In other words, the registration and settlement device 50 determines whether or not the non-contact operation detected in step S1 is a non-contact operation performed on the front side of the button. If it is a non-contact operation corresponding to the input area (step S2: YES), proceed to step S10. If it is not a non-contact operation corresponding to the input area (step S2: NO), this flowchart ends.

[0079] Step S10: The registration and settlement device 50 (CPU 201) accepts a contactless input. For example, the registration and settlement device 50 accepts the contactless operation detected in step S1 as an operation on a button displayed in a position corresponding to the contactless operation. Then, this flowchart ends.

[0080] According to the flowchart of Figure 8(A), the registered settlement device 50 in non-contact detection mode (non-contact operation only input mode) does not accept input in operation status 1, as shown in Figure 7(A), but accepts non-contact input in operation status 2 and operation status 3.

[0081] (Flowchart in Figure 8(B)) Step S3: The registration and settlement device 50 (touch sensor) determines whether or not a touch operation (operation of operation status 3) on the customer side display unit 205 has been detected. If a touch operation has been detected (Step S3: YES), proceed to Step S11. If a touch operation has not been detected (Step S3: NO), this flowchart ends.

[0082] Step S4: The registration and settlement device 50 (CPU 201, touch sensor, etc.) determines whether the touch operation (touch operation on the detection surface on which the button is displayed) corresponds to an input area on the display screen (for example, a button display area). In other words, the registration and settlement device 50 determines whether the touch operation detected in step S3 is a touch operation on a button. If the touch operation corresponds to the input area (step S4: YES), proceed to step S11. If the touch operation does not correspond to the input area (step S4: NO), this flowchart ends.

[0083] Step S11: The registration and settlement device 50 (CPU 201) accepts a touch input. For example, the registration and settlement device 50 accepts the touch operation detected in step S3 as an operation on a button displayed at a position corresponding to the touch operation. Then, this flowchart ends.

[0084] According to the flowchart in Figure 8(B), the registered settlement device 50 in contact detection mode (contact operation-only input mode) does not accept input in operation status 1 or operation status 2 (shown as "no input" in the figure), as shown in Figure 7(B), but does accept contact input in operation status 3.

[0085] (Flowchart in Figure 9) 9, the mode switching counter is a counter (for example, a counter value stored in RAM 203) that counts the number of consecutive non-touch operations corresponding to the input area in operation status 3. Specifically, the mode switching counter counts the number of consecutive non-touch operations corresponding to the input area in step S52 (YES) (step S63).

[0086] Step S21: As in step S1 of FIG. 8(A), the registration and settlement device 50 (distance sensor unit 206) determines whether or not a non-contact operation has been detected on the customer-side display unit 205. If a non-contact operation has been detected (step S21: YES), the process proceeds to step S23. If a non-contact operation has not been detected (step S21: NO), the process ends.

[0087] Step S23: As in step S3 of Figure 8 (B), the registration and settlement device 50 (touch sensor) determines whether or not a touch operation on the customer side display unit 205 has been detected. If a touch operation has been detected (step S23: YES), proceed to step S52. If a touch operation has not been detected (step S23: NO), proceed to step S32.

[0088] Step S32: The registration and settlement device 50 (CPU 201, distance sensor unit 206, etc.) determines whether the non-touch operation corresponds to an input area on the display screen, similar to step S2 in FIG. 8(A). If the non-touch operation corresponds to an input area (step S32: YES), proceed to step S40. If the non-touch operation does not correspond to an input area (step S32: NO), this flowchart ends.

[0089] Step S40: The registration and settlement device 50 (CPU 201) accepts the non-contact input, as in step S10 of Figure 8 (A). That is, the registration and settlement device 50 accepts the non-contact operation detected in step S21 as an operation on the button displayed in the position corresponding to the non-contact operation. Then, proceed to step S42.

[0090] Step S42: The registration and settlement device 50 (CPU 201) initializes the value of the mode switching counter (substitutes 0 into the counter value), and then this flowchart ends.

[0091] Step S52: As in step S32, the registration and settlement device 50 (CPU 201, touch sensor, etc.) determines whether the non-touch operation corresponds to an input area on the display screen. If the non-touch operation corresponds to an input area (step S52: YES), proceed to step S60. If the non-touch operation does not correspond to an input area (step S52: NO), this flowchart ends.

[0092] Step S60: The registration and settlement device 50 (CPU 201) accepts the non-contact input, as in step S40. That is, the registration and settlement device 50 accepts the non-contact operation detected in step S21 as an operation on the button displayed in the position corresponding to the non-contact operation. Then, the process proceeds to step S63.

[0093] Step S63: The registration settlement device 50 adds 1 to the value of the mode switching counter, and then proceeds to step S64. Step S64: The registration and settlement device 50 determines whether the value of the mode switching counter is equal to or greater than a predetermined number (e.g., 3). That is, the registration and settlement device 50 determines whether the non-touch operation corresponding to the input area in operation status 3 has been performed a predetermined number of times (e.g., 3 times) or more in succession. If the value of the mode switching counter is equal to or greater than the predetermined number (step S64: YES), proceed to step S65. If the value of the mode switching counter is less than the predetermined number (step S64: NO), this flowchart ends.

[0094] Step S65: The registration and settlement device 50 initializes the value of the mode switching counter (substitutes 0 into the counter value), and then proceeds to step S66. Step S66: The registration and settlement device 50 shifts from the first combined detection mode to the contact detection mode. Then, this flowchart ends. After shifting to the contact detection mode, the flowchart shown in Figure 8(B) is executed.

[0095] According to the flowchart in Fig. 9, the registered settlement device 50 in the first combined detection mode (non-contact operation priority input mode) does not accept input in operation situation 1, as shown in Fig. 7(C), but accepts non-contact input in operation situation 2 and operation situation 3. Furthermore, if detection (contact detection) by the contact detection unit in operation situation 3 occurs a certain number of times in succession (three times in succession in the flowchart in Fig. 9), the device transitions to contact detection mode (contact operation-only input mode).

[0096] (Flowchart in Figure 10) 10, the mode switching counter is a counter (for example, a counter value stored in RAM 203) that counts the number of consecutive non-touch operations corresponding to the input area in operation status 2. Specifically, the mode switching counter counts the number of consecutive non-touch operations corresponding to the input area in step S132 (YES) (step S143).

[0097] Step S121: As in step S1 of FIG. 8(A), the registration and settlement device 50 (distance sensor unit 206) determines whether or not a non-contact operation has been detected on the customer-side display unit 205. If a non-contact operation has been detected (step S121: YES), the process proceeds to step S123. If a non-contact operation has not been detected (step S121: NO), the process ends.

[0098] Step S123: As in step S3 of Figure 8 (B), the registration and settlement device 50 (touch sensor) determines whether or not a touch operation on the customer-side display unit 205 has been detected. If a touch operation has been detected (step S123: YES), proceed to step S154. If a touch operation has not been detected (step S123: NO), proceed to step S132.

[0099] Step S132: The registration and settlement device 50 (CPU 201, distance sensor unit 206, etc.) determines whether the non-touch operation corresponds to an input area on the display screen, similar to step S2 in FIG. 8(A). If the non-touch operation corresponds to an input area (step S132: YES), proceed to step S143. If the non-touch operation does not correspond to an input area (step S132: NO), this flowchart ends.

[0100] Step S143: The registration settlement device 50 adds 1 to the value of the mode switching counter, and then proceeds to step S144. Step S144: The registration and settlement device 50 determines whether the value of the mode switching counter is equal to or greater than a predetermined number (e.g., 3). That is, the registration and settlement device 50 determines whether the non-touch operation corresponding to the input area in operation status 2 has been performed a predetermined number of times (e.g., 3 times) or more in succession. If the value of the mode switching counter is equal to or greater than the predetermined number (step S144: YES), proceed to step S145. If the value of the mode switching counter is less than the predetermined number (step S144: NO), this flowchart ends.

[0101] Step S145: The registration settlement device 50 initializes the value of the mode switching counter (substitutes 0 into the counter value), and then proceeds to step S146. Step S146: The registration and settlement device 50 shifts from the second combined detection mode to the non-contact detection mode. Then, this flowchart ends. After shifting to the non-contact detection mode, the flowchart shown in Figure 9(A) is executed.

[0102] Step S154: The registration and settlement device 50 (CPU 201, touch sensor, etc.) determines whether the touch operation corresponds to an input area on the display screen, similar to step S4 in Figure 8 (B). If the touch operation corresponds to an input area (step S154: YES), proceed to step S161. If the touch operation does not correspond to an input area (step S154: NO), this flowchart ends.

[0103] Step S161: The registration and settlement device 50 (CPU 201) accepts the touch input, as in step S11 of Figure 9 (B). That is, the registration and settlement device 50 accepts the touch operation detected in step S123 as an operation on the button displayed at the position corresponding to the touch operation. Then, proceed to step S162. Step S162: The registration and settlement apparatus 50 (CPU 201) initializes the value of the mode switching counter (substitutes 0 into the counter value), and then this flowchart ends.

[0104] According to the flowchart in Fig. 10, the registered settlement device 50 in the second combined detection mode (contact operation priority input mode) does not accept input in operation status 1 or operation status 2, as shown in Fig. 7(D), but accepts contact input in operation status 3. Furthermore, if detection (contactless detection) by the contactless detection unit in operation status 2 occurs a certain number of times in succession (three times in succession in the flowchart in Fig. 10), the device transitions to contactless detection mode (contactless operation-only input mode).

[0105] Next, the display on the registration and settlement device 50 (customer side display unit 205) will be described using Figures 11 to 14. For ease of explanation, in Figures 11 to 14, it is assumed that the registration and settlement device 50 has two input modes (detection modes): a non-contact operation-only input mode (non-contact detection mode) and a contact operation-only input mode (contact detection mode).

[0106] 11 to 13 are examples of displays on the registration and settlement device 50. Specifically, FIG. 11 is an example of a registration screen displayed on the customer display unit 205. FIG. 12 is an example of a shopping bag purchase screen displayed on the customer display unit 205. FIG. 13 is an example of a payment method (settlement method) selection screen displayed on the customer display unit 205. It is assumed that the operation mode of the registration and settlement device 50 is full self-service mode.

[0107] Fig. 11(A) is an example of a registration screen displayed on the customer side display unit 205 when in the contact operation-only input mode. Fig. 11(B) is an example of a registration screen displayed on the customer side display unit 205 when in the non-contact operation-only input mode. Below, the registration screens shown in Fig. 11(A) and Fig. 11(B) will be explained starting from the top of the screen.

[0108] An input method display area HR11 showing the input method (contact input / contactless input) is provided on the upper left side of the registration screen. When the touch-only input mode is selected, "contact input" is displayed in the input method display area HR11, as shown in Fig. 11(A). When the non-contact-only input mode is selected, "non-contact input" is displayed in the input method display area HR11, as shown in Fig. 11(B).

[0109] A message MS12 about the input method is displayed below the input method display area HR11. When the touch-only input mode is selected, the message MS12 displays the message "Please operate the buttons by touching them," as shown in Fig. 11(A). When the non-contact-only input mode is selected, the message MS12 displays the message "Please operate the buttons without touching them," as shown in Fig. 11(B).

[0110] An input method switching button BT13 for switching the input method (input mode) is provided on the upper right side of the registration screen. The input method switching button BT13 displayed in the non-contact operation dedicated input mode (input method switching button BT13 in FIG. 11(B)) is larger than the input method switching button BT13 displayed in the contact operation dedicated input mode (input method switching button BT13 in FIG. 11(A)).

[0111] When the input method switching button BT13 on the registration screen of Fig. 11(A) is operated (touched), the screen switches to the registration screen of Fig. 11(B). When the input method switching button BT13 on the registration screen of Fig. 11(B) is operated (non-touch operation), the screen switches to the registration screen of Fig. 11(A). In other words, when the input method switching button BT13 is operated on the screen for the contact operation-only input mode, the screen switches to the screen for the non-touch operation-only input mode, and when the input method switching button BT13 is operated on the screen for the non-touch operation-only input mode, the screen switches to the screen for the contact operation-only input mode.

[0112] A message MS14 regarding switching of the input method is displayed below the input method switching button BT13. When the touch-only input mode is selected, the message MS14 displays the message "Switching to non-contact input," as shown in Fig. 11(A). When the non-contact-only input mode is selected, the message MS14 displays the message "Switching to touch input," as shown in Fig. 11(B).

[0113] A message MS20 about how to register a product is displayed below messages MS12 and MS14. Below message MS20 are a total information display area HR21 that displays total information about registered products, and a registration information display area HR24 that displays registration information for each product.

[0114] Below the registration information display area HR24 is provided a checkout button BT30 for completing product registration and proceeding to checkout. The checkout button BT30 displayed in the non-contact operation-only input mode (checkout button BT30 in FIG. 11(B)) is larger than the checkout button BT30 displayed in the contact operation-only input mode (checkout button BT30 in FIG. 11(A)).

[0115] When the checkout button BT30 is operated (touched) in the contact-only input mode (i.e., when the checkout button BT30 in Fig. 11(A) is operated), the screen transitions to the payment method selection screen shown in Fig. 13(A). When the checkout button BT30 is operated (contactless operation) in the contactless input mode (i.e., when the checkout button BT30 in Fig. 11(B) is operated), the screen transitions to the payment method selection screen shown in Fig. 13(B).

[0116] A message MS31 regarding the preset buttons is displayed below the checkout button BT30. A number of preset buttons are displayed below the message MS31. In the touch-only input mode, as shown in FIG. 11(A), the vegetables button BT32, the fruits button BT33, the fresh fish button BT34, and the meat button BT35 are displayed. In the non-contact-only input mode, as shown in FIG. 11(B), the vegetables button BT32 and the fruits button BT33 are displayed larger than in the contact-only input mode. In other words, the preset buttons displayed in the non-contact-only input mode are larger than those displayed in the contact-only input mode, and the number of preset buttons displayed in the non-contact-only input mode is smaller than the number of preset buttons displayed in the contact-only input mode.

[0117] Arrow buttons BT40 are provided on the left and right of the preset buttons for switching (swapping) the display of the preset buttons. The arrow buttons BT40 displayed in the non-contact operation-only input mode (arrow buttons BT40 in FIG. 11(B)) are larger than the arrow buttons BT40 displayed in the contact operation-only input mode (arrow buttons BT40 in FIG. 11(A)).

[0118] Below the preset buttons are provided a store clerk call button BT50, a plastic bag purchase button BT51, a cancel button BT51, and language change buttons BT53 to BT55. As shown in Figures 11(A) and 11(B), the store clerk call button BT50 displayed in the non-contact operation-only input mode is larger than the store clerk call button BT50 displayed in the contact operation-only input mode. The same is true for the plastic bag purchase button BT51, etc.

[0119] When the Buy Plastic Bag button BT51 is operated (touched) in the contact-only input mode (i.e., when the Buy Plastic Bag button BT51 in Fig. 11(A) is operated), the screen will transition to the buy plastic bag screen shown in Fig. 12(A). When the Buy Plastic Bag button BT51 is operated (non-contact operation) in the non-contact-only input mode (i.e., when the Buy Plastic Bag button BT51 in Fig. 11(B) is operated), the screen will transition to the buy plastic bag screen shown in Fig. 12(B).

[0120] Fig. 12(A) is an example of a plastic bag purchase screen displayed on customer-side display unit 205 in the contact-only input mode. Fig. 12(B) is an example of a plastic bag purchase screen displayed on customer-side display unit 205 in the non-contact-only input mode. Below, we will explain the plastic bag purchase screens shown in Figs. 12(A) and 12(B), focusing on the parts that differ from the registration screen.

[0121] As with the registration screen, the upper part of the shopping bag purchase screen is provided with an input method display area HR11 and an input method switching button BT13, and displays a message MS12 and a message MS14.

[0122] When the input method switching button BT13 on the plastic bag purchase screen in Fig. 12(A) is touched, the screen switches to the plastic bag purchase screen in Fig. 12(B). When the input method switching button BT13 on the plastic bag purchase screen in Fig. 12(B) is operated without touching it, the screen switches to the plastic bag purchase screen in Fig. 12(A).

[0123] A message MS60 about how to purchase plastic bags is displayed below the total information display area HR21. Below the message MS60, plastic bag images GA61 to GA63, each including the size and price of a plastic bag, are displayed.

[0124] Below the large-sized shopping bag image GA61, there is a purchase quantity display area HR64 that displays the number of items purchased. The same is true below the medium-sized shopping bag image GA62 and the small-sized shopping bag image GA63 (reference numerals are omitted in the figure).

[0125] On the left and right of the purchase quantity display area HR64 for each size (each purchase quantity display area HR64 in FIG. 12(A)) displayed in the contact-only input mode, there are provided a plus button BT65 for increasing the purchase quantity of that size, and a minus button BT66 for decreasing the purchase quantity of that size. On the left of the purchase quantity display area HR64 for each size (each purchase quantity display area HR64 in FIG. 12(B)) displayed in the non-contact operation-only input mode, there are provided a plus button BT65 for increasing the purchase quantity of that size, and a minus button BT66 for decreasing the purchase quantity of that size. The plus button BT65 displayed in the non-contact operation-only input mode (the plus button BT65 in FIG. 12(B)) is larger than the plus button BT65 displayed in the contact-only input mode (the plus button BT65 in FIG. 12(A)). The same is true for the minus button BT66.

[0126] A decision button BT70 for deciding to purchase a shopping bag is provided below the purchase quantity display area HR64 etc. The decision button BT70 displayed in the non-contact operation-only input mode (decision button BT70 in FIG. 12(B)) is larger than the decision button BT70 displayed in the contact operation-only input mode (decision button BT70 in FIG. 12(A)).

[0127] Figure 13(A) is an example of a payment method selection screen displayed on customer display unit 205 when in contact-only input mode. Figure 13(B) is an example of a payment method selection screen displayed on customer display unit 205 when in non-contact-only input mode. Below, the payment method selection screens shown in Figures 13(A) and 13(B) will be explained, focusing on the differences from the registration screen.

[0128] The upper part of the payment method selection screen is provided with an input method display area HR11 and an input method switching button BT13, similar to the registration screen and the shopping bag purchase screen, and displays a message MS12 and a message MS14.

[0129] When the input method switching button BT13 on the payment method selection screen of Fig. 13(A) is touched, the screen switches to the payment method selection screen of Fig. 13(B). When the input method switching button BT13 on the payment method selection screen of Fig. 13(B) is operated without touching it, the screen switches to the payment method selection screen of Fig. 13(A).

[0130] Below the messages MS12 and MS14, a message MS80 regarding the payment method (settlement method) is displayed.

[0131] Below the message MS80, a payment method designation button display area HR90 is provided, which displays multiple payment method designation buttons (cash button, credit button, prepaid button, etc.) for designating (selecting) a payment method. As shown in FIGS. 13(A) and 13(B), the payment method designation buttons displayed in the contactless operation-only input mode are larger than the payment method designation buttons displayed in the contactless operation-only input mode. Also, as shown in FIG. 13(B), in the contactless operation-only input mode, some payment method designation buttons (the EPAY button and FPEY button shown in FIG. 13(A)) may not be displayed in the payment method designation button display area HR90. If some payment method designation buttons cannot be displayed in the payment method designation button display area HR90, an "Other" button is displayed in the payment method designation button display area HR90 to display other payment method designation buttons (the EPAY button and FPEY button), as shown in FIG. 13(B).

[0132] Fig. 14 is an example of a display of the registration settlement device 50. Specifically, Fig. 14 is an example of a transaction start screen (registration start screen) displayed on the customer side display unit 205. For ease of explanation, the order has been reversed, but the registration settlement device 50 displays the transaction start screen before the transaction starts (standby state), and transitions from the transaction start screen to the registration screen (Fig. 11).

[0133] (Figure 14(A) Trading start screen) Before starting a transaction, the registration and settlement device 50 displays the transaction start screen shown in Fig. 14(A). At the top of the transaction start screen shown in Fig. 14(A), an input method display area HR11 is provided, and a message MS12 regarding the input method is displayed. In addition, a registration start button BT01 is provided in the center of the screen. The registration start button BT01 is a button for starting a transaction.

[0134] The transaction start screen shown in FIG. 14(A) displays "Contact Input" in the input method display area HR11, and displays the message "Please operate by touching the buttons" as the message MS12, similar to the registration screen shown in FIG. 11(A), the shopping bag purchase screen shown in FIG. 12(A), and the payment method selection screen shown in FIG. 13(A). In other words, the transaction start screen shown in FIG. 14(A) is a screen in a touch-only input mode, similar to the registration screen shown in FIG. 11(A). In other words, the transaction start screen shown in FIG. 14(A) accepts touch operations. For example, when the registration start button BT01 is touched, the screen transitions to the registration screen shown in FIG. 11(A) (however, a registration screen (initial registration screen) in which no products have been registered).

[0135] (Figure 14(B) Trading start screen) Before starting a transaction, the registration and settlement device 50 may display the transaction start screen shown in Figure 14(B) instead of the transaction start screen shown in Figure 14(A). An input method display area HR11 is provided at the top of the transaction start screen shown in Figure 14(B), and a message MS12 regarding the input method is displayed. In addition, a registration start button BT01 is provided in the center of the screen.

[0136] The transaction start screen shown in FIG. 14(B) displays "contactless input" in the input method display area HR11, and displays the message "Please operate the buttons without touching" as the message MS12, similar to the registration screen shown in FIG. 11(B), the shopping bag purchase screen shown in FIG. 12(B), and the payment method selection screen shown in FIG. 12(B). In other words, the transaction start screen shown in FIG. 14(B) is a screen for an input mode exclusively for contactless operation, similar to the registration screen shown in FIG. 11(B). In other words, the transaction start screen shown in FIG. 14(B) accepts contactless operation. For example, when the registration start button BT01 is operated without touching, the screen transitions to the registration screen (initial registration screen) shown in FIG. 11(B).

[0137] (Figure 14(C) Trading start screen) Before a transaction begins, the registration and settlement device 50 may display the transaction start screen shown in FIG. 14(C) instead of the transaction start screen shown in FIG. 14(A) or FIG. 14(B). An input method display area HR11 is provided at the top of the transaction start screen shown in FIG. 14(A), and a message MS12 regarding the input method is displayed. In addition, a registration start button BT02 and a registration start button BT03 are provided in the center of the screen. Both the registration start button BT02 and the registration start button BT03 are buttons for starting a transaction, but the registration start button BT02 is a button that is operated when a contact operation (touch) is desired, and the registration start button BT03 is a button that is operated when a contactless operation is desired.

[0138] The transaction start screen shown in FIG. 14(C), like the transaction start screen shown in FIG. 14(A), displays "Contact Input" in the input method display area HR11 and displays the message MS12 saying "Please operate by touching the buttons." In other words, the transaction start screen shown in FIG. 14(C), like the transaction start screen shown in FIG. 14(A), is a screen for a touch-only input mode. In other words, the transaction start screen shown in FIG. 14(C) accepts touch operations (touch). For example, when the registration start button BT02 is touched, the screen transitions to the registration screen (initial registration screen) shown in FIG. 11(A), and when the registration start button BT03 is touched, the screen transitions to the registration screen (initial registration screen) shown in FIG. 11(B).

[0139] (Figure 14(D) Trading start screen) Before starting a transaction, the registration and settlement device 50 may display the transaction start screen shown in Figure 14(D) instead of the transaction start screen shown in Figures 14(A) to 14(C). An input method display area HR11 is provided at the top of the transaction start screen shown in Figure 14(D), and a message MS12 regarding the input method is displayed. In addition, a registration start button BT02 and a registration start button BT03 are provided in the center of the screen.

[0140] The transaction start screen shown in FIG. 14(D), like the transaction start screen shown in FIG. 14(B), displays "Non-contact input" in the input method display area HR11 and displays the message MS12 saying "Please operate the buttons without touching." In other words, the transaction start screen shown in FIG. 14(D), like the transaction start screen shown in FIG. 14(B), is a screen for an input mode exclusively for non-contact operation. In other words, the transaction start screen shown in FIG. 14(D) accepts non-contact operation. For example, when the registration start button BT02 is operated without touching, the screen transitions to the registration screen (initial registration screen) shown in FIG. 11(A), and when the registration start button BT03 is operated without touching, the screen transitions to the registration screen (initial registration screen) shown in FIG. 11(B).

[0141] 11 to 13 have been described as display examples when a non-contact operation-only input mode (non-contact detection mode) and a contact operation-only input mode (contact detection mode) are implemented, but we will now explain display examples when a non-contact operation priority input mode (first combined detection mode) and a contact operation priority input mode (second combined detection mode) are implemented.

[0142] (Example of display for non-contact operation priority input mode) The following describes a case where the registration and settlement device 50 implements a non-contact operation priority input mode (first combined detection mode). In the non-contact operation priority input mode, non-contact input is accepted as shown in FIG. 7(C). Therefore, when in the non-contact operation priority input mode, the registration and settlement device 50 displays a screen with large buttons. For example, when in the non-contact operation priority input mode, the registration and settlement device 50 may display the registration screen shown in FIG. 11(B) as the registration screen, the plastic bag purchase screen shown in FIG. 12(B) as the plastic bag purchase screen, and the payment method selection screen shown in FIG. 13(B) as the payment method selection screen. In other words, when in the non-contact operation priority input mode, the registration and settlement device 50 may display a screen similar to that in the non-contact operation-only input mode, such as by displaying "Non-contact input" in the input method display area HR11.

[0143] (Example of display of touch operation priority input mode) The following describes a case where the registration and settlement device 50 implements a touch-operation-priority input mode. In the touch-operation-priority input mode, touch input is accepted as shown in FIG. 7(D). Therefore, when in the touch-operation-priority input mode, the registration and settlement device 50 does not need to display a screen with large buttons. For example, when in the touch-operation-priority input mode, the registration and settlement device 50 may display the registration screen shown in FIG. 11(A) as the registration screen, the plastic bag purchase screen shown in FIG. 12(A) as the plastic bag purchase screen, and the payment method selection screen shown in FIG. 13(A) as the payment method selection screen. In other words, when in the touch-operation-priority input mode, the registration and settlement device 50 may display a screen similar to that in the touch-operation-only input mode, such as by displaying "contact input" in the input method display area HR11.

[0144] 11 to 13, attention is focused on the non-touch operation dedicated input mode and the contact operation dedicated input mode, and it has been explained that when the input method switching button BT13 is operated (non-touch operation) in the non-touch operation dedicated input mode, the input mode switches to the contact operation dedicated input mode, and when the input method switching button BT13 is operated (touch operation) in the contact operation dedicated input mode, the input mode switches to the non-touch operation dedicated input mode. However, overall, when the input method switching button BT13 is operated (non-touch operation) in the non-touch operation dedicated input mode or the non-touch operation priority input mode, the input mode switches to the contact operation dedicated input mode or the contact operation priority input mode, and when the input method switching button BT13 is operated (touch operation) in the contact operation dedicated input mode or the contact operation priority input mode, the input mode switches to the non-touch operation dedicated input mode or the non-touch operation priority input mode.

[0145] Next, a description will be given of the control of the input mode (detection mode) in the registration and settlement device 50. The registration and settlement device 50 controls the input mode (detection mode), for example, in one of the following ways.

[0146] (Aspect 1 of input mode control) In the first mode, the input mode at the start of processing for each transaction is the contact input mode (either the contact-only input mode or the contact-priority input mode, whichever is preset), and if an explicit operation (operation of the input method switching button BT13) is performed after the start of processing, or if an implicit operation (a predetermined number of consecutive non-contact operations) is performed in addition to the explicit operation in the contact-priority input mode, the input mode for that transaction is changed to the non-contact input mode (either the non-contact-only input mode or the non-contact-priority input mode, whichever is preset). In other words, in the first mode, the contact input mode is the initial setting, and the non-contact input mode is switched to based on the operation (explicit operation or implicit operation). In the first mode, the registration and settlement device 50 displays, for example, the transaction start screen shown in FIG. 14(A), and when the registration start button BT01 is touched, the registration screen (initial registration screen) shown in FIG. 11(A) is displayed.

[0147] (Aspect 2 of input mode control) In the first mode, the input mode at the start of processing for each transaction is set to the non-input mode (either the non-contact operation-only input mode or the non-contact operation priority input mode, which is preset). If an explicit operation (operation of the input method switching button BT13) is performed after the start of processing, or if an implicit operation (a predetermined number of consecutive contact operations) is performed in addition to the explicit operation in the non-contact operation priority input mode, the input mode for that transaction is set to the contact input mode (either the contact operation-only input mode or the contact operation priority input mode, which is preset). In other words, in the second mode, the non-contact input mode is the initial setting, and the mode is switched to the contact input mode based on the operation (explicit operation or implicit operation). In the second mode, the registration and settlement device 50 displays, for example, the transaction start screen shown in FIG. 14(B), and displays the registration screen (initial registration screen) shown in FIG. 11(B) when the registration start button BT01 is operated in a non-contact manner.

[0148] (Aspect 3 of input mode control) In the third mode, the input mode is selected (specified) for each transaction at the start of processing (the input mode can be switched based on an explicit or implicit operation after processing has started). In the third mode, the registration and settlement device 50 displays, for example, the transaction start screen shown in FIG. 14(C) or the transaction start screen shown in FIG. 14(C). When the transaction start screen shown in FIG. 14(C) is displayed, if the registration start button BT02 is touched, the registration screen (initial registration screen) shown in FIG. 11(A) is displayed, and when the registration start button BT03 is touched, the registration screen (initial registration screen) shown in FIG. 11(B) is displayed. When the transaction start screen shown in FIG. 14(D) is displayed, if the registration start button BT02 is operated without touching, the registration screen (initial registration screen) shown in FIG. 11(A) is displayed, and when the registration start button BT03 is operated without touching, the registration screen (initial registration screen) shown in FIG. 11(B) is displayed.

[0149] 11 to 13 show examples of displays on the customer-side display unit 205 when the operation mode of the registered settlement device 50 is the full self-service mode, but the same applies to other operation modes. In other words, even when the operation mode is the face-to-face mode or the settlement-only mode, the customer-side display unit 205 displays each screen according to the input mode (detection mode), just as when the operation mode is the full self-service mode.

[0150] As described above, the registration settlement device 50 controls (determines, switches) the input mode for the customer side display unit 205 by the customer's explicit operation on the customer side display unit 205 (operation of the input method switching button BT13) or the customer's implicit operation on the customer side display unit 205 (a predetermined number of consecutive contact operations, a predetermined number of consecutive non-touch operations).

[0151] (Payment device 51) The appearance of settlement device 51 is not shown in the figure, but it differs from registration settlement device 50 in that it does not have components equivalent to clerk display unit 210, key operation unit 211, and clerk scanner unit 212, but is otherwise similar to registration settlement device 50. In other words, although a structural diagram is also omitted, settlement device 51 is equipped with a CPU 301, ROM 302, RAM 303, hard disk 304, display unit 305, distance sensor unit 306, scanner unit 307, card payment unit (non-cash payment unit) 308, change dispenser (cash payment unit) 309, printing unit 313, audio output unit 314, communication unit 315, imaging unit 316, and sign pole 317. These can communicate with each other via a bus.

[0152] The CPU 301, ROM 302, RAM 303, hard disk 304, display unit 305, distance sensor unit 306, scanner unit 307, card payment unit 308, change machine 309, printing unit 313, audio output unit 314, communication unit 315, imaging unit 316 and sign pole 317 provided in the settlement device 51 are similar to the CPU 201, ROM 202, RAM 203, hard disk 204, customer side display unit 205, distance sensor unit 206, customer side scanner unit 207, card payment unit 208, change machine 209, printing unit 213, audio output unit 214, communication unit 215, imaging unit 216 and sign pole 217 provided in the registered settlement device 50, so description thereof will be omitted.

[0153] The settlement device 51 is equipped with a display unit 305 similar to the customer-side display unit 205 equipped in the registration settlement device 50, and a distance sensor unit 306 similar to the distance sensor unit 206 equipped in the registration settlement device 50. In other words, the registration settlement device 50 has been described as being equipped with the customer-side display unit 205 incorporating a touch sensor that detects input operations by touching the display screen, and the distance sensor unit 206 that detects input operations by non-touching the display screen, and the same is true for the settlement device 51. In other words, the settlement device 51 is equipped with a display unit 305 incorporating a touch sensor that detects input operations by touching the display screen, and the distance sensor unit 306 that detects input operations by non-touching the display screen.

[0154] Furthermore, the registered settlement device 50 has been described as having four types of detection modes (input modes), but the same is true for the settlement device 51.

[0155] The settlement device 51 may further include a key operation unit on which various buttons are arranged, a human sensor that detects the presence of an operator (customer), and the like.

[0156] Fig. 15 shows examples of displays on the mobile terminal 60. Fig. 15(A) is a transaction start screen (menu screen) for service A. When using (registering) service A, the mobile terminal 60 displays the transaction start screen as shown in Fig. 15(A). Various buttons are arranged on the transaction start screen. For example, the transaction start screen has a shopping start button BT600 arranged thereon for receiving a shopping start instruction.

[0157] Fig. 15(B) is a registration screen (initial registration screen) that is displayed after the shopping start button BT600 is pressed on the transaction start screen of Fig. 15(A). The upper side of the registration screen is a captured image display area HR601 that mainly displays captured images. The lower side of the registration screen is a registration information display area HR602 that mainly displays product registration information.

[0158] Fig. 15(C) is a registration screen when the barcode attached to the product (loaf of bread) is being imaged on the registration screen of Fig. 15(B). That is, when a customer registers a desired product (a product to be purchased), the barcode attached to the product is read as shown in Fig. 15(C).

[0159] 15(D) is a registration screen after product registration is complete (registration screen after product registration). Specifically, the mobile terminal 60 transmits the product code acquired from the barcode to the cloud server 20. The cloud server 20 references the product master and acquires the product name "bread" and the price "¥220" based on the product code. The cloud server 20 stores the product information (product code, product name "bread", quantity "1", price "¥220", etc.) as transaction information (cart information) for the transaction, and transmits the product information (product name "bread", price "¥220", etc.) to the mobile terminal 60. Upon receiving the product information from the cloud server 20, the mobile terminal 60 reflects the product information of the product in the registration information display area HR602. Specifically, as shown in Fig. 15(D), the mobile terminal 60 displays the registered information for the product (product name "bread", quantity "1", price "220 yen") (symbol a), and displays the total information (estimated total "1 item 220 yen") (symbol b). The mobile terminal 60 displays part of the registered information (quantity) as a quantity button BT603. The quantity button BT603 is a button for changing the quantity.

[0160] After registering a product (one item), the mobile terminal 60 displays an operable Proceed to Checkout button BT604 for accepting payment instructions, as shown in Fig. 15(D). When the customer wishes to proceed to checkout (to complete product registration), the customer operates the Proceed to Checkout button BT604.

[0161] FIG. 15(E) shows a registration screen following the scene in FIG. 15(D) after the registration of the second product (oolong tea) is completed. That is, the mobile terminal 60 transmits the product code obtained from the barcode attached to the second product to the cloud server 20. The cloud server 20 references the product master and obtains the product name "oolong tea" and the price "¥150" based on the product code. The cloud server 20 stores the product information (product code, product name "oolong tea", quantity "1", price "¥150", etc.) as transaction information for the transaction, and transmits the product information (product name "oolong tea", price "¥150", etc.) to the mobile terminal 60. The mobile terminal 60, having received the product information from the cloud server 20, reflects the product information for the second product in the registration information display area HR602. Specifically, as shown in Figure 15(E), the mobile terminal 60 displays (adds) the registered information for the product (product name "Oolong Tea", quantity "1", price "¥150") and displays (updates) the total information (estimated total "2 items ¥370").

[0162] FIG. 15(F) shows a two-dimensional code display screen that is displayed after the Proceed to Checkout button BT604 is operated, following the scene in FIG. 15(E). The two-dimensional code display screen displays a two-dimensional code 605 for checkout. The two-dimensional code 605 is a two-dimensional code that contains information required for executing the checkout process. For example, the two-dimensional code 605 is a two-dimensional code of transaction identification information (cart identification information) that identifies the transaction information of the transaction from among multiple pieces of transaction information stored in the cloud server 20. Note that the information to be two-dimensionally coded does not have to be transaction identification information, as long as the transaction information of the transaction can be obtained after reading. For example, the two-dimensional code 605 may be a two-dimensional code of location information of the transaction information of the transaction (a storage location within the sales system 1, such as a URI (Uniform Resource Identifier)).

[0163] Additionally, the two-dimensional code display screen has an estimated total display area HR606 and a back button BT607. In the example of FIG. 15(F), the estimated total display area HR606 displays the estimated total "2 items 370 yen." The back button BT607 is a button for returning to shopping (restarting shopping). When the back button BT607 is operated, the mobile terminal 60 displays a registration screen (the registration screen displayed immediately before the Proceed to Checkout button BT604 was operated) instead of the two-dimensional code display screen.

[0164] Figure 15(G) shows how the settlement device 51 reads the two-dimensional settlement code 605. After completing product registration, the customer has the settlement device 51 read the two-dimensional settlement code 605 displayed on the mobile terminal 60, as shown in Figure 15(G).

[0165] The settlement device 51 displays a settlement start screen before settlement starts (standby state, etc.), and when the settlement two-dimensional code 605 is read on the settlement start screen, it displays a product list screen.

[0166] (Example of display on settlement device 51) 16 and 17 are examples of displays on the settlement device 51. Specifically, FIG. 16 is an example of a settlement start screen displayed on the display unit 305. FIG. 17 is an example of a product list screen displayed on the display unit 305.

[0167] Fig. 16(A) is an example of a settlement start screen displayed on the display unit 305 in contact input mode. Fig. 16(B) is an example of a settlement start screen displayed on the display unit 305 in non-contact input mode. Below, the settlement start screens shown in Fig. 16(A) and Fig. 16(B) will be explained starting from the top of the screen.

[0168] The upper part of the settlement start screen is provided with an input method display area HR11 and an input method switching button BT13, and displays a message MS12 and a message MS14, similar to the screen (registration screen, etc.) on the customer side display unit 205 of the registration settlement device 50. The input method switching button BT13 displayed in the non-contact input mode (input method switching button BT13 in FIG. 16(B)) is larger than the input method switching button BT13 displayed in the contact input mode (input method switching button BT13 in FIG. 16(A)).

[0169] When the input method switch button BT13 on the settlement start screen of Fig. 16(A) is touched, the screen switches to the settlement start screen of Fig. 16(B). When the input method switch button BT13 on the settlement start screen of Fig. 16(B) is operated without touching it, the screen switches to the settlement start screen of Fig. 16(A).

[0170] Below messages MS12 and MS14, a message MS100 is displayed instructing the user to read the two-dimensional settlement code 605 (QR code (registered trademark) in the figure) displayed on the mobile terminal 60. Below message MS100, an image GA110 is displayed showing how to read the two-dimensional settlement code 605.

[0171] If the two-dimensional checkout code 605 is read in contact input mode (i.e., if the two-dimensional checkout code 605 is read while the checkout start screen in Fig. 16(A) is displayed), the screen will transition to the product list screen shown in Fig. 17(A). If the two-dimensional checkout code 605 is read in non-contact input mode (i.e., if the two-dimensional checkout code 605 is read while the checkout start screen in Fig. 16(B) is displayed), the screen will transition to the product list screen shown in Fig. 17(B).

[0172] Below the message MS100, there are provided a store clerk call button BT50, a plastic bag purchase button BT51, a cancel button BT51, and language change buttons BT53 to BT55, similar to the screen (registration screen, etc.) on the customer side display unit 205 of the registration and settlement device 50. The store clerk call button BT50 displayed in the non-contact input mode is larger than the store clerk call button BT50 displayed in the contact input mode. The same is true for the plastic bag purchase button BT51, etc.

[0173] When the Buy Plastic Bag button BT51 is operated (touched) in contact input mode (i.e., when the Buy Plastic Bag button BT51 shown in FIG. 16(A) is operated), the screen transitions to a buy plastic bag screen corresponding to the contact input mode (not shown; the buy plastic bag screen as shown in FIG. 12(A)). When the Buy Plastic Bag button BT51 is operated (non-contact operation) in non-contact input mode (i.e., when the Buy Plastic Bag button BT51 shown in FIG. 16(B) is operated), the screen transitions to a buy plastic bag screen corresponding to the contactless input mode (not shown; the buy plastic bag screen as shown in FIG. 12(B)).

[0174] Fig. 17(A) is an example of a product list screen displayed on the display unit 305 in contact input mode. Fig. 17(B) is an example of a product list screen displayed on the display unit 305 in non-contact input mode. Below, the product list screens shown in Figs. 17(A) and 17(B) will be explained, focusing on the differences from the registration screen (Fig. 11) of the registration and settlement device 50.

[0175] As with the checkout start screen, the upper part of the product list screen is provided with an input method display area HR11 and an input method switching button BT13, and displays a message MS12 and a message MS14.

[0176] When the input method switching button BT13 on the product list screen of Fig. 17(A) is touched, the screen switches to the product list screen of Fig. 17(B). When the input method switching button BT13 on the product list screen of Fig. 17(B) is operated without touching it, the screen switches to the product list screen of Fig. 17(A).

[0177] Below the messages MS12 and MS14, a message MS120 is displayed instructing the customer to check the details of the product registered on the mobile terminal 60 and to press the checkout button if there are no problems with the details.

[0178] Below the message MS120 are provided a total information display area HR21, a price range quantity display area HR22 showing the quantity of products by price range, and a registration information display area HR24. By reading the two-dimensional settlement code 605, the settlement device 51 requests transaction information for the transaction from the cloud server 20, and based on the transaction information acquired (received) from the cloud server 20, displays the total information for the products registered in the transaction in the total information display area HR21, displays the quantity of products by price range in the price range quantity display area HR22, and displays the registration information for each product in the registration information display area HR24.

[0179] Below the registration information display area HR24 is provided a checkout button BT130 for finishing checking out the products and proceeding to checkout. The checkout button BT130 displayed in non-contact input mode (checkout button BT130 in FIG. 17(B)) is larger than the checkout button BT130 displayed in contact input mode (checkout button BT130 in FIG. 17(A)).

[0180] When the checkout button BT130 is operated (touched) in contact input mode (i.e., when the checkout button BT130 in FIG. 17(A) is operated), the screen transitions to a payment method selection screen corresponding to the contact input mode (not shown, payment method selection screen such as that shown in FIG. 13(A)). When the checkout button BT130 is operated (contactless operation) in non-contact input mode (i.e., when the checkout button BT130 in FIG. 17(B) is operated), the screen transitions to a payment method selection screen corresponding to the contactless input mode (not shown, payment method selection screen such as that shown in FIG. 13(B)).

[0181] (Setting of input mode in settlement device 51 by mobile terminal 60) The mobile terminal 60 may accept an operation related to the input mode of the settlement device 51 (an operation to set the contact input mode / an operation to set the contactless input mode). For example, the mobile terminal 60 may accept an operation to select (set) the input mode of the settlement device 51 when service A is first used, and may subsequently accept an operation to change the mode as appropriate. Alternatively, for example, one of the input modes of the settlement device 51 (e.g., the contact input mode) may be initially set as the initial value for service A, and the mobile terminal 60 may accept an operation to change the mode as appropriate. Note that information related to the input mode of the settlement device 51 (setting information to set the contact input mode / setting information to set the contactless input mode) may be stored in a storage unit of the mobile terminal 60, or may be stored in a customer master held by the cloud server 20 or the like, or may be stored in association with the transaction identification information (cart identification information) of the transaction.

[0182] FIG. 18 is an example of a display on the mobile terminal 60. The mobile terminal 60 may display the transaction start screen shown in FIG. 18(A) or FIG. 18(B) instead of the transaction start screen shown in FIG. 15(A). Specifically, when the contact input mode is set as the input mode in the settlement device 51, the mobile terminal 60 may display the transaction start screen shown in FIG. 18(A). When the contactless input mode is set as the input mode in the settlement device 51, the mobile terminal 60 may display the transaction start screen shown in FIG. 18(B).

[0183] The transaction start screen shown in Figure 18(A) or Figure 18(B) displays a message MS612 regarding the input mode in the settlement device 51. When the contact input mode is set as the input mode in the settlement device 51, the mobile terminal 60 displays the message "The buttons on the settlement device are touch operated" as message MS612, as shown in Figure 18(A). When the contactless input mode is set as the input mode in the settlement device 51, the mobile terminal 60 displays the message "The buttons on the settlement device are contactless operated" as message MS612, as shown in Figure 18(B).

[0184] An input method switch button BT613 for switching the input mode in the settlement device 51 is provided below the message MS612 on the transaction start screen shown in Figure 18(A) or Figure 18(B). When the input method switch button BT613 on the transaction start screen in Figure 18(A) is touched, the portable terminal 60 updates (changes) the input mode setting in the settlement device 51 from contact input mode to non-contact input mode, and switches to the transaction start screen in Figure 18(B). When the input method switch button BT613 on the transaction start screen in Figure 18(B) is touched, the portable terminal 60 updates (changes) the input mode setting in the settlement device 51 from non-contact input mode to contact input mode, and switches to the transaction start screen in Figure 18(A).

[0185] When the Start Shopping button BT600 on the transaction start screen shown in FIG. 18(A) is touched, the mobile terminal 60 displays a message MS612 similar to the registration screen shown in FIG. 18(C) and an initial registration screen (not shown) on which the input method switch button BT613 is located, and when the Start Shopping button BT600 on the transaction start screen shown in FIG. 18(B) is touched, the mobile terminal 60 displays a message MS612 similar to the registration screen shown in FIG. 18(D) and an initial registration screen (not shown) on which the input method switch button BT613 is located.

[0186] Furthermore, the mobile terminal 60 may display a registration screen such as that shown in Figure 18(C) or Figure 18(D) instead of the registration screen shown in Figure 15(E) etc. Specifically, when the contact input mode is set as the input mode in the settlement device 51, the mobile terminal 60 may display the registration screen shown in Figure 18(C). When the contactless input mode is set as the input mode in the settlement device 51, the mobile terminal 60 may display the registration screen shown in Figure 18(D).

[0187] 18(A), the registration screen shown in Figure 18(C) displays a message MS612 stating "The buttons on the settlement machine are touch operated," and below the message MS612 is provided an input method switch button BT613 for switching the input mode on the settlement device 51. The registration screen shown in Figure 18(D) displays a message MS612 stating "The buttons on the settlement machine are non-touch operated," and below the message MS612 is provided an input method switch button BT613 for switching the input mode on the settlement device 51, similar to the transaction start screen shown in Figure 18(B).

[0188] When the input method switch button BT613 on the registration screen of Figure 18(C) is touched, the portable terminal 60 updates (changes) the input mode setting on the settlement device 51 from contact input mode to non-contact input mode and switches to the registration screen of Figure 18(D). When the input method switch button BT613 on the registration screen of Figure 18(D) is touched, the portable terminal 60 updates (changes) the input mode setting on the settlement device 51 from non-contact input mode to contact input mode and switches to the registration screen of Figure 18(C).

[0189] When the Proceed to Checkout button BT604 on the registration screen shown in Figure 18(C) is touched, the mobile terminal 60 displays a two-dimensional code display screen that displays a two-dimensional checkout code 605, which is a two-dimensional code that contains information required to execute the checkout process (such as cart identification information) and information for controlling the checkout device 51 to switch to contact input mode. On the other hand, when the Proceed to Checkout button BT604 on the registration screen shown in Figure 18(D) is touched, the mobile terminal 60 displays a two-dimensional code display screen that displays a two-dimensional checkout code 605, which is a two-dimensional code that contains information required to execute the checkout process and information for controlling the checkout device 51 to switch to contactless input mode. Therefore, by reading the two-dimensional checkout code 605, the checkout device 51 can recognize the input mode in which it should operate.

[0190] 18(A) to 18(D) (transaction start screen, registration screen), the input method switch button BT613 is shown as a relatively large button, but the input method switch button BT613 may be a smaller button than the Proceed to Checkout button BT604. Also, the message MS612 and the input method switch button BT613 may be displayed on at least one screen, but not all, of the transaction start screen (FIGS. 18(A) and 18(B)), the initial registration screen (not shown), and the registration screen (FIGS. 18(A) and 18(B)).

[0191] As described above with reference to FIG. 18 , the mobile terminal 60 can declare contact / contactless mode for the settlement device 51. When the settlement device 51 reads the two-dimensional settlement code 605, which is a two-dimensional code of information for controlling the settlement device 51 to the contactless input mode (when the settlement device 51 displays the product list screen of FIG. 17(B)), a message such as "Starting in contactless mode" may be displayed on the product list screen (or in front of the product list screen). Because not all devices in a store are necessarily equipped with the distance sensor unit 206 (i.e., when settlement devices that do not support contactless input and settlement devices that support contactless input are mixed in the store), the mobile terminal 60 may display (for example, on a layout screen) the number, installation locations, and usage status of each settlement device 51 that does not support contactless input and each settlement device 51 that supports contactless input. This allows customers who are users of the mobile terminal 60 to use the payment device that suits their situation, taking into consideration the congestion situation and whether it is contact or non-contact.

[0192] Next, a description will be given of the control of the input mode (detection mode) in the settlement device 51. The settlement device 51 switches the input mode (detection mode) in one of the following ways.

[0193] (Aspect 1 of input mode control) Mode 1 in the settlement device 51 is the same as Mode 1 in the registered settlement device 50 described above. That is, Mode 1 in the settlement device 51 is a mode in which the contact input mode is the initial setting and is switched to the non-contact input mode based on an operation (explicit operation, implicit operation). In Mode 1, the settlement device 51 displays, for example, a settlement start screen such as that shown in FIG. 16(A). Note that in Mode 1, the mobile terminal 60 displays various screens that are not related to the input mode in the settlement device 51 (for example, various screens such as those shown in FIG. 15).

[0194] (Aspect 2 of input mode control) Mode 2 in the settlement device 51 is the same as Mode 2 in the registered settlement device 50 described above. That is, Mode 2 in the settlement device 51 is a mode in which the non-contact input mode is the initial setting and is switched to the contact input mode based on an operation (explicit operation, implicit operation). In Mode 2, the settlement device 51 displays, for example, a settlement start screen such as that shown in FIG. 16(B). Note that in Mode 2, the mobile terminal 60 displays various screens (for example, various screens such as those shown in FIG. 15) that are not related to the input mode in the settlement device 51.

[0195] (Aspect 3 of input mode control) Aspect 3 is an aspect in which an input mode is selected (specifically, an input mode is selected on the mobile terminal 60) before processing begins on the settlement device 51 (an aspect in which the input mode can be switched based on an explicit or implicit operation even after processing begins on the settlement device 51). In aspect 3, the mobile terminal 60 displays various screens (for example, various screens such as those shown in FIG. 18) that display the input mode on the settlement device 51. Also, in aspect 3, the settlement device 51 may display a settlement start screen that is not related to the input mode on the settlement device 51 (for example, a settlement start screen (not shown) that does not have the input method display area HR11 or input method switching button BT13 at the top).

[0196] In aspect 3, when the settlement device 51 reads a two-dimensional settlement code 605 in which information for control to switch to contact input mode, etc., is two-dimensionally coded (the two-dimensional settlement code 605 displayed on a two-dimensional code display screen (not shown) to which a registration screen such as that shown in FIG. 18(C) is transitioned), the settlement device 51 displays a product list screen corresponding to the contact input mode (the product list screen such as that shown in FIG. 17(A)). When the settlement device 51 reads a two-dimensional settlement code 605 in which information for control to switch to non-contact input mode, etc., is two-dimensionally coded (the two-dimensional settlement code 605 displayed on a two-dimensional code display screen (not shown) to which a registration screen such as that shown in FIG. 18(D) is transitioned), the settlement device 51 displays a product list screen corresponding to the contactless input mode (the product list screen such as that shown in FIG. 17(B)).

[0197] As described above, the settlement device 51 controls (determines, switches) the input mode for the display unit 305 by the customer's explicit operation on the display unit 305 (operation of the input method switching button BT13), the customer's explicit operation on the mobile terminal 60 (operation of the input method switching button BT613), or the customer's implicit operation on the customer-side display unit 205 (a predetermined number of consecutive contact operations, a predetermined number of consecutive non-touch operations).

[0198] (Weighting and pricing device 70) Although it has been described that the supermarket S is equipped with a store controller 30, a transaction status management device 40, a registration and settlement device 50, and a settlement device 51 (FIG. 1), the devices installed in the store are not limited to the above-mentioned devices. For example, a weighing and pricing device 70 (not shown) may also be installed in the store. The weighing and pricing device 70 may be connected to the LAN 19.

[0199] The weighing pricing device 70 is used by customers to weigh products sold by weight (products sold by weight), and print and issue product labels for the products after weighing.

[0200] Although not shown in the figures, the weighing pricing device 70 includes, for example, a CPU 401, a ROM 402, a RAM 403, a hard disk 404, a display unit 405, a distance sensor unit 406, a printing unit 413, a communication unit 415, and a weighing unit 418. These can communicate with each other via a bus. The CPU 401, ROM 402, RAM 403, hard disk 404, display unit 405, and distance sensor unit 406 included in the weighing pricing device 70 are similar to the CPU 201, ROM 202, RAM 203, hard disk 204, customer-side display unit 205, and distance sensor unit 206 included in the registration and settlement device 50, and therefore some or all of the description will be omitted.

[0201] The weighing pricing device 70 is equipped with a display unit 405 similar to the customer-side display unit 205 equipped in the registration and settlement device 50, and a distance sensor unit 406 similar to the distance sensor unit 206 equipped in the registration and settlement device 50. In other words, the registration and settlement device 50 has been described as being equipped with the customer-side display unit 205 having a built-in touch sensor that detects input operations by touching the display screen, and the distance sensor unit 206 that detects input operations by non-touching the display screen, and the same is true for the weighing pricing device 70. In other words, the weighing pricing device 70 is equipped with a display unit 405 having a built-in touch sensor that detects input operations by touching the display screen, and the distance sensor unit 406 that detects input operations by non-touching the display screen.

[0202] Furthermore, the registration and settlement device 50 has been described as having four types of detection modes (input modes), but the same is true for the weighing and pricing device 70.

[0203] The communication unit 415 communicates with other devices. For example, the communication unit 415 receives information from another device for identifying one of multiple types of weight-sold products sold in the store. As an example, the communication unit 415 receives product identification information identifying a weight-sold product from another device (referred to as device 90 (not shown)). For example, multiple devices 90 are installed in a weight-sold product corner in a product display area, one for each type of weight-sold product. Each device 90 includes, for example, a memory unit 903 that stores product identification information identifying the weight-sold product displayed by that device 90, a detection unit 919 that detects an operation (movement) on that device 90, and a communication unit 915 that transmits the product identification information to the weight-sold pricing device 70 via wireless communication when the detection unit 919 detects the operation. In other words, the communication unit 415 of the weight-sold pricing device 70 receives product identification information of the weight-sold product corresponding to that device 90 from the device 90 that detected the operation. Specific examples of the device 90 will be described later.

[0204] The communication between the weighing and pricing device 70 (communication unit 415) and the device 90 (communication unit 915) may be wireless communication via LAN 19 or wireless communication via short-range wireless communication (Bluetooth (registered trademark), etc.). The weighing and pricing device 70 may be provided with a first communication unit compatible with the LAN and a second communication unit compatible with short-range wireless communication, separately.

[0205] The weighing unit 418 measures the weight of a product or the like (a product sold by weight, a container) placed on a scale (not shown). The printing unit 413 prints and issues product labels for the products sold by weight weighed by the weighing unit 418. For example, the printing unit 413 may print and issue product labels on which a barcode or the like encoding the weight (NET) of the products sold by weight weighed by the weighing unit 418, the selling price, etc., is printed.

[0206] The CPU 401 is a central processing unit that controls the operation of the weighing and pricing device 70 by reading and executing programs stored in the ROM 402. For example, the CPU 401 identifies a product sold by weight (a product sold by weight that is a candidate product sold by weight) based on product identification information received by the communication unit 415. The CPU 401 causes the display unit 405 to display a product button (product preset button) corresponding to the identified product sold by weight (a product sold by weight that is a candidate product sold by weight). The CPU 401 also calculates the weight of the product sold by weight by subtracting the weight of the container from the weight value measured by the weighing unit 418, and further calculates the selling price of the product sold by weight by referring to the unit price per weight of the product sold by weight (stored in the device itself or another accessible device). The CPU 401 causes the display unit 405 to display the calculated weight and selling price of the product sold by weight.

[0207] The weighing and pricing device 70 may further include a key operation unit, an audio output unit, an imaging unit, a sign pole, a human presence sensor, etc. The weighing and pricing device 70 may further include an audio input unit (microphone) that accepts audio input.

[0208] The flow of purchasing merchandise sold by weight will be briefly explained. A customer operates a device 90 corresponding to the merchandise sold by weight to be purchased. The customer also places the merchandise sold by weight to be purchased in a shopping cart or the like. When purchasing multiple types of merchandise sold by weight, a customer operates a device 90 corresponding to each of the merchandise sold by weight to place each of the merchandise sold by weight in a shopping cart or the like. Each device 90 detects the customer's operation and transmits product identification information to the merchandise pricing device 70, so that the merchandise pricing device 70 can identify merchandise sold by weight that is a candidate for weighing (a merchandise sold by weight placed in a shopping cart or the like) based on the product identification information. Next, the customer moves to the location where the merchandise pricing device 70 is installed. The customer uses the merchandise pricing device 70 to weigh the merchandise sold by weight to be purchased, and affixes a product label printed and issued by the merchandise pricing device 70 to the merchandise sold by weight, for example. The weighing pricing device 70 prints and issues a product label for each type of weighed product, and therefore weighs each type of weighed product (i.e., different types of weighed products are not weighed together). Therefore, when a customer purchases multiple types of weighed products, the customer specifies the weighed weighed products before weighing them (or specifies the weighed weighed products after weighing them).

[0209] Figure 19 is an example of a display on the weighing pricing device 70. The weighing pricing device 70 displays a product selection screen such as that shown in Figure 19(A). For example, if a customer operates a device 90 corresponding to XX apples and a device 90 corresponding to XX lemons, places XX apples and XX lemons in a shopping cart or the like, moves the cart to the weighing pricing device 70, and operates a predetermined button (start button, not shown) on the initial screen (not shown) of the weighing pricing device 70, the weighing pricing device 70 displays a product selection screen such as that shown in Figure 19(A).

[0210] At the top of the product selection screen shown in FIG. 19(A) is a weight etc. display area HR200 that displays the weight, selling price, etc. of a product sold by weight. Below (on the left side of) the weight etc. display area HR200 is an input method display area HR11. The input method display area HR11 displays "non-contact input." Below the input method display area HR11 is displayed a message MS201 regarding the operation method. Specifically, the message MS201 displays the message "Select a product (non-contact operation) and place the product on the stand. Please operate by touching the button."

[0211] Below the message MS201, there is provided a product preset button display area HR202 that displays product preset buttons. In the product preset button display area HR202, a product preset button BT203-1 corresponding to XX apple and a product preset button BT203-2 corresponding to XX lemon are displayed. In other words, in the product preset button display area HR202, product preset buttons corresponding to the weighed-out sales products that are candidates for weighing and that have been identified by operating the device 90 are displayed.

[0212] The product selection screen shown in Fig. 19(A) displays only product preset buttons corresponding to the candidate weighed products, so the number of displayed product preset buttons is not large. Therefore, on the product selection screen shown in Fig. 19(A), each product preset button is displayed large and in non-contact input mode. Note that on the product selection screen shown in Fig. 19(A), the weighing pricing device 70 erases any product preset button that has been operated (non-contact operation).

[0213] The weighing pricing device 70 may display the product selection screen shown in Fig. 19(B). For example, the weighing pricing device 70 may display the product selection screen shown in Fig. 19(B) when a predetermined operation (for example, operation of the search button at the bottom right of the screen) is performed on the product selection screen shown in Fig. 19(A). The weighing pricing device 70 may also display the product selection screen shown in Fig. 19(B) when there are no candidate weighing products (for example, when the customer forgets to operate the equipment 90).

[0214] At the top of the product selection screen shown in FIG. 19(B), there is provided a weight etc. display area HR200 that displays the weight, selling price, etc. of a product sold by weight. Below (on the left side of) the weight etc. display area HR200, there is provided an input method display area HR11. The input method display area HR11 displays "touch input." Below the input method display area HR11, there is displayed a message MS211 regarding the operation method. Specifically, the message MS211 displays the message "Please find the product. Please touch the keyboard or touch a color, etc."

[0215] A product preset button display area HR212 for displaying product preset buttons is provided below the message MS211. Product preset buttons corresponding to products sold by weight extracted by keyboard input or the like are displayed in the product preset button display area HR212.

[0216] Below the product preset button display area HR212, there are provided switching tabs TB213 (home tab TB213a, fruit tab TB213b, vegetable TB213c) for switching the display of product preset buttons in the product preset button display area HR212. When the home tab TB213a is selected, the weighing pricing device 70 displays product preset buttons corresponding to all of the weighing products extracted by keyboard input or the like in the product preset button display area HR212 (if the number of buttons is large, the buttons may be displayed across multiple pages). When the fruit tab TB213b is selected, the weighing pricing device 70 displays product preset buttons corresponding to the weighing products classified as fruit among the weighing products extracted by keyboard input or the like in the product preset button display area HR212 (if the number of buttons is large, the buttons may be displayed across multiple pages). When the vegetable tab TB213c is selected, the weighing pricing device 70 displays product preset buttons corresponding to weighing products classified as vegetables among the weighing products extracted by keyboard input, etc., in the product preset button display area HR212 (if there are a large number of buttons, they may be displayed on multiple pages).

[0217] Below the tab TB213 are a character button display area HR214 that displays character (hiragana, alphabet, number) buttons, a color button display area HR215 that displays color buttons, a voice input button BT216 that declares voice input, a handwriting input button BT217 that declares handwriting input, a handwriting reception area UT218 that accepts handwriting input (hiragana, alphabet, numbers, kanji), and a result display field HR219 that displays the input results (input results of character buttons) and the recognition results (recognition results of voice input or handwriting input).

[0218] For example, if a customer operates the character "ri" in the character button display area HR214, the weighing pricing device 70 displays "ri" in the result display field HR219, and displays a product preset button corresponding to a weighing product containing "ri (hiranaga) or "ri (katakana)" (such as "XX apple", "XX apple", etc.) in the product preset button display area HR212.

[0219] When a customer operates the red button in the color button display area HR215, the weighing pricing device 70 refers to the color information preset for each weighing product, and displays the product preset button corresponding to the weighing product that corresponds to the color red (such as "XX apple," "XX apple," or "XX tomato") in the product preset button display area HR212.

[0220] When a customer operates the voice input button BT216 to input voice, the weighing pricing device 70 displays the voice recognition result in the result display field HR219, and displays a product preset button corresponding to the weighing product corresponding to the voice recognition result in the product preset button display area HR212 (referred to as the "Home" tab). For example, when the weighing pricing device 70 recognizes "apple," it displays "apple" in the result display field HR219, and displays a product preset button corresponding to a weighing product containing "apple (hiranaga)" or "apple (katakana)" (such as "xx apple" or "xx apple") in the product preset button display area HR212.

[0221] When a customer operates the handwriting input button BT217 and inputs characters into the handwriting reception area UT218, the weighing pricing device 70 displays the character recognition result in the result display field HR219, and displays a product preset button corresponding to the weighing product corresponding to the character recognition result in the product preset button display area HR212 (referred to as the "Home" tab). For example, when the weighing pricing device 70 recognizes "north", it displays "north" in the result display field HR219, and displays a product preset button corresponding to a weighing product containing "north" (such as "XXX from Hokkaido") in the product preset button display area HR212.

[0222] 19(B), the product selection screen is set to the contact input mode because the size of each character button in the character button display area HR214 and each color button in the color button display area HR215 is small. Note that on the product selection screen shown in FIG. 19(B), the weighing and pricing device 70 erases any product preset button that has been operated (touched).

[0223] As described above, the weighing pricing device 70 controls (determines, switches) the input mode for the display unit 405 based on the type of screen (e.g., the product selection screen shown in Figure 19(A), the product selection screen shown in Figure 19(B)) and the customer's implicit operation on the display unit 405 (a predetermined number of consecutive touch operations, a predetermined number of consecutive non-touch operations).

[0224] (Mixing contact and non-contact inputs on the same screen) 19(B), the product preset buttons displayed in the product preset button display area HR212 can be displayed relatively large. For example, when there are few extracted bulk products (when the search is narrowed down), the number of product preset buttons displayed in the product preset button display area HR212 decreases, so it is possible to display each product preset button large. Alternatively, when there are many buttons, it is possible to display each product preset button large, assuming that they will be displayed across multiple pages.

[0225] Furthermore, the voice input button BT216 and handwriting input button BT217 are displayed larger than the character buttons in the character button display area HR214 and the color buttons in the color button display area HR215.

[0226] Therefore, some parts of the product selection screen shown in FIG. 19(B) (for example, the character buttons in the character button display area HR214, the color buttons in the character button display area HR214, etc.) may be contact input, and other parts (for example, the product preset buttons in the product preset button display area HR212, the voice input button BT216, the handwriting input button BT217, etc.) may be contactless input. In other words, contact input and contactless input may be mixed on the same screen. An input mode in which contact input and contactless input are mixed on the same screen may be called a mixed input mode (or composite input mode). Note that the "mixed" in the mixed input mode indicates that contact input and contactless input are "mixed" when the entire screen (i.e., multiple buttons) are focused on; however, when focusing on individual buttons on the screen, it is either contact input or contactless input, so it is not "mixed."

[0227] Methods for mixing contact input and non-contact input on the same screen (methods for realizing a mixed input mode) include, for example, Method 1 and Method 2 below. (Method 1) A detection mode modified from the second combined detection mode (FIG. 7(D)) is prepared and applied to a screen that combines contact input and non-contact input (for example, the product selection screen shown in FIG. 19(B)). In the second combined detection mode, as shown in FIG. 7(D), for all operation areas on the screen, no input is detected in operation status 2 (within the detection space) and input is detected (contact input) in operation status 3 (on the detection screen). On the other hand, in a detection mode modified from the second combined detection mode described above, for one area on the screen (for example, each character button in the character button display area HR214), no input is detected in operation status 2 and input is detected (contact input) in operation status 3, as in the second combined detection mode, but for other areas (for example, the product preset buttons in the product preset button display area HR212), input is detected (non-touch input) in operation status 2 (it may be either input detected (contact input) or input detected (non-touch input) in operation status 3). In addition, on a screen where contact input and non-contact input are mixed, the "one area" and the "other area" are set in advance (the same applies to method 2). (Method 2) A detection mode modified from the second combined detection mode (FIG. 7(C)) is prepared and applied to a screen that combines contact input and non-contact input (for example, the product selection screen shown in FIG. 19(B)). In the first combined detection mode, as shown in FIG. 7(C), all operation areas on the screen are determined to have an input (non-contact input) in both operation status 2 (within the detection space) and operation status 3 (on the detection screen). On the other hand, in a detection mode modified from the above-described first combined detection mode, one area on the screen (for example, the product preset buttons in the product preset button display area HR212) is determined to have an input (non-touch input) in both operation status 2 and operation status 3, as in the first combined detection mode, but other areas (for example, the character buttons in the character button display area HR214) are determined to have no input in operation status 2 and to have an input (contact input) in operation status 3.

[0228] When displaying a screen that includes both contact input and non-contact input, the weighing pricing device 70 may display information that allows the operator to identify the contact input and non-contact input areas. For example, the weighing pricing device 70 may distinguish between the contact input area (a range that includes one or more operation targets) and the non-contact input area on the screen, for example, by displaying them with different background colors, or may notify the operator of the input method (contact input / non-contact input) for each item. Furthermore, the weighing pricing device 70 may notify the operator of which part of the screen is the contact input area or the non-contact input area (e.g., the area with the smaller area) by, for example, displaying a background color or by surrounding it with a frame, or may notify the operator of the input method for one of the contact input items or the non-contact input items (e.g., the item with the fewer number of items). In addition, when the weighing pricing device 70 displays a screen that mixes contact input and non-contact input, it may display in the input method display area HR11 that contact input and non-contact input are mixed (for example, "contact input / non-contact input").

[0229] (Further use of voice input) The product preset button may be selected (designated) by voice input without operating (contactless operation or contact operation) the product preset button in the product preset button display area HR212. For example, when the weighing pricing device 70 displays the product preset button BT203-1 and the product preset button BT203-2 as shown in Fig. 19(A) in the product preset button display area HR212 in Fig. 19(B), it may determine that the product preset button BT203-1 has been operated when "12" or "left" is voice recognized, and may determine that the product preset button BT203-2 has been operated when "45" or "right" is voice recognized.

[0230] (equipment 90) For example, the device 90 may store device identification information that identifies the device 90, and may transmit the device identification information to the weighing pricing device 70 by wireless communication when an operation on the device 90 is detected. In other words, the information for identifying one weighing product received by the weighing pricing device 70 (communication unit 415) may be the device identification information of the device 90. When the weighing pricing device 70 receives device identification information from the device 90, the weighing pricing device 70 may refer to information (stored in the weighing device itself or another accessible device) indicating the correspondence between the device identification information and the product identification information, and identify a weighing candidate product (a weighing product placed in a shopping cart, etc.).

[0231] The devices 90 may be electronic shelf labels installed near each of the products sold by weight. That is, when a customer purchases, for example, "XX apple," the customer touches the electronic shelf label installed near the "XX apple." The electronic shelf label detects the customer's touch (such as vibration) (detection unit 919) and transmits product identification information (or device identification information) to the weighing pricing device 70 (communication unit 915).

[0232] The device 90 may be a sensor device installed in a display container that stores each of the bulk products (nuts, dried fruits, etc.). For example, the display container may have an operating unit (lid, lever, etc.) that is operated when removing the bulk product, and the sensor device may be installed in the operating unit, etc. of the display container, and detect when a customer operates the operating unit. In other words, when a customer purchases "XX nuts," for example, the customer operates a lever, etc. of the display container that stores "XX nuts." The sensor device detects the customer's operation (detection unit 919) and transmits product identification information (or device identification information) to the bulk pricing device 70 (communication unit 915).

[0233] The device 90 may be a mobile terminal 60. For example, when a customer purchases a "XX apple," the customer uses the mobile terminal 60 to capture an image of a code (for example, a two-dimensional code encoding the product identification information of the "XX apple") printed (or displayed, in the case of an electronic shelf label) on a shelf label placed near the "XX apple." The mobile terminal 60 acquires the product identification information of the "XX apple" from the code and transmits the acquired product identification information to the weighing pricing device 70, for example, via short-range wireless communication (Bluetooth (registered trademark), etc.). Note that when the device 90 is a mobile terminal 60, the weighing pricing device 70 does not need to print or issue a product label. Furthermore, when the device 90 is a mobile terminal 60, the weighing pricing device 70 may transmit weight information and the like of the product sold by weighing to the mobile terminal 60, for example, via short-range wireless communication.

[0234] (Printing device 80) Although it has been described that the supermarket S is equipped with a store controller 30, a transaction status management device 40, a registration and settlement device 50, and a settlement device 51 (FIG. 1), the devices installed in the store are not limited to the above-mentioned devices. For example, a printing device 80 (not shown) may also be installed in the store.

[0235] The printing device 80 is installed in the back room and used by store staff. The printing device 80 weighs products sold by weight (meat, fish, prepared dishes, etc.) and prints and issues labels for the products (product labels to be affixed to the products or shelf labels to be affixed to product shelves) after weighing. The printing device 80 may be part of (or connected to) a packaging machine that packages products sold by weight (meat, fish, etc.) placed on packaging items (foam trays, clear trays, etc.) in film (vinyl chloride, polypropylene film, etc.).

[0236] Although not shown in the figures, the printing device 80 includes, for example, a CPU 501, a ROM 502, a RAM 503, a hard disk 504, a display unit 505, a distance sensor unit 506, a printing unit 513, and a weighing unit 518. These can communicate with each other via a bus. The printing device 80 includes the CPU 501, ROM 502, RAM 503, hard disk 504, display unit 505, distance sensor unit 506, printing unit 513, and weighing unit 518. These are similar to the CPU 401, ROM 402, RAM 403, hard disk 404, display unit 405, distance sensor unit 406, printing unit 413, and weighing unit 418 included in the weighing and pricing device 70, and therefore their description will be omitted.

[0237] Printing device 80 is equipped with a display unit 505 similar to customer-side display unit 205 equipped in registration and settlement device 50, and a distance sensor unit 506 similar to distance sensor unit 206 equipped in registration and settlement device 50. In other words, while it has been described that registration and settlement device 50 is equipped with customer-side display unit 205 incorporating a touch sensor that detects input operations by touching the display screen, and distance sensor unit 206 that detects input operations by non-contact on the display screen, the same is true for printing device 80. In other words, printing device 80 is equipped with display unit 505 incorporating a touch sensor that detects input operations by touching the display screen, and distance sensor unit 506 that detects input operations by non-contact on the display screen.

[0238] Furthermore, the registration and settlement device 50 has been described as having four types of detection modes (input modes), but the same is true for the printing device 80.

[0239] The printing device 80 may further include a key operation unit, an audio output unit, an audio input unit (microphone), a storage medium input unit, a communication unit, etc. The printing device 80 may acquire various information (e.g., setting information for the labels of each metered product) to be stored in the storage unit (RAM 503, hard disk 504) from a storage medium (USB, etc.) via the storage medium input unit, or may receive the information from another device via the communication unit.

[0240] 20 and 21 are examples of displays on the printing device 80. The printing device 80 displays a pricing screen such as that shown in FIG. 20(A). For example, when a bulk product for which a label is to be printed and issued is called up (for example, when a store clerk inputs designated information (product number, product name, etc.) for specifying a bulk product on a product call-up screen (not shown) that accepts input of designated information for specifying the bulk product), the printing device 80 displays a pricing screen such as that shown in FIG. 20(A). The left side of the pricing screen shown in FIG. 20(A) is a setting information display area that displays label setting information for the called-up bulk product and can accept changes (adjustments) to the setting information. The right side of the pricing screen shown in FIG. 20(A) is a label image display area that displays image information (label image) of the label to be printed and issued based on the setting information.

[0241] A message MS300 regarding operation methods is displayed on the lower left side of the pricing screen shown in Fig. 20(A). Specifically, message MS300 displays the message "If you agree, please press the label issue button." A label confirmation button BT301 is located on the lower right side of the pricing screen shown in Fig. 20(A) to proceed to label printing and issuance (more specifically, to the image confirmation operation before label printing and issuance). The pricing screen in Fig. 20(B) will be described later.

[0242] In the pricing screen shown in FIG. 20(A), the buttons for changing (adjusting) the setting information and the label confirmation button BT301 are small, so the contact input mode is used.

[0243] The printing device 80 displays a print item confirmation screen such as that shown in Fig. 21(A). For example, when a store clerk operates the label confirmation button BT301 on the pricing screen shown in Fig. 20(A), the printing device 80 displays a print item confirmation screen such as that shown in Fig. 21(A). The printing device 80 displays a label image on the print item confirmation screen. The printing device 80 also notifies (displays) that certain print items on the label image (print items set in advance as setting information) are print items that are subject to pointing confirmation and have not yet been confirmed (unconfirmed), and accepts pointing confirmation by the store clerk for print items that are subject to pointing confirmation and have not yet been confirmed.

[0244] 21(A), the items that are subject to pointing confirmation and that were printed before pointing confirmation are the price per 100g (398 yen), the selling price (326 yen), and the expiration date (21.6.25). To notify the user that the items are subject to pointing confirmation and that were printed before pointing confirmation, the printing device 80 changes the background style of the relevant printing items (price per 100g, selling price, expiration date) to a second style (shaded) that differs from the usual first style (for example, plain), and adds (displays) a double circle.

[0245] When the printing device 80 receives a pointing confirmation from a store clerk for a printed item that is a target item for pointing confirmation and that has not yet been confirmed, the printing device 80 notifies (displays) that the item is a printed item that has been confirmed by pointing. For example, the printing device 80 notifies that the item is a target item for pointing confirmation and that has not yet been confirmed by changing the background style to a third style (diagonal lines) that is different from the usual first style (plain) and second style (shaded), and erases the double circle.

[0246] For example, when a store clerk points and confirms the sales price (a target item for pointing and confirmation and one of the print items before pointing and confirmation) on the print item confirmation screen shown in FIG. 21(A), the printing device 80 displays a print item confirmation screen such as that shown in FIG. 21(B). On the print item confirmation screen shown in FIG. 21(B), the background of the target item for pointing and confirmation (sales price) for which pointing and confirmation was received is changed to the third pattern (diagonal lines), and the double circle is removed. Furthermore, when the printing device 80 receives pointing and confirmation from the store clerk for all target items for pointing and confirmation, it displays a print item confirmation screen such as that shown in FIG. 21(C). On the print item confirmation screen shown in FIG. 21(C), the background of all target items for pointing and confirmation (price per 100g, sales price, and expiration date) is changed to the third pattern (diagonal lines), and the double circle is removed.

[0247] As shown in FIG. 21C, on the print item confirmation screen after all pointing confirmations have been completed, an execute button is displayed, and the label is printed and issued after the execute button is operated.

[0248] On the print item confirmation screen shown in FIG. 21, the operation area for the target items for pointing confirmation is relatively large, so the non-contact input mode is used (pointing confirmation is performed by non-contact operation).

[0249] As described above, the printing device 80 controls (determines, switches) the input mode for the display unit 505 based on the type of screen (e.g., the pricing screen shown in Figure 20(A) or the print item confirmation screen shown in Figure 21) or the customer's implicit operation on the display unit 505 (a predetermined number of consecutive touch operations, a predetermined number of consecutive non-touch operations).

[0250] (Mixing contact and non-contact inputs on the same screen) The printing device 80 may display a pricing screen such as that shown in FIG. 20(B) instead of the pricing screen shown in FIG. 20(A). For example, when a user calls up a bulk product for which a label is to be printed and issued, the printing device 80 may display a pricing screen such as that shown in FIG. 20(B). The left side of the pricing screen shown in FIG. 20(B), like the pricing screen shown in FIG. 20(A), displays label setting information for the called-up bulk product and is a setting information display area that can accept changes (adjustments) to the setting information. The right side of the pricing screen shown in FIG. 20(B), like the print item confirmation screen shown in FIG. 21, displays a label image and is an area that accepts non-contact pointing confirmation. Note that the method of mixing contact input and non-contact input on the same screen (method of realizing a mixed input mode) may be, for example, Method 1 or Method 2 described above.

[0251] When the printing device 80 displays a screen that mixes contact input and non-contact input (for example, the pricing screen in Figure 20(B)), it may display information that allows the operator to see which parts are contact input and which parts are non-contact input, similar to the weighing pricing device 70.

[0252] Although the printing device 80 does not display the input method display area HR11 on the pricing screen in Fig. 20 or the print item confirmation screen in Fig. 21, it may display the input method display area HR11 as in the screens of other devices. On a screen where contact input and non-contact input are mixed (for example, the pricing screen in Fig. 20(B)), the input method display area HR11 may display that contact input and non-contact input are mixed, as in the metric pricing device 70.

[0253] When all pointing confirmations are completed on the pricing screen shown in Fig. 20(B), an execute button (not shown in Fig. 21(B)) is displayed, and the label is printed and issued after the execute button is pressed. In other words, when the pricing screen shown in Fig. 20(B) is displayed, the label is printed and issued without displaying the print item confirmation screen.

[0254] (Alert using distance sensor) Because the detection space of the distance sensor unit 206 is not visible, the operator may unconsciously insert an item (e.g., a wallet, bag, or mobile phone (portable rental terminal)) into the detection space, which could lead to an erroneous operation. If the distance sensor unit 206 continuously detects the same coordinates for a certain period of time, the registration and settlement device 50 may determine that an item has entered the detection space and issue a notification such as, "There is an item in front of the screen. Please move the item away from the screen as this may cause an erroneous operation." to encourage the operator to remove the item from the detection space. Furthermore, if the distance sensor unit 206 continues to recognize an item for a predetermined period of time (e.g., if the distance sensor unit 206 continues to recognize an item for a predetermined period of time spanning the end of the transaction), the registration and settlement device 50 may determine that an item has been left behind and issue a notification. The notification of the lost item may be issued via the screen (lost item notification screen) of the registration and settlement device 50 or the sign pole 217, or may be issued by sending a notification to another device in the system, such as the transaction status management device 40. This allows the store clerk or the owner to be notified of any lost property, ensuring that the property is retrieved and returned to the owner (which ultimately contributes to preventing crimes such as theft). If an item is removed from the detection space while the lost property notification screen is displayed, the registered settlement device 50 may cancel the lost property notification and display (automatically play) a video of the most recent transaction. This allows the store clerk who retrieves the lost property to immediately (on the spot) check the characteristics (clothing, appearance) of the customer who is believed to be the owner of the retrieved property, and use these characteristics to find the person and return the property. Note that a similar notification may also be made using a touch panel.

[0255] Note that, for example, as with the switching button BT13 shown in Figures 11(A) and (B), the button size is different for contact input and non-contact input for the following reason: Because the detection accuracy of a distance sensor is lower than that of a touch panel, the button size is made larger for non-contact input (the spacing between buttons (button centers of gravity) is increased) so that the operation of the intended button is correctly recognized even with a somewhat lower detection accuracy, or so that the operation of a button other than the intended button is not erroneously recognized. Furthermore, apart from the issue of the detection accuracy of the distance sensor (i.e., even if the detection accuracy of the distance sensor were high), with contact input the position of the finger can be fixed by pressing it against the touch panel (detection surface), whereas with non-contact input the finger needs to be kept without any support in the space in front of the intended button (detection space), making operation relatively difficult. Therefore, in non-contact input, the size of the buttons is made larger to improve usability so that even if there is a slight movement, the finger does not move out of the space in front of the intended button (so that the operation of the intended button is correctly recognized) or so that the finger does not enter the space in front of a button other than the intended button (so that the operation of a button other than the intended button is not mistakenly recognized).

[0256] (If there are reserved items) A reserved item is an item that was not properly registered due to a specific reason and is temporarily registered in a reserved state. Examples of reserved items include unscanned items that were not properly scanned on the mobile terminal 60, age verification items that require age verification of the purchaser before sale, and tagged items that have electronic tags attached for reasons such as high price. While Figures 17(A) and 17(B) show an example in which reserved items are not included among the registered items, if reserved items are included, the settlement device 51 can notify the user that reserved items are included and call a store clerk (attendant clerk). The clerk called by the settlement device 51 displays a dedicated screen on the settlement device 51 and performs various processes on the reserved items (e.g., scanning unscanned items) to confirm product information and price information. This cancels the reserved items (releases the hold), making the item available for payment by the customer. When a clerk is called, it is preferable to use contact mode, which allows for faster processing, because the clerk must operate a dedicated screen and the customer must wait. Therefore, if the mode used by the customer before the call to the store clerk is the contactless mode, the mode may be automatically switched from the contactless mode to the contact mode (for example, automatically based on the reading of the store clerk card to be displayed on the dedicated screen).

[0257] FIG. 22 is an example of a display on the settlement device 51. FIG. 22(A) is a diagram showing a pop-up display of a small screen SG01 related to maintenance of the settlement device 51. Note that the input method display area HR11 to message MS120 at the top of the screen are omitted from the screen of FIG. 22(A) (as is the case with the screen of FIG. 22(B)). This screen (as is the case with the screen of FIG. 22(B)) is operated by a store clerk, so it is basically operated in contact mode (for example, the initial setting is contact mode when the screen starts to be displayed). The same is true for the screen of FIG. 22(B).

[0258] Note that the area to which attention should be paid on the screen in Fig. 22(A) is the area of the small screen SG01. Therefore, as shown in Fig. 22(A), the settlement device 51 displays the area of the small screen SG01 and the area AR501 so that their visibility is different. Specifically, the settlement device 51 darkens the display of the area AR501, thereby relatively improving the visibility of the small screen SG01. By displaying them with different visibility, the range to which the operator should pay attention becomes clear, thereby improving operability.

[0259] FIG. 22(B) is a diagram showing a pop-up display of a small screen SG02 related to deleting (cancelling) a reserved item (an unscanned item). Areas AR521 and AR522, including a total information display area HR21 and a price-range quantity display area HR22, are present, and the small screen SG02 is displayed in front of the area AR522. The small screen SG02 includes a product information area AR41, an input operation area AR42, a register button BT41, a cancel button BT42, and a captured image area AR43 (a target captured image area AR43-1 and a next captured image area AR43-2). The product information area AR41 displays the product name, product code, price, and registered quantity. The registered quantity can be input (registered) by operating the plus and minus buttons arranged in the product information area AR41. The input operation area AR42 is an area where a software keyboard and buttons for inputting product information in the product information area AR41 are arranged. In the input operation area AR42, a keyboard with a key layout suitable for numeric input and a keyboard with a key layout suitable for character input can be switched depending on the operation. A preset call button BT421 is arranged in the input operation area AR42. By operating the preset call button BT421, a preset key screen is displayed on which preset keys corresponding to each product are arranged. For example, if the store clerk knows the product name of the pending product to be processed (to be released from pending), the store clerk may display the preset key screen. The store clerk operates the preset key of the product to be processed from among the preset keys arranged in the displayed preset key screen to input product information of the product to be processed into the product information area AR41. In addition, a product code input declaration button BT422 is arranged in the input operation area AR42. The product code input declaration button BT422 is a button that is operated to declare that a product code will be input. After operating the product code input declaration button BT422, the store clerk operates, for example, a keyboard arranged in the input operation area AR42 to input the numerical value of the product code that is printed or otherwise indicated on the product to be processed. This causes the product code to be entered into the product information area AR41.In the captured image area AR43, the target captured image area AR43-1 is an area where the target captured image is displayed. The target captured image is an image obtained by capturing an image when the product to be processed this time is within the image capture range. In the captured image area AR43, the next captured image area AR43-2 is an area where the next captured image is displayed. The next captured image is an image obtained by capturing an image during a product registration operation performed after the product registration operation corresponding to the product to be processed this time. In other words, the next captured image is an image corresponding to the product registration operation in which the product code was first successfully read and the product was identified after the product registration operation corresponding to the product to be processed this time. If there is an image in which an item as a product is detected among the images obtained in response to the next product registration operation, the image including the detected product is selected as the next captured image. A quantity display unit NM is arranged in the captured image area AR43-2. The quantity display unit NM is an image unit that displays the quantity (registered quantity) registered by, for example, a customer's operation for a product that was successfully registered by the product registration operation when the next captured image was captured. By placing the quantity display unit NM, the store clerk can grasp the registered quantity of the product that has been correctly registered in overlap with the product to be processed at the stage of performing the hold release operation, and can accurately perform the tasks and operations related to hold release.

[0260] Note that the area to be noted on the screen in FIG. 22(B) is the area of the small screen SG02. Furthermore, the information shown in area AR521 is information that supplements the information displayed on the small screen SG02. Therefore, as shown in FIG. 22(B), the settlement device 51 displays the visibility of the auxiliary area AR521, which displays information that supplements the information displayed on the small screen SG02, which is the area of interest, with the same visibility as the small screen SG02, which is the area of interest. In this way, the operator can more accurately grasp the display content using the auxiliary information, compared to when areas other than the area of interest are uniformly darkened.

[0261] The embodiment has been described above, and according to the embodiment, it is possible to input using an input method that is suitable for the situation.

[0262] (Variations, etc.) Although the embodiments have been described above, the device configuration, data configuration, processing flow, display and output modes, etc. can be appropriately changed, for example, as shown in the following (1), (2), etc. Furthermore, the following (1), (2), etc. may be appropriately combined.

[0263] (1) In the above embodiment, an example was described in which the registration and settlement device 50 displayed a screen in which the input method display area HR11 and the input method switching button BT13 were separately provided. However, the registration and settlement device 50 may also display a screen in which the input method is indicated and a switching button for switching the input method is provided. In other words, the switching button for switching the input method may display the input method. The same applies to other devices (e.g., the settlement device 51, etc.). Apart from the switching button, an icon indicating the current mode (non-contact / contact) may be displayed, and the background color and screen design may be made different depending on the current mode (non-contact / contact).

[0264] (2) In the above embodiment, an example was described in which the button is displayed larger in the case of non-contact input than in the case of contact input, and the display within (above) the button (button name, etc.) is larger in the case of non-contact input than in the case of contact input, but the display within the button does not have to be larger.

[0265] (3) In the above embodiment, it has been described that buttons are displayed larger for non-contact input than for contact input, but they do not necessarily have to be displayed larger. For example, if the number of buttons is small even for non-contact input, the buttons can be placed farther apart, so buttons of approximately the same size as those for contact input can be displayed for non-contact input. Reducing the number of buttons can at least reduce false recognition in non-contact input.

[0266] (4) In the above embodiment, the buttons are displayed larger for non-contact input than for contact input. However, the buttons may also be displayed larger for contact input (for example, at a size similar to that for non-contact input). Considering that the reason non-contact operation is welcomed (expected) is due to the consumer psychology of not wanting to touch a touch panel that has been touched by an unspecified number of people, making the buttons larger can have a certain effect even for contact input via a touch panel. In other words, increasing the touchable range (area) increases the probability of touching a part that has not been touched by others, or reduces the probability that others will have touched a part that you have touched first, thereby reducing the psychological burden. A button size change button may be placed on a portion of the screen (for example, in a large size) so that the button size can be freely adjusted to suit the user's preference, whether in contact or non-contact mode.

[0267] (5) In the above embodiment, an example was described in which the weighing pricing device 70 and the printer 80 mixed contact input and non-contact input on the same screen (an example in which a mixed input mode was provided). However, the registration settlement device 50 (similar to the settlement device 51) may also mixed contact input and non-contact input on the same screen (a mixed input mode may be provided), as in the weighing pricing device 70 and the printer 80. When the registration settlement device 50 (similar to the settlement device 51) displays a screen in which contact input and non-contact input are mixed, it may display information that allows the operator to identify the contact input and the non-contact input, as in the weighing pricing device 70. Furthermore, when the registration settlement device 50 (similar to the settlement device 51) displays a screen in which contact input and non-contact input are mixed, it may display a message in the input method display area HR11 indicating that contact input and non-contact input are mixed (for example, "contact input / non-contact input").

[0268] (6) In the above embodiment, the customer-side display unit 205 of the registration and settlement device 50 is described as being operated by a customer, but may also be operated by a store clerk. For example, as described in the above embodiment, the customer operates the registration and settlement processes, but the store clerk may operate the customer-side display unit 205 for various setting and maintenance processes, closing processes, etc. Also, the display unit 305 of the settlement device 51 is described as being operated by a customer, but may also be operated by a store clerk. For example, as described in the above embodiment, the customer operates the general settlement processes, but the store clerk may operate the display unit 305 for specific settlement processes (processing related to age verification products, processing when barcodes are not read correctly, etc.), various setting and maintenance processes, closing processes, etc. Also, the display unit 405 of the weighing and pricing device 70 is described as being operated by a customer, but may also be operated by a store clerk. For example, as described in the above embodiment, the customer operates the entire process from operating the product preset button to printing and issuing the product label, but the store clerk may operate the display unit 405 for various settings, maintenance processes, etc.

[0269] (7) In the above embodiment, the registration and settlement device 50 accepts contactless inputs to the customer display unit 205 but does not accept contactless inputs to the clerk display unit 210. However, contactless inputs may be accepted on the clerk display unit 210 in addition to the customer display unit 205. For example, the registration and settlement device 50 may be configured to install a distance sensor unit similar to the distance sensor unit 206 installed on the outside of the display screen of the customer display unit 205 on the outside of the display screen of the clerk display unit 210, so that contactless inputs are accepted on the clerk display unit 210 as well. In other words, contactless inputs may be accepted on a screen operated by the clerk in addition to a screen operated by the customer. The distance sensor unit may be installed on the left side of the clerk display unit 210 (the left side of the clerk display unit 210 as seen from the clerk operating the clerk display unit 210), on the right side, above, or below, but is preferably installed on the left or right side. Installing it on the left side of the clerk-side display unit 210 is effective because it does not interfere with the movement of the eyes or hands between the clerk-side display unit 210 and the key operation unit 211 installed on the right side. Installing it above the clerk-side display unit 210 is effective because it does not interfere with the movement of the eyes or hands between the clerk-side display unit 210 and the product at hand, and it is also less likely to collect small particles of dust.

[0270] (8) In the above embodiment, it was explained that when the operation mode of the registration and settlement device 50 is in face-to-face mode or settlement-only mode, the customer-side display unit 205 displays each screen according to the input mode (detection mode), just as when it is in full-self mode. However, in relation to (7) above, when the operation mode is in registration-only mode (i.e., also on the store clerk-side display unit 210), each screen according to the input mode (detection mode) may be displayed.

[0271] (9) In the above embodiment, the registration and settlement device 50 was described as controlling (determining, switching) the input mode for the customer-side display unit 205 by an explicit operation by the customer on the customer-side display unit 205 (operation of the input method switching button BT13) or an implicit operation by the customer on the customer-side display unit 205 (a predetermined number of consecutive touch operations, a predetermined number of consecutive non-touch operations), but the method of controlling the input mode is not limited to this. For example, the input mode may be controlled based on one or more of the following methods a to h. In other words, the input mode may be controlled by one or more of the following methods a to i. In relation to (8) above, the same applies to the control of the input mode for the clerk-side display unit 210.

[0272] (Method a) An explicit operation by the customer on the customer-side display unit 205. That is, as illustrated in the embodiment, the input mode is controlled based on the operation of the input method switching button BT13. Note that if the input mode is not controlled based on an explicit operation by the customer, the input method switching button BT13 is not arranged on the screen. (Method b) Implicit operation by the customer on the customer-side display unit 205. In other words, as illustrated in the embodiment, the input mode is controlled based on a predetermined number of consecutive contact operations and a predetermined number of consecutive non-touch operations. Note that if the input mode is not controlled based on implicit operations by the customer, the non-touch operation priority input mode and the contact operation priority input mode are not necessary (are not implemented). (Method c) Screen (screen type) to be operated. That is, like the weighing pricing device 70 and the printing device 80, the input mode is controlled based on the screen (screen type) to be operated. Also, as explained in (5) above, like the weighing pricing device 70 and the printing device 80, a screen corresponding to the mixed input mode may be displayed. (Method d) Information about the customer who is the operator. For example, an input mode is registered (set) in advance for each customer, and the input mode is controlled based on the registered information (setting information). (Method e) Date and time, day of the week, etc. In other words, the input mode is controlled based on the date and time, day of the week, etc. (Method f) Information from another device. For example, the input mode is controlled based on an input method switching command sent from the transaction status management device 40 operated by a store clerk. (Method g) Type of operator operating the customer-side display unit 205. In other words, related to (6) above, the input mode is controlled based on whether the customer-side display unit 205 is being operated by a customer or a store clerk. For example, the input mode may be controlled to non-contact input mode when the customer is operating the unit, and to contact input mode when the store clerk is operating the unit. The registration and settlement device 50 may determine that the operation is being performed by a store clerk when a store clerk logs in. The registration and settlement device 50 may also have a customer operation mode operated by a customer and a store clerk operation mode operated by a store clerk, and may control the input mode depending on whether it is in the customer operation mode or the store clerk operation mode. For example, the registration and settlement device 50 may be controlled to non-contact input mode in the customer operation mode and to contact input mode in the store clerk operation mode. The registration and settlement device 50 may switch from the customer operation mode to the store clerk operation mode when a store clerk logs in. (Method h) Operation by the store clerk on the store clerk's display unit 210. In other words, the input mode is controlled based on a predetermined operation by the store clerk on the opposite store clerk's display unit 210. A switch button for switching the input mode may be provided on the screen displayed by the store clerk's display unit 210. (Method i) Operation mode. For example, the input mode may be controlled depending on whether the mode is full self-service mode or face-to-face mode (or payment-only mode). Also, as related to (8) above, the input mode on the store clerk display unit 210 may be controlled depending on whether the mode is face-to-face mode or registration-only mode.

[0273] (10) In the above embodiment, the settlement device 51 controls (determines, switches) the input mode for the display unit 305 based on the customer's explicit operation on the display unit 305 (operation of the input method switching button BT13) or the customer's implicit operation on the display unit 305 (a predetermined number of consecutive contact operations, a predetermined number of consecutive non-touch operations), but the method for controlling the input mode is not limited to this. For example, the input mode may be controlled based on one or more of the above methods a to h described for the input modes of the registered settlement device 50. In other words, the input mode may be controlled based on one or more of the above methods a to h.

[0274] (11) In the above embodiment, the weighing and pricing device 70 was described as controlling (determining, switching) the input mode for the display unit 405 based on the type of screen (e.g., the product selection screen shown in FIG. 19(A), the product selection screen shown in FIG. 19(B)) or the customer's implicit operation on the display unit 405 (a predetermined number of consecutive touch operations, a predetermined number of consecutive non-touch operations), but the method for controlling the input mode is not limited to this. For example, the input mode may be controlled based on one or more of the following methods a to g. In other words, the input mode may be controlled by one or more of the following methods a to g.

[0275] (Method a) Explicit operation by the customer on the display unit 405. In other words, the input mode is controlled based on explicit operation by the customer, similar to the registered settlement device 50 and settlement device 51. When the input mode is controlled based on explicit operation by the customer, an input method switching button BT13 is placed on the screen. (Method b) Implicit operation by the customer on the display unit 405. That is, as illustrated in the embodiment, the input mode is controlled based on a predetermined number of consecutive contact operations and a predetermined number of consecutive non-touch operations. Note that if the input mode is not controlled based on implicit operations by the customer, the non-touch operation priority input mode and the contact operation priority input mode are not necessary (are not implemented). (Method c) Screen (screen type) to be operated. That is, as illustrated in the embodiment, the input mode is controlled based on the screen (screen type). Also, as illustrated in the embodiment, a screen corresponding to the mixed input mode may be displayed. (Method d) Information about the customer who is the operator. For example, an input mode is registered (set) in advance for each customer, and the input mode is controlled based on the registered information (setting information). (Method e) Date and time, day of the week, etc. In other words, the input mode is controlled based on the date and time, day of the week, etc. (Method f) Information from another device. For example, the input mode is controlled based on an input method switching command sent from the transaction status management device 40 operated by a store clerk. (Method g) Type of operator operating the display unit 405. That is, related to (6) above, the input mode is controlled based on whether the display unit 405 is being operated by a customer or a store clerk. For example, the input mode may be controlled to non-contact input mode when the display unit 405 is being operated by a customer, and to contact input mode when the display unit 405 is being operated by a store clerk. The weighing pricing device 70 may determine that the operation is being performed by a store clerk when a store clerk logs in. The weighing pricing device 70 may also have a customer operation mode operated by a customer and a store clerk operation mode operated by a store clerk, and may control the input mode depending on whether it is in the customer operation mode or the store clerk operation mode. The weighing pricing device 70 may be controlled to non-contact input mode in the customer operation mode, and to contact input mode in the store clerk operation mode. The weighing pricing device 70 may switch from the customer operation mode to the store clerk operation mode when a store clerk logs in.

[0276] (12) In the above embodiment, the printing device 80 controls (determines, switches) the input mode for the display unit 505 based on the type of screen (e.g., the pricing screen shown in FIG. 20(A) or the print item confirmation screen shown in FIG. 21) or the customer's implicit operation on the display unit 505 (a predetermined number of consecutive touch operations, a predetermined number of consecutive non-touch operations). However, the method for controlling the input mode is not limited to this. For example, the input mode may be controlled based on one or more of the above methods a to e described for the input mode of the weighing pricing device 70. In other words, the input mode may be controlled based on one or more of the above methods a to e. Note that the operator of the weighing pricing device 70 is a customer, but the operator of the printing device 80 is a store clerk. Therefore, for example, method a is interpreted as "an explicit operation on the display unit 505 by a customer" in the case of the weighing pricing device 70, but as "an explicit operation on the display unit 505 by a store clerk" in the case of the printing device 80.

[0277] (13) In the above embodiment, it was explained that the contact detection unit (touch sensor) of the registration and settlement device 50 is turned off (the module is stopped) in the contactless detection mode (contactless operation-only input mode), but the detection result of contact detection by the contact detection unit may be ignored without being turned off. Also, it was explained that the contactless detection unit (distance sensor unit 206) is turned off (the module is stopped) in the contact detection mode (contact operation-only input mode), but the detection result of contact detection by the contactless detection unit may be ignored without being turned off. The same applies to the other devices (settlement device 51, weighing and pricing device 70, printing device 80).

[0278] (14) In the above embodiment, when both the non-contact detection unit and the contact detection unit are ON (in the first combined detection mode and the second combined detection mode of FIG. 7 ), a predetermined non-contact operation or a predetermined contact operation is prioritized (in the first combined detection mode, the non-touch operation is basically reflected as an input, and in the second combined detection mode, the contact operation is basically reflected as an input). However, the control when both the non-contact detection unit and the contact detection unit are ON is not limited to the above. For example, control may be performed according to the earlier detection by the non-contact detection unit or the contact detection unit (first come, first served control). In this regard, a finger is necessarily detected in the detection space before it is detected on the detection surface ( FIG. 6 ). However, since detection by the distance sensor unit 206 takes longer than detection by the touch sensor, in the case of a typical operation (when the finger quickly reaches the detection surface), a detection signal by the touch sensor is transmitted to the CPU 201 before a detection signal by the distance sensor unit 206. Therefore, when the operator intends a non-touch operation and stops his / her finger in the detection space (i.e., does not touch the detection surface), the distance sensor unit 206 detects the finger in the detection space, and the detection signal is transmitted to the CPU 201. In this case, the registration and settlement device 50 reflects the non-touch operation as an input (accepts the non-touch operation). On the other hand, when the operator intends a contact operation and quickly brings his / her finger to the detection surface, the distance sensor unit 206 detects the finger in the detection space, and then the touch sensor detects the finger, but the detection signal from the touch sensor is transmitted to the CPU 201 before the detection signal from the distance sensor unit 206. In this case, the registration and settlement device 50 reflects the contact operation as an input (accepts the contact operation). Therefore, for example, assuming that it takes 1 second for detection by the distance sensor unit 206 (for the signal to reach the CPU 201) and 0.2 seconds for detection by the touch sensor (same as above), if a finger enters the detection space (the optical path of the distance sensor 206) and touches the detection surface before 0.8 seconds have passed since the finger was detected by the distance sensor 206, the detection signal from the touch sensor will arrive first, and the registration and settlement device 50 will accept this as a contact operation. On the other hand, if a finger enters the detection space and touches the detection surface after 0.8 seconds have passed since the finger was detected by the distance sensor 206, the detection signal from the distance sensor unit 206 will arrive first, and the registration and settlement device 50 will accept this as a non-contact operation.As described above, it is possible to realize a state in which both devices are utilized, and basically a first-come, first-served control. When there are two consecutive detection signals, such as when there is a detection signal from the distance sensor unit 206 after a detection signal from the touch sensor (when the detection surface is touched before the above-mentioned 0.8 seconds have elapsed) or when there is a detection signal from the touch sensor after a detection signal from the distance sensor unit 206 (when the detection surface is touched after the above-mentioned 0.8 seconds have elapsed), the second detection signal is ignored. In other words, when there are detection signals for the same coordinates (or coordinates within a predetermined range) from different devices (distance sensor unit 206, touch sensor) within a predetermined time (within 1 to 2 seconds in the above example), the registration and settlement device 50 ignores the second detection signal.

[0279] (15) In the above embodiment, operations (touch operations and non-touch operations) on buttons provided on the screen are described, but the operation target is not limited to buttons. The operation target may be a part or all of the area on the screen as long as it can accept operations.

[0280] (16) In the above embodiment, the distance sensor unit 206 is provided on the left side of the customer-side display unit 205 of the registration and settlement device 50. However, the location of the distance sensor unit 206 is not limited to the left side. For example, the distance sensor unit 206 may be provided on the right side, above, or below the customer-side display unit 205. As explained in the above embodiment, installing the distance sensor unit 206 on the left side of the customer-side display unit 205 is effective because it does not interfere with the movement of the eyes or hands between the customer-side display unit 205 and the card payment unit 208. Similarly, installing the distance sensor unit 206 on the upper side of the customer-side display unit 205 is effective because it does not interfere with the movement of the eyes or hands between the customer-side display unit 205 and the items in hand (products), and is less likely to collect small particles of dust. The same applies to other devices.

[0281] (17) In (7) and (16) above, examples were described in which the position of the distance sensor unit was determined in relation to the devices (key operation unit 211, card payment unit 208). However, instead of or in addition to the relationship with the devices, the position of the distance sensor unit may be determined in terms of customer flow lines. For example, in the case of a full-self service (such as a full-self service mode registration and settlement device 50 or a device that always operates as a full-self service registration and settlement device), a shopping basket containing unregistered products is placed upstream of the flow line, the products are registered in front of the device, and the registered products are moved to another shopping basket downstream. In this case, when registering products in front of the device, if the product has a barcode, product registration is completed by passing the product in front of the scanner area where the scanner unit at the bottom of the screen can recognize it. However, for products without barcodes, such as vegetables, screen operation (operation of preset keys) is required. Therefore, it is preferable not to place a distance sensor between an upstream shopping basket and other downstream shopping baskets (including intermediate screens) because it would be an obstacle. Furthermore, instead of or in addition to considerations of the relationship with devices and customer flow, the distance sensor unit 206 in the registration and settlement device 50 is attached to the vertical side of the display device (the infrared emitter and infrared receiver are arranged vertically). However, the position of the distance sensor unit may also be determined from the perspective of screen size and aspect ratio. For example, as shown in FIG. 2, the registration and settlement device 50 has a relatively large, vertically long screen. If a distance sensor were attached to the horizontal side (top or bottom) and sensing was performed vertically, the sensing distance would be long, which could reduce sensing accuracy. However, if a distance sensor were attached to the vertical side (left side in the above embodiment) and sensing was performed horizontally, the sensing distance would be shorter than if sensing was performed vertically, thereby maintaining sensing accuracy even on a relatively large screen. Note that the screen size and aspect ratio of the registration and settlement device 50 are not limited to the example shown in FIG. 2, etc. The same applies to other devices (such as the settlement device 51, the weighing and pricing device 70, and the printer 80). For each device, the position of the distance sensor unit may be determined from the perspective of its relationship with the device, customer movement (or, in the case of a device not used by customers, the flow of operations by store staff), or screen size and aspect ratio.

[0282] (18) In the above embodiment, the distance sensor unit 206 provided in the registration and settlement device 50 is described as measuring distance using infrared rays, but it may also measure distance using ultrasound or laser. The same applies to other devices.

[0283] (19) In the above embodiment, an example was described in which the registration and settlement device 50 detects a non-contact operation using the distance sensor unit 206, but the method for detecting a non-contact operation is not limited to this. For example, the registration and settlement device 50 may detect a non-contact operation using the following method. The same applies to other devices. (a) Non-contact operation is detected using an object detection sensor (such as a photoelectric sensor) that has an integrated light-emitting unit and a light-receiving unit. One object detection sensor that has an integrated light-emitting unit and a light-receiving unit is installed on the left (or right) side of the customer-side display unit 205, and the other is installed on the top (or bottom) side of the customer-side display unit 205. The left-right position of the customer-side display unit 205, which is the operating position for non-contact operation, is detected by the object detection sensor installed on the left (or right) side of the customer-side display unit 205, and the up-down position of the customer-side display unit 205, which is the operating position for non-contact operation, is detected by the object detection sensor installed on the top (or bottom) side of the customer-side display unit 205. (b) A pair of object detection sensors (photoelectric sensors, etc.) consisting of a separate light-emitting unit and light-receiving unit are installed on the left and right sides of the customer-side display unit 205 (for example, the light-emitting unit is set on the left side and the light-receiving unit is set on the right side), and another pair is installed above and below the customer-side display unit 205 (for example, the light-emitting unit is set on the top side and the light-receiving unit is set on the bottom side). The left-right position of the customer-side display unit 205 among the operating positions for contactless operation is detected by the object detection sensors installed on the left and right sides of the customer-side display unit 205, and the up-down position of the customer-side display unit 205 among the operating positions for contactless operation is detected by the object detection sensors installed above and below the customer-side display unit 205. (c) A non-contact operation is detected based on a change in capacitance of the customer-side display unit 205. When the change in capacitance at a certain position on the customer-side display unit 205 reaches a first threshold (when the change is equal to or greater than the first threshold and less than a second threshold that is greater than the first threshold), it is determined that a non-contact operation has occurred at that position. When the change in capacitance at a certain position on the customer-side display unit 205 reaches a second threshold, it is determined that a contact operation has occurred at that position.

[0284] (20) In the above embodiment, the registered settlement device 50 notifies the customer, who is the operator, of the input method (by displaying it in the input method display area HR11). However, the registered settlement device 50 may notify a person other than the operator (a store clerk, a customer other than the operator) of the input method. For example, the registered settlement device 50 may transmit information indicating the input method to a device operated by the store clerk (e.g., the transaction status management device 40, a terminal carried by the store clerk, etc.). The registered settlement device 50 may also illuminate the sign pole 217 in a lighting pattern corresponding to the input method (e.g., a first lighting pattern for contact input, a second lighting pattern for non-contact input). Note that information indicating the relationship between the lighting pattern of the sign pole 217 and the input method may be notified (e.g., by printed matter or signage) near the registered settlement device 50. The input method (the input method for each registered settlement device 50 in the case of multiple registered settlement devices) may also be displayed on the signage. For example, the transaction status management device 40 may control the display on the signage (display of the input method for each registered settlement device 50) based on information indicating the input method (e.g., information indicating the input mode) received from each registered settlement device 50.

[0285] (21) In the above embodiment, the input method for the registration and settlement device 50 having multiple operating modes was described, but the device may have each of these operating modes. In other words, the input method for the registration and settlement device 50 can also be applied to a device that always operates as a full-self registration and settlement device (a device having a function equivalent to the full-self mode of the registration and settlement device 50), a device that always operates as a semi-self settlement device (a device having a function equivalent to the settlement-only mode of the registration and settlement device 50), or a device that always operates as a semi-self registration device (a device having a function equivalent to the registration-only mode of the registration and settlement device 50).

[0286] (22) In the above embodiment, the registration and settlement device 50, the settlement device 50, the weighing and pricing device 70, and the printing device 80 were described as devices having multiple input modes (e.g., contact input mode, non-contact input mode). However, devices having multiple input modes are not limited to the registration and settlement device 50, the settlement device 50, the weighing and pricing device 70, and the printing device 80. For example, a full-self-service registration and settlement device that is mainly operated by customers (a device having functions equivalent to the full-self-service mode of registration and settlement device 50, but unlike registration and settlement device 50, it may not require a configuration for operation by a store clerk such as store clerk-side scanner unit 212), a semi-self-service settlement device that is mainly operated by customers (a device having functions equivalent to the settlement-only mode of registration and settlement device 50, but unlike registration and settlement device 50, it may not require a configuration for operation by a store clerk such as store clerk-side scanner unit 212), or a general registration device (a device having functions equivalent to the registration-only mode of registration and settlement device 50, but unlike registration and settlement device 50, it may not require a configuration for operation by a customer such as customer-side scanner unit 207) may be equipped with multiple input modes. Furthermore, the devices are not limited to supermarkets, convenience stores, drug stores, home centers, electronics retailers, etc., but may also be payment machines, ticket vending machines, reservation machines, charging machines (devices that accept prepaid deposits) installed in various places (restaurants, hospitals, movie theaters, amusement parks, event venues, baseball stadiums, accommodation facilities, stations, airports, tourist spots, etc.).

[0287] In relation to (22) above, the semi-self-service registration device (the same applies to the registration settlement device 50 in registration-only mode, etc.) may specify the contact or contactless mode of the settlement device. For example, after registering products on the semi-self-service registration device (after pressing the subtotal button), the customer may be asked whether they prefer contact or contactless, and the customer may perform an operation according to the confirmation result (an operation specifying contact if the customer responds that they prefer contact, or an operation specifying contactless if the customer responds that they prefer contactless), and the contact or contactless designation information may be sent to the settlement device along with the registration information. The settlement device that receives the contact or contactless designation information along with the registration information operates in either the contact or contactless operating mode based on the contact or contactless designation information. This allows the customer to operate the settlement device to which the registration information is sent using the operation method (contact or contactless) that they communicated to the store clerk.

[0288] In addition, in a semi-self-service registration device in which a settlement device is not specified (selected) (for example, in a case where registration information is sent to a suitable (available) settlement device by operating the send button), there are two operations (operating the send button and operating to specify contact / contactless), but the order of the two operations is not particularly limited. In other words, the send button may be operated after the contact / contactless specification operation, or the send button may be operated after the contact / contactless specification operation. The same applies to a case where a settlement device is specified in a semi-self-service registration device and a send button is provided for each settlement device (in other words, the operation to specify the destination settlement device also serves as the send operation). In addition, in a semi-self-service registration device in which a settlement device is specified and a specification button for each settlement device is provided in addition to the send button, there are three operations (operation to specify the settlement device, operation of the send button, and operation to specify contact / contactless), but the order of the three operations is not particularly limited.

[0289] Furthermore, if a store contains both payment devices that do not support contactless input and payment devices that do, the destination of the registration information may be controlled depending on whether the customer desires contactless or contactless input. Specifically, if the customer desires contactless input (i.e., performs an operation to specify contactless mode on the registration device), the registration information may be controlled not to be sent to payment devices that do not support contactless input. For example, in a semi-self-service registration device in which a payment device is not specified (i.e., registration information is sent to a preferred payment device by operating the send button), when contactless input is specified, the registration information may be sent to one of the payment devices that support contactless input, and not sent to payment devices that do not support contactless input (i.e., the payment device may be excluded from the list of possible destinations). Furthermore, in a semi-self-service registration device in which a payment device is specified and a send button is provided for each payment device, the send button may be operated after specifying contact / contactless, and when contactless input is specified, the send button corresponding to the payment device that does not support contactless input may not be operated (e.g., grayed out).

[0290] As mentioned above, the registered settlement device 50 can transmit registration information to other devices even when in face-to-face mode. In other words, a registered settlement device 50 in face-to-face mode can settle the bill at its own device (customer side) or at another device. Therefore, the store clerk may confirm with the customer whether they prefer contactless or contactless settlement, and decide whether to settle the bill at its own device or at another device (any settlement device).

[0291] <Summary of the embodiment> [Technical field] The present invention relates to a processing device and a program. [Background technology] BACKGROUND ART Electronic devices that accept contact input and non-contact input are known (see, for example, Patent Document 1). [Prior art document] [Patent documents] [Patent Document 1] Patent No. 6833981 [Summary of the Invention] [Problem to be solved by the invention] However, since contact input and non-contact input are controlled according to the operation regardless of the situation, there is a problem that input cannot be made using an input method that suits the situation. The present invention has been made in consideration of such circumstances, and an object of the present invention is to provide a technology that enables input using an input method that is suitable for the situation. [Means for solving the problem]

[0292] (1) In order to solve the above-mentioned problems, a processing device (e.g., registration and settlement device 50, settlement device 51, weighing and pricing device 70, printing device 80) that is one aspect of the present invention is a processing device characterized by comprising: a display means (e.g., customer side display unit 205, display unit 305, display unit 405, display unit 505) that displays a screen including operators (e.g., buttons, etc.); a contact detection means (e.g., a touch sensor) that can detect contact operations on the operators; a non-contact detection means (e.g., distance sensor unit 206, distance sensor unit 306, distance sensor unit 406, distance sensor unit 506) that can detect non-contact operations on the operators; and a determination means that determines (e.g., based on method a to method i) one of the contact input mode by the contact operation and the non-contact input mode by the non-contact operation as the input mode for the operators. The processing device of (1) enables input appropriate for the situation (the various situations shown in methods a to i). For example, input appropriate for the operator operating the processing device (method a, method b, method d, method g) or the operation target (method c) is possible. Furthermore, in the printing device 80, pointing and confirmation is a non-contact operation, so it is possible to prevent the display screen from becoming dirty or unsanitary due to pointing and confirmation.

[0293] (2) The processing device described in (1) is characterized in that the determination means determines one of the contact input mode and the non-contact input mode based on whether the display means is operated by a store clerk or a customer (method g). The processing device of (2) enables input using an input method suitable for the situation.

[0294] (3) The processing device according to (1) or (2) is characterized in that it comprises a first display means (e.g., a store clerk display unit 210) capable of detecting the contact operation and a second display means (e.g., a customer display unit 205) capable of detecting the contact operation and the non-contact operation, and the determining means determines one of the contact input mode and the non-contact input mode based on the contact operation on the first display means (method h). The processing device (3) allows suitable input depending on the situation.

[0295] (4) The processing device according to any one of (1) to (3), wherein the display means displays the operator larger when in the non-contact input mode than when in the contact input mode. The processing device of (4) facilitates non-contact input when in non-contact input mode.

[0296] (5) A processing device according to any one of (1) to (4), comprising a payment means for making a payment, wherein the non-contact detection means is positioned so as not to be on an approximate straight line connecting the display means and the payment means. The processing device of (5) allows for convenient contactless input. In other words, the contactless detection means does not interfere with the payment operation of the payment means, allowing for contactless input without imposing any burden on the payment operation.

[0297] (6) In order to solve the above-mentioned problems, one aspect of the present invention is a program that causes a computer to function as a processing device equipped with a display means, and that causes the computer to function as a contact detection means capable of detecting a contact operation on the operator, a non-contact detection means capable of detecting a non-contact operation on the operator, and a determination means that determines, as an input mode for the operator, one of a contact input mode by the contact operation and a non-contact input mode by the non-contact operation. The program (6) allows for suitable input depending on the situation.

[0298] Note that programs (e.g., specific applications for the mobile terminal 60, etc.) for implementing the functions of each of the above-described devices (e.g., the headquarters server 10, the store controller 30, the transaction status management device 40, the registration and settlement device 50, the settlement device 51, the mobile terminal 60, the shopping cart, etc.) may be recorded on a computer-readable recording medium, and the programs recorded on the recording medium may be loaded into a computer system and executed to perform processing for each of the above devices. Here, "loading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The term "computer system" here includes hardware such as an OS and peripheral devices. The term "computer system" may also include multiple computer devices connected via a network, including communication lines such as the Internet, a WAN, a LAN, and a dedicated line. The term "computer-readable recording medium" refers to portable media such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, and a storage device such as a hard disk built into a computer system. Thus, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM. The term "recording medium" also includes internal or external recording media accessible from a distribution server for distributing the program. The program code stored on the recording medium of the distribution server may be different from the program code in a format executable by the terminal device. In other words, the format in which the program is stored on the distribution server is not important as long as it can be downloaded from the distribution server and installed in a format executable by the terminal device. The program may be divided into multiple parts, each downloaded at a different time and then combined on the terminal device, or each part may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" also includes a storage medium that stores a program for a certain period of time, such as volatile memory (RAM) within a computer system that serves as a server or client when a program is transmitted over a network. The program may also be for implementing part of the functions described above.Furthermore, the above-mentioned functions may be realized in combination with a program already recorded in the computer system, that is, a so-called differential file (differential program). [Explanation of symbols]

[0299] 1. Sales system 10...Headquarters server 20...Cloud server 30...Store Controller 40...Transaction status management device 50...Registration and settlement device 51…Payment device 60...Mobile devices 70...Weighting and pricing device

Claims

1. a display means for displaying a screen including operators; a contact detection means capable of detecting a contact operation on the operation element; a non-contact detection means capable of detecting a non-contact operation on the operation element; a determination means for determining, as an input mode for the operator, one of a contact input mode by the contact operation and a non-contact input mode by the non-contact operation; Equipped with The determining means The contact input mode or the non-contact input mode is determined based on whether the display means is operated by a store clerk or a customer. A processing device characterized by:

2. a display means for displaying a screen including operators; a contact detection means capable of detecting a contact operation on the operation element; a non-contact detection means capable of detecting a non-contact operation on the operation element; a determination means for determining, as an input mode for the operator, one of a contact input mode by the contact operation and a non-contact input mode by the non-contact operation; Equipped with The display means In the non-contact input mode, the operation element is displayed larger than in the contact input mode. A processing device characterized by:

3. a display means for displaying a screen including operators; a contact detection means capable of detecting a contact operation on the operation element; a non-contact detection means capable of detecting a non-contact operation on the operation element; a determination means for determining, as an input mode for the operator, one of a contact input mode by the contact operation and a non-contact input mode by the non-contact operation; Non-cash payment methods and Equipped with The non-contact detection means The display means is configured with a plurality of detection members, and the plurality of detection members are arranged side by side at positions protruding from the screen of an outer frame on one side of the longitudinal direction of the display means so as to face the other side of the longitudinal direction, The non-cash payment means is The display means is disposed on the other side in the longitudinal direction. A processing device characterized by:

4. A program that causes a computer to function as a processing device having a display unit, The computer a display control means for displaying a screen including the operators on a display unit; a contact detection means capable of detecting a contact operation on the operation element; a non-contact detection means capable of detecting a non-contact operation on the operation element; a determining means for determining, as an input mode for the operator, one of a contact input mode by the contact operation and a non-contact input mode by the non-contact operation; It functions as The determining means The contact input mode or the non-contact input mode is determined based on whether the display unit is operated by a store clerk or a customer. A program characterized by:

5. A program that causes a computer to function as a processing device having a display unit, The computer a display control means for displaying a screen including the operators on a display unit; a contact detection means capable of detecting a contact operation on the operation element; a non-contact detection means capable of detecting a non-contact operation on the operation element; a determining means for determining, as an input mode for the operator, one of a contact input mode by the contact operation and a non-contact input mode by the non-contact operation; It functions as The display control means In the non-contact input mode, the operator is displayed larger than in the contact input mode. A program characterized by:

Images